-- Logs begin at Sat 2022-10-29 02:04:08 UTC, end at Sat 2022-10-29 04:32:47 UTC. -- Oct 29 02:29:51.284231 n-d-862964-4 systemd[1]: Starting Devstack devstack@keystone.service... Oct 29 02:29:51.293679 n-d-862964-4 devstack@keystone.service[82068]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 29 02:29:51 2022] *** Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: nodename: n-d-862964-4 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: machine: x86_64 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: clock source: unix Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: pcre jit disabled Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: detected number of CPU cores: 4 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: current working directory: / Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: detected binary path: /usr/bin/uwsgi-core Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: your processes number limit is 47680 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: your memory page size is 4096 bytes Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: detected max file descriptor number: 2048 Oct 29 02:29:51.295866 n-d-862964-4 devstack@keystone.service[82068]: lock engine: pthread robust mutexes Oct 29 02:29:51.296592 n-d-862964-4 devstack@keystone.service[82068]: thunder lock: enabled Oct 29 02:29:51.296592 n-d-862964-4 devstack@keystone.service[82068]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 29 02:29:51.296592 n-d-862964-4 devstack@keystone.service[82068]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 29 02:29:51.334602 n-d-862964-4 devstack@keystone.service[82068]: Python main interpreter initialized at 0x5600709a99c0 Oct 29 02:29:51.334602 n-d-862964-4 devstack@keystone.service[82068]: python threads support enabled Oct 29 02:29:51.334602 n-d-862964-4 devstack@keystone.service[82068]: your server socket listen backlog is limited to 100 connections Oct 29 02:29:51.334602 n-d-862964-4 devstack@keystone.service[82068]: your mercy for graceful operations on workers is 90 seconds Oct 29 02:29:51.334958 n-d-862964-4 devstack@keystone.service[82068]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 02:29:51.335034 n-d-862964-4 devstack@keystone.service[82068]: *** Operational MODE: preforking *** Oct 29 02:29:51.335280 n-d-862964-4 devstack@keystone.service[82068]: *** uWSGI is running in multiple interpreter mode *** Oct 29 02:29:51.335280 n-d-862964-4 devstack@keystone.service[82068]: spawned uWSGI master process (pid: 82068) Oct 29 02:29:51.335480 n-d-862964-4 systemd[1]: Started Devstack devstack@keystone.service. Oct 29 02:29:51.337330 n-d-862964-4 devstack@keystone.service[82068]: spawned uWSGI worker 1 (pid: 82079, cores: 1) Oct 29 02:29:51.337330 n-d-862964-4 devstack@keystone.service[82068]: spawned uWSGI worker 2 (pid: 82080, cores: 1) Oct 29 02:29:51.337330 n-d-862964-4 devstack@keystone.service[82068]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 02:29:55.521355 n-d-862964-4 devstack@keystone.service[82080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:29:55.521355 n-d-862964-4 devstack@keystone.service[82080]: from cryptography.utils import int_from_bytes Oct 29 02:29:55.522216 n-d-862964-4 devstack@keystone.service[82080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:29:55.522216 n-d-862964-4 devstack@keystone.service[82080]: from cryptography.utils import int_from_bytes Oct 29 02:29:55.522646 n-d-862964-4 devstack@keystone.service[82079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:29:55.522646 n-d-862964-4 devstack@keystone.service[82079]: from cryptography.utils import int_from_bytes Oct 29 02:29:55.523152 n-d-862964-4 devstack@keystone.service[82079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 02:29:55.523152 n-d-862964-4 devstack@keystone.service[82079]: from cryptography.utils import int_from_bytes Oct 29 02:29:55.571164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:29:55.571341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:29:55.571504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] command line args: [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:29:55.571798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:29:55.571938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ================================================================================ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:29:55.572139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 02:29:55.572276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] admin_token = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.572361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 02:29:55.572440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] config_dir = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.572515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] command line args: [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 02:29:55.572580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.572736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 02:29:55.572829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] config_source = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.572901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ================================================================================ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 02:29:55.572975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] debug = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] admin_token = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] config_dir = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] config_source = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.573968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] debug = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_config_append = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] insecure_debug = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_dir = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.574938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_config_append = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_dir = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.575897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.576946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.577923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] publish_errors = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.578963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] notification_format = cadf {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] publish_errors = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.579941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] standard_threads = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_journal = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.580992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_json = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] standard_threads = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_stderr = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] use_syslog = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] strict_password_check = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_eventlog = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.581887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.581971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_journal = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.582068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.582145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_json = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.582309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_stderr = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.582387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.582486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] use_syslog = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.582572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.582716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] watch_log_file = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 02:29:55.582799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.582969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.583959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.584865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.585847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.586968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.587982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.588936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.589864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.590946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.591923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.592977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.593997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.594940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.595985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.596980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.597959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.598874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.599999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.600928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.enabled = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.601892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.602982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.603989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.604912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.605941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.606941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.external = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.password = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.607882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] auth.token = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.external = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.mapped = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.608960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.password = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] auth.token = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.609916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.610959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.611909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.612856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.613836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.614847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.615988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.616931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.617966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.618901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.619965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.620983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.621150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.621229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.621380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.621773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.621948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.622949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.623885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.624965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.625967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.password = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.626926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.627873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.628968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.629960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.630945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.631886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.632982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.633943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.634963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.635900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.636992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] policy.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.637934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.638956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.639901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.640969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.641944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] role.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.642959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.643962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.644935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.645900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.646995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.647933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.648846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.649964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.provider = fernet {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.650982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.651920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] trust.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.652868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.653997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.654992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.655937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.656852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:29:55.657464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.657967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.658200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.658439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.658673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 02:29:55.658845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=82079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 02:29:55.686378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.686597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.686816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.687236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.687475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.687706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.695076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.696352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.723805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.723934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.724033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.724234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.775558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.776467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.823213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.823497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.823615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.823876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.977457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.977746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.977953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.978095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.978252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.978499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.978709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.978951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.979150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.979395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.979605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:55.979783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.001609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.001853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.001987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.002881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.003054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.003235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.013825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.014185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.026759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.026892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.026961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.027959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.028049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=82079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 02:29:56.044684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.044900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 02:29:56.045024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.045231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.045356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 02:29:56.045444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 02:29:56.045598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.045723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.045790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 02:29:56.045972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.046116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.046342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.046466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.046611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.046736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.046842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.056082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.056372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.056635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.056759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.056915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.057060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.057258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.057547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.063897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.064606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.066872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.067162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.067447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.067641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.067767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.068974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.069171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.069296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.069445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.069544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.069716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.069859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.070044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.070326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.070600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.092346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.093439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.093788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.094095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.094945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.095234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.100025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.100300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.100537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.100661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.100747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.101042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.107012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.107319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.107561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.107849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.111997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.112288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.112573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.112853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.113090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.113237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.113401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.113525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.113670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.113795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.113951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.114045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.114245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.114568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.114929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.115209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.129934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.130185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.131371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.131663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.134228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.135581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.137427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.137699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.138846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.139149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.141965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.143410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.145070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.146718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.148422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.148717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.149011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.149303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.149589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.149900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.150043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.150279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.150572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.150874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.151144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.151436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.165693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.166005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.166269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.166530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.167321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.167616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.167887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.168156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.173452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.175024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.175204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.176578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.176704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.176827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.178364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.178657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.179541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.179826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.180218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.180496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.180794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.181379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.181672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.181987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.182279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.182662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.191906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.192193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.192567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.192863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.193176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.193445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.193729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.193981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.194272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.194562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.194833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.195226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.195507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.195788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.209164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.212069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.212195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.215015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.215143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.216450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.217946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.218072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.218344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.218623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.219394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.220905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.221194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.221595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.225097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.226595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.228256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.229590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.229716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.229900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.230160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.230465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.232657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.233056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.233333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.233627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.238281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.238572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.238809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.241728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.242049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.242320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.247137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.247419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.247701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.247960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.248232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.248503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.248776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.249063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.249382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.249557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=82079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 02:29:56.249657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.249870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.249974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.250980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.251263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.251567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.251845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.252129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.252405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.252675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.252969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.253326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=82079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 02:29:56.283890 n-d-862964-4 devstack@keystone.service[82080]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600709a99c0 pid: 82080 (default app) Oct 29 02:29:56.287216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283663-bc0e-49a4-a50d-e37fa8f9344a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:29:56.287497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283663-bc0e-49a4-a50d-e37fa8f9344a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:29:56.287763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb283663-bc0e-49a4-a50d-e37fa8f9344a None None] PATH_INFO: `/v3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:29:56.287914 n-d-862964-4 devstack@keystone.service[82079]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5600709a99c0 pid: 82079 (default app) Oct 29 02:29:56.291924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sat Oct 29 02:29:56 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:03.098687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:03.099544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:03.099544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:03.103915 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:03.109518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:03.110019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:03.110152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:03.180973 n-d-862964-4 devstack@keystone.service[82080]: INFO dbcounter [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] Registered counter for database keystone Oct 29 02:30:03.202357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG oslo_db.sqlalchemy.engines [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:30:03.210046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writer thread running {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:30:03.391058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG passlib.handlers.bcrypt [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82080) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 02:30:03.391348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG passlib.handlers.bcrypt [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82080) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 02:30:03.453513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:03.456262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:03.597151 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 02:30:04.077688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:04.147317 n-d-862964-4 devstack@keystone.service[82079]: INFO dbcounter [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] Registered counter for database keystone Oct 29 02:30:04.169169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG oslo_db.sqlalchemy.engines [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 29 02:30:04.176341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writer thread running {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 29 02:30:04.295191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73652b-1310-48e5-93d7-e3a9fdd0ef11 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:04.300675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:04.301300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:04.301579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:04.301836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:04.310561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:04.361956 n-d-862964-4 devstack@keystone.service[82079]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 02:30:04.362230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705d399-3626-4e2c-8c4f-351b9227e7cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:04.372925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Oct 29 02:30:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:30:04.381969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:04.403245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa66732-626d-4b4c-ac67-c77c877ec5c0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:04.409246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:04.410413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:04.410692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:04.410958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] PATH_INFO: `/v3/projects/78e88c459a88409388afe930208caca8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:04.414915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] RBAC: Authorizing `identity:get_project(project_id=78e88c459a88409388afe930208caca8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:04.464389 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 02:30:04.464724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4acbf-3fa3-4061-8288-5a2048d09380 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:04.469241 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Oct 29 02:30:04 2022] GET /identity/v3/projects/78e88c459a88409388afe930208caca8 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:06.625307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b917-0b83-46e2-9ee1-a73a6e281c13 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:06.626207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b917-0b83-46e2-9ee1-a73a6e281c13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:06.626207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792b917-0b83-46e2-9ee1-a73a6e281c13 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:06.632656 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:06.638933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:06.639363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:06.639452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:06.660929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:06.662548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:06.671346 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 02:30:06.936596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b917-0b83-46e2-9ee1-a73a6e281c13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:06.954110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792b917-0b83-46e2-9ee1-a73a6e281c13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:06.960166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8102-61ec-42db-af45-f61c02fef3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:06.960771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8102-61ec-42db-af45-f61c02fef3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:06.961049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8102-61ec-42db-af45-f61c02fef3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:06.961317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8102-61ec-42db-af45-f61c02fef3d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:06.969913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8102-61ec-42db-af45-f61c02fef3d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:06.971686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8102-61ec-42db-af45-f61c02fef3d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:06.980742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Oct 29 02:30:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:30:06.987130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:07.002711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fabed5-95a8-4edc-b7e1-3334290f54ca None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:07.009319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e4de5-8b34-46e1-8e2d-9c7e3b672210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:07.009993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e4de5-8b34-46e1-8e2d-9c7e3b672210 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:07.010268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e4de5-8b34-46e1-8e2d-9c7e3b672210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:07.010536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e4de5-8b34-46e1-8e2d-9c7e3b672210 admin admin] PATH_INFO: `/v3/users/16efc903cbf0459289b5f4c2d93cddb0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:07.012016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e4de5-8b34-46e1-8e2d-9c7e3b672210 admin admin] RBAC: Authorizing `identity:get_user(user_id=16efc903cbf0459289b5f4c2d93cddb0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:07.013919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e4de5-8b34-46e1-8e2d-9c7e3b672210 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:07.015468 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sat Oct 29 02:30:06 2022] GET /identity/v3/users/16efc903cbf0459289b5f4c2d93cddb0 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:09.170891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bb046-0721-4648-b0f2-b6f4f06c9f79 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.171462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bb046-0721-4648-b0f2-b6f4f06c9f79 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.171462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bb046-0721-4648-b0f2-b6f4f06c9f79 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.172753 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:09.178186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.178604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.178725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.198219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:09.199410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:09.244223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7a9b2-a80e-4f7e-b999-dea88f9075b7 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.244511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7a9b2-a80e-4f7e-b999-dea88f9075b7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.244779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7a9b2-a80e-4f7e-b999-dea88f9075b7 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.249851 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:30:09.252338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.252623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.252889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.291167 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:09.295131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG passlib.handlers.bcrypt [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=82079) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 02:30:09.295517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG passlib.handlers.bcrypt [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=82079) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 02:30:09.344048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:09.345648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:09.452276 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:09.551869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:09.578419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:09.662529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee07216-2f50-424f-ad30-5c5c34c061c7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:09.696179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:09.696831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.697106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.697376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.709016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:09.716436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:09.717916 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:09.718973 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:09.719840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:09.724907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:09.805908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:09.815949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b467589-20c4-4190-be82-15b6479c6710 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:09.818563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:09.827256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8773d-7e4e-4de5-9130-031d67517470 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:09.853389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:09.854341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.854618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.854887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.855859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:09.857295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:09.861405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:09.862078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:09.862353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:09.862737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:09.863402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:09.863703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:09.865237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:09.869796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 02:30:09.869796 n-d-862964-4 devstack@keystone.service[82079]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:30:09.869796 n-d-862964-4 devstack@keystone.service[82079]: [parameters: {'id': '4eb751d80845433db8fce4093dc860c2', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 02:30:09.869796 n-d-862964-4 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 02:30:09.877868 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:09.883754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:30:09.888693 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 02:30:09.889609 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 02:30:09.890595 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 02:30:09.891408 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:30:09.892251 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:30:09.892965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'id': '4eb751d80845433db8fce4093dc860c2', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 02:30:09.893766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:09.894489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:09.895368 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 8/16] 10.222.0.16 () {60 vars in 1137 bytes} [Sat Oct 29 02:30:09 2022] POST /identity/v3/domains => generated 190 bytes in 174 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:30:09.896022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:09.986893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae991c2-26ba-4692-a6a1-cd17f1fa2332 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:09.998340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277da0b0-464e-4b55-8127-fba3c900fec9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:10.022301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:10.022968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:10.023244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:10.023525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] PATH_INFO: `/v3/users/16efc903cbf0459289b5f4c2d93cddb0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:10.024650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] RBAC: Authorizing `identity:get_user(user_id=16efc903cbf0459289b5f4c2d93cddb0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:10.026149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:10.027731 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:09 2022] GET /identity/v3/users/16efc903cbf0459289b5f4c2d93cddb0 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:10.031309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:10.032256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:10.032535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:10.032803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:10.033445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:10.048980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:10.051193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:10.052868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:30:10.068580 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:10.069488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:30:10.070331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:30:10.070331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:30:10.070331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:10.070331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:30:10.075560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:10.096485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:10.136215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3a0c8-4874-4392-b6e1-1f09d7367894 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:10.171329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:10.171975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:10.172250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:10.172522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:10.173646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:10.175179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:10.176748 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:10.177310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c19c99-0009-4105-b2b7-9628b28860f6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:10.182776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:10.214530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:10.215202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:10.215485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:10.215757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:10.216398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:10.216697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:10.218115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d90752-bee8-4419-ae0a-6fe03d69df0d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:10.235549 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:10.263793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:10.284774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c33f19-34ab-441a-8b28-250a2e87d94d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:10.320110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec8b53e-e53e-4572-bf78-b5fb896b2cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:10.320782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8b53e-e53e-4572-bf78-b5fb896b2cbd None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:10.321054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8b53e-e53e-4572-bf78-b5fb896b2cbd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:10.321319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec8b53e-e53e-4572-bf78-b5fb896b2cbd None admin] PATH_INFO: `/v3/domains/default/users/16efc903cbf0459289b5f4c2d93cddb0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:10.323319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8b53e-e53e-4572-bf78-b5fb896b2cbd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=16efc903cbf0459289b5f4c2d93cddb0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:10.324811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec8b53e-e53e-4572-bf78-b5fb896b2cbd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:10.439421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 11/21] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Oct 29 02:30:10 2022] PUT /identity/v3/domains/default/users/16efc903cbf0459289b5f4c2d93cddb0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:30:12.852229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d4a8-e31e-4de8-963d-00f694d3bc64 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:12.852229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d4a8-e31e-4de8-963d-00f694d3bc64 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:12.852229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65d4a8-e31e-4de8-963d-00f694d3bc64 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:12.852229 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:12.871114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2a14-e94d-4444-b5ae-8d5d588d240a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:12.872332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2a14-e94d-4444-b5ae-8d5d588d240a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:12.872802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c2a14-e94d-4444-b5ae-8d5d588d240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:12.918950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf4c2a14-e94d-4444-b5ae-8d5d588d240a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:12.920851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf4c2a14-e94d-4444-b5ae-8d5d588d240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:12.995790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5885c-9207-4330-9ac7-6ea4ff0bc1ae None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:12.996105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5885c-9207-4330-9ac7-6ea4ff0bc1ae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:12.996346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5885c-9207-4330-9ac7-6ea4ff0bc1ae None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:12.999169 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:13.007779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d3b1-304f-4ed3-b06e-efbb19617567 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.008061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d3b1-304f-4ed3-b06e-efbb19617567 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.008326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9d3b1-304f-4ed3-b06e-efbb19617567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.047286 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:13.048634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-daf9d3b1-304f-4ed3-b06e-efbb19617567 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:13.049902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-daf9d3b1-304f-4ed3-b06e-efbb19617567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:13.158884 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:13.315019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095528c-d649-45e4-8f46-cb3e8fdd72b5 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.315645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095528c-d649-45e4-8f46-cb3e8fdd72b5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.316130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095528c-d649-45e4-8f46-cb3e8fdd72b5 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.320588 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:13.326352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.326644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.326921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.344669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b30b46-6b44-4efd-a9c9-b5ffdcfb12b6 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.345703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b30b46-6b44-4efd-a9c9-b5ffdcfb12b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.346224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b30b46-6b44-4efd-a9c9-b5ffdcfb12b6 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.347776 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:13.353293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.353917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.354388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.366891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:13.373830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:13.373830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:13.398832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:13.400377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:13.488119 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:13.489239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:13.540501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:13.559379 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:13.559981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:13.623511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e311b-d92d-4217-8523-e32845d81c22 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:13.659514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:13.660158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.660440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.660713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.669446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:13.671870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:13.673636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:30:13.690690 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:13.691599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:30:13.692397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:30:13.692397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:30:13.692397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:13.692397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 15/30] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:13.702763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:13.834808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ce6d6-e611-451e-a641-7d4cf9505074 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:13.869797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:13.870473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.870757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.871029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.875933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5f350-539e-4d72-9177-6c71dfcd94bf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:13.891041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:13.897450 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:13.898278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:13.899016 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:13.900222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:13.962516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:13.963255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:13.963539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:13.963812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:13.964471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:13.964777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:13.966205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:13.979097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:13.995461 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:13.996224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:14.030938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76110015-60b0-445c-b3ca-4e1ba21d26aa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:14.061185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:14.105433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:14.106006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.106313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.106556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.107229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:14.108755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:14.115169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c92ad-a16e-4314-9351-8dde47582702 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:14.131029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 17/33] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Oct 29 02:30:13 2022] POST /identity/v3/roles => generated 219 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:14.131904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:14.160021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:14.161051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.161589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.162287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.163385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:14.163847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:14.165828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:14.180848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 17/34] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:14.182116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:14.264020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff305c3f-9b9d-4ff5-8743-992f88f1ecdf None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:14.303685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccf12b-1902-4270-a68c-c20ba1e0997e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:14.304953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:14.321487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:14.344113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:14.344533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.345472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.345472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.347574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:14.350087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:14.367113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fd7cc-5824-442c-bf15-6a3041d5c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:14.373831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd7cc-5824-442c-bf15-6a3041d5c2fa None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.373831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd7cc-5824-442c-bf15-6a3041d5c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.373831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fd7cc-5824-442c-bf15-6a3041d5c2fa None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.373831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fd7cc-5824-442c-bf15-6a3041d5c2fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:14.377836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fd7cc-5824-442c-bf15-6a3041d5c2fa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:14.427287 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 18/35] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:30:14 2022] POST /identity/v3/projects => generated 301 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:14.428771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:14.539685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 18/36] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Oct 29 02:30:14 2022] POST /identity/v3/roles => generated 225 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:14.541230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6dee4-7902-40d3-9262-753fe45a291b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.541530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6dee4-7902-40d3-9262-753fe45a291b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.541787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c6dee4-7902-40d3-9262-753fe45a291b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.550553 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 19/37] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:14.563374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2b49-066c-4f33-a1ae-75680f801c22 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.563699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2b49-066c-4f33-a1ae-75680f801c22 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.563933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f2b49-066c-4f33-a1ae-75680f801c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.613833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-145f2b49-066c-4f33-a1ae-75680f801c22 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:14.621914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-145f2b49-066c-4f33-a1ae-75680f801c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:14.765836 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 20/38] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:14.773836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be42950-7d58-4559-9c23-7ff97a1887d4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:14.841827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0650b58-5363-4825-bc80-9864949d1a46 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.841827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0650b58-5363-4825-bc80-9864949d1a46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.841827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0650b58-5363-4825-bc80-9864949d1a46 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.841827 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:14.849822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.849958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:14.850067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.850067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.850184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:14.850184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:14.850184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] PATH_INFO: `/v3/users/16efc903cbf0459289b5f4c2d93cddb0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:14.851307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] RBAC: Authorizing `identity:get_user(user_id=16efc903cbf0459289b5f4c2d93cddb0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:14.853834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:14.857824 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 19/40] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:14 2022] GET /identity/v3/users/16efc903cbf0459289b5f4c2d93cddb0 => generated 247 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:14.861844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:14.876594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:14.876594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:14.925826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:14.973843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:15.068624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:15.106460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:15.115477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fca04-d6d5-4d65-9f95-f8275a692820 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:15.155198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:15.156121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:15.156229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:15.156436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:15.157737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:15.159679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:15.161511 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 20/42] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:15.167579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:15.192802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04581b6-0dad-4674-a6ee-2719723c00a9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:15.233136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:15.234215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:15.234669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:15.235191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:15.236030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:15.237716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:15.256876 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 23/43] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Oct 29 02:30:15 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:15.257996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:15.285621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb66bf7-9b7f-4ba7-87f5-e71e7964fe9f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:15.297592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:15.336265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:15.337582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:15.338177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:15.338624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:15.340834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.domain.id=default, user.id=16efc903cbf0459289b5f4c2d93cddb0) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:15.341359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:15.343169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:15.362170 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 21/44] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Oct 29 02:30:15 2022] GET /identity/v3/role_assignments?user.id=16efc903cbf0459289b5f4c2d93cddb0&scope.domain.id=default&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 530 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:15.403410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:15.411073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919721e-2f7b-421c-ba80-31e44ef71fe8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:15.463698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ddb55-4c1f-4bb5-8ce1-8e9967cd560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:15.464829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ddb55-4c1f-4bb5-8ce1-8e9967cd560f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:15.465271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ddb55-4c1f-4bb5-8ce1-8e9967cd560f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:15.465699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ddb55-4c1f-4bb5-8ce1-8e9967cd560f None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:15.467192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ddb55-4c1f-4bb5-8ce1-8e9967cd560f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:15.468930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ddb55-4c1f-4bb5-8ce1-8e9967cd560f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:15.470888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 24/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:15.478444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:15.621796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89627e38-8385-4e79-899a-d334f295c050 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:15.655225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3cb2-ba05-42ee-8600-8f424c36d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:15.655848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3cb2-ba05-42ee-8600-8f424c36d2db None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:15.656128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3cb2-ba05-42ee-8600-8f424c36d2db None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:15.656402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3cb2-ba05-42ee-8600-8f424c36d2db None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:15.657056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3cb2-ba05-42ee-8600-8f424c36d2db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:15.658566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3cb2-ba05-42ee-8600-8f424c36d2db None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:15.686367 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:30:15 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:17.806738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d445-1da7-47f8-b20d-0c755fa0b4cb None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:17.807613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d445-1da7-47f8-b20d-0c755fa0b4cb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:17.807613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d445-1da7-47f8-b20d-0c755fa0b4cb None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:17.809848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:17.816160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:17.816849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:17.817068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:17.841496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:17.842719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:17.860894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:17.915462 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:18.183975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8d445-1da7-47f8-b20d-0c755fa0b4cb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:18.293460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8d445-1da7-47f8-b20d-0c755fa0b4cb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:18.328413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72155c9-fd58-4d2b-9667-0c64f36f7e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:18.329077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72155c9-fd58-4d2b-9667-0c64f36f7e11 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:18.329361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72155c9-fd58-4d2b-9667-0c64f36f7e11 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:18.329634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72155c9-fd58-4d2b-9667-0c64f36f7e11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:18.330835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72155c9-fd58-4d2b-9667-0c64f36f7e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:18.332296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72155c9-fd58-4d2b-9667-0c64f36f7e11 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:18.334194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:18.340864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:18.454758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56dfec-dd42-4428-8ad5-dce2fc136842 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:18.489835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534c375-b733-4063-be92-0bd793151866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:18.490467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c375-b733-4063-be92-0bd793151866 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:18.490745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c375-b733-4063-be92-0bd793151866 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:18.491023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534c375-b733-4063-be92-0bd793151866 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:18.491667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534c375-b733-4063-be92-0bd793151866 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:18.493128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534c375-b733-4063-be92-0bd793151866 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:18.524839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 24/50] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Oct 29 02:30:18 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:20.647496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334bbd-173f-430b-8c5b-3ad2b2ae9003 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:20.648022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334bbd-173f-430b-8c5b-3ad2b2ae9003 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:20.648022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17334bbd-173f-430b-8c5b-3ad2b2ae9003 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:20.649404 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 27/51] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:20.655769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:20.656467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:20.656613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:20.673741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:20.679918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:20.681655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:20.748908 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 25/52] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:21.012734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334bbd-173f-430b-8c5b-3ad2b2ae9003 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:21.047252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:21.121377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17334bbd-173f-430b-8c5b-3ad2b2ae9003 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:21.156172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67169ac1-b9b1-4091-ac83-26c65b45e471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:21.156838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67169ac1-b9b1-4091-ac83-26c65b45e471 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:21.157306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67169ac1-b9b1-4091-ac83-26c65b45e471 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:21.157552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67169ac1-b9b1-4091-ac83-26c65b45e471 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:21.158744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67169ac1-b9b1-4091-ac83-26c65b45e471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:21.160403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67169ac1-b9b1-4091-ac83-26c65b45e471 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:21.162434 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 28/53] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:21.171356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:21.286038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbb6c-dafe-4aa3-aad2-98d3e3b24db0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:21.324063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c334665-5efc-4479-a681-32c0aac75797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:21.324681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c334665-5efc-4479-a681-32c0aac75797 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:21.324960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c334665-5efc-4479-a681-32c0aac75797 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:21.325230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c334665-5efc-4479-a681-32c0aac75797 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:21.325914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c334665-5efc-4479-a681-32c0aac75797 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:21.327358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c334665-5efc-4479-a681-32c0aac75797 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:21.339233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:21.354132 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 26/54] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:21 2022] POST /identity/v3/users => generated 275 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:24.717497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab05565-f131-463a-82b8-938ccea5c70f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:24.717497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab05565-f131-463a-82b8-938ccea5c70f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:24.717497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab05565-f131-463a-82b8-938ccea5c70f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:24.717497 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 29/55] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:24.728790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab1245-0097-42cb-aa43-83f6c7e1e19e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:24.729726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab1245-0097-42cb-aa43-83f6c7e1e19e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:24.730191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab1245-0097-42cb-aa43-83f6c7e1e19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:24.767006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aaab1245-0097-42cb-aa43-83f6c7e1e19e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:24.768515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aaab1245-0097-42cb-aa43-83f6c7e1e19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:24.780766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c832-f87c-4523-b37c-582346170857 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:24.781356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c832-f87c-4523-b37c-582346170857 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:24.781797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7c832-f87c-4523-b37c-582346170857 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:24.783372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 30/56] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:30:24.789213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269a4e-90bb-487a-a58d-d1a2b1fbc470 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:24.789736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269a4e-90bb-487a-a58d-d1a2b1fbc470 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:24.790221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f269a4e-90bb-487a-a58d-d1a2b1fbc470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:24.827322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f269a4e-90bb-487a-a58d-d1a2b1fbc470 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:24.828915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f269a4e-90bb-487a-a58d-d1a2b1fbc470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:24.856317 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 27/57] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:24.920483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f576-a588-4d3f-8f7a-ace0152584a9 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:24.921125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f576-a588-4d3f-8f7a-ace0152584a9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:24.921588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2f576-a588-4d3f-8f7a-ace0152584a9 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:24.923187 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 28/58] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:30:24.928519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc77a9-1a52-4506-9158-4c76bb511152 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:24.929046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc77a9-1a52-4506-9158-4c76bb511152 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:24.929525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc77a9-1a52-4506-9158-4c76bb511152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:24.936430 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 31/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:24.970898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-89dc77a9-1a52-4506-9158-4c76bb511152 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:24.972425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89dc77a9-1a52-4506-9158-4c76bb511152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:25.121958 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 29/60] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:25.191253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b250b62-3815-47da-ba4c-da857bce56c6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.191598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b250b62-3815-47da-ba4c-da857bce56c6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.191810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b250b62-3815-47da-ba4c-da857bce56c6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.193457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 32/61] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:25.198781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.199074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.199354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.214280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b250b62-3815-47da-ba4c-da857bce56c6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.218700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:25.219925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:25.278849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:25.280435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:25.304637 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 30/62] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:25.313823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.378743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b250b62-3815-47da-ba4c-da857bce56c6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:25.423564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:25.424731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.425112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.425484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.439182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:25.440579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8e78c-f351-4838-901d-cee67d041dea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:25.482109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733f393-084d-4907-a4f8-f36d4e8afe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:25.482789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f393-084d-4907-a4f8-f36d4e8afe27 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.483070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f393-084d-4907-a4f8-f36d4e8afe27 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.483345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733f393-084d-4907-a4f8-f36d4e8afe27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.496042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733f393-084d-4907-a4f8-f36d4e8afe27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a733f393-084d-4907-a4f8-f36d4e8afe27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:25.501295 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:25.502217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:25.502977 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 31/63] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:25.504304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68e0-9d16-4ab2-9cde-041080e378b7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.504798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68e0-9d16-4ab2-9cde-041080e378b7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.505239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced68e0-9d16-4ab2-9cde-041080e378b7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.509468 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:25.509468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced68e0-9d16-4ab2-9cde-041080e378b7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:25.562295 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:25.563104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:25.563919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 33/65] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:30:25.565877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.568919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:25.634325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced68e0-9d16-4ab2-9cde-041080e378b7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:25.657705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:25.667633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4aa780-df6d-464a-a44e-d9fd38bcb27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:25.668300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aa780-df6d-464a-a44e-d9fd38bcb27a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.668578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aa780-df6d-464a-a44e-d9fd38bcb27a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.668848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4aa780-df6d-464a-a44e-d9fd38bcb27a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.671425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44ee6c-ac76-4d91-aeae-2076739d35de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:25.678998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4aa780-df6d-464a-a44e-d9fd38bcb27a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-dd4aa780-df6d-464a-a44e-d9fd38bcb27a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:25.683833 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:25.684690 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:25.685425 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 33/66] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:25.686116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.686345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.686685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.704371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:25.705555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:25.709774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:25.710426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.710709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.710983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.711671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:25.712062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:25.713414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:25.723330 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 34/67] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:25.723955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.779122 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 34/68] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:25.782772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.819121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:25.830165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bbb7d-081e-4b4b-bafe-32f92d8ac60e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:25.868940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:25.869557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.869858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.870133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.870790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:25.871098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:25.872792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:25.881047 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:25.881682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.895151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4e89-b9a8-42c5-bcdd-c6e1a2bc5711 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:25.896344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:25.933493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:25.934225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:25.934509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:25.934792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:25.945691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:25.950888 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:25.951759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:25.952510 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:25.953688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:25.992090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8952d0-3b19-447e-af9d-30858189bd9c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.028615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.029508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.029796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.030102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.030766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:26.031211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.034373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.046502 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.047604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.054435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.063463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135607f3-dea2-4572-b8d6-67e440bb19c9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.095547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.096186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.096461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.096724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] PATH_INFO: `/v3/users/62c7aa43a9fd41578b1c632db7d55d19` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.109673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] RBAC: Authorizing `identity:get_user(user_id=62c7aa43a9fd41578b1c632db7d55d19)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.111183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.112799 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:25 2022] GET /identity/v3/users/62c7aa43a9fd41578b1c632db7d55d19 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.113550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.120715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.149253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f979d1-1836-454d-8d78-778b393f63d5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.182771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.183417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.183701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.183965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] PATH_INFO: `/v3/users/62c7aa43a9fd41578b1c632db7d55d19` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.185366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] RBAC: Authorizing `identity:get_user(user_id=62c7aa43a9fd41578b1c632db7d55d19)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.186881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.188476 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/users/62c7aa43a9fd41578b1c632db7d55d19 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.189237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.217626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889ab5e9-1918-4acb-89ba-30e00c3bb910 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.253931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.254558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.255014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.255185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.255854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:26.256180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.257568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.266124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 37/74] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.266932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.281573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.292246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace6f5a-6497-4e4b-be36-0059d488bb9c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.326032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.326667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.326948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.327226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.328346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.329835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.333838 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.333838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.345627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.365413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1eb81-8906-43dd-b5ed-e15dea349bbd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.398248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.398882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.399158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.399476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] PATH_INFO: `/v3/users/16efc903cbf0459289b5f4c2d93cddb0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.400534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] RBAC: Authorizing `identity:get_user(user_id=16efc903cbf0459289b5f4c2d93cddb0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.402010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.403595 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 38/76] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/users/16efc903cbf0459289b5f4c2d93cddb0 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.404349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.431148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af062c35-a30c-4668-9a03-121af2783d8e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.463939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.464585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.464863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.465136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.466327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.467767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.469451 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 39/77] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.470245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.490363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.510471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ec39c-de81-4d5e-9fdd-ce42b6f0b2be None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.545067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.545712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.546465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.546753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.547869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.549612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.551325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.553842 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.558721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.573979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1c5c2-a21e-4976-88c9-89c31f6f9925 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.607596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.608227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.608505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.608780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] PATH_INFO: `/v3/users/62c7aa43a9fd41578b1c632db7d55d19` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.609939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] RBAC: Authorizing `identity:get_user(user_id=62c7aa43a9fd41578b1c632db7d55d19)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.611434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.613023 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/users/62c7aa43a9fd41578b1c632db7d55d19 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.613777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.656027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd56bd-04b3-4bc0-ac44-38542f1a7968 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.690324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.690938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.691218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.691490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.692143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.693872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.716181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 40/80] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:26 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:26.717162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.720559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.733281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef90bc-d8e6-419e-808e-57d254eae462 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.774071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.774735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.775022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.775301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.776777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.779249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.781086 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 41/81] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:26.782027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.801242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.837728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe254-d0d2-4884-9702-bafcfa688603 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.872553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.873238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.873519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.873794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/62c7aa43a9fd41578b1c632db7d55d19/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.875834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] RBAC: Authorizing `identity:create_grant(project_id=717a3ccf0b6d44d28eba4df5b9801aec, user_id=62c7aa43a9fd41578b1c632db7d55d19, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.877341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.894666 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 41/82] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:26 2022] PUT /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/62c7aa43a9fd41578b1c632db7d55d19/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:26.895566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:26.905907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d828760a-0e71-4752-9d2f-ceb1b40d2b69 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:26.962944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:26.964125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:26.964403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:26.965192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/62c7aa43a9fd41578b1c632db7d55d19/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:26.967706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] RBAC: Authorizing `identity:create_grant(project_id=717a3ccf0b6d44d28eba4df5b9801aec, user_id=62c7aa43a9fd41578b1c632db7d55d19, role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:26.969185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:26.989715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:26.995083 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:26 2022] PUT /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/62c7aa43a9fd41578b1c632db7d55d19/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:26.995968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:27.095349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587c36c-f456-4aa3-903d-385187d7a54f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:27.116384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:27.153188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:27.154762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:27.154762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:27.154762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] PATH_INFO: `/v3/projects/71e496e518e24997b781c10020f68ed5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:27.155845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] RBAC: Authorizing `identity:get_project(project_id=71e496e518e24997b781c10020f68ed5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:27.157553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:27.159895 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:26 2022] GET /identity/v3/projects/71e496e518e24997b781c10020f68ed5 => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:27.160006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9dd43-c072-4b65-a6d1-6381536d97ea None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:27.167943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:27.217700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c90b1-a1b9-44b3-91c1-789d669ecbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:27.217904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c90b1-a1b9-44b3-91c1-789d669ecbd8 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:27.219673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c90b1-a1b9-44b3-91c1-789d669ecbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:27.219673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c90b1-a1b9-44b3-91c1-789d669ecbd8 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/16efc903cbf0459289b5f4c2d93cddb0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:27.222261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c90b1-a1b9-44b3-91c1-789d669ecbd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=717a3ccf0b6d44d28eba4df5b9801aec, user_id=16efc903cbf0459289b5f4c2d93cddb0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:27.224077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c90b1-a1b9-44b3-91c1-789d669ecbd8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:27.253990 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 43/85] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:26 2022] PUT /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/16efc903cbf0459289b5f4c2d93cddb0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:27.313053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74b127-627d-468a-abe7-91aff6597b73 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:27.375001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:27.385481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c60962-f1d4-4f02-8359-188f3ae38f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:27.386582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60962-f1d4-4f02-8359-188f3ae38f57 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:27.387068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60962-f1d4-4f02-8359-188f3ae38f57 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:27.387557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c60962-f1d4-4f02-8359-188f3ae38f57 None admin] PATH_INFO: `/v3/projects/71e496e518e24997b781c10020f68ed5/users/62c7aa43a9fd41578b1c632db7d55d19/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:27.392800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c60962-f1d4-4f02-8359-188f3ae38f57 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e496e518e24997b781c10020f68ed5, user_id=62c7aa43a9fd41578b1c632db7d55d19, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:27.395207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c60962-f1d4-4f02-8359-188f3ae38f57 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:27.417025 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 43/86] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:27 2022] PUT /identity/v3/projects/71e496e518e24997b781c10020f68ed5/users/62c7aa43a9fd41578b1c632db7d55d19/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:29.359497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076adcf4-6596-4616-86ce-bca16a1a3ad8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:29.360019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076adcf4-6596-4616-86ce-bca16a1a3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:29.360019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076adcf4-6596-4616-86ce-bca16a1a3ad8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:29.361547 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 44/87] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:29.367976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e122c-4adf-4c29-b75e-d0f8c1319730 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:29.367976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e122c-4adf-4c29-b75e-d0f8c1319730 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:29.367976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e122c-4adf-4c29-b75e-d0f8c1319730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:29.398975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f16e122c-4adf-4c29-b75e-d0f8c1319730 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:29.400514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f16e122c-4adf-4c29-b75e-d0f8c1319730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:29.508050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 44/88] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:30.017514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a0fe-3570-422b-97d7-4f231237a7a8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.017885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a0fe-3570-422b-97d7-4f231237a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.018232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a0fe-3570-422b-97d7-4f231237a7a8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.019819 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 45/89] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:30.031610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af2bf7-eb6d-4101-bbcc-035693c0b1b8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.031933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af2bf7-eb6d-4101-bbcc-035693c0b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.032168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af2bf7-eb6d-4101-bbcc-035693c0b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.070907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86af2bf7-eb6d-4101-bbcc-035693c0b1b8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:30.072132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86af2bf7-eb6d-4101-bbcc-035693c0b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:30.075255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a0fe-3570-422b-97d7-4f231237a7a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:30.210785 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 45/90] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:30.212487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd802-3963-4aa5-a666-063b5cad62fc None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.213188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd802-3963-4aa5-a666-063b5cad62fc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.213655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fd802-3963-4aa5-a666-063b5cad62fc None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.215171 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 46/91] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:30.223977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299ee0-595a-4709-8f10-df4993648091 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.224258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299ee0-595a-4709-8f10-df4993648091 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.224539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299ee0-595a-4709-8f10-df4993648091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.263409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a299ee0-595a-4709-8f10-df4993648091 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:30.263409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a299ee0-595a-4709-8f10-df4993648091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:30.316689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a0fe-3570-422b-97d7-4f231237a7a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:30.376443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:30.411381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:30.412041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.412306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.412583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.414605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:30.439441 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 47/92] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:30.443020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:30.449248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:30.450099 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:30.450837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:30.452147 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 46/93] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:30:30.453634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4ef3-aae0-45a5-ac71-3628a2d25e79 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.454220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4ef3-aae0-45a5-ac71-3628a2d25e79 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.454842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df4ef3-aae0-45a5-ac71-3628a2d25e79 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.456401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 48/94] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:30.467135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:30.471058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.471572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.472037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.523708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:30.524550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:30.694344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f934c-18e9-4705-ab9b-c9abbdd86beb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:30.741358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:30.742339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.742758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.743165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.744307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:30.745795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:30.747712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537059e9-c917-4abc-8a1b-8a112c6cc7e9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:30.753119 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 49/95] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:30.754270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:30.770921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:30.772675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4083e2-e22a-40df-ad6d-087027dc43be None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.774682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4083e2-e22a-40df-ad6d-087027dc43be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.776644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4083e2-e22a-40df-ad6d-087027dc43be None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.783427 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 48/97] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:30.784534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4083e2-e22a-40df-ad6d-087027dc43be None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:30.870885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:30.901233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1e675-31bd-487b-ba04-d320fa57db63 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:30.918247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:30.930736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4083e2-e22a-40df-ad6d-087027dc43be None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:30.954742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:30.955753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.956225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.956687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.978665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:30.980435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58e47d-1850-4f91-8b2a-76f0050bcd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:30.981884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58e47d-1850-4f91-8b2a-76f0050bcd3c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:30.982168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58e47d-1850-4f91-8b2a-76f0050bcd3c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:30.982445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58e47d-1850-4f91-8b2a-76f0050bcd3c None admin] PATH_INFO: `/v3/users/62c7aa43a9fd41578b1c632db7d55d19` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:30.984948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58e47d-1850-4f91-8b2a-76f0050bcd3c None admin] RBAC: Authorizing `identity:get_user(user_id=62c7aa43a9fd41578b1c632db7d55d19)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:30.987463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58e47d-1850-4f91-8b2a-76f0050bcd3c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:30.990930 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 49/98] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:30 2022] GET /identity/v3/users/62c7aa43a9fd41578b1c632db7d55d19 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:30.995417 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:30.996239 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:30.997305 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 50/99] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:30.998719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.003485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.003485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.003485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.034827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:31.036078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:31.152987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59615c-0f5f-4763-9102-c423dcdacb0e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.153336 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:31.154575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.219454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.219454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.219454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.219454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.228553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.241145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:31.247585 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:31.248414 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:31.249183 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:31.253612 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 51/101] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:30:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:31.254498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.286277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883583b-2920-428e-9e21-04d106bfc8e1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.291810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.321351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f6af6-3254-4703-92a0-024d2d2b38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.321998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f6af6-3254-4703-92a0-024d2d2b38c2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.322279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f6af6-3254-4703-92a0-024d2d2b38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.322545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f6af6-3254-4703-92a0-024d2d2b38c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.365635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709b39e-4c7c-4aba-9560-c0d6e3a02a23 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.390623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f6af6-3254-4703-92a0-024d2d2b38c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:31.392201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f6af6-3254-4703-92a0-024d2d2b38c2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:31.402256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.403502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.403974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.404459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.405373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:31.405919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:31.407520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:31.416545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:31.422224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.450542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.503149 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 51/103] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:31.504675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e86b3-6ad0-4efa-b37d-1ee2595367bc None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.505304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e86b3-6ad0-4efa-b37d-1ee2595367bc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.505583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e86b3-6ad0-4efa-b37d-1ee2595367bc None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.510025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 52/104] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:31.510842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e86b3-6ad0-4efa-b37d-1ee2595367bc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.523803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.530893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ab956-f584-4eba-a516-dd3fcb3972ef None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.568797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.569676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.570185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.570453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.571580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:31.573041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:31.574981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 53/105] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:31.575435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.629411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e86b3-6ad0-4efa-b37d-1ee2595367bc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.666905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.667972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.668269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.668550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.669552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:31.669979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:31.671325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:31.680042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa71eb-6525-4dcd-a79c-6aeea2c5a9ab None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.680193 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 53/106] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:31.680889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.703001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.715231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.715892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.716153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.716429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] PATH_INFO: `/v3/users/e5e8fbccafc5401b80c5786f2adabfa8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.730749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] RBAC: Authorizing `identity:get_user(user_id=e5e8fbccafc5401b80c5786f2adabfa8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:31.732267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:31.733987 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 54/107] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/users/e5e8fbccafc5401b80c5786f2adabfa8 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:31.734757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.760334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.799884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a4a1-5bd5-4ba6-b7c4-16cd636bef22 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.839689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f040610-ddd7-4276-addb-4f76ac6b9a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.840338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040610-ddd7-4276-addb-4f76ac6b9a0e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.840624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040610-ddd7-4276-addb-4f76ac6b9a0e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.840901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f040610-ddd7-4276-addb-4f76ac6b9a0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.846965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e961e7f-0cc5-4404-be86-40780477fc1e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:31.852575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f040610-ddd7-4276-addb-4f76ac6b9a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3f040610-ddd7-4276-addb-4f76ac6b9a0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:31.858055 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:31.858906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 54/108] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:31.864476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.865139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.865139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.879601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:31.882031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:31.891178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:31.891830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:31.892489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:31.892489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:31.893846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:31.895150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:31.897040 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 55/109] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:31.897942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.955228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 55/110] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:31.970000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:31.970000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:31.991683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.004085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9150b1-c53e-4046-8737-3d6a807db893 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.044506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.045049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.045327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.045599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.046298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.047743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.080078 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 56/111] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:30:31 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:32.080784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbdfbb8-16db-4adb-8db5-9a444aadf6b8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.080956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.137866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.138538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.138821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.139103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] PATH_INFO: `/v3/users/62c7aa43a9fd41578b1c632db7d55d19` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.143381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] RBAC: Authorizing `identity:get_user(user_id=62c7aa43a9fd41578b1c632db7d55d19)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.144886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.146713 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 56/112] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:31 2022] GET /identity/v3/users/62c7aa43a9fd41578b1c632db7d55d19 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:32.147578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.268512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5a9b6-8ed0-41ce-9223-f7e6ebb53540 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.294209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.315225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.315939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.316099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.316368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.317750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.319216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.320911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 57/113] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:32.322644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.331539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9264809-176f-4325-9e94-30b39e5429c8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.337350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.379216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.379442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.379879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.380243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.381505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:32.381505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.383592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.393248 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 57/114] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:32.398892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.464762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5998c9a-6890-4671-8a80-0f8fd15cbbfb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.516665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.517305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.517583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.517881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.518617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] RBAC: Adding query filter params (role.id=c74dbb4a211246e2bcfa31161d49118e, scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec, user.id=62c7aa43a9fd41578b1c632db7d55d19) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:32.518946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.521710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.525273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a35aa6-d5ac-4278-a872-3020b11273e9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.528286 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 58/115] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/role_assignments?user.id=62c7aa43a9fd41578b1c632db7d55d19&scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:32.528701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.593110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.593712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.594119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.594396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.600141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.643117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.686922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f7f81-a97e-4cc7-9fb6-fe4c7fafbfe6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.731778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.733337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.748707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.749085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.749378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.749660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.765276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:32.775986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:32.776895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:32.777630 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:32.780480 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 59/116] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:32.781603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.891817 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 58/117] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:32.891817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:32.914319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87b5f4-01de-47f0-9a7c-717af83fc6f8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:32.930441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.950113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:32.957306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:32.958141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:32.958420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:32.958882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/e5e8fbccafc5401b80c5786f2adabfa8/roles/bb11de660c754576894eca58933a8853` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:32.961852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] RBAC: Authorizing `identity:create_grant(project_id=717a3ccf0b6d44d28eba4df5b9801aec, user_id=e5e8fbccafc5401b80c5786f2adabfa8, role_id=bb11de660c754576894eca58933a8853)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:32.963698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:32.982178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 60/118] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:32 2022] PUT /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/users/e5e8fbccafc5401b80c5786f2adabfa8/roles/bb11de660c754576894eca58933a8853 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:32.983012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:33.020315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8727af4e-3d3c-48db-b666-0969d02a6cdd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:33.092573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:33.093315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:33.093595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:33.093899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] PATH_INFO: `/v3/users/16efc903cbf0459289b5f4c2d93cddb0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:33.095748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] RBAC: Authorizing `identity:get_user(user_id=16efc903cbf0459289b5f4c2d93cddb0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:33.097222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:33.099126 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 59/119] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/users/16efc903cbf0459289b5f4c2d93cddb0 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:33.099961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:33.215394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b1b53-4baa-4894-a8d2-149c7b491b77 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:33.280413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94446ef-5042-4210-856c-a32b4b45d3ec None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:33.282540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:33.283494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:33.283967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:33.284432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:33.285313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:33.285894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:33.287699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:33.292350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:33.308769 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 61/120] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:33.309999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:33.364079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:33.365150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:33.365678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:33.366182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:33.368466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:33.370995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:33.373251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 60/121] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:33 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:33.374598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:33.425638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:33.508741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a451b78-f17d-4a7c-9d83-dbe07ec1867c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:33.518586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e5537-985a-4c63-8a86-0d506f686e7b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:33.554131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:33.554807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:33.555062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:33.555333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] PATH_INFO: `/v3/users/62c7aa43a9fd41578b1c632db7d55d19` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:33.556649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] RBAC: Authorizing `identity:get_user(user_id=62c7aa43a9fd41578b1c632db7d55d19)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:33.558137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:33.559943 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 61/122] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:33 2022] GET /identity/v3/users/62c7aa43a9fd41578b1c632db7d55d19 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:33.560512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:33.570313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:33.570939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:33.571215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:33.571487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:33.637372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:33.687986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:33.689523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:33.703118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3325ae-41a9-4523-8068-08482a23cdb3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:33.757837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:33.757837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:33.757837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:33.757837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:33.758248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] RBAC: Adding query filter params (role.id=01496d3e63b6459e87ed8315dc4b66b7, scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec, user.id=62c7aa43a9fd41578b1c632db7d55d19) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:33.758248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:33.758248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:33.777449 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 62/123] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:33 2022] GET /identity/v3/role_assignments?user.id=62c7aa43a9fd41578b1c632db7d55d19&scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec&role.id=01496d3e63b6459e87ed8315dc4b66b7 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:33.777449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:33.782980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:33.885684 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 62/124] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:33.893630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:34.002359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d244904-5313-4a89-b39a-8b5fd26d41da None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:34.008282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:34.055209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:34.055777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.056059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.056393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.133364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371e17ca-8a41-48ac-8f60-c04f4ff59f73 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:34.156812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:34.158670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:34.177345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:34.177713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.178042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.178321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.179551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:34.181049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:34.182825 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 63/125] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:33 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:34.189843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:34.220894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:34.323699 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 63/126] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:34.324684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:34.329354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:34.330886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331753eb-f8fa-4ba4-bc28-a65657738b27 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:34.379924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:34.381271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.382218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.382708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.383647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec, user.id=16efc903cbf0459289b5f4c2d93cddb0) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:34.384156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:34.385870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2042353-fc3b-4d75-b0b6-3be1a7e38fa2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:34.393116 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 64/127] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:34 2022] GET /identity/v3/role_assignments?user.id=16efc903cbf0459289b5f4c2d93cddb0&scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:34.444471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d291da6-41fb-4cec-9b0b-90b13574ac32 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.445096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d291da6-41fb-4cec-9b0b-90b13574ac32 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.445568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d291da6-41fb-4cec-9b0b-90b13574ac32 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.447661 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 65/128] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:34.461287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.461992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.462282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.505460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:34.505460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:34.516456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9278f-dff8-4af9-80d6-18c56574d99e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:34.586755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:34.588180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.590155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.590718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] PATH_INFO: `/v3/projects/71e496e518e24997b781c10020f68ed5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.592301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] RBAC: Authorizing `identity:get_project(project_id=71e496e518e24997b781c10020f68ed5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:34.595326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:34.598768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 64/129] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:34 2022] GET /identity/v3/projects/71e496e518e24997b781c10020f68ed5 => generated 312 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:34.605452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:34.623383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 66/130] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:34.695243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:34.732846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9699d-31ce-4bb3-a5af-6d1a82ef301c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:34.774118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:34.775028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:34.775456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:34.775881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:34.776611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] RBAC: Adding query filter params (role.id=c74dbb4a211246e2bcfa31161d49118e, scope.project.id=71e496e518e24997b781c10020f68ed5, user.id=62c7aa43a9fd41578b1c632db7d55d19) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:34.776920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:34.778415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:34.789887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:34 2022] GET /identity/v3/role_assignments?user.id=62c7aa43a9fd41578b1c632db7d55d19&scope.project.id=71e496e518e24997b781c10020f68ed5&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:34.914320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:34.942529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:35.043611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ca254-e748-43a7-8d2e-cd64ca53bed6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:35.085696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f311b-0916-4db7-afa5-f16573001258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:35.086379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f311b-0916-4db7-afa5-f16573001258 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:35.088946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f311b-0916-4db7-afa5-f16573001258 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:35.088946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f311b-0916-4db7-afa5-f16573001258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:35.089567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f311b-0916-4db7-afa5-f16573001258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:35.092780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f311b-0916-4db7-afa5-f16573001258 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:35.092780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 67/132] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:35.098823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:35.210882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312bc17-bae5-41d8-b0e9-d8d6721bd20b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:35.253984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f45e0-c567-4f72-b300-ce25c1cb48bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:35.254687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f45e0-c567-4f72-b300-ce25c1cb48bd None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:35.255018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f45e0-c567-4f72-b300-ce25c1cb48bd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:35.255284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f45e0-c567-4f72-b300-ce25c1cb48bd None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:35.255972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f45e0-c567-4f72-b300-ce25c1cb48bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:35.257493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f45e0-c567-4f72-b300-ce25c1cb48bd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:35.273110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:35.305847 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 66/133] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:35 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:30:35.385757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047135-09c5-4c27-9ad7-5ec138fff6b8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:35.386142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047135-09c5-4c27-9ad7-5ec138fff6b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:35.386419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71047135-09c5-4c27-9ad7-5ec138fff6b8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:35.388039 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 68/134] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:35.394004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:35.394300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:35.394569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:35.414747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:35.416321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:35.494601 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 67/135] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:35.777919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71047135-09c5-4c27-9ad7-5ec138fff6b8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:35.884188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:35.909771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71047135-09c5-4c27-9ad7-5ec138fff6b8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:35.956972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:35.957625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:35.958155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:35.958267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:35.970410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:35.975769 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:35.976662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:35.977507 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 69/136] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:35.988475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:36.101386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09492e-5f3d-435d-ad70-e78fc95de94d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:36.126719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:36.139095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:36.140135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:36.140564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:36.140978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:36.141825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:36.142305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:36.143924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:36.157043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 68/137] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:36.163173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:36.291539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68770842-3ea2-4488-b866-d7b121f19aa8 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:36.327135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:36.327777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:36.328065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:36.328338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] PATH_INFO: `/v3/users/e5e8fbccafc5401b80c5786f2adabfa8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:36.329474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e5e8fbccafc5401b80c5786f2adabfa8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:36.331044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:36.334082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 70/138] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:36 2022] GET /identity/v3/users/e5e8fbccafc5401b80c5786f2adabfa8 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:36.340075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:36.461010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0d02f3-a8dc-4dbb-a7ca-b02d72934105 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:36.498327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:36.498935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:36.499219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:36.499512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:36.565699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:36.584922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:36.589864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:36.692378 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 69/139] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:36.698264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:36.716911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:36.809667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b63640-23ae-4456-b6bd-a5f8b3c979c1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:36.848037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11297dea-c38e-4629-9122-724a452c8ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:36.848737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11297dea-c38e-4629-9122-724a452c8ef2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:36.849031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11297dea-c38e-4629-9122-724a452c8ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:36.849326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11297dea-c38e-4629-9122-724a452c8ef2 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:36.850470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11297dea-c38e-4629-9122-724a452c8ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:36.851927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11297dea-c38e-4629-9122-724a452c8ef2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:36.853584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 71/140] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:36 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:36.859763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:36.946293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:36.967991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd74232-099b-4d56-9dd1-f312ad294009 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:37.009642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:37.010524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:37.010710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:37.010973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:37.014928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] RBAC: Adding query filter params (role.id=bb11de660c754576894eca58933a8853, scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec, user.id=e5e8fbccafc5401b80c5786f2adabfa8) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:37.015303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:37.018494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d616a-9ebb-441d-9ede-05f8a17fd473 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:37.026607 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 70/141] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:36 2022] GET /identity/v3/role_assignments?user.id=e5e8fbccafc5401b80c5786f2adabfa8&scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec&role.id=bb11de660c754576894eca58933a8853 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:37.755411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7151-1681-4f0e-9d64-46b37937bdfa None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:37.755735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7151-1681-4f0e-9d64-46b37937bdfa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:37.755945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e7151-1681-4f0e-9d64-46b37937bdfa None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:37.757463 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 72/142] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:37.762869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730557c-077a-4641-bf78-f11478546116 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:37.763160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730557c-077a-4641-bf78-f11478546116 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:37.763436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730557c-077a-4641-bf78-f11478546116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:37.782021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d730557c-077a-4641-bf78-f11478546116 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:37.783220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d730557c-077a-4641-bf78-f11478546116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:37.858450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 71/143] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:37.948089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd21d80-0a12-40d5-8ac9-c222a408d51b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:37.948601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd21d80-0a12-40d5-8ac9-c222a408d51b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:37.948674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd21d80-0a12-40d5-8ac9-c222a408d51b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:37.950051 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 73/144] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:37.956929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce36f-1d66-48a7-b7d6-38b431c6ff88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:37.957214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce36f-1d66-48a7-b7d6-38b431c6ff88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:37.957490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ce36f-1d66-48a7-b7d6-38b431c6ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:37.977795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d71ce36f-1d66-48a7-b7d6-38b431c6ff88 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:37.979462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d71ce36f-1d66-48a7-b7d6-38b431c6ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:38.057771 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 72/145] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:38.099217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5659877-d614-4331-8a42-36bb214cc342 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.099842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5659877-d614-4331-8a42-36bb214cc342 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.102666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5659877-d614-4331-8a42-36bb214cc342 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.104266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 74/146] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:38.111358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.111941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.112677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.127682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5659877-d614-4331-8a42-36bb214cc342 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.138920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:38.140196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:38.142350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:38.222788 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 73/147] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:38.240237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:38.264164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5659877-d614-4331-8a42-36bb214cc342 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.300414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.301348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.301995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.302449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.314483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:38.319942 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:38.320767 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:38.321657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:38.323695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 75/148] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:38.329496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.336140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.448612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c131-31f3-426c-92f4-e21cdee4890e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.471786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78b253-4afb-4ccc-8710-cde2db61cb64 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.491716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.492711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.493126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.493632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.494612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:38.494917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:38.496389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:38.502271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:38.506231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 74/149] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:38.507041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.512344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.513067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.513351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.513622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.522978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:38.526234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:38.531952 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:38.532868 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:38.534137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.622161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40559daa-aa19-4871-8933-384afd2cc7f6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.649627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f6e10f-3d6c-42e0-bacc-543e03ed241b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.657558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.658236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.658507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.658774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.659990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:38.661512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:38.665861 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 75/151] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:38.665861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.687737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.688630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.688907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.689181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] PATH_INFO: `/v3/users/841da163ae7d439b8a20b9e62f03eabc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.704609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] RBAC: Authorizing `identity:get_user(user_id=841da163ae7d439b8a20b9e62f03eabc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:38.706070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:38.708079 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/users/841da163ae7d439b8a20b9e62f03eabc => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:38.712790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.740346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:38.775051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:38.783637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c11b5-5a71-428b-bc5c-77230091492d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.819184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.819827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.820087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.820358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.821023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:38.821390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:38.821575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d6a8c-1426-4abd-b9b9-0961f4aee226 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.822952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:38.831681 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 76/153] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:38.832517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.859716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:38.860339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:38.860614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:38.860884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:38.861759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:38.863571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:38.887519 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 78/154] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:38 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:38.895318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:38.954410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a8f8e-0e86-4007-b859-91cfa50f7973 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:38.992353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:39.001260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:39.001964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:39.003582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:39.003882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:39.005577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:39.007231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:39.009240 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 77/155] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:39.015644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:39.036698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e75f1-e97d-49df-a1b7-61298b87ac6e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:39.061870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:39.088912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:39.089560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:39.090153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:39.090153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] PATH_INFO: `/v3/users/841da163ae7d439b8a20b9e62f03eabc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:39.092357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] RBAC: Authorizing `identity:get_user(user_id=841da163ae7d439b8a20b9e62f03eabc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:39.093856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:39.095273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 79/156] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:38 2022] GET /identity/v3/users/841da163ae7d439b8a20b9e62f03eabc => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:39.101085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:39.160675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff04a68-3215-4f11-b20d-622868b615af None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:39.220497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:39.220497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:39.220497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:39.220805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/841da163ae7d439b8a20b9e62f03eabc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:39.225827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcdec1385dc42659b0f390a1c06e0e3, user_id=841da163ae7d439b8a20b9e62f03eabc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:39.225827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:39.249587 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:39 2022] PUT /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/841da163ae7d439b8a20b9e62f03eabc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:39.263074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a0735-e9db-43c8-8d7a-8b080845166b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:39.305739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0867-cb94-47f5-bd64-1e88a0bf52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:39.306677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0867-cb94-47f5-bd64-1e88a0bf52cb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:39.307099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0867-cb94-47f5-bd64-1e88a0bf52cb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:39.307656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0867-cb94-47f5-bd64-1e88a0bf52cb None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:39.309020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0867-cb94-47f5-bd64-1e88a0bf52cb None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:39.310736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0867-cb94-47f5-bd64-1e88a0bf52cb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:39.312688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:39 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:39.324917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:39.440447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:39.507621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942c634-11db-4f8f-944b-69c3344e7182 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:39.549839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a84b75-8350-42c1-a01f-48bb824da539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:39.549839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a84b75-8350-42c1-a01f-48bb824da539 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:39.549839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a84b75-8350-42c1-a01f-48bb824da539 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:39.550284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a84b75-8350-42c1-a01f-48bb824da539 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/841da163ae7d439b8a20b9e62f03eabc/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:39.552958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a84b75-8350-42c1-a01f-48bb824da539 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcdec1385dc42659b0f390a1c06e0e3, user_id=841da163ae7d439b8a20b9e62f03eabc, role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:39.554594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a84b75-8350-42c1-a01f-48bb824da539 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:39.591738 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 79/159] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:39 2022] PUT /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/841da163ae7d439b8a20b9e62f03eabc/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:30:41.409162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00727b36-aece-40b7-9048-9f5e470f7ab0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:41.409712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00727b36-aece-40b7-9048-9f5e470f7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:41.409712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00727b36-aece-40b7-9048-9f5e470f7ab0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:41.411178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 81/160] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:41.416583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9285-4118-4656-b87e-68c1807ce981 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:41.417013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9285-4118-4656-b87e-68c1807ce981 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:41.417136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b9285-4118-4656-b87e-68c1807ce981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:41.451016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1f5b9285-4118-4656-b87e-68c1807ce981 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:41.452331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f5b9285-4118-4656-b87e-68c1807ce981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:41.580025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e7ae-93de-41f0-bc49-cc1f0fb6132e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:41.580572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e7ae-93de-41f0-bc49-cc1f0fb6132e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:41.580990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6e7ae-93de-41f0-bc49-cc1f0fb6132e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:41.586731 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 82/161] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:41.593046 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 80/162] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:41.593553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:41.605997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:41.606716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:41.656663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:41.658269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:41.788106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:41.797027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030a7b2-8aa2-48ec-a9a7-04490cdd95af None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:41.797533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030a7b2-8aa2-48ec-a9a7-04490cdd95af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:41.797972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030a7b2-8aa2-48ec-a9a7-04490cdd95af None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:41.799461 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 81/163] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:30:41.808033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b5809-e3f3-40dc-a1ff-e58230cb5820 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:41.808567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b5809-e3f3-40dc-a1ff-e58230cb5820 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:41.809041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b5809-e3f3-40dc-a1ff-e58230cb5820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:41.839284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-468b5809-e3f3-40dc-a1ff-e58230cb5820 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:41.843664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-468b5809-e3f3-40dc-a1ff-e58230cb5820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:41.847675 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 83/164] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:41.902737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:41.906990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:41.930014 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 82/165] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:42.104253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28219-733f-456f-a5b3-61a2c6c4614b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.104841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28219-733f-456f-a5b3-61a2c6c4614b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.105302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28219-733f-456f-a5b3-61a2c6c4614b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.107039 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 83/166] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:30:42.112163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.112676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.113131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.131897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb081da3-39fc-4422-ad1b-3660c1f7a294 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.154932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:42.156361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:42.180446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.181145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.181608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.181771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.195848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:42.201866 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:42.203119 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:42.203988 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:42.206174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 84/167] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:42.212430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.243833 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 84/168] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:42.244848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.263867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:42.347972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0b4c27-5caf-40df-b582-684ade552db5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.357829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:42.364269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b793b50-bb56-4aa8-a95b-bbd43fdcd90e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.391748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.392501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.392751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.393015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.393684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:42.394044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:42.395454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:42.408387 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 85/169] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:42.409118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.409235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.410183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.411008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.411741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.414405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:42.417112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:42.419999 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 85/170] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:42.421017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.538092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9d5ba-f38e-4db6-8b74-ebdcd14fa353 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.563158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84499acb-1fc3-4ec6-b667-ae2b8cbff29b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.572151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:42.573981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.574729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.575016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.575285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.586345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:42.592059 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:42.593088 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:42.594092 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 86/171] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:42.598730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.600394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.601033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.601305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.601576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] PATH_INFO: `/v3/users/bc5c8a6b9f1c421ca477a02c6f2fb8b2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.616127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] RBAC: Authorizing `identity:get_user(user_id=bc5c8a6b9f1c421ca477a02c6f2fb8b2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:42.617535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:42.619220 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 86/172] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/users/bc5c8a6b9f1c421ca477a02c6f2fb8b2 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:42.619980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.633003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:42.708306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0235fc8-cfc1-42f7-ab44-ae2f700d0512 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.729411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d92c0e-5fef-4fb8-ba93-0ce85155952a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.742911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.743549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.743807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.744080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.744728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:42.746194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:42.765014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.765651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.765963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.766255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.768315 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 87/173] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:42 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:42.768874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.786542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:42.803168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:42.804243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:42.805201 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:42.810352 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 87/174] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:42.814239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.882660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:42.885376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:42.912168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f963c9e-be8d-40fd-86f3-88bdee89eb12 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:42.958599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:42.959725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:42.959725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:42.959725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:42.960407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:42.960712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:42.962166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:42.972872 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 88/175] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:42.973776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:42.980361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3619fd-7fd1-411f-870f-e2715221327f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.022180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.022831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.023108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.025726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.025726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.026025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.027667 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:43.031028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:43.098028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033885b0-7fc8-4cf6-a8ca-dc15b5086231 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.144552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.145737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.146049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.146314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.146977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:43.147277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.148677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.159830 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:30:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:43.164774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:43.165455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:43.174471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f9cf-98ed-4864-b77c-c2749f43a774 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.186614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:43.210769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.211540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.211867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.212238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] PATH_INFO: `/v3/users/841da163ae7d439b8a20b9e62f03eabc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.213457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] RBAC: Authorizing `identity:get_user(user_id=841da163ae7d439b8a20b9e62f03eabc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.215680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.216800 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:43 2022] GET /identity/v3/users/841da163ae7d439b8a20b9e62f03eabc => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:43.217697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:43.293940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7045882-9371-4ed5-8da3-f122e532df75 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.323698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc1bdb-c24b-4f8e-a12c-8f155bb9c7e2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.341111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.342201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.342549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.342891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/bc5c8a6b9f1c421ca477a02c6f2fb8b2/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.345398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcdec1385dc42659b0f390a1c06e0e3, user_id=bc5c8a6b9f1c421ca477a02c6f2fb8b2, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.347516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.363618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.364578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.364800 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 90/179] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:43 2022] PUT /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/bc5c8a6b9f1c421ca477a02c6f2fb8b2/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:43.364930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.365243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] PATH_INFO: `/v3/users/841da163ae7d439b8a20b9e62f03eabc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.366237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:43.366694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] RBAC: Authorizing `identity:get_user(user_id=841da163ae7d439b8a20b9e62f03eabc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.368384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.376398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 90/180] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:43 2022] GET /identity/v3/users/841da163ae7d439b8a20b9e62f03eabc => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:43.377661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:43.414421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:43.463988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:43.505927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e9424-188b-491c-9ac9-db4ca6ead7e2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.547207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.548793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.549243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.550753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.629521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.630840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663de4c-b698-4cd8-aa2f-10bc3db083ea None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:43.631863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.688511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:43.689457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:43.690148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:43.693351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:43.730281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:43.783260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 91/181] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:43.789029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:43.815797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:43.817986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:43.878203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:43.967504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f08a8-5b3c-4225-8dc0-1f52260159cf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:44.000560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:44.006307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:44.102004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:44.103157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:44.103668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:44.104136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:44.105567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:44.113905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:44.116351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 92/183] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:43 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:44.122130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:44.158553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09db29-b0f4-4a0a-8639-64b07878dd16 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:44.198642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:44.206540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:44.207193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:44.207466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:44.207786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:44.213867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:44.213867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:44.216352 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 92/184] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:44 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:44.223611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:44.274873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:44.344471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cbed5-9c89-4718-a692-1cdd31d13be0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:44.385008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:44.386637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:44.387000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:44.388169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:44.389898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] RBAC: Adding query filter params (role.id=01496d3e63b6459e87ed8315dc4b66b7, scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3, user.id=841da163ae7d439b8a20b9e62f03eabc) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:44.390213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:44.392804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0473a-cf1b-4f80-a1b2-89cb6091f29e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:44.401582 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 93/185] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:44 2022] GET /identity/v3/role_assignments?user.id=841da163ae7d439b8a20b9e62f03eabc&scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3&role.id=01496d3e63b6459e87ed8315dc4b66b7 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:44.431795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6701-f172-4608-834e-d2de853e6f85 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:44.510867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:44.511441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:44.511723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:44.512000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:44.512773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3, user.id=841da163ae7d439b8a20b9e62f03eabc) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:44.513085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:44.514717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d4dc2-2bc5-4194-b7d5-ce7eb3ae8bfa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:44.522150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 93/186] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:44 2022] GET /identity/v3/role_assignments?user.id=841da163ae7d439b8a20b9e62f03eabc&scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:45.302679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691af90-d54e-40b4-b284-2c7f13ea3b6a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.303720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691af90-d54e-40b4-b284-2c7f13ea3b6a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.304225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691af90-d54e-40b4-b284-2c7f13ea3b6a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.305885 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 94/187] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:45.311233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.311648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.311720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.330306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:45.331456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:45.368603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d87c1f-5abb-4848-9dc6-ffbfeeaeb049 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.369148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d87c1f-5abb-4848-9dc6-ffbfeeaeb049 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.369424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d87c1f-5abb-4848-9dc6-ffbfeeaeb049 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.372160 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 95/188] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:45.377911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.378193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.378831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.397721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:45.398940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:45.402748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 94/189] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:45.456442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:45.468362 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 96/190] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:45.669994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:45.706586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:45.731950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:45.786671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8e65d-0598-45a5-8383-1bcad55d9145 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:45.820109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74289b81-394a-419a-95fb-8acc1ad2d2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:45.820669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74289b81-394a-419a-95fb-8acc1ad2d2b6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.820939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74289b81-394a-419a-95fb-8acc1ad2d2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.821203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74289b81-394a-419a-95fb-8acc1ad2d2b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.831846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74289b81-394a-419a-95fb-8acc1ad2d2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:45.834717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878d982-4309-41da-b6ce-9bc6a7f5bfcb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-74289b81-394a-419a-95fb-8acc1ad2d2b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:45.836766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:45.837836 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:45.838624 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:45.843814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0673e01-f17a-4b2b-bbe4-a935432e9397 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.844099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0673e01-f17a-4b2b-bbe4-a935432e9397 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.844373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0673e01-f17a-4b2b-bbe4-a935432e9397 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.845642 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 96/192] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:45.846358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0673e01-f17a-4b2b-bbe4-a935432e9397 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:45.870464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf3ede-3b8d-4e26-ba44-dc97dc4545ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:45.871093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf3ede-3b8d-4e26-ba44-dc97dc4545ca None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.871365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf3ede-3b8d-4e26-ba44-dc97dc4545ca None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.871929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf3ede-3b8d-4e26-ba44-dc97dc4545ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.873019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf3ede-3b8d-4e26-ba44-dc97dc4545ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:45.874510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf3ede-3b8d-4e26-ba44-dc97dc4545ca None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:45.876088 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 97/193] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:45.877168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.877443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.877943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.894785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:45.896053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:45.936633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:45.947004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0673e01-f17a-4b2b-bbe4-a935432e9397 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:45.948355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:45.959360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 98/194] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:45.973960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:45.980991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:45.981610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:45.982047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:45.982326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:45.982987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:45.983288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:45.984658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:45.992660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 97/195] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:45.998446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.063784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0096628-5006-4cac-8894-e3ee01460a54 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.097253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.097790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.098086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.098405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.099043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:46.100475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:46.102212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774b6d8-465e-45eb-8ba1-0112d9fe7bab None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.122778 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 99/196] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:45 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:46.146334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.147000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.147278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.147552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] PATH_INFO: `/v3/users/e05cf785a24d4d859b8f14d77887ccfd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.166112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] RBAC: Authorizing `identity:get_user(user_id=e05cf785a24d4d859b8f14d77887ccfd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:46.167613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:46.169509 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 98/197] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:45 2022] GET /identity/v3/users/e05cf785a24d4d859b8f14d77887ccfd => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:46.175063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.228853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:46.229216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.247461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:46.291259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5bbff-4de3-47be-ba86-8fb8639e1f4a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.330851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.331505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.331760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.332386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.333824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:46.335302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:46.336962 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 100/198] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:46 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:46.343475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.350488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a8929-296b-4f4e-8863-6de5f02198fb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.394119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.395525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.395811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.396087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.410157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:46.416401 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:46.417313 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:46.418149 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 99/199] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:46.424344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.466056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59357ccf-a23f-44ae-bea6-7f21507b1c78 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.480391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:46.504884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.506037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.506520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.507007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/e05cf785a24d4d859b8f14d77887ccfd/roles/bb11de660c754576894eca58933a8853` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.509150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcdec1385dc42659b0f390a1c06e0e3, user_id=e05cf785a24d4d859b8f14d77887ccfd, role_id=bb11de660c754576894eca58933a8853)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:46.510903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:46.519608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:46.529324 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 101/200] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:30:46 2022] PUT /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/users/e05cf785a24d4d859b8f14d77887ccfd/roles/bb11de660c754576894eca58933a8853 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:30:46.567676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77785f24-c4e1-41fb-91d5-7d96574b783e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.608396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.609057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.609336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.609606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.610309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:46.610611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:46.612084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:46.622703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 100/201] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:46.629660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.742871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f653850-1acb-4e36-b2af-fff108674af2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.783358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.784013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.784345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.784622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] PATH_INFO: `/v3/users/bc5c8a6b9f1c421ca477a02c6f2fb8b2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.785863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] RBAC: Authorizing `identity:get_user(user_id=bc5c8a6b9f1c421ca477a02c6f2fb8b2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:46.787402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:46.789195 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 102/202] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:46 2022] GET /identity/v3/users/bc5c8a6b9f1c421ca477a02c6f2fb8b2 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:46.794609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:46.897841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a17a9-cc4c-41b1-8f23-230d90db367b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:46.931894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:46.932512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:46.932787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:46.933056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:46.935703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:47.002188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:47.003655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:47.108520 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 101/203] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:47.114424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:47.159215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:47.223174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e6678-e79b-4f34-ba13-c82e38483f28 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:47.261043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63d0ce-a0fb-48b0-81f1-6ae1cffac7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:47.261678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d0ce-a0fb-48b0-81f1-6ae1cffac7f7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:47.261980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d0ce-a0fb-48b0-81f1-6ae1cffac7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:47.262252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63d0ce-a0fb-48b0-81f1-6ae1cffac7f7 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:47.263370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d0ce-a0fb-48b0-81f1-6ae1cffac7f7 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:47.264824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63d0ce-a0fb-48b0-81f1-6ae1cffac7f7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:47.266877 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 103/204] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:47 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:47.272457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:47.307560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:47.374655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f68da6-a868-454e-8f2f-edc872661896 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:47.409321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:47.409891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:47.410171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:47.410440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:47.411213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] RBAC: Adding query filter params (role.id=c74dbb4a211246e2bcfa31161d49118e, scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3, user.id=bc5c8a6b9f1c421ca477a02c6f2fb8b2) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:47.411518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:47.412956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb2452-7c77-44d5-a2bf-51929d124c79 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:47.419200 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 102/205] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:47 2022] GET /identity/v3/role_assignments?user.id=bc5c8a6b9f1c421ca477a02c6f2fb8b2&scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:48.483410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffed0b-fde8-42d1-9283-0fe38c25eeb3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:48.483954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffed0b-fde8-42d1-9283-0fe38c25eeb3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:48.483954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffed0b-fde8-42d1-9283-0fe38c25eeb3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:48.485314 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 104/206] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:48.490446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb96ff-dc5d-4ec5-9e38-c39f9de61608 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:48.490872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a89f-571f-48a7-8fa8-88c718efb8be None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:48.490947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb96ff-dc5d-4ec5-9e38-c39f9de61608 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:48.491037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a89f-571f-48a7-8fa8-88c718efb8be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:48.491107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb96ff-dc5d-4ec5-9e38-c39f9de61608 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:48.491173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6a89f-571f-48a7-8fa8-88c718efb8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:48.492482 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 103/207] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:48.497544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bbf3e-f181-46ea-beac-316b2c71815c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:48.497844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bbf3e-f181-46ea-beac-316b2c71815c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:48.498122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bbf3e-f181-46ea-beac-316b2c71815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:48.511977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2d6a89f-571f-48a7-8fa8-88c718efb8be None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:48.513167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2d6a89f-571f-48a7-8fa8-88c718efb8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:48.515709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e67bbf3e-f181-46ea-beac-316b2c71815c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:48.516868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e67bbf3e-f181-46ea-beac-316b2c71815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:48.593499 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 105/208] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:48.594671 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 104/209] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:48.744760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b19d-059a-456e-af70-889749c9973d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:48.744940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b19d-059a-456e-af70-889749c9973d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:48.745207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843b19d-059a-456e-af70-889749c9973d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:48.747063 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 106/210] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:48.752127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:48.752410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:48.752645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:48.771540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:48.772725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:48.796475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:48.843805 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:48.860930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b19d-059a-456e-af70-889749c9973d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:48.862056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:48.911142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:48.966788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd397f5-9642-4e29-ae69-b8a4740bc4a2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:48.970882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843b19d-059a-456e-af70-889749c9973d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.001448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.002044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.002325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.002599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.003703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.005293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.007082 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 106/212] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:49.010598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.011242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.011526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.011793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.012522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.024985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:49.031459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:49.032327 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:49.033118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 107/213] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:49.039635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.043366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:49.126412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb1e22-0fe6-463d-9439-9ec8536a3d4b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.143280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:49.146826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01717759-c779-48bf-ba80-aa4458cc98f6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.158875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.159484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.159758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.160031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.160723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.162464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.181717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.182462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.182742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.183007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.183669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:49.183971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.185230 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 107/214] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:30:49 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:49.185325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.186065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.194851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 108/215] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:49.200769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.284347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:49.306716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7cc05-bce9-40ee-86cd-7481ba8aefd6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.318895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488ed58-195c-415d-8a5f-b95241befd7d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.348553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.349571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.350064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.350564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.360142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.360142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.360142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.360489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] PATH_INFO: `/v3/users/7028ec1a4e144e41b5ccb772169d5c87` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.364321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:49.369758 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:49.370816 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:49.372084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 108/216] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:49.378607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] RBAC: Authorizing `identity:get_user(user_id=7028ec1a4e144e41b5ccb772169d5c87)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.378823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.380143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.381972 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 109/217] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/users/7028ec1a4e144e41b5ccb772169d5c87 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:49.389401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.412885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:49.499027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4844f721-8194-45c3-b8fc-c34f3b2bbbae None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.502792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc7075-fc51-4289-9517-a52c4a07b41a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.536867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.537576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.538730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.538730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.538890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:49.539158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.540477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.550673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.550673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.550920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.551140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.552090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] RBAC: Adding query filter params (role.id=c74dbb4a211246e2bcfa31161d49118e, user.id=7028ec1a4e144e41b5ccb772169d5c87, scope.system=all) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:49.552253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.557979 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 109/218] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:49.558656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.560409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.565263 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/role_assignments?user.id=7028ec1a4e144e41b5ccb772169d5c87&scope.system=all&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:49.565823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:49.677328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d690151-5367-44b5-ad52-34042f0cd944 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.716191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.716871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.717144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.717414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] PATH_INFO: `/v3/users/e05cf785a24d4d859b8f14d77887ccfd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.718707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] RBAC: Authorizing `identity:get_user(user_id=e05cf785a24d4d859b8f14d77887ccfd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.720301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:49.721971 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 110/220] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/users/e05cf785a24d4d859b8f14d77887ccfd => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:49.727937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:49.818988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:49.835883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce9659-8227-4444-9a7b-3d778c7422c6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:49.870809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:49.871421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:49.872008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:49.872328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:49.941224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:49.942745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:50.031065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:50.048502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 111/221] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:30:50.054552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:50.132772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:50.159907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cf06b-6377-4407-968a-8982f7e34b94 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:50.200324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfbe6a-9eb6-42a9-b47d-2c554e3604d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:50.200966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfbe6a-9eb6-42a9-b47d-2c554e3604d5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:50.201240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfbe6a-9eb6-42a9-b47d-2c554e3604d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:50.201504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfbe6a-9eb6-42a9-b47d-2c554e3604d5 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:50.202644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfbe6a-9eb6-42a9-b47d-2c554e3604d5 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:50.204076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfbe6a-9eb6-42a9-b47d-2c554e3604d5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:50.206036 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 111/222] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:30:50 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:50.214927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:50.319765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe99157-b867-4fd0-ad3b-f31ae86f8bc3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:50.357657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:50.358314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:50.358594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:50.358866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:50.359597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] RBAC: Adding query filter params (role.id=bb11de660c754576894eca58933a8853, scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3, user.id=e05cf785a24d4d859b8f14d77887ccfd) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:50.359907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:50.361373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3f57f-ea0c-453a-b41d-dcf5081816d6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:50.367423 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 112/223] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:30:50 2022] GET /identity/v3/role_assignments?user.id=e05cf785a24d4d859b8f14d77887ccfd&scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3&role.id=bb11de660c754576894eca58933a8853 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:51.544719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f36b0-5b3e-49d5-b7d0-a75dc7e275fc None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:51.544719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f36b0-5b3e-49d5-b7d0-a75dc7e275fc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:51.544719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f36b0-5b3e-49d5-b7d0-a75dc7e275fc None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:51.545397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 112/224] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:51.550329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb39f22-f507-43a6-be23-6dd95b0f344b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:51.550730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb39f22-f507-43a6-be23-6dd95b0f344b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:51.550922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb39f22-f507-43a6-be23-6dd95b0f344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:51.570121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0fb39f22-f507-43a6-be23-6dd95b0f344b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:51.571362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0fb39f22-f507-43a6-be23-6dd95b0f344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:51.600068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613555-2648-490e-aae1-4e30305b3a21 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:51.600421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613555-2648-490e-aae1-4e30305b3a21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:51.600867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613555-2648-490e-aae1-4e30305b3a21 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:51.602467 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 113/225] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:30:51.607566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078efee5-00af-45c1-8bde-1af0c2491fb8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:51.607846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078efee5-00af-45c1-8bde-1af0c2491fb8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:51.608279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078efee5-00af-45c1-8bde-1af0c2491fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:51.620870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:51.628641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-078efee5-00af-45c1-8bde-1af0c2491fb8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:51.630391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-078efee5-00af-45c1-8bde-1af0c2491fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:51.647871 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 113/226] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:51.704866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 114/227] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:51.782589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a038f6-d8fe-4c13-b7ed-a6c90841bcf2 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:51.782921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a038f6-d8fe-4c13-b7ed-a6c90841bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:51.783081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a038f6-d8fe-4c13-b7ed-a6c90841bcf2 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:51.784635 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 114/228] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:51.789965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:51.790249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:51.790525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:51.809027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:51.810154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:51.873918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:51.879192 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 115/229] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:51.921190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a038f6-d8fe-4c13-b7ed-a6c90841bcf2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:51.973753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.033103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a038f6-d8fe-4c13-b7ed-a6c90841bcf2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.068077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.068637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.068917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.069182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.079145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:52.084048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:52.084938 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:52.086676 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 115/230] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:52.091531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.098261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695fdf09-02d5-49bc-9191-f8dc1b3fa639 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.133996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.134693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.134970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.135193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:52.135292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.136379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.137869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.139608 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 116/231] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:52.145026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.196110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8d5be-ee86-44ff-9a29-30c1eeba6f2e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.208674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:52.228390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.228999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.229281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.229588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.230285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:52.230584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.231992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.240081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 116/232] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:52.240583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d7e7e-4b5c-43ee-bad2-8da5811bfdb7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.242625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.276461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.277102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.277383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.277654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.287509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:52.292403 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:52.293257 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:52.294234 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 117/233] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:52.295047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.340095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:52.343117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387d39c-4e6a-40e0-a7ba-d1443ac942f5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.376168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.376787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.377071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.377341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.377996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.379484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.394565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcadec-f015-44da-8820-adc84b6a7962 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.397020 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 117/234] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Oct 29 02:30:52 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:30:52.398738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.423421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:52.434987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.436096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.436540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.436813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] PATH_INFO: `/v3/users/1aa6248321234b32b3f8b52134af9568` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.453885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa6248321234b32b3f8b52134af9568)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.456279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.458237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 118/235] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:52 2022] GET /identity/v3/users/1aa6248321234b32b3f8b52134af9568 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:52.464343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.522195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91537363-13c8-43c5-8e46-687bcc6ca31a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.563413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.564386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.564386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.564547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.565253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:52.565551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.567203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.575992 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 118/236] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:52.581927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.587425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a76bed-151e-420c-b5f1-856362e08f80 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.609483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:52.627267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.627885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.628160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.628426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.629150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] RBAC: Adding query filter params (role.id=bb11de660c754576894eca58933a8853, user.id=1aa6248321234b32b3f8b52134af9568, scope.system=all) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:52.629519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.631025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.637323 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 119/237] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Oct 29 02:30:52 2022] GET /identity/v3/role_assignments?user.id=1aa6248321234b32b3f8b52134af9568&scope.system=all&role.id=bb11de660c754576894eca58933a8853 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:52.701077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a320a-54a1-4566-ab3b-dd4e7aa73031 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.739974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390fbac-dfc4-4d38-893e-1e39dfff2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.740614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fbac-dfc4-4d38-893e-1e39dfff2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.740907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fbac-dfc4-4d38-893e-1e39dfff2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.741179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390fbac-dfc4-4d38-893e-1e39dfff2ec2 None admin] PATH_INFO: `/v3/users/7028ec1a4e144e41b5ccb772169d5c87` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.742406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390fbac-dfc4-4d38-893e-1e39dfff2ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=7028ec1a4e144e41b5ccb772169d5c87)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.743890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390fbac-dfc4-4d38-893e-1e39dfff2ec2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.745721 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 119/238] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:52 2022] GET /identity/v3/users/7028ec1a4e144e41b5ccb772169d5c87 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:52.751668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:52.807213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:52.860610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec84e9-775a-4a8f-baa9-44f6037f5136 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:52.898110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5760d1-4369-4687-a0f4-c587ca83b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:52.899116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5760d1-4369-4687-a0f4-c587ca83b6df None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:52.899533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5760d1-4369-4687-a0f4-c587ca83b6df None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:52.899957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5760d1-4369-4687-a0f4-c587ca83b6df None admin] PATH_INFO: `/v3/system/users/7028ec1a4e144e41b5ccb772169d5c87/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:52.901551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5760d1-4369-4687-a0f4-c587ca83b6df None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7028ec1a4e144e41b5ccb772169d5c87, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:52.903360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5760d1-4369-4687-a0f4-c587ca83b6df None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:52.916710 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 120/239] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Oct 29 02:30:52 2022] PUT /identity/v3/system/users/7028ec1a4e144e41b5ccb772169d5c87/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:30:54.590145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f237a29-81d3-4cf6-a23d-d6f839e49622 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:54.590672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f237a29-81d3-4cf6-a23d-d6f839e49622 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:54.590672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f237a29-81d3-4cf6-a23d-d6f839e49622 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:54.592056 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 120/240] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:54.597351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cff594-b7a2-47d0-a41c-5afc4cd51831 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:54.597776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cff594-b7a2-47d0-a41c-5afc4cd51831 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:54.598020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cff594-b7a2-47d0-a41c-5afc4cd51831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:54.617005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-41cff594-b7a2-47d0-a41c-5afc4cd51831 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:54.618237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41cff594-b7a2-47d0-a41c-5afc4cd51831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:54.692710 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 121/241] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:54.765759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af21b-2ce7-4145-89a7-5c639d7fe6b5 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:54.766068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af21b-2ce7-4145-89a7-5c639d7fe6b5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:54.766344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19af21b-2ce7-4145-89a7-5c639d7fe6b5 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:54.767714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 121/242] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:54.773206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07255e1-301e-45b3-931b-0053ac871685 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:54.773489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07255e1-301e-45b3-931b-0053ac871685 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:54.773765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07255e1-301e-45b3-931b-0053ac871685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:54.792471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a07255e1-301e-45b3-931b-0053ac871685 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:54.793659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a07255e1-301e-45b3-931b-0053ac871685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:54.834847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:54.863390 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 122/243] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:30:54.960796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af21b-2ce7-4145-89a7-5c639d7fe6b5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.048507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638f54b-32d3-494c-82c1-ae385c2e8dcd None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.048847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638f54b-32d3-494c-82c1-ae385c2e8dcd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.049074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4638f54b-32d3-494c-82c1-ae385c2e8dcd None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.051243 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 123/244] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:55.056561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.056902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.057230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.057336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:55.070297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19af21b-2ce7-4145-89a7-5c639d7fe6b5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.075530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:55.076819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:55.108582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.109243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.109590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.109960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.111049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.112510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.114161 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 122/245] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:30:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:55.119966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.146041 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 124/246] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:55.147258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.235466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeabeff-ed0f-4afc-a402-ae04370d51b1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.248494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a49123-78cf-4525-ae10-a2985028520a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.250785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:55.271979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.272597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.272874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.273165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.273769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.275240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.284546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.285188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.285570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.286002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.292733 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 123/247] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Oct 29 02:30:55 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:30:55.303576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:55.308842 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:55.309793 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:55.310906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 125/248] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:55.316200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.339224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:55.416802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.431659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d17287-8a21-4e33-9e67-b1f0a36c4e91 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.472078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.472694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.472990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.473267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.474024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] RBAC: Adding query filter params (name=reader) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:55.474324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.475738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.484266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 124/249] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:55.489869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.537097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0ecd2-3e00-48ae-b3ec-d9cad4cb26bd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.583696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.584372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.584655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.584921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.593450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:55.599245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:55.605455 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:55.606666 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:55.607454 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:55.608038 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 126/250] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:55.613782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.619656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56584f7f-7b39-48bd-9580-2b597cdcf65f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.647085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:55.664546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.665196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.665473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.665744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] PATH_INFO: `/v3/users/1aa6248321234b32b3f8b52134af9568` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.667488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] RBAC: Authorizing `identity:get_user(user_id=1aa6248321234b32b3f8b52134af9568)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.668395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.670320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 125/251] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/users/1aa6248321234b32b3f8b52134af9568 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:55.676573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.743155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579100-f0f1-4e34-aa72-cfd7b704f398 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.787110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.787897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.788506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.788790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.789744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:55.790086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.791496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.793873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc030112-2e25-4847-8997-d597d35f9a68 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.804772 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 127/252] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:55.809899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:55.844334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.845319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.845585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.845946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] PATH_INFO: `/v3/system/users/1aa6248321234b32b3f8b52134af9568/roles/bb11de660c754576894eca58933a8853` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.848010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1aa6248321234b32b3f8b52134af9568, role_id=bb11de660c754576894eca58933a8853)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.849994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.862016 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 126/253] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Oct 29 02:30:55 2022] PUT /identity/v3/system/users/1aa6248321234b32b3f8b52134af9568/roles/bb11de660c754576894eca58933a8853 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:55.921871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:55.934502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ae17a-6829-445c-8639-01b538ef7057 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:55.979497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b27cca-a156-41d7-a0a9-65066c898094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:55.980389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27cca-a156-41d7-a0a9-65066c898094 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:55.980808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27cca-a156-41d7-a0a9-65066c898094 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:55.981214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b27cca-a156-41d7-a0a9-65066c898094 None admin] PATH_INFO: `/v3/users/7028ec1a4e144e41b5ccb772169d5c87` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:55.982805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27cca-a156-41d7-a0a9-65066c898094 None admin] RBAC: Authorizing `identity:get_user(user_id=7028ec1a4e144e41b5ccb772169d5c87)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:55.984484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b27cca-a156-41d7-a0a9-65066c898094 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:55.986350 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 128/254] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/users/7028ec1a4e144e41b5ccb772169d5c87 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:55.992431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:56.011079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:56.115201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfff13-9fa9-409b-a2ab-98d24fefac9e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:56.152575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:56.153202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:56.153484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:56.153755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:56.154518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] RBAC: Adding query filter params (role.id=c74dbb4a211246e2bcfa31161d49118e, user.id=7028ec1a4e144e41b5ccb772169d5c87, scope.system=all) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:56.154819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:56.156287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fd8c1-f7f2-484b-b8ac-27f3152e58a2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:56.169672 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 127/255] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Oct 29 02:30:55 2022] GET /identity/v3/role_assignments?user.id=7028ec1a4e144e41b5ccb772169d5c87&scope.system=all&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:57.716830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9ac9-706c-4a78-a2df-54478df1e118 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:57.717723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9ac9-706c-4a78-a2df-54478df1e118 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:57.718189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf9ac9-706c-4a78-a2df-54478df1e118 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:57.719728 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 129/256] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:57.725494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f19d1-62fe-4a10-9602-558a3729b47e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:57.725971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f19d1-62fe-4a10-9602-558a3729b47e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:57.726046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f19d1-62fe-4a10-9602-558a3729b47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:57.750291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2c5f19d1-62fe-4a10-9602-558a3729b47e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:57.751493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c5f19d1-62fe-4a10-9602-558a3729b47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:57.827437 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 128/257] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 29 02:30:58.215172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b297-3eee-495c-8a06-023a2750ef48 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.215849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b297-3eee-495c-8a06-023a2750ef48 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.216326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6b297-3eee-495c-8a06-023a2750ef48 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.217971 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 130/258] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:58.235432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.235719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.235981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.258346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:58.259558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:58.272214 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 129/259] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 29 02:30:58.379123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b297-3eee-495c-8a06-023a2750ef48 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.392635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6b297-3eee-495c-8a06-023a2750ef48 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.399529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.400176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.400457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.400726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.412486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:58.417504 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:58.418392 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:58.419166 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 131/260] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:30:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:58.424559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.436492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5ae63-9784-48c8-9306-e93a28e0f457 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.440971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.441598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.441989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.442268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.442947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:58.443251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:58.445060 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:30:58.445060 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:30:58.445060 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:30:58.446004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:58.454143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:58.458125 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 130/261] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:30:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:58.464709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.476660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7809c-6bef-4666-912a-b258b9c42c05 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.481190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.485892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.486202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.486481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.494000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:58.495843 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:30:58.495843 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:30:58.495843 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:30:58.497448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:58.499611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 132/262] 10.222.0.16 () {56 vars in 1201 bytes} [Sat Oct 29 02:30:58 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:58.505331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.519378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15b53c-8ee7-4d11-90c1-f7d465e0c37c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.524086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6b71b-18db-4c9d-8dad-474b4c856599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.524739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b71b-18db-4c9d-8dad-474b4c856599 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.525018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b71b-18db-4c9d-8dad-474b4c856599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.525298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6b71b-18db-4c9d-8dad-474b4c856599 admin admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.526441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6b71b-18db-4c9d-8dad-474b4c856599 admin admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:58.528581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6b71b-18db-4c9d-8dad-474b4c856599 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:58.530374 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 131/263] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Oct 29 02:30:58 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:58.536716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.546924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7412028-44ed-4579-a02d-51339a246b9b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.551440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.552116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.552396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.552675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.559717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=717a3ccf0b6d44d28eba4df5b9801aec, group_id=0ea0faea65a6453bafce1b17aa3e6b2d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:58.559835 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:30:58.559835 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:30:58.559835 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:30:58.561746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee4dfe-ad69-4197-8218-242a9b366ab9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:58.583513 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 133/264] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Oct 29 02:30:58 2022] PUT /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:58.737838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247463-97b1-44ca-8df4-8ad40d67464b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.738336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247463-97b1-44ca-8df4-8ad40d67464b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.738336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247463-97b1-44ca-8df4-8ad40d67464b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.740121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 132/265] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:58.745499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.745989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.746062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.771260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:58.772524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:58.791927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247463-97b1-44ca-8df4-8ad40d67464b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.892912 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 134/266] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 29 02:30:58.912523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247463-97b1-44ca-8df4-8ad40d67464b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.921136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d839530-ffe5-43ff-ad06-d4d02038c451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.921791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d839530-ffe5-43ff-ad06-d4d02038c451 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.922088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d839530-ffe5-43ff-ad06-d4d02038c451 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.922358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d839530-ffe5-43ff-ad06-d4d02038c451 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.942062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d839530-ffe5-43ff-ad06-d4d02038c451 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3d839530-ffe5-43ff-ad06-d4d02038c451 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:58.951268 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:58.952205 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:58.953644 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 133/267] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Oct 29 02:30:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:58.958393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:58.977205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89738-60a0-4c15-baf4-d7e8deda5580 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.977506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89738-60a0-4c15-baf4-d7e8deda5580 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.977753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b89738-60a0-4c15-baf4-d7e8deda5580 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.979163 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 134/268] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:30:58.980337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585f524-d601-4514-99e0-8a2c8b56e3d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:58.994604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:58.995145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.995252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:58.995415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.995487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:58.995676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.995828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:58.996355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:58.996965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:58.998025 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:30:58.998025 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:30:58.998025 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:30:58.998927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.009215 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 135/269] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Oct 29 02:30:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:59.015028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.027068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:30:59.028295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:30:59.031882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5e29-63a2-45af-98b5-620b4242118e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.036463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.037108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.037386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.037699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.038861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.040916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.042898 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 136/270] 10.222.0.16 () {56 vars in 1201 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:59.048382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.060897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a788078-2b1b-49a3-b48a-56bba5ade80b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.071293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.072191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.072473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.072742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.074905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.078268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.081610 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 137/271] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:30:59.089479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.110209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11096fa4-8df4-486e-ae70-bad86c1c301b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.119127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.120019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.120298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.120566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.126905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] RBAC: Authorizing `identity:create_grant(project_id=717a3ccf0b6d44d28eba4df5b9801aec, group_id=0ea0faea65a6453bafce1b17aa3e6b2d, role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.131279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.155481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 138/272] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Oct 29 02:30:59 2022] PUT /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:59.161331 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 135/273] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:30:59.279708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.338268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:59.365689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8b35-4d34-4941-9087-57556ed2f47b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.370979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.371951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.372238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.372512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.389139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:59.394958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:59.395977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:30:59.397229 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 139/274] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:59.402257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.415498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e01462-b48b-48ec-8b61-d52803cffaf0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.422418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.423050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.423330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.423603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.424289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:59.424687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.426534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.436476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:59.442002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.452931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bf030-1420-4c27-9d49-0e161794fe61 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.457611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.458285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.458610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.458928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.460138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.462170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.464164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1201 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:59.469458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.479874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f91d08-55c1-49d8-942e-66b05fe5b448 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.485254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.485933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.486258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.486530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.487722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.490237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.492303 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 137/277] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:30:59.498053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.509223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c1e05-459a-4abd-b5f7-3b11867f416b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.514098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.514906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.515249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.515591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.518173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcdec1385dc42659b0f390a1c06e0e3, group_id=0ea0faea65a6453bafce1b17aa3e6b2d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.521226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:30:59.544267 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 141/278] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Oct 29 02:30:59 2022] PUT /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:30:59.620573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.686430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:30:59.743605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dc5c6-6795-415a-b304-857e4659d03b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.786719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.787471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.787748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.788139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.800189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:30:59.805995 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:30:59.806872 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:30:59.807640 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 138/279] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:30:59.813271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:30:59.943485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadf3c-7f4c-4c67-af69-f691485b9fbd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:30:59.989010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:30:59.989640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:30:59.989938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:30:59.990206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:30:59.990882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:30:59.991179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:30:59.992564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ca1b6-8cdf-47e2-a652-30ae8a225ce2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:00.002471 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 142/280] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:30:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:00.008178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:00.113319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbeddc-a35c-4fb5-9111-9782ad9ea262 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.113914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbeddc-a35c-4fb5-9111-9782ad9ea262 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.114190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbeddc-a35c-4fb5-9111-9782ad9ea262 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.116131 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 143/281] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:00.122484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.122765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.123035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.132676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6c96c-97e2-421c-9182-8c3426f3d08e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:00.156871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:00.159283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:00.167990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:00.195611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:00.196259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.196536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.196803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] PATH_INFO: `/v3/users/1aa6248321234b32b3f8b52134af9568` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.199205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:00.199342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] RBAC: Authorizing `identity:get_user(user_id=1aa6248321234b32b3f8b52134af9568)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:00.200760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:00.202717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 139/282] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:31:00 2022] GET /identity/v3/users/1aa6248321234b32b3f8b52134af9568 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:00.213142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:00.266621 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 144/283] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 02:31:00.328487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce93485e-5ccd-448f-aaab-20e14e5de04b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:00.366040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:00.367003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.367490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.367958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.368875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] RBAC: Adding query filter params (role.id=bb11de660c754576894eca58933a8853, user.id=1aa6248321234b32b3f8b52134af9568, scope.system=all) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:00.369374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:00.371036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:00.386529 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 140/284] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Oct 29 02:31:00 2022] GET /identity/v3/role_assignments?user.id=1aa6248321234b32b3f8b52134af9568&scope.system=all&role.id=bb11de660c754576894eca58933a8853 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:00.818129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:00.827616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8087bf4-de73-45ae-b1ec-9c20f51ea548 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:00.834282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:00.834932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.835209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.835477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.851242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:00.856177 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:00.857047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:00.857882 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 145/285] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Oct 29 02:31:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:00.864737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:00.883548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf4a37-551f-4cf1-aa94-2ff880be303a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:00.889412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:00.890362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.890839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.891303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.892176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:00.892670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:00.894537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3597e-eefe-4d0e-adba-4aa0c8eb80f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:00.908031 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 141/286] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Oct 29 02:31:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:00.913340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:00.923332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7674-c6b3-4c4a-9000-e22d83fbcaa5 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.923930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7674-c6b3-4c4a-9000-e22d83fbcaa5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.924419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d7674-c6b3-4c4a-9000-e22d83fbcaa5 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.926138 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 142/287] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:00.932521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.932686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612589a-4723-45ca-a5bd-6144d12cb9f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:00.933181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.933767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.942038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:00.944598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.944598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.944598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.946547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:00.948502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:00.950165 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 146/288] 10.222.0.16 () {56 vars in 1201 bytes} [Sat Oct 29 02:31:00 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:00.955711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:00.959278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:00.960902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:00.971287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a14645-68d6-489f-8297-9570610f51e2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:00.978654 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 143/289] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 29 02:31:00.979539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:00.980240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:00.980595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:00.980920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:00.982169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:00.984383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:00.986174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 147/290] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Oct 29 02:31:00 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:00.992344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:01.005711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a1232-f9e5-428c-9ae0-0f35187a2ee0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:01.013197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:01.014201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:01.014673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:01.015144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:01.017506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcdec1385dc42659b0f390a1c06e0e3, group_id=0ea0faea65a6453bafce1b17aa3e6b2d, role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:01.018826 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:31:01.018826 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:31:01.018826 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:31:01.021390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:01.045826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Oct 29 02:31:00 2022] PUT /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3/groups/0ea0faea65a6453bafce1b17aa3e6b2d/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:01.290833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:01.301628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29770a74-6277-4bac-817a-434e5b152fe4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:01.369294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:01.370052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:01.370339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:01.370609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:01.382142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:01.387083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:01.387946 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:01.388719 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 148/292] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:01.395878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:01.406316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51828799-11f7-473e-b17c-94388bb60fe4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:01.413267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:01.413910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:01.414188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:01.414457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:01.415190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:01.415496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:01.417179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:01.422943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:01.427671 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 145/293] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:01.433337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:01.445731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c4cc9-dcf6-4290-b364-1fbcbebcb608 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:01.456582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:01.457292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:01.457631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:01.457974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] PATH_INFO: `/v3/groups/d67b590de56e42e1bc3d038294051279` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:01.463807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] RBAC: Authorizing `identity:get_group(group_id=d67b590de56e42e1bc3d038294051279)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:01.465903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:01.467606 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 149/294] 10.222.0.16 () {56 vars in 1201 bytes} [Sat Oct 29 02:31:01 2022] GET /identity/v3/groups/d67b590de56e42e1bc3d038294051279 => generated 229 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:01.473301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:01.484125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3964b8-1d0e-4335-881f-982836c6332e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:01.489750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43387481-87dd-47b4-aca8-422c80baecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:01.490469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43387481-87dd-47b4-aca8-422c80baecc6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:01.490750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43387481-87dd-47b4-aca8-422c80baecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:01.491021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43387481-87dd-47b4-aca8-422c80baecc6 admin admin] PATH_INFO: `/v3/projects/78e88c459a88409388afe930208caca8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:01.494044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43387481-87dd-47b4-aca8-422c80baecc6 admin admin] RBAC: Authorizing `identity:get_project(project_id=78e88c459a88409388afe930208caca8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:01.496031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43387481-87dd-47b4-aca8-422c80baecc6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:01.498200 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 146/295] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Oct 29 02:31:01 2022] GET /identity/v3/projects/78e88c459a88409388afe930208caca8 => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:01.504057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:01.514872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3ebe-565a-44dd-9e65-299def6187bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:01.522263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e13bc-f55a-4f7d-ae76-394b6fdf7338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:01.522991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e13bc-f55a-4f7d-ae76-394b6fdf7338 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:01.523308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e13bc-f55a-4f7d-ae76-394b6fdf7338 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:01.523631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e13bc-f55a-4f7d-ae76-394b6fdf7338 admin admin] PATH_INFO: `/v3/projects/78e88c459a88409388afe930208caca8/groups/d67b590de56e42e1bc3d038294051279/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:01.525850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e13bc-f55a-4f7d-ae76-394b6fdf7338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e88c459a88409388afe930208caca8, group_id=d67b590de56e42e1bc3d038294051279, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:01.528735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e13bc-f55a-4f7d-ae76-394b6fdf7338 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:01.554223 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 150/296] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Oct 29 02:31:01 2022] PUT /identity/v3/projects/78e88c459a88409388afe930208caca8/groups/d67b590de56e42e1bc3d038294051279/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:31:02.032468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c996a97-3ab5-4212-9b08-5bac0145a3d3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.033162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c996a97-3ab5-4212-9b08-5bac0145a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.033162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c996a97-3ab5-4212-9b08-5bac0145a3d3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.034753 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 147/297] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:02.040079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f912-aa09-4ab4-94d4-81241d365faa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.040619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f912-aa09-4ab4-94d4-81241d365faa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.040619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97f912-aa09-4ab4-94d4-81241d365faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.064096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b97f912-aa09-4ab4-94d4-81241d365faa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:02.065288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b97f912-aa09-4ab4-94d4-81241d365faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:02.143366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:02.152228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 151/298] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:02.533996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8930e39-4b6d-495f-a5e3-9f13ea6bd9be None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.534375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8930e39-4b6d-495f-a5e3-9f13ea6bd9be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.534536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8930e39-4b6d-495f-a5e3-9f13ea6bd9be None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.535975 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 148/299] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:02.542368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d96f9-96eb-4086-a832-07d954adf5e4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.542651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d96f9-96eb-4086-a832-07d954adf5e4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.542926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d96f9-96eb-4086-a832-07d954adf5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.579476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-460d96f9-96eb-4086-a832-07d954adf5e4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:02.580684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-460d96f9-96eb-4086-a832-07d954adf5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:02.583461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8930e39-4b6d-495f-a5e3-9f13ea6bd9be None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:02.750364 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 152/300] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:02.774263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cacc7-11c6-4165-8f7c-6814b412b6db None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.774570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cacc7-11c6-4165-8f7c-6814b412b6db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.774812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cacc7-11c6-4165-8f7c-6814b412b6db None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.776414 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 153/301] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:02.781277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.781560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.781866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.810413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:02.811524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:02.815023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8930e39-4b6d-495f-a5e3-9f13ea6bd9be None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:02.866635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:02.867274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:02.867548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:02.867861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:02.882593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:02.888331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:02.889198 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:31:02.889994 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:02.892040 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 149/302] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:02.901555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:02.953215 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 154/303] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:02.993356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.048579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b602ec-b41c-48eb-899f-56172c1e5b0c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.076172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.089710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.090358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.090634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.090904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.091570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:03.091871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:03.093278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:03.105660 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 150/304] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:31:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:03.111356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.151724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.198322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bad930-72cb-47d9-8795-7bebb63e9158 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.237469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.238285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.238640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.238910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] PATH_INFO: `/v3/roles/member` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.251866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:03.257075 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:03.257958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:03.258742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 155/305] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:03.264137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.332774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fafb7b-8907-4b58-b9e5-a88ee28327c3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.362909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.388611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.389237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.389514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.389783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.429122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fff02-2ebb-42f2-8e34-5065903f6bec None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.459751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.477559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.478485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.478774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.479047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.479670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:03.479773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:03.480003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:03.481385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:03.482358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:03.490403 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 156/306] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:03.491239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.605005 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 151/307] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 29 02:31:03.605905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.631532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2d495-4ff8-4775-9406-dedf2db8b7d5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.635532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.685173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.685990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.686393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.686665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.702397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:03.709636 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:03.710560 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:03.712032 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 157/308] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:03.712744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.740872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b6c2f-d9b7-47eb-9f97-a3084d8d8580 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.771232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.781198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.781827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.782125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.782393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.833321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd189e9-edc3-41d6-8a4c-a6b7ca2dbf2e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:03.856073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:03.857443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:03.872792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:03.873443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:03.873722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:03.874020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:03.875160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:03.876606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:03.878406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:03.880175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 158/309] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:03.881012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:03.986548 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 152/310] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:03.989268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.010283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113abe33-ac86-471d-ab51-c42bad7b5923 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.048179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.048968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.049564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.049886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.050843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:04.051218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.052618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.056225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.066676 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 159/311] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.067659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.108013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e062b5-7f97-4d2f-90d2-27596354321e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.128256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.148463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.149290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.149918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.150262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.151616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.153065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.155729 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 153/312] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Oct 29 02:31:03 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.156490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.202838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43d7cd-7496-41e9-aec6-b7112804a4e3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.245087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1ce47-ed5d-4b4a-b28c-633e994dcf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.245734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ce47-ed5d-4b4a-b28c-633e994dcf56 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.246057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ce47-ed5d-4b4a-b28c-633e994dcf56 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.246336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ce47-ed5d-4b4a-b28c-633e994dcf56 None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.247819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1ce47-ed5d-4b4a-b28c-633e994dcf56 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.249418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1ce47-ed5d-4b4a-b28c-633e994dcf56 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.252247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 160/313] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.253468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a957f2-b027-48bd-b9e7-17e9042df7db None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.253750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a957f2-b027-48bd-b9e7-17e9042df7db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.257624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a957f2-b027-48bd-b9e7-17e9042df7db None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.259613 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 161/314] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:04.260589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a957f2-b027-48bd-b9e7-17e9042df7db None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.298480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c721f4e-32a3-43bf-a935-8911bbdf91d6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.315815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.350324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2c9f3-97c0-4893-9ef8-8f81a4b45b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.350948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2c9f3-97c0-4893-9ef8-8f81a4b45b73 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.351228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2c9f3-97c0-4893-9ef8-8f81a4b45b73 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.351502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2c9f3-97c0-4893-9ef8-8f81a4b45b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.388064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a957f2-b027-48bd-b9e7-17e9042df7db None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.420824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.428144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.428759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.429029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.429294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.430048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] RBAC: Adding query filter params (group.id=0ea0faea65a6453bafce1b17aa3e6b2d, role.id=c74dbb4a211246e2bcfa31161d49118e, scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:04.430353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.431895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.435840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2c9f3-97c0-4893-9ef8-8f81a4b45b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.437532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2c9f3-97c0-4893-9ef8-8f81a4b45b73 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.438023 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 162/315] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/role_assignments?group.id=0ea0faea65a6453bafce1b17aa3e6b2d&scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.438872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.579287 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:04.580583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111b94-9919-4e42-9dd3-1364741dce81 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.580866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111b94-9919-4e42-9dd3-1364741dce81 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.581138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8111b94-9919-4e42-9dd3-1364741dce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.594854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1902b-36af-409a-b6c6-db6931965637 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.600130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.612184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f8111b94-9919-4e42-9dd3-1364741dce81 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:04.613624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8111b94-9919-4e42-9dd3-1364741dce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:04.646168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb84c9-341e-48fb-913a-e44b3a0ed652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.646742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb84c9-341e-48fb-913a-e44b3a0ed652 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.647026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb84c9-341e-48fb-913a-e44b3a0ed652 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.647302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb84c9-341e-48fb-913a-e44b3a0ed652 None admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.649430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb84c9-341e-48fb-913a-e44b3a0ed652 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.651054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb84c9-341e-48fb-913a-e44b3a0ed652 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.652565 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 163/317] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.653786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727de5-c05c-44a5-809b-b2775800db4f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.654106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727de5-c05c-44a5-809b-b2775800db4f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.654381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84727de5-c05c-44a5-809b-b2775800db4f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.655949 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 164/318] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:04.656670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84727de5-c05c-44a5-809b-b2775800db4f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.696277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 155/319] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:04.698874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.699337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.699748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.721936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:04.723305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:04.735679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.776939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84727de5-c05c-44a5-809b-b2775800db4f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.804388 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:04.805063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.819976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.820726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.821001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.821271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] PATH_INFO: `/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.822422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] RBAC: Authorizing `identity:get_project(project_id=717a3ccf0b6d44d28eba4df5b9801aec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.824490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.826178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 165/321] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/projects/717a3ccf0b6d44d28eba4df5b9801aec => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.831566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.878627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:04.930438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6460d06-ac92-4d0c-9acd-5ed883be6dcc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.945288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da29b52-d151-40ba-8e46-20ffd2387646 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:04.974256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.974941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.975640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.975921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.976933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] RBAC: Adding query filter params (group.id=0ea0faea65a6453bafce1b17aa3e6b2d, role.id=c74dbb4a211246e2bcfa31161d49118e, scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:04.977245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.979636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.983313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:04.983958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:04.984234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:04.984506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:04.985616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:04.986300 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 157/322] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/role_assignments?group.id=0ea0faea65a6453bafce1b17aa3e6b2d&scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3&role.id=c74dbb4a211246e2bcfa31161d49118e => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:04.987127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:04.989214 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 166/323] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:04.993028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:04.995087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.010389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.137047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6ec60-d6af-4955-b2bf-72ca85d0a75c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.148048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.156377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4edaf-675c-42e7-86a5-b1c6bf44004c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.188102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.188713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.188995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.189265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.190281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] RBAC: Adding query filter params (group.id=0ea0faea65a6453bafce1b17aa3e6b2d, role.id=01496d3e63b6459e87ed8315dc4b66b7, scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:05.190584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:05.192889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:05.200157 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 167/324] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/role_assignments?group.id=0ea0faea65a6453bafce1b17aa3e6b2d&scope.project.id=717a3ccf0b6d44d28eba4df5b9801aec&role.id=01496d3e63b6459e87ed8315dc4b66b7 => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:05.200994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.204776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.205441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.205716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.206019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.221376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:05.228961 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:05.230471 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:05.231350 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 158/325] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:05.241727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.334368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.355165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763d708-598e-488d-aa33-752c1817d3fa None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.375593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a58c2-14c1-49ca-9911-5d50b1b87824 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.406996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.407637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.408013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.408174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.419114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.419727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.420764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.421132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.421626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:05.421744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:05.422072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:05.423473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:05.427045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:05.427944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:05.428727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 168/326] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:05.434685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.437772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 159/327] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:05.444680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.476493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.554566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e82bd-bbaa-4b30-bd81-68be99d07fb4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.578761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f926c0bf-efe7-4d91-be23-86b997d94fea None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.594926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.595687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.595972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.596238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.597263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:05.597567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:05.599083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:05.609338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 169/328] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:05.612899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.615405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.620180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.620796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.621129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.622521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.700972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:05.702708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:05.730034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.737760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c2a9-e5bc-4f4e-b6f0-696069ebb1a7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.778677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.779418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.779693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.780012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.814391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 160/329] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:05.820309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.860301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.862309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:05.864178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:05.932126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6caeefd-b412-453e-b9fa-bc89589a52ef None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:05.953703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:05.961575 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 170/330] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 29 02:31:05.965707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:05.966649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:05.967005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:05.967102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:05.967284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] PATH_INFO: `/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:05.968415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] RBAC: Authorizing `identity:get_project(project_id=fbcdec1385dc42659b0f390a1c06e0e3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:05.969931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:05.971564 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 161/331] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/projects/fbcdec1385dc42659b0f390a1c06e0e3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:05.977036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:06.064592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c2c18-2768-4b5e-aaa1-2596b97e8749 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:06.072068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:06.075160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc5e95-0987-4f0b-821b-dd7c0f3e0c1b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:06.098350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:06.098983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:06.099252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:06.099520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] PATH_INFO: `/v3/projects/78e88c459a88409388afe930208caca8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:06.100629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] RBAC: Authorizing `identity:get_project(project_id=78e88c459a88409388afe930208caca8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:06.102108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:06.103729 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 171/332] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/projects/78e88c459a88409388afe930208caca8 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:06.109295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:06.110350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:06.110985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:06.111260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:06.111529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] PATH_INFO: `/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:06.112617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] RBAC: Authorizing `identity:get_group(group_id=0ea0faea65a6453bafce1b17aa3e6b2d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:06.114180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:06.115775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 162/333] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Oct 29 02:31:05 2022] GET /identity/v3/groups/0ea0faea65a6453bafce1b17aa3e6b2d => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:06.121444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:06.168171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:06.205075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e80c41-0ac5-4928-af31-a5516efc5511 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:06.220439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35da87f-c0e6-47fb-9a25-2299bc9ad5c6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:06.237118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:06.237739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:06.238040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:06.238306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] PATH_INFO: `/v3/groups/d67b590de56e42e1bc3d038294051279` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:06.239454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] RBAC: Authorizing `identity:get_group(group_id=d67b590de56e42e1bc3d038294051279)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:06.240871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:06.242494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 172/334] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Oct 29 02:31:06 2022] GET /identity/v3/groups/d67b590de56e42e1bc3d038294051279 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:06.248723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:06.253638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:06.254328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:06.254598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:06.254864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:06.255583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] RBAC: Adding query filter params (group.id=0ea0faea65a6453bafce1b17aa3e6b2d, role.id=01496d3e63b6459e87ed8315dc4b66b7, scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:06.255884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:06.257307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51716a50-bdea-4843-98a6-36f4024194a1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:06.263195 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 163/335] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Oct 29 02:31:06 2022] GET /identity/v3/role_assignments?group.id=0ea0faea65a6453bafce1b17aa3e6b2d&scope.project.id=fbcdec1385dc42659b0f390a1c06e0e3&role.id=01496d3e63b6459e87ed8315dc4b66b7 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:06.353284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59430b85-31a1-4afa-89cf-2f5829376a68 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:06.384723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:06.391371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:06.391988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:06.392269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:06.392532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:06.393265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] RBAC: Adding query filter params (group.id=d67b590de56e42e1bc3d038294051279, role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=78e88c459a88409388afe930208caca8) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:06.393569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:06.395119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca9c20-208d-4559-a91d-5b089e9dcefa None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:06.401688 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 173/336] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Oct 29 02:31:06 2022] GET /identity/v3/role_assignments?group.id=d67b590de56e42e1bc3d038294051279&scope.project.id=78e88c459a88409388afe930208caca8&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:09.025077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d5b8-4aa2-433a-9730-205f58e3353d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.025624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d5b8-4aa2-433a-9730-205f58e3353d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.025624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5d5b8-4aa2-433a-9730-205f58e3353d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.027276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 164/337] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:09.036613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642118-2869-431a-b6b6-85aa9337bd3a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.037104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642118-2869-431a-b6b6-85aa9337bd3a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.037187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e642118-2869-431a-b6b6-85aa9337bd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.062344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e642118-2869-431a-b6b6-85aa9337bd3a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:09.063619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e642118-2869-431a-b6b6-85aa9337bd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:09.155007 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 174/338] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:09.494570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5d5b8-4aa2-433a-9730-205f58e3353d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:09.518720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930c45-7edb-4f39-b515-cad05c960248 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.519342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930c45-7edb-4f39-b515-cad05c960248 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.519890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930c45-7edb-4f39-b515-cad05c960248 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.521448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 175/339] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:09.527461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aeafbd-f44e-4d01-8b76-f0ada29eaffb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.528025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aeafbd-f44e-4d01-8b76-f0ada29eaffb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.528503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aeafbd-f44e-4d01-8b76-f0ada29eaffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.543210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:09.566512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-71aeafbd-f44e-4d01-8b76-f0ada29eaffb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:09.567823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71aeafbd-f44e-4d01-8b76-f0ada29eaffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:09.638407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5d5b8-4aa2-433a-9730-205f58e3353d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:09.639422 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 176/340] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:09.640985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d1f16-3096-41e6-acff-5584d2144ad7 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.641476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d1f16-3096-41e6-acff-5584d2144ad7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.642006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d1f16-3096-41e6-acff-5584d2144ad7 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.643444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 177/341] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:09.661322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16dc2-bb3e-4b4b-a55e-287dd8f400a2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.662001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16dc2-bb3e-4b4b-a55e-287dd8f400a2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.662475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b16dc2-bb3e-4b4b-a55e-287dd8f400a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.689169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e7b16dc2-bb3e-4b4b-a55e-287dd8f400a2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:09.691407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7b16dc2-bb3e-4b4b-a55e-287dd8f400a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:09.706550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:09.707870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.708381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.708863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.726108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:09.728083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:09.759319 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:09.760262 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:09.761094 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:09.761094 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:09.761094 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:09.768407 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 165/342] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:09.776573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:09.795322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:09.831074 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 178/343] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:09.906395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:09.923229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4322-5ea1-419e-ba27-2dc96635d1d7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:09.931315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18cd4-9da4-4506-a15b-97ec92586f84 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.931897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18cd4-9da4-4506-a15b-97ec92586f84 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.932368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed18cd4-9da4-4506-a15b-97ec92586f84 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.934889 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 179/344] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:09.943990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.944538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.945026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.970602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:09.971228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:09.971470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:09.971599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:09.971766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:09.972395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:09.972754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:09.974032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:09.974334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.002028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 166/345] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:10.007556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.045506 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 180/346] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:10.047110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.122853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e7235-e029-43cd-95b2-99cc1f1a8835 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.150512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a7d12-237d-4a61-bb67-ce1b92991cf9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.165844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:10.173648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.174346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.174619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.174886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.175759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.177413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.195617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.196607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.197119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.197584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.210835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.214972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.215196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:10.220028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 167/347] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:31:10 2022] POST /identity/v3/users => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:31:10.230356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:10.238456 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:10.239861 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:10.240713 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:10.240713 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:10.240713 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:10.242839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 181/348] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:10.250490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.432680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c1d20-aa08-403d-9ded-e5c1c18775c9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.434430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55b8b8-94ea-4ae6-8fbb-754041d22a0e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.470892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.471535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.471813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.472083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.474938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.475550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.475825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.476093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.476732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:10.477029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.478431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.483403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.484855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.492753 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 182/349] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:10.493481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:10.504562 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:10.505469 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:10.506427 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:10.506427 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:10.506427 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:10.506427 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 168/350] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:10.506662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.538751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:10.577370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:10.634436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec09b-c9fa-4bd4-82de-e4945b1e89e5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.638856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18856a7a-9cda-4443-9478-08580bbe9c56 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.673349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.673996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.674277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.674543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.676183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.676959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.677396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.677826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.678617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.680196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.684982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.686377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-27b2c98e-9b8a-47d2-8dea-91d27714632a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:10.709835 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:10.710788 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:10.711649 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:10.711649 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:10.711649 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:10.711817 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 169/351] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:31:10 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:10.711817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.711950 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 183/352] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:10.711950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe87b9-5412-447d-9ca4-545146137f03 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.711950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe87b9-5412-447d-9ca4-545146137f03 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.711950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe87b9-5412-447d-9ca4-545146137f03 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.711950 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 184/353] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:10.719968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.722855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.722855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.745505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:10.747168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:10.841488 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 185/354] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:10.842798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.862231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:10.871542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b4117-d4ee-4645-9b70-ea6964bfc180 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:10.890975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:10.926690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:10.927766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:10.927766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:10.927930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:10.928706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:10.929083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:10.931758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:10.950447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 170/355] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:10.951625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:10.988094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c02c-8361-471e-8648-0c41a17cb75c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:11.033183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:11.034106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:11.034388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:11.034658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:11.035411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:11.035956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:11.038297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:11.052893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 186/356] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:11.061222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:11.074273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627e710-746d-4dcb-bb01-e20ccb3eca86 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:11.151143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:11.151814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:11.152029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:11.152297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:11.152999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:11.154435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:11.165691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:11.189826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 171/357] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:31:10 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:11.189826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:11.224050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:11.244180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e632a27-6671-4fd5-b06d-6d08f0de91de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:11.307777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:11.308397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:11.308675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:11.308997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:11.309646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:11.311637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:11.344290 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 187/358] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:31:11 2022] POST /identity/v3/users => generated 249 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:11.382136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719bafb-dc17-406b-9744-f7b1cbc8bc7d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:11.422624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:11.423255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:11.423529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:11.423792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:11.424482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:11.425997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:11.435346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.sql.core [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 29 02:31:11.435346 n-d-862964-4 devstack@keystone.service[82080]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 29 02:31:11.435346 n-d-862964-4 devstack@keystone.service[82080]: [parameters: {'id': 'eee79acb68fa487aa432e328050c5ed6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 29 02:31:11.435346 n-d-862964-4 devstack@keystone.service[82080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Oct 29 02:31:11.452778 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return ref.to_dict() Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:31:11.453716 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application yield resource Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise self.value Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.commit() Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 02:31:11.454652 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.flush() Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application compat.raise_( Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:31:11.455492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:31:11.456325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:31:11.457149 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [parameters: {'id': 'eee79acb68fa487aa432e328050c5ed6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:11.459223 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 29 02:31:11.461238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:11.463138 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 172/359] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Oct 29 02:31:11 2022] POST /identity/v3/roles => generated 144 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:11.463287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:11.596336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4fe82-14f3-4a4e-8c82-a748d5600ebf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:11.622673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:11.637154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab483d-61c3-491f-8cbf-0de9a9b616eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:11.637860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab483d-61c3-491f-8cbf-0de9a9b616eb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:11.638137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab483d-61c3-491f-8cbf-0de9a9b616eb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:11.638401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab483d-61c3-491f-8cbf-0de9a9b616eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:11.649279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab483d-61c3-491f-8cbf-0de9a9b616eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ceab483d-61c3-491f-8cbf-0de9a9b616eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:11.655489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:11.656402 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:11.657173 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 188/360] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:11.663245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:11.768811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:11.782289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23574e84-ce60-4392-b3d4-d7cd95b4716e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:11.838598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:11.839154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:11.839438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:11.839718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:11.840405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:11.840712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:11.842129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b698817-77f8-4fb4-8f09-372a036fc638 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:11.851288 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 173/361] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:12.747155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3afff5-d5c5-4b6b-9af0-b7a4b0a82c13 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:12.747675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3afff5-d5c5-4b6b-9af0-b7a4b0a82c13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:12.747675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3afff5-d5c5-4b6b-9af0-b7a4b0a82c13 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:12.749296 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 189/362] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:12.754519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:12.754944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:12.755118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:12.773975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:12.775157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:12.847435 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 174/363] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:13.221273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3afff5-d5c5-4b6b-9af0-b7a4b0a82c13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:13.325895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3afff5-d5c5-4b6b-9af0-b7a4b0a82c13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:13.360912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d425f7-9867-43bb-b793-757d151eda2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:13.361628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d425f7-9867-43bb-b793-757d151eda2a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.361932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d425f7-9867-43bb-b793-757d151eda2a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.362198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d425f7-9867-43bb-b793-757d151eda2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.374858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d425f7-9867-43bb-b793-757d151eda2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-08d425f7-9867-43bb-b793-757d151eda2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:13.379914 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:13.380887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:13.381665 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 190/364] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:13.392483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:13.494438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:13.511500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c28a6f-66be-4bf0-85b8-7cefaf6c03f6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.512127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c28a6f-66be-4bf0-85b8-7cefaf6c03f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.512610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c28a6f-66be-4bf0-85b8-7cefaf6c03f6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.514455 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 191/365] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:13.520562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd12ce-2959-4343-ad74-08a48c4075ad None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.522700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd12ce-2959-4343-ad74-08a48c4075ad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.522700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd12ce-2959-4343-ad74-08a48c4075ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.536697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54888694-f12a-4364-bca6-f9a9a0b90631 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:13.565447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dddd12ce-2959-4343-ad74-08a48c4075ad None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:13.567205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dddd12ce-2959-4343-ad74-08a48c4075ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:13.623872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:13.627110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.629548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.630257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.631209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:13.633325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:13.635133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:13.653699 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 175/366] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:13.662453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:13.666278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:13.698114 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 192/367] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:13.738962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269714-9398-4d64-a0cf-ed57d6018e27 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.739257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269714-9398-4d64-a0cf-ed57d6018e27 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.739716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49269714-9398-4d64-a0cf-ed57d6018e27 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.741234 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 193/368] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:13.746342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08da54-f9f0-4767-8922-139c7b029b7d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.747088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08da54-f9f0-4767-8922-139c7b029b7d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.747500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08da54-f9f0-4767-8922-139c7b029b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.776875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bc08da54-f9f0-4767-8922-139c7b029b7d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:13.779308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc08da54-f9f0-4767-8922-139c7b029b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:13.871142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ade7c-b5a3-4526-8d0e-46c82ad31c74 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:13.920076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 194/369] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:13.947640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:13.948559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:13.948988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:13.949398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:13.964770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:13.966522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:13.971292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:13.990685 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:13.991823 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:13.992870 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:13.992870 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:13.992870 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:13.994625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 176/370] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:13.999784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c506e3d-fbab-404a-8e2a-17c3b95a894b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.000328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.000435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c506e3d-fbab-404a-8e2a-17c3b95a894b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.000901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c506e3d-fbab-404a-8e2a-17c3b95a894b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.002703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 195/371] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:14.003892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c506e3d-fbab-404a-8e2a-17c3b95a894b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.104512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebc8ac-85a7-4aed-b112-b85794a58349 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.117687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c506e3d-fbab-404a-8e2a-17c3b95a894b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.130797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.142592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.143204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.143479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.144095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.144938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:14.145243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.146880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45b767-7885-4fe3-bd96-e729d00d67b9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.157134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.158045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.158520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.158987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.159159 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 177/372] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:14.160382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.160729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.161004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.170744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:14.176127 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:14.177132 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:14.178352 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:14.180619 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 196/373] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:14.181593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.183778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:14.185312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:14.241150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.254636 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 178/374] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:14.255503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.283783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7927c16-9f98-47bb-8b4d-2508046e73bf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.324339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.325351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.325968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.326437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.334700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.337378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:14.353321 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:14.354273 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:14.355204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:14.357882 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 197/375] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:14.358824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.369730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732233c-5043-420c-a1e6-a6de3f5e0a0f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.392340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.413022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.414025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.414363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.414698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.415586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:14.415953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.417691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.429888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 179/376] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:14.430977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.481527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ad88-4703-4ab2-90ea-ad3918f0ab14 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.488347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.521685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.522778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.523287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.523743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.537292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:14.548865 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:14.549767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:14.550669 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 198/377] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:14.556646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.560271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4998519-1f60-4c4f-b315-035ae8353449 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.595346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.595956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.596228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.596491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.597207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:14.597506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.599181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.641520 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 180/378] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:14.641520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.655569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.672328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c050472-4484-4850-8a43-0993c686c28f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.709830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.713831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.713831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.713831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.722050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.723597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:14.738936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:14.739855 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:14.740679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:14.740679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:14.740679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:14.740679 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 199/379] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:14.740899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.751940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1b76c-2297-4807-ace1-d65d344231d1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.755036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.787753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.788275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.788565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.788829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.789508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:14.789889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.791352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.801403 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 181/380] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:14.802437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.854155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd42e1-a3a7-48e7-87b4-e255b782d4b8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.891104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.891728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.892005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.892274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.895232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:14.904765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:14.908901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b196d-aba3-4614-95e6-d5a887fcb016 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:14.909682 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:14.910646 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:14.911573 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 200/381] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:14.912207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.947945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:14.948582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:14.948865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:14.949137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:14.959505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:14.960958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:14.975129 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:14.976029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:14.976864 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:14.976864 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:14.976864 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:14.976864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 182/382] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:14.977072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:14.996115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.014585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc7063-60d0-4457-b464-080e0d55d202 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.047433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.048000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.048271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.048534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.049158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:15.049455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.050890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cca13-59f9-4709-8480-82a0b519e1dd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.062566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 201/383] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:15.063744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ec9a-3df9-4eac-b5c2-eb7540174dbf None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.064018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ec9a-3df9-4eac-b5c2-eb7540174dbf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.064284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b5ec9a-3df9-4eac-b5c2-eb7540174dbf None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.065475 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 202/384] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:15.066181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5ec9a-3df9-4eac-b5c2-eb7540174dbf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.079777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028daa7-3462-47db-9ca2-9887b9a95805 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.113846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.114504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.114776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.115021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.123825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.128354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.130243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:15.144152 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:15.145049 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:15.146210 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:15.146210 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:15.146210 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:15.146210 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 183/385] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:15.146210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.172615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b5ec9a-3df9-4eac-b5c2-eb7540174dbf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.206840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.207577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.207780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.208042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.208697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:15.208995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.210413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.215691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.219274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 203/386] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:15.224187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.246117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361cba-53f4-48eb-931d-63dafc9bde92 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.279478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.280081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.280351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.280643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.281272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:15.281572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.282994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2466ac-f6e1-483f-8b99-727c01e21819 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.294421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 184/387] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:15.295566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.295839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.296102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.313470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:15.314653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:15.324269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4a448-f7e5-43c3-95f3-00acde6d737f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.341626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.357705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.358360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.358630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.358894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.366450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.367891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:15.379310 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:15.380256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 29 02:31:15.381723 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:15.382265 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 185/388] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:15.382333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 204/389] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:15.382333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.382461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.459623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.484971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a4492-e46a-4749-b0e8-6830fd42a1bc None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.502255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef6064-fa49-4b2d-ba68-b461930e69f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.519690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.520319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.520590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.520852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.532119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.533576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.537418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.538076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.538353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.538673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.539318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:15.539624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.540995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:15.551336 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:15.552243 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:15.553054 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:15.553054 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:15.553054 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:15.553054 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 205/390] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:15.560771 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 186/391] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:15.560771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.560987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.590874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.663631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f7b4-011f-477b-946b-835b7d8dd588 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.663980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009b1a-54ad-4f7d-b73a-28ae084eb2db None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.682986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.697316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.697494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.697963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.698058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.698235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.698319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.698497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.698582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.699225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:15.699528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.700951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.705216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.706683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.718390 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 187/392] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:15.718850 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:15.719628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:15.720461 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:15.720868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.720945 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 206/393] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:15.720945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.810070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.819747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d0ddc-bf77-4339-8573-e5476ed499f4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.820342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf260f-1968-4137-baaf-3505c78679fb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.853718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.854282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.854556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.854824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.855458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:15.855760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.855968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:15.856601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:15.856877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:15.857126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.857210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:15.864894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:15.866377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:15.868434 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 188/394] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:15.869141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:15.878830 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:15.879778 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:15.880648 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 207/395] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:15.881202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:15.911797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:15.970833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5506f-1719-4b9c-b72d-394c862c5f08 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:15.978147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4532848-9cfc-42a5-8795-a43c65d46791 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.004424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.005048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.005319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.005587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.010912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.011535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.011811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.012086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.015474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.016950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.022582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.024015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:16.031028 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:16.031937 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:16.032759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:16.032759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:16.032759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:16.032759 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 189/396] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:16.032977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:16.039104 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:16.040200 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:16.041314 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:16.041314 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:16.041314 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:16.044764 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 208/397] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:16.045586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.048446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.125756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.135898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf8a23-bb04-487f-a42a-6118eeafb47a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.145304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a9a39-d574-4ee9-900c-d4616e189d80 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.169836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.170482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.170757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.171028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.171696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:16.171997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.173444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.177818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.178462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.178734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.178999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.186219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.187635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.190529 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 190/398] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:16.191350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:16.198641 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:16.199574 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 209/399] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:16.200556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.259310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.293601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5655d-2c21-40a0-a555-ee4b77567671 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.297005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9f757-5918-42cc-85b4-0861e2889125 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.326512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.327121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.327384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.327652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.328379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:16.328680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.328775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.329372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.329648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.329944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.330214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.330571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:16.330868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.332294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.345035 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 210/400] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:16.345845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.347766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 191/401] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:16.350739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.361274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.444372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803e82a0-7c11-4913-b9df-99b65f9135dc None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.450809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe56ac1-95b1-49e6-a16f-36900862463a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.466140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.478079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.478680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.478955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.479220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.479846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:16.480145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.481504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.483679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.484336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.484612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.484882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/81efa701407b4cb583969bef4ad35194/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.494772 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 211/402] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:16.495647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.501645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=81efa701407b4cb583969bef4ad35194, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.503145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.517308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 192/403] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:16 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/81efa701407b4cb583969bef4ad35194/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:16.518008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.603079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.609948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7162ab-c1c3-4ab4-9efa-48941ecb211a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.646877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.647505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.647784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.648125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.648799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:16.649109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.650634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.656488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84a4d6-d553-4f13-9dc0-4673bf3d1268 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.689796 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 212/404] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:16.690680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.700868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.701581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.701954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.702288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.703343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.704453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.727310 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 193/405] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:31:16 2022] POST /identity/v3/users => generated 247 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:16.728202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.756682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.839787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85aeb0-a1e1-4f21-9e12-9a1e12d8763d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.863519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05cb4-7888-4938-b6d1-90a3427f9168 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:16.879440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.880086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.880339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.880613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.882065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:16.895774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.897986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.907009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:16.908051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:16.908518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:16.908994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:16.914648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:16.915525 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:16.916731 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:16.916731 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:16.916731 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:16.916731 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 213/406] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:16.916731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:16.919215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:16.921530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:16.934224 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:16.935116 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:16.935946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:16.940083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 194/407] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:16.941690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.034947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.046885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3145-3353-4786-9365-30240f8a0e46 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.075008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecccda3-9243-47d8-9358-014c62eb0a07 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.090143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.090787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.091321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.091598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.108166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.110316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.115237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.115852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.116128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.116452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.117200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:17.118068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.119951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:17.126712 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:17.127680 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:17.129193 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:17.129193 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:17.129193 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:17.129193 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 214/408] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:17.129193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.133651 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 195/409] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:17.135401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.179618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.245617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5f0b-b328-46c1-b923-1deca633a9b6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.275300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77616faa-0040-4473-a2b8-0b3f858d3f02 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.281240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.281937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.282214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.282526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.283214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:17.283516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.285015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.303094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 215/410] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:17.303936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.308354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.319682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.320625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.321046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.321686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.322999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:17.323702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.325491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.342383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 196/411] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:17.344282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.411207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578485b-f355-4baa-8ba7-f85508e66774 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.450115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.450458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.450733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.451003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.459216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.460656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:17.471840 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:17.472784 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:17.473611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 216/412] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:17.474524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.481024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.490760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a088d-91eb-4b5a-b9ee-7f9fd233f45b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.536912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.538448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.538869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.539307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/e800c060beb045008c905a591d290cb2/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.540958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.559446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=e800c060beb045008c905a591d290cb2, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.561079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.578103 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 197/413] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:17 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/e800c060beb045008c905a591d290cb2/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:17.579999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.604647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742dc4e-db6e-48e7-adaa-516dac6f6ad1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.675064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.675831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.676113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.676384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.688998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.690489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.714352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c065d-2403-44ca-a9f8-9d5e52a1663c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:17.718369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:17.719256 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:17.720083 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 217/414] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:17.725601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.752897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.754056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.754674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.755117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.755993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:17.756508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.758231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.779780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 198/415] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:17.785245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.794256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.861480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf83f5-e47f-4da7-9b02-77dcf1a35979 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.900934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:17.915198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.916055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.916498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.917016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:17.917927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:17.918489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:17.920102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:17.936674 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 218/416] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:17.944046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:17.946435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60578a-5a46-4b3f-9cee-d6ba3159e5c9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:17.982612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719bf7c-4101-4b5f-b3eb-bc2668772ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:17.983269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719bf7c-4101-4b5f-b3eb-bc2668772ed1 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:17.983543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719bf7c-4101-4b5f-b3eb-bc2668772ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:17.983815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719bf7c-4101-4b5f-b3eb-bc2668772ed1 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/8e709a640a524fd0a3e272d397c75e6c/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:18.000341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719bf7c-4101-4b5f-b3eb-bc2668772ed1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=8e709a640a524fd0a3e272d397c75e6c, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:18.001722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719bf7c-4101-4b5f-b3eb-bc2668772ed1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:18.019314 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 199/417] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:17 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/8e709a640a524fd0a3e272d397c75e6c/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:31:18.063956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1753c-00aa-48ab-81e2-db41e6c36cff None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:18.101998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21870eac-2b08-4f52-9226-cd2421a4b2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:18.103018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870eac-2b08-4f52-9226-cd2421a4b2c6 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:18.103641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870eac-2b08-4f52-9226-cd2421a4b2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:18.104101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21870eac-2b08-4f52-9226-cd2421a4b2c6 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/0e12ad7dd0524e218c5d4be524ec7cb5/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:18.121321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870eac-2b08-4f52-9226-cd2421a4b2c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=0e12ad7dd0524e218c5d4be524ec7cb5, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:18.123694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21870eac-2b08-4f52-9226-cd2421a4b2c6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:18.140170 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 219/418] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:17 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/0e12ad7dd0524e218c5d4be524ec7cb5/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:31:18.924867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0d8de-5bf9-4251-a8a4-437a22d7cce5 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:18.925166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0d8de-5bf9-4251-a8a4-437a22d7cce5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:18.925353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0d8de-5bf9-4251-a8a4-437a22d7cce5 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:18.927038 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 200/419] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:18.932798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cff49-7ce7-4491-baa8-965ff68d717b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:18.933291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cff49-7ce7-4491-baa8-965ff68d717b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:18.933362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cff49-7ce7-4491-baa8-965ff68d717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:18.958951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a0cff49-7ce7-4491-baa8-965ff68d717b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:18.960195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a0cff49-7ce7-4491-baa8-965ff68d717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:19.000764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:19.055089 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 220/420] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:19.133974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6c33a-36d5-4737-83c3-d39297fc8f5e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:19.134512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6c33a-36d5-4737-83c3-d39297fc8f5e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:19.134512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6c33a-36d5-4737-83c3-d39297fc8f5e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:19.136208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 201/421] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:19.141474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:19.141765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:19.142067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:19.166945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:19.168162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:19.251437 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 221/422] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:19.538006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6c33a-36d5-4737-83c3-d39297fc8f5e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:19.610558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:19.666519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6c33a-36d5-4737-83c3-d39297fc8f5e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:19.689076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:19.708946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:19.709582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:19.709886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:19.710157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:19.721070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:19.726350 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:19.727215 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:19.728459 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 202/423] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:19.735183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:19.839319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e540d7a-4184-4fc8-ba84-7ebce2501e5c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:19.873611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:19.874378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:19.874713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:19.875039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:19.875761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:19.876125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:19.877555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:19.886161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:19.886450 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 203/424] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:19.891995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:19.894669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:19.912707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350cbaf-9051-47a3-87f0-a499bbeacbd2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:19.978606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:19.979318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:19.979599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:19.979863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:19.999282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:19.999515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ced7d5-0ba9-487f-8544-6b1391c5542f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:20.004180 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:20.005062 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:20.005868 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:20.014252 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 222/425] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:20.020030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.036831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.037468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.037913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.038187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.063438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.064921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:20.096708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:20.099014 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:20.101045 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:20.101045 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:20.101045 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:20.101045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 204/426] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:20.103913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.141764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.220925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aef1a0-1568-4863-a622-51d1cc8ec091 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.237562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82729d-f74b-4619-a20d-b39d68632d4d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.258081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.258690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.258964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.259232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.259876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:20.260175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.261715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.274967 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 205/427] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:20.283121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.358640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.359292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.359571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.359838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.360508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:20.360807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.362216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.384065 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 223/428] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:20.387992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.389070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.402965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037fc47-a8fb-47e8-86a0-93ba1d2258df None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.435574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.440269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.440906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.441181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.441497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.450214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.451657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7c538e41-8357-4b6e-8b0b-c9d46e7d1a60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:20.465700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:20.466657 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:20.467544 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 206/429] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:20.472425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b31d-a236-42ad-a2a2-7febb9af93e3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.472788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b31d-a236-42ad-a2a2-7febb9af93e3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.473043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9b31d-a236-42ad-a2a2-7febb9af93e3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.474379 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 207/430] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:20.475065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b31d-a236-42ad-a2a2-7febb9af93e3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.569126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87509505-dc5a-44d6-96bf-cccb58999ff4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.598259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9b31d-a236-42ad-a2a2-7febb9af93e3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.615199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.616512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.616990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.617916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.635356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.637542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.637670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.638299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.638557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.638826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.639684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:20.639994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.641457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4472787-d829-4a72-a1bb-d4c448897243 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1d4ae5df-923a-4179-8f8c-f8635a04a907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:20.658362 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:20.659350 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:20.660521 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:20.660521 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:20.660521 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:20.660521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 224/431] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:20.660840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 208/432] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:20.662205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b298-370c-4264-8032-094858702765 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.665114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b298-370c-4264-8032-094858702765 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.665114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5b298-370c-4264-8032-094858702765 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.665114 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 209/433] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:20.665940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b298-370c-4264-8032-094858702765 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.666208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.666774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.667104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.675525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.687664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:20.688872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:20.753219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.759191 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 225/434] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:20.760127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:20.779042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5b298-370c-4264-8032-094858702765 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.814587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47aea8-6dbe-4a89-ba68-20b6a0ffec01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.815222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47aea8-6dbe-4a89-ba68-20b6a0ffec01 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.815469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47aea8-6dbe-4a89-ba68-20b6a0ffec01 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.815739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47aea8-6dbe-4a89-ba68-20b6a0ffec01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.869338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fea9c7-a0ff-4625-b45c-4e6a673f4102 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:20.887121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47aea8-6dbe-4a89-ba68-20b6a0ffec01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.888581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47aea8-6dbe-4a89-ba68-20b6a0ffec01 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.897109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.906198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:20.906809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.907084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.907517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.908442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:20.908750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:20.910159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea262e8-a503-41e4-9875-133f0d96b13d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:20.926122 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 226/435] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:20.926122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:20.926122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:20.926122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:20.941427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:20.942653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:20.998599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:20.999650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 210/436] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:21.000966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734904fc-2f7d-491e-843c-740fb2d0c009 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.001317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734904fc-2f7d-491e-843c-740fb2d0c009 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.001595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734904fc-2f7d-491e-843c-740fb2d0c009 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.003015 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 211/437] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:21.003550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734904fc-2f7d-491e-843c-740fb2d0c009 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.025306 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 227/438] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:21.025306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.113019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734904fc-2f7d-491e-843c-740fb2d0c009 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.120851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.129570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c8766-910c-4500-880a-72bd828a4be2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.150024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.150718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.150914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.151183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.158601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.160261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.164197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.164905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.165183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.165450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-403c2ce9-0e57-400b-98eb-a667e3061448 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:21.172977 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.173889 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:21.174765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 212/439] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.175858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.175858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.176005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.180885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.182276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.194959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:21.196157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:21.198360 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.199250 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:21.200108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:21.200108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:21.200108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:21.200108 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 228/440] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.200319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.244504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.286070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 213/441] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:21.294008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.307411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79caeb-0554-45f7-839a-1885c63bf905 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.341276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.341933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.342208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.342472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.353323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:21.358543 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.359481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:21.360248 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 229/442] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.361052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.395026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.401140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530e68b-9521-4053-baf8-22d69444e0e6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.437522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.438141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.438412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.438678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.439395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:21.439695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.441112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.459807 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 214/443] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:21.460933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.468716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.472737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55595e31-edf9-4847-919b-e4418fdb897c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.508567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.509189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.509457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.509851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.510594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:21.510893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.512264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.525036 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 230/444] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:21.526323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.562820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9dd80-65bb-417b-863b-b86e6a2c3afa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.596072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.596700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.596977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.597249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.607266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:21.612048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.613163 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:21.614021 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 215/445] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.614653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.627202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d4b0-ead3-4fbb-9a98-2b2aa321273b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.629650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.661322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.662156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.662156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.662395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.663042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:21.663348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.664705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.672323 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 231/446] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:21.673159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.700152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.715223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1b4a3-3dbe-49a3-8b4b-ca5de89c4873 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.748146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.748771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.749044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.749310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.758869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.760312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:21.774231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.775150 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:21.775971 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:21.775971 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:21.775971 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:21.775971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 216/447] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.776429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.776518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79c0f7-5b93-43b5-873d-370263f169f7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.812442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.813060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.813332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.813594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.820453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.821920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:21.833166 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.834065 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:21.834887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 232/448] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.835350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.844867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.879683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac26bf2-b644-4453-9526-c3b1c05cce8e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.911784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.912345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.912617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.912882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.915371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:21.923082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:21.928525 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:21.929439 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:21.930406 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 217/449] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:21.931305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:21.937962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bf67d-b9b6-4b45-80a1-dd855a60c1c3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:21.971462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:21.972057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:21.972329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:21.972764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:21.973417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:21.973718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:21.975121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:21.982777 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 233/450] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:21.983554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.030987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f38f10-3b69-4b1b-a20c-1981d6e12342 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.055240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.064386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.065022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.065299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.065570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.075879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.077322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.079513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75d08e-c32a-4066-a0a2-2533c46892ce None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:22.091107 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:22.092009 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:22.097683 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:22.097683 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:22.097683 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:22.097683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 218/451] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:22.097683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.114987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.115589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.115863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.116116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.116755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.117055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.118436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.130167 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 234/452] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.130942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.135168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.193642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78148f66-d83c-4880-8c4d-2f0e4a1db0a4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.226011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.226640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.226918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.227241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.227844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bb35b-bf43-4910-817d-f19614aeadd3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.227957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.228238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.229669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.241744 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 219/453] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.242694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.266048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.266811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.267409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.267679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.268332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.268632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.270093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.280900 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 235/454] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.280900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.283450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.338361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb55a-bc97-4cb9-9b1c-ef0e91f73100 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.340490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.372141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.372771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.373045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.373311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.375479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed446d-cd26-4e44-9203-f1667669ea7f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.383248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.384696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:22.399131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:22.400039 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:22.400859 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:22.400859 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:22.400859 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:22.400859 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 220/455] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:22.401067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.413407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.414043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.414320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.414592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.415230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.415511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.416889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.428779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 236/456] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.429567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.489934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.500111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22217a1-0bd1-4988-bc2a-6bfe96943659 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.528115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122034a6-5f4d-47f5-b0c4-30276111de5e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.532821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.533454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.533728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.534022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.540626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.542104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:22.553489 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:22.554372 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:22.555236 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 221/457] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:22.555695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.563202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.566624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.567242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.567738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.568302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.569037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=81efa701407b4cb583969bef4ad35194) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.569346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.570845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.577137 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 237/458] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/role_assignments?user.id=81efa701407b4cb583969bef4ad35194&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.577763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.668303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda1492-676f-49a0-8aa4-82cf667e3b0c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.696881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3cdbc-3736-4985-82c3-4f2c3ae52a3f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.707748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.708751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.709036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.709456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.721754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.723435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.736828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.737454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.737738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.738034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.738734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.739039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:22.739333 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:22.740217 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:22.741062 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:22.741062 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:22.741062 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:22.741221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.741289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 222/459] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:22.741765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.744876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.760575 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 238/460] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.761674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.816015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:22.861387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddacd24-35a1-4118-8ae8-a4386d110b55 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.867247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a636aa9-48aa-44b0-a88d-28bfd8de7a07 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:22.897438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.898116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.898376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.898649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.904772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:22.905471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:22.905654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:22.905954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:22.906558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.906652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:22.906926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:22.908024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.908332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:22.919907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:22.920811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 29 02:31:22.921684 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:22.925135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 239/461] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:22.925829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 223/462] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:22.926434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.926681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:22.992040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.029492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107acb53-8b4c-4e7b-b46a-bc3d9abfedcd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.033499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e957c2-a14c-44a3-8244-de22f3c3f2eb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.041106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.068527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.069164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.069443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.069715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.071877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.072646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.073129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.073407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.074080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:23.074391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.075764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.078565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.080009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:23.092142 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:23.093048 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 02:31:23.099234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:23.099744 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 240/463] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:23.100146 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 224/464] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:23.100213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.100289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.200860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70837b36-913d-406d-8511-ec835c1aefae None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.205468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a887637-938d-49fa-8f55-d8e946a7c7c5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.224930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.238012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.238665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.238939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.239234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.239942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:23.240264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.241730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.244997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.245478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.245792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.246045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/5f8edd4b12d54ce39915d2e9831b3d88/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.264710 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 225/465] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:23.264710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.265969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=5f8edd4b12d54ce39915d2e9831b3d88, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.267432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.281927 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 241/466] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:23 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/5f8edd4b12d54ce39915d2e9831b3d88/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:23.282521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.317747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.405667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334fd7d-7cd2-42d1-9b27-1f5329095bbf None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.426037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24c8ca-9806-45c2-963d-392680a0404e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.444798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.445556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.445859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.446134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.454656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.456152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:23.469822 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:23.470756 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 02:31:23.471913 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:23.472401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.472401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.472401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.472692 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 226/467] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:23.472760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.472824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.472888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:23.472960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.477560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.503185 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 242/468] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:23.504228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.527617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.603973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.606694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7a9f-620a-49e1-85a4-7b945c115052 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.630687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cc405-6b1c-4caf-bf6f-2f9e6f786208 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.653026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.654000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.654472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.655446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.671703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.672701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.673050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.673393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.674214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:23.674579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.676238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.696748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 243/469] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:23.703055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.750378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.752456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.807340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.815930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcfd390-d787-41f3-aeaa-98978ee631bf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:23.858875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:23.859525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:23.859796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:23.860108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:23.864645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:23.872392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 227/470] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:23.877653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:23.945714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:23.947719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:23.980161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88306f-0d0c-44d7-a2f6-1fb29cf93fe0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.016006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.016619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.016897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.017167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.035377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.067978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 244/471] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:24.069224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.106324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.108027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.109650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.181507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be76e0-c012-4373-a863-b66ae84382cb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.218878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.219929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.220400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.220888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.232269 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 228/472] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:24.232940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.233368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.235195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:24.252792 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:24.253864 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:24.254730 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:24.254730 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:24.254730 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:24.256924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 245/473] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:24.258105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.275584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.338220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446b6e5-3427-4db1-9dbf-db511d53538e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.355743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.369431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8edb69-9395-48d7-bbb3-87858b4dde8a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.375965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.376653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.376936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.377203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.388175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.389836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:24.405379 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:24.406507 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:24.407358 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:24.407358 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:24.407358 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:24.407358 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 229/474] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:24.407930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.409997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.411022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.411492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.412039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.423790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.425891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:24.441445 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:24.442565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:24.443380 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:24.443380 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:24.443380 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:24.445536 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 246/475] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:24.446538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.503909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.513329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b40d08-8bdb-4bb4-90a1-d42c261a0f4c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.549018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.550015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.550314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.550642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.551308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:24.551613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.553029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.560743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8829af-1280-448f-9449-585c35a36cfb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.565546 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 230/476] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:24.566687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.608875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.610131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.610581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.611337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.612472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:24.612944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.615143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.627373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.633499 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 247/477] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:24.634521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.671169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3411ef-1392-4253-8544-a7c8649058ab None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.713062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.714148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.714265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.714635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.715407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:24.715799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.717293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.729877 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 231/478] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:24.730941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.746200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.765417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035c39d-ba9c-4522-93fe-6026bc27bd35 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.811935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.812975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.813253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.813522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.820958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.822430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:24.834512 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:24.835342 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:24.836181 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 248/479] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:24.836635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.842819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ecdc1-0d13-45ce-9e0b-42cbfed02f96 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.877007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.877550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.877843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.878122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.885012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.886475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8e549c32-1b64-4124-a58f-c2cd6b81fd8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:24.897531 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:24.898404 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:24.899227 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 232/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:24.900259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122519e-f5c6-4391-9132-ecd8c9d10421 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.900259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122519e-f5c6-4391-9132-ecd8c9d10421 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.900259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122519e-f5c6-4391-9132-ecd8c9d10421 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.906036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 233/481] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:24.906036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122519e-f5c6-4391-9132-ecd8c9d10421 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:24.907608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.951417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65942e6a-78fb-42d4-8b42-0648553ed5ad None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:24.974044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:24.987021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:24.987739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:24.988145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:24.988559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:24.995403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:24.997237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.005667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122519e-f5c6-4391-9132-ecd8c9d10421 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:25.009856 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:25.010846 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:25.011910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:25.017237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 249/482] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:25.018165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.041393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.042040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.042315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.042601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.043319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.043607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.045033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781d4e-98f6-4eea-9d35-b29a24690cda None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.056524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 234/483] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.057723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.058040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.058313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.076003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:25.077166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:25.137857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae36384-8e1a-48cb-8a8f-777a93782f5f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.145739 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 235/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:25.146782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.169337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:25.186676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.187711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.188202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.188723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.189606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.190155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.191971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.206936 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 250/485] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.208138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.215431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:25.258156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc8c6-2295-4c24-b5ae-c20cebae4728 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.294390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.295058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.295338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.295608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.296346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.296654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.298120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.315707 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 236/486] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.316633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.327224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dbaad6-6a92-483b-a258-59b634131254 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.365308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.366509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.367399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.367978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.368957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=e800c060beb045008c905a591d290cb2) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.369541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.371245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.386026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 251/487] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/role_assignments?user.id=e800c060beb045008c905a591d290cb2&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.387009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.448569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8f1d8-b394-4186-a194-443b1f0b1ea2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.470417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:25.476109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:25.493088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.493943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.494291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.494627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.495451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=8e709a640a524fd0a3e272d397c75e6c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.495830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.498046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.505755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 237/488] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/role_assignments?user.id=8e709a640a524fd0a3e272d397c75e6c&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.515109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.559271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1301050-07d9-4179-9eaf-51c3e7844859 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.603191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.603824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.604101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.604370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.605121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=0e12ad7dd0524e218c5d4be524ec7cb5) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.605642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.607249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fece6b-a23b-42cc-83e5-d85c5b8c2acd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.615016 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 252/489] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/role_assignments?user.id=0e12ad7dd0524e218c5d4be524ec7cb5&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.616660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3afc9-721b-4579-be58-7f36dec0360e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.617139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3afc9-721b-4579-be58-7f36dec0360e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.617584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3afc9-721b-4579-be58-7f36dec0360e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.619501 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 253/490] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:25.627250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.627849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.628305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.650157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:25.651421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:25.694168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca0ef1-75f9-445b-b394-67cbb42b20a1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.746066 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 254/491] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:25.747878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.748665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.748938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.749209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.762879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:25.768289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:25.769212 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:25.770283 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 238/492] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:25.779043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:25.824561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:25.884833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70405b4f-33b5-479b-84f7-8d7181ff57e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:25.919098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:25.919717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:25.919999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:25.920269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:25.920992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:25.921299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:25.922713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:25.931836 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 255/493] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:25.937270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.015096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:26.029456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.112650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee52131-2134-44b4-8347-aa090147f5db None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.165121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.165877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.166168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.166433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.184362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:26.189581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01966ce6-951e-4447-b30f-ab1b55ecfb77 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.194656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:26.196154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:26.227915 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:26.229506 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:26.230776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:26.230776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:26.230776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:26.231738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 239/494] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:26.235296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.239158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.240001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.240423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.240866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.264063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:26.270631 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:26.271732 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:26.272735 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:26.277766 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 256/495] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:26.283142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.423327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:26.431921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0f5d-faf2-4cfa-9576-0e3331e17b2b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.461924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4b562-b6d3-4c02-8347-7b8ac6bd128d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.501045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.501668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.501970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.502234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.502877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:26.503197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:26.504741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:26.528276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 240/496] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:26.530703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.531799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.531799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.531986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.532588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:26.532883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:26.534296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:26.536890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.559318 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 257/497] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:26.571195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.621383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:26.665613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4a7b-862e-4c41-9213-037525f87340 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.707144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.707781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.708057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.708327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.712930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cee90f-00e9-4076-b2d2-b4f9cd42b3a4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.716985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:26.719469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:26.734363 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:26.735453 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:26.736361 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 241/498] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:26.743462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.778143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.779023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.779260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.779533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.791788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:26.793242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:26.798169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:26.810064 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:26.811061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:26.811910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:26.811910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:26.811910 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:26.811910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 258/499] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:26.818884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:26.902847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:26.933072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61588cb-fa4c-4375-b977-0a7eaf01e68c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:26.969918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:26.970671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:26.970951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:26.971227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:26.972136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:26.972485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:26.973895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:26.988711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 259/500] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:26.998809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.016157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b167877-0c10-4b5a-bf89-b249ed04a1b4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.054533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.055073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.055352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.055624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:27.056357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:27.057223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:27.058699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:27.084560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 242/501] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:27.085869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.218581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:27.226428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611e4c-ac09-4d50-a52c-0f0309b30dbf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.266678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae3579-44b9-4a28-8889-b133f42ed321 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.297953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.300390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.301025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.302399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:27.305495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:27.314377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:27.317301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:27.321165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.322068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.322540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.324224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:27.342760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:27.343789 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:27.344770 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:27.348467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:27.350113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:27.352079 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 260/502] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:27.353328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:27.377503 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:27.378750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:27.379760 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:27.379760 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:27.379760 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:27.381788 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 243/503] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:27.395048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.517868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5d0b6-b4cb-4803-a4a5-c953b131e693 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.552633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:27.565610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.566620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.567051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.567458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:27.568268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:27.568711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:27.568863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c9826a-374e-4138-a060-bd7fc0be75b1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.570647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:27.584659 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 244/504] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:27.590782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.639240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.640840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.641475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.642564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:27.644705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:27.645192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:27.647812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:27.682607 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 261/505] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Oct 29 02:31:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:27.688824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.774541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05acc26-1c26-43e1-97eb-2d968f0721c5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.783576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:27.839669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.840229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.840508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.840781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:27.852544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:27.854116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:27.868754 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:27.869661 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:27.870642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:27.874045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 245/506] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:27.876295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:27.896388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb98c7-44db-4fd6-b03c-9aa83bd114d7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:27.953636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:27.986633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a67135-b401-41f1-b428-73b8b7066bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:27.987276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67135-b401-41f1-b428-73b8b7066bc1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:27.987556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67135-b401-41f1-b428-73b8b7066bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:27.987822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a67135-b401-41f1-b428-73b8b7066bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.021623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8fd8dd-eda7-45cf-981d-78eff660d942 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:28.061719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:28.062527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.062815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.063096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.063816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:28.064129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.065641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.084561 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 246/507] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:28.087114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.148563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a67135-b401-41f1-b428-73b8b7066bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.150112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a67135-b401-41f1-b428-73b8b7066bc1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.212089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:28.224551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d824a-d7d1-4c14-be90-cd591da0352e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:28.234033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:28.258846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370201cf-9ac9-43d1-85bc-8693462ba300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:28.259504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370201cf-9ac9-43d1-85bc-8693462ba300 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.259745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 262/508] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 29 02:31:28.260223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370201cf-9ac9-43d1-85bc-8693462ba300 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.260223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370201cf-9ac9-43d1-85bc-8693462ba300 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/81efa701407b4cb583969bef4ad35194/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.261075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449cb9-ded9-4b61-9820-9d83d8f91845 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.261363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449cb9-ded9-4b61-9820-9d83d8f91845 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.261631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e449cb9-ded9-4b61-9820-9d83d8f91845 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.261995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370201cf-9ac9-43d1-85bc-8693462ba300 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=81efa701407b4cb583969bef4ad35194, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.263045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 263/509] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:28.263417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370201cf-9ac9-43d1-85bc-8693462ba300 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.263951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d2b9-a5f3-42a4-bff2-cb199564b5a9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.264308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d2b9-a5f3-42a4-bff2-cb199564b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.264580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973d2b9-a5f3-42a4-bff2-cb199564b5a9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.265964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 264/510] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:28.266886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe0ff-7fb1-42fd-a6f7-db37a604a00d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.267220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe0ff-7fb1-42fd-a6f7-db37a604a00d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.267492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdbe0ff-7fb1-42fd-a6f7-db37a604a00d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.268810 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 265/511] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:28.270105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe0ff-7fb1-42fd-a6f7-db37a604a00d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.281691 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 247/512] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:28 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/81efa701407b4cb583969bef4ad35194/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:31:28.283525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40634e7e-e998-470e-bf43-81985c296d19 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.283809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40634e7e-e998-470e-bf43-81985c296d19 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.284077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40634e7e-e998-470e-bf43-81985c296d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.308485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-40634e7e-e998-470e-bf43-81985c296d19 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:28.309751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40634e7e-e998-470e-bf43-81985c296d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:28.384328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdbe0ff-7fb1-42fd-a6f7-db37a604a00d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:28.384542 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 248/513] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:28.385845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.386143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.386411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.406287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:28.407404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:28.436817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:28.438037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.438463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.438899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.453133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.454888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-21615241-4fe2-47c0-980a-05b163ac6e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:28.478211 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:28.479412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:28.480520 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:28.480520 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:28.480520 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:28.482197 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 266/514] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:28.483539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.483877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.484073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.493296 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 249/515] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:28.494548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.502526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:28.508840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:28.510622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:28.523122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:28.617777 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 267/516] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:28.627676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd39a4c-330a-4a12-aa6d-64452cc3a701 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:28.669390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:28.669951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.670232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.670502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.671152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:28.671453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.672828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.684936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.685554 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 250/517] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:28.691039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.814698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b737859-0057-4bf0-be9c-ebda1cb9caea None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:28.827397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:28.841322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ac0ed-9cee-46a6-9a7b-14701d24d9f3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:28.853284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:28.853889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.854169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.854438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.855021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.857175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:28.870184 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:28.871238 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:28.872391 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 268/518] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Oct 29 02:31:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:28.873194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.883541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:28.885825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:28.886652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:28.887089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:28.887493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:28.895037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:28.896727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:28.909479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:28.910926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:28.911799 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:28.918452 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 251/519] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:28.919572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:28.979444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92235ef2-b945-420f-8da7-b3663fee2e5b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.017544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.018430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.018539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.018725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] PATH_INFO: `/v3/services/network` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.019343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.020827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.027721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d821f-b594-479e-8047-9e3ea6707fa5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:29.029579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:29.030653 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:29.031519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 269/520] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:28 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:29.036402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.065842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.066780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.067054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.067318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.067942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.068239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.069644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.074163 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 252/521] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Oct 29 02:31:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.074939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.091488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:29.103064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:29.144106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610370b-8b11-450f-90e0-968218b0402f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.181785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.182348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.182621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.183061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.184061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.184373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.185832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.186758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99860da5-6d8a-4451-a466-091abfa7f8b6 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.199303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 270/522] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.201041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.222466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.223169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.223447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.223717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.234355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.235808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:29.250304 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:29.251272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:29.252143 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:29.252143 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:29.252143 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:29.252143 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 253/523] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:29.252143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.308414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282cb78-05d6-4fcf-8059-1542eeb277f3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.324377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:29.333125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:29.345701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.346497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.346774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.347492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.348206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.348464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.349825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.354303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 271/524] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.354902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.369968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677c1c7-56c4-4d15-ba75-55f8995bfe20 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.403882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.404469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.404741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.405023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.405648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.405977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.407370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.421829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 254/525] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.421829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.472113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262f8f7-6561-4651-9060-fe59f01273e6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.513008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.513720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.514086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.514453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.515282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=5f8edd4b12d54ce39915d2e9831b3d88) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.515690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.517259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.534483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 272/526] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/role_assignments?user.id=5f8edd4b12d54ce39915d2e9831b3d88&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.535745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.555878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8853d6e-98a9-4bf7-8155-408184b6626f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.590247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:29.599019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.600874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.601484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.603326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.604098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.604405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.605855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.635111 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 255/527] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.640907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:29.643107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:29.720923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5a07e-e548-414b-8e98-bd6e632e3ada None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.757959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe561c0-1141-41fa-a7ab-216ee16e6d20 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:29.796002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.796754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.797253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.797615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.798478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] RBAC: Adding query filter params (type=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:29.798873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.800324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8db20e-b9f1-4e80-9d2f-11bd33734fd0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.807312 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 273/528] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:29.815320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f16179-5400-4108-b6e5-db9b0b5b171d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:29.815953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f16179-5400-4108-b6e5-db9b0b5b171d None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:29.816320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f16179-5400-4108-b6e5-db9b0b5b171d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:29.816593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f16179-5400-4108-b6e5-db9b0b5b171d None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:29.817264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f16179-5400-4108-b6e5-db9b0b5b171d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:29.821343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f16179-5400-4108-b6e5-db9b0b5b171d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:29.855924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 256/529] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:31:29 2022] POST /identity/v3/users => generated 254 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:31:30.621391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036310c1-6c39-4c88-b7bd-1758d49aa2f1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:30.622288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036310c1-6c39-4c88-b7bd-1758d49aa2f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:30.622288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036310c1-6c39-4c88-b7bd-1758d49aa2f1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:30.623856 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 274/530] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:30.629374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:30.629817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:30.630012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:30.655123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:30.656328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:30.709067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:30.742038 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 257/531] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:31.031601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036310c1-6c39-4c88-b7bd-1758d49aa2f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:31.172265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036310c1-6c39-4c88-b7bd-1758d49aa2f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:31.191480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:31.211504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:31.212135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:31.212412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:31.212681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:31.223415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:31.228189 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:31.229091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:31.230317 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 275/532] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:31.235771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:31.352310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada2e12-2d4c-4bd3-bb3b-ba01ad5dd9aa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:31.390543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:31.391160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:31.391435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:31.391708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:31.392535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:31.392841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:31.394335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:31.409046 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 258/533] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:31.414745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:31.547598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9caa28-c887-42ee-a0f8-6c738ee29af5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:31.601047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:31.601698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:31.602002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:31.602274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:31.623183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:31.624647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:31.641670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:31.642668 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:31.643557 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:31.643557 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:31.643557 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:31.643557 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 276/534] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:31.649872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:31.711782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:31.805724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b94b-e581-46ce-99e7-9e7b1f9ea26d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:31.846371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:31.846982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:31.847297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:31.847582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:31.848234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:31.848533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:31.849930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:31.862318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 259/535] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:31.867713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:31.917070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:32.014113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5c9ac9-6fab-4419-b004-f06a918b5cb7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:32.065366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:32.066082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.066371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.066643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.080041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:32.081663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5ee68227-d045-4584-a721-129c570387f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:32.093397 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:32.094446 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:32.095369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 277/536] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Oct 29 02:31:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:32.103559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:32.167617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566625b5-e478-4a25-95df-6c1569d14246 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.167811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566625b5-e478-4a25-95df-6c1569d14246 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.168170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566625b5-e478-4a25-95df-6c1569d14246 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.169599 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 278/537] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:32.175795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55707d69-2eab-42f3-82c2-a514d3f61224 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.176249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55707d69-2eab-42f3-82c2-a514d3f61224 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.176615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55707d69-2eab-42f3-82c2-a514d3f61224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.196998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-55707d69-2eab-42f3-82c2-a514d3f61224 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:32.198549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-55707d69-2eab-42f3-82c2-a514d3f61224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:32.240682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:32.248017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12765-1161-420f-8d72-15ca1a5a89b4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:32.303934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:32.304583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.304818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.305085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.305832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:32.306144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:32.307093 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 279/538] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 02:31:32.307571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:32.308798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e8322-f486-4dc9-af67-7e48f796b680 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.309419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e8322-f486-4dc9-af67-7e48f796b680 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.309928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e8322-f486-4dc9-af67-7e48f796b680 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.311732 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 280/539] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:32.318511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1414ac-fbe3-464f-9129-3f073971737e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.319085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1414ac-fbe3-464f-9129-3f073971737e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.319570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1414ac-fbe3-464f-9129-3f073971737e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.336801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 260/540] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Oct 29 02:31:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:32.339150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb1414ac-fbe3-464f-9129-3f073971737e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:32.340500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb1414ac-fbe3-464f-9129-3f073971737e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:32.344911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:32.353552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:32.462622 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 281/541] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:32.485115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724ff96-ab8a-4fb5-a228-c9413f3c9ca7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:32.521679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:32.522328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.522604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.522881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.555392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:32.591304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abf45-3985-4540-a324-ecc3e0bc2622 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.591671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abf45-3985-4540-a324-ecc3e0bc2622 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.591941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924abf45-3985-4540-a324-ecc3e0bc2622 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.593515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 282/542] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:32.601965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.602241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.602787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.612589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:32.614398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:32.636892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:32.638907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:32.726313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 261/543] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 02:31:32.727972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:32.736507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 283/544] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:32.737204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:32.795690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:32.824095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:32.851962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6dbcb2-4daa-43bf-9e10-d8bc765b400f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:32.852618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855087d4-471a-45e1-8cb2-ea8d359f9c80 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:32.894264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:32.895409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.895531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:32.896067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.896174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:32.896410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:32.896679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.897035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:32.898098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:32.900031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:32.909335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:32.911022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:32.928324 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 262/545] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:32 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:32.928324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:32.941483 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:32.942614 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:32.943495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:32.943495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:32.943495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:32.945374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 284/546] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:32.956643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.070433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b677-d7df-481d-ab15-071c1ebef96c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.083600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.112410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c800b23-b859-4488-bab2-8c8c6ebbfb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.114210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800b23-b859-4488-bab2-8c8c6ebbfb9a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.114360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800b23-b859-4488-bab2-8c8c6ebbfb9a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.114597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800b23-b859-4488-bab2-8c8c6ebbfb9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.118062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1897295-d1db-460a-9fd9-af114cae9638 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.128019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c800b23-b859-4488-bab2-8c8c6ebbfb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-2c800b23-b859-4488-bab2-8c8c6ebbfb9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:33.136462 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:33.137440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:33.138303 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:33.139729 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 263/547] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:33.140273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2356-fbc4-42e4-af41-88b7a91f57e2 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.140553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2356-fbc4-42e4-af41-88b7a91f57e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.140823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2356-fbc4-42e4-af41-88b7a91f57e2 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.142249 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 264/548] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:33.142845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2356-fbc4-42e4-af41-88b7a91f57e2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.156475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.168026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.168643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.169460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.169460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.169840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:33.170783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.171551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.188308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 285/549] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:33.189552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.258333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2356-fbc4-42e4-af41-88b7a91f57e2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.297659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b2120-73e0-42e1-a025-da169602ee3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.298341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2120-73e0-42e1-a025-da169602ee3a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.298722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2120-73e0-42e1-a025-da169602ee3a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.298895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b2120-73e0-42e1-a025-da169602ee3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.305593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e016-cbdf-4dc6-a51e-4dbeebeeb648 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.309322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b2120-73e0-42e1-a025-da169602ee3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-736b2120-73e0-42e1-a025-da169602ee3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:33.314270 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:33.315226 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:33.316128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 265/550] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:33.317322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.317421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.317836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.335705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:33.336809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:33.349569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.350435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.350718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.350994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.351661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:33.352029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.353409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.362420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.367457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 286/551] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:33.367457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.411543 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 266/552] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 02:31:33.412216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.436973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.494966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94acc8-db92-49d1-b549-313b2d1cd47a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.533408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.534092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.534367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.534635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.546418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.547906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.554861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f078d53-a470-4c73-9824-86debc9859c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:33.560629 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:33.561509 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:33.562429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:33.567016 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 287/553] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:33.567887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.612047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.613219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.614179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.614454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.615129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:33.615432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.616816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.625782 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 267/554] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:33.626745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.652450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.695767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd0433-43bd-4a6f-8145-e9df206be10f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.710326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.732460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dcc24-ddf7-44ac-a173-f86777c53a44 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.739243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.740501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.740937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.741711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.755230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.756877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.766629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.767237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.767515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.767787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.768473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:33.768775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.770286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:33.774365 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:33.775488 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:33.776565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:33.776565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:33.776565 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:33.778465 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 288/555] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:33.779827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.782384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 268/556] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:33.783016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.866893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:33.888525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b1483-e350-49fa-a629-29dabe09db98 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.898226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c72cfb-56de-433e-a9fb-5e85bfaca153 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:33.924265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.924885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.925164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.925491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.926473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.927846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.937466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:33.938235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:33.938429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:33.938866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:33.944807 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 269/557] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:33 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:33.945789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.950232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:33.951804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:33.971409 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:33.972484 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:33.974163 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:33.974163 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:33.974163 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:33.974163 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 289/558] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:33.974163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:33.995583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:34.097490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700a014-a3be-411c-948c-3e4f6d6c9c16 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.107798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e04d4-54de-4d3a-9897-643dc2838ff2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.136266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.137333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.137856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.138394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.139243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:34.139748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.141214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.148478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:34.153391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.154018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 270/559] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:34.154268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.154370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.154554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.155280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=81efa701407b4cb583969bef4ad35194) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:34.155580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.156617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.157054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.164498 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 290/560] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:33 2022] GET /identity/v3/role_assignments?user.id=81efa701407b4cb583969bef4ad35194&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:34.170088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.274000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:34.299614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89ed0e-967c-4f1d-8f06-966a3f0dfb40 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.305349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910a8f0-4747-4296-b36d-3947be2b15fd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.363026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.364039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.364510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.364990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.365874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:34.366387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.367969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.368150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.368844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.369126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.369398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.378202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.380140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.383194 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 271/561] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:34.388456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:34.405137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:34.406137 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:34.407051 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:34.410285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 291/562] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:34.415646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.463634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:34.512545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162220c3-f71d-46d8-be76-9b2062f5bccd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.541791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10a53e-7356-4553-909a-2a95bba26b29 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.552754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.553764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.554365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.554828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.564207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.565923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:34.580243 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:34.581399 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:34.582639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:34.583292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.583292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.583292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.583292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.583596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:34.583596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.585832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.585949 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 272/563] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:34.591041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.598765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:34.611823 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 292/564] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:34.618175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.714653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b945a1-34ef-43ff-8476-0116cdfe9b04 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.750344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:34.784685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.785472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.785755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.786037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.786775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:34.787080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.794404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc3000-4539-42e5-a4fe-663f693758e8 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:34.796293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.831279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 273/565] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:34.839481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:34.870978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:34.871599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:34.872188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:34.872458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:34.894658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:34.896121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:34.924470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:34.926204 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:34.927418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:34.927418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:34.927418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:34.927418 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 293/566] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:34.932107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.003740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9796a9-7c7b-480b-b831-26f52ce68402 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.040636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.041279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.041556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.041843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.053343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.055150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:35.071335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:35.072365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:35.073842 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:35.073842 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:35.073842 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:35.073842 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 274/567] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:35.078093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.080034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:35.113115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:35.199884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2bb8d-18da-466f-ade7-81f02a25e454 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.227581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39604fa-f99b-41a1-8896-3ee3a8f1b8f1 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.244260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.244878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.245155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.245421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.246716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:35.247336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.249389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e88105-60f1-42ae-80a7-ede8a62ff25a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.265886 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 275/568] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:35.267428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fcb7-010c-4878-a7ba-8414c59c14d9 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.267902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fcb7-010c-4878-a7ba-8414c59c14d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.268359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307fcb7-010c-4878-a7ba-8414c59c14d9 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.271272 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 276/569] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:35.272237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307fcb7-010c-4878-a7ba-8414c59c14d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.285611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.286349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.286645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.287210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.288124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:35.288434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.289830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13795c-89c5-4bfb-88ee-edc6ef18d027 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.303108 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 294/570] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:35.304129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.304401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.304671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.326994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:35.328180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:35.370745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:35.388453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307fcb7-010c-4878-a7ba-8414c59c14d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.414970 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 295/571] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:35.415355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.436731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.437881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.438398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.438903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.447615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.449555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:35.470478 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:35.471502 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:35.472447 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:35.476048 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 277/572] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:35.482350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.506023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:35.667783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ab8f7-5e79-471a-926d-6884882e908a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.675759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc377da-a371-4af1-a188-db1421f78852 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.726713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.727720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.728187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.728660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.729534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:35.732241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.735708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.751257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.752212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.752713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.753169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.767128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.768578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.769475 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 278/573] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:35.771128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.783697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:35.796061 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:35.797556 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:35.798725 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:35.806969 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 296/574] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:35.810937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:35.910485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f8374-a8b7-41d9-a11e-db82d3622d09 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.970306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:35.971524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:35.972880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:35.973453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:35.974902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:35.977324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:35.978780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:35.984945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94719057-5498-497f-a5ef-aa5109b6b157 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:35.999044 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:36.000376 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:36.001421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:36.008143 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 279/575] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Oct 29 02:31:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:36.008143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:36.056853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.058050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.058593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.059080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/fbb367d26b64430385f8032099f9e311/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.075265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=fbb367d26b64430385f8032099f9e311, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.077262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.106109 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 297/576] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:35 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/fbb367d26b64430385f8032099f9e311/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:36.107592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:36.171909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:36.229575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c172c7-5889-4135-9b46-4414ea8ad92a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:36.294828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cedadb-d765-4394-93a4-7b12f44d16f9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:36.319070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.319314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.319531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.319868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.320570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:36.320877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.323413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.338188 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 280/577] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:36.350396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:36.352128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.352986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.353567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.354097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.354938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:36.355509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.357154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.362786 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 298/578] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Oct 29 02:31:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:36.368884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:36.385218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:36.477050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4723e-19db-4667-8b59-aebc7c63ba12 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:36.516495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.517587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.518098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.518612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.519733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:36.520267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.521879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.528111 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 299/579] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Oct 29 02:31:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:36.534426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:36.538171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a0dd5-19ac-45a7-9826-c323d3303a95 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:36.604038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:36.622780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1abcc-4194-4113-aa02-e7d92982cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.623467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1abcc-4194-4113-aa02-e7d92982cff2 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.623775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1abcc-4194-4113-aa02-e7d92982cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.624393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1abcc-4194-4113-aa02-e7d92982cff2 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/5f8edd4b12d54ce39915d2e9831b3d88/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.626617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:36.627886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1abcc-4194-4113-aa02-e7d92982cff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=5f8edd4b12d54ce39915d2e9831b3d88, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.629989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1abcc-4194-4113-aa02-e7d92982cff2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.650300 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 281/580] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:36 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/5f8edd4b12d54ce39915d2e9831b3d88/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:36.657832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97640b6-0326-4ccf-b3b7-cd603d4156f0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.658677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97640b6-0326-4ccf-b3b7-cd603d4156f0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.659127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccba1d2-3552-4be8-8643-1efc9eeca453 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:36.659373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97640b6-0326-4ccf-b3b7-cd603d4156f0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.661531 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 282/581] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:36 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:36.669625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d700-2e7b-4162-a6db-c69e3994c58f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.670286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d700-2e7b-4162-a6db-c69e3994c58f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.670820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4d700-2e7b-4162-a6db-c69e3994c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.707107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bcc4d700-2e7b-4162-a6db-c69e3994c58f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:36.707892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.708526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.708799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.709066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.709602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bcc4d700-2e7b-4162-a6db-c69e3994c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:36.709833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] RBAC: Adding query filter params (interface=public, service_id=31114cda62a444b1b2266f61d47ba3dd, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:36.710146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.711535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.723998 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 300/582] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:31:36 2022] GET /identity/v3/endpoints?service_id=31114cda62a444b1b2266f61d47ba3dd&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:36.730308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:36.858812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274eb34-9734-49dd-a362-340f4f3381a9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:36.872184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 283/583] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:36.874267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d7b9-d8e3-4931-a55a-8f8404d86406 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.874766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d7b9-d8e3-4931-a55a-8f8404d86406 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.875252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68d7b9-d8e3-4931-a55a-8f8404d86406 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.876855 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 284/584] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:36.883388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.883702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.883874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.914556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:36.915753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:36.927216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:36.927851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:36.928136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:36.928406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:36.929014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:36.930448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:36.937885 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 301/585] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:31:36 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:37.008340 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 285/586] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:37.221861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:37.225992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:37.340352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:37.354650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e782658-83a6-4ce7-93f2-0e17b060df76 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:37.398460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:37.399113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:37.399392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:37.399664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] PATH_INFO: `/v3/services/network` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:37.400464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:37.401619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:37.417434 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:37.418648 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:37.419527 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 302/587] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:37.428586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:37.454153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:37.523006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:37.547145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb304829-7e79-4a1a-9cc2-d1ecbaae7af4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:37.578549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b18eb3-e29a-4eed-ad97-69c73215fad9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:37.613166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:37.613166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:37.613166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:37.613166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:37.613602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:37.613602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:37.621089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:37.623191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:37.624440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:37.625153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:37.630839 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:37.631763 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:37.632639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:37.634748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] RBAC: Adding query filter params (name=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:37.635321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:37.636916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:37.640657 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 286/588] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:37.644567 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 303/589] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:37.645693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:37.654827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:37.792438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454718b-abf6-4a76-91b5-7d24ac985914 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:37.818147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:37.849038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:37.849666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:37.849972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:37.850244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:37.850883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:37.851188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:37.852603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:37.864871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332890e-40e3-48b6-acb5-5b68c668a96c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:37.867547 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 287/590] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:37.868490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:37.919463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:37.929135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:37.929773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:37.930125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:37.930395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:37.931023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] RBAC: Adding query filter params (type=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:37.931494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:37.934677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:37.945550 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 304/591] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:37.951279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:38.051958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a315e-a0ac-48bf-ba22-14972789b536 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:38.115024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:38.115643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:38.115923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:38.116196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:38.116832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:38.117134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:38.118538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:38.123182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3844e33-8f03-423f-91b3-1cfb08cac06a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:38.123648 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 288/592] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:38.183266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:38.183907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:38.184240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:38.184557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:38.185284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] RBAC: Adding query filter params (interface=public, service_id=d0e22d6d8918427fa063116400fdc186, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:38.185596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:38.187075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35778a5-83d4-4bb9-9cc7-c9771dab576e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:38.197074 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 305/593] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:31:37 2022] GET /identity/v3/endpoints?service_id=d0e22d6d8918427fa063116400fdc186&interface=public®ion_id=RegionOne => generated 194 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:38.203181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:38.265022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:38.341661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b184283-b1a8-4236-8b32-40c931ddeff7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:38.377201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6287a-60be-48fe-92fb-2511a757fe65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:38.377827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6287a-60be-48fe-92fb-2511a757fe65 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:38.378120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6287a-60be-48fe-92fb-2511a757fe65 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:38.378417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6287a-60be-48fe-92fb-2511a757fe65 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:38.379062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6287a-60be-48fe-92fb-2511a757fe65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:38.380498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6287a-60be-48fe-92fb-2511a757fe65 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:38.386215 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 289/594] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:31:38 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:38.714273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9952f-d8e5-480f-babd-0085ad8c82d3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:38.714674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9952f-d8e5-480f-babd-0085ad8c82d3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:38.714863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9952f-d8e5-480f-babd-0085ad8c82d3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:38.716178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 306/595] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:38.722021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2852-c1fa-4426-a797-c01367e847f9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:38.722382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2852-c1fa-4426-a797-c01367e847f9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:38.722662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a2852-c1fa-4426-a797-c01367e847f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:38.744016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3d4a2852-c1fa-4426-a797-c01367e847f9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:38.745231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d4a2852-c1fa-4426-a797-c01367e847f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:38.831855 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 290/596] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:39.227999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9952f-d8e5-480f-babd-0085ad8c82d3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:39.275392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b413-81b0-4fe5-8d74-1e16c0f43432 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.275392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b413-81b0-4fe5-8d74-1e16c0f43432 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.275392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b413-81b0-4fe5-8d74-1e16c0f43432 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.277033 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 291/597] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:39.282378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca2c7-8bbe-4c01-ad23-9ce1c9c6d1df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.282656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca2c7-8bbe-4c01-ad23-9ce1c9c6d1df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.282926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca2c7-8bbe-4c01-ad23-9ce1c9c6d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.303101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:39.314811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd7ca2c7-8bbe-4c01-ad23-9ce1c9c6d1df None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:39.316075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd7ca2c7-8bbe-4c01-ad23-9ce1c9c6d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:39.350411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9952f-d8e5-480f-babd-0085ad8c82d3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:39.369600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:39.388573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:39.389581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.390076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.390555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.402855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:39.408091 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:39.409003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:31:39.410187 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:39.412947 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 307/598] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:39.418534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:39.433073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 292/599] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:39.590988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f1f2f-5dbd-4245-8ec8-8801b498b18a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:39.611366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:39.633144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:39.633755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.634052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.634319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.634984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:39.635283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:39.636705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:39.637190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eeea7-0ffb-4df0-9a5e-bffcf09e03a0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.637473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eeea7-0ffb-4df0-9a5e-bffcf09e03a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.637741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109eeea7-0ffb-4df0-9a5e-bffcf09e03a0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.640271 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 293/600] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:39.644555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.644839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.645115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.648063 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 308/601] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:39.654512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:39.686061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:39.688203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:39.813766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 294/602] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:39.822295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a48cf-f3e1-47ad-9d52-ab1853053090 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:39.861279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:39.862344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:39.862855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:39.863345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:39.871640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:39.882154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:39.884598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:39.905106 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:39.906152 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:39.907044 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:39.907044 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:39.907044 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:39.909226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 309/603] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:39.918547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:39.994065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.050289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621fa03-594f-4489-9ea5-b8b493fa3b34 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.055266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.090432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e52321-163d-423b-8e6c-01583061f232 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.126640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.127674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.128143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.128697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.129516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:40.129897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.130274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.130654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.130931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.131203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.132520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.141784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:40.146613 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:40.147553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:31:40.148396 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:40.153942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 295/604] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:40.153942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.154504 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 310/605] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:40.155902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.258076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe48b3-9cfd-4ad5-bf2a-8de935ebf9cc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.270210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812498da-0bc3-47fe-b937-b70f35714cf2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.274518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.294341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.295001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.295250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.295522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.296167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.297720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:40.307248 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:40.308257 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 02:31:40.309080 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:40.313539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 296/606] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:40.314645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.315718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.316597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.317071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.317828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.319711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:40.320246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.321843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.333021 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 311/607] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:40.334173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.346513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.428434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab5dc9-15ce-4c49-96f6-5e3a94ce880b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.462990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.463742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.463926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.464190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.467908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dad26-4c76-4556-bde9-b5df1a0b1d55 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.472829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.474323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:40.486246 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:40.487278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 297/608] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:40.488357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.518670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.520293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.520796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.521446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.522256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:40.522922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.525127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.532212 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 312/609] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:40.533202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.572995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.591560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.618363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4cd0-0c25-4db4-8b35-65fdefaf198f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.663205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7169e4-1594-484f-9ff3-c0c0e4663888 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.664071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.664920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.665599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.666107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.680053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.681764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:40.696733 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:40.697875 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:40.698944 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:40.698944 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:40.698944 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:40.705139 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 298/610] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:40.706583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.709022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.710264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.710691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.711125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.713132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:40.713636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.715436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.748830 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 313/611] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:40.748830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.831240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.843569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ba1d0-7c62-4cdb-89bf-ee6f912d07a2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.858085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a549e-e10e-4de7-949a-48e3efc820f7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:40.877937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.878630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.879016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.879292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.879917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:40.880224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.881625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.882905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:40.887277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 299/612] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:40.888330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.892345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:40.892953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.893226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.893490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.894279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:40.894605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:40.896066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a89026b-28bf-4b80-b25c-024fdc1f0600 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:40.907716 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 314/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:40.909108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea0c5-0992-4978-b012-a6febb27afd4 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.909363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea0c5-0992-4978-b012-a6febb27afd4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.909658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea0c5-0992-4978-b012-a6febb27afd4 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.910887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 315/614] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:40.911885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663e06-bec4-4f11-af6e-7edd49d07c67 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:40.912172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663e06-bec4-4f11-af6e-7edd49d07c67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:40.912409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663e06-bec4-4f11-af6e-7edd49d07c67 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:40.913747 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 316/615] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:40.914307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663e06-bec4-4f11-af6e-7edd49d07c67 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:40.994543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255453d6-c765-407f-99f2-cb6a86907a29 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.014304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663e06-bec4-4f11-af6e-7edd49d07c67 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.028046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d5fed-22ee-4bba-aded-405e33827dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.028746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d5fed-22ee-4bba-aded-405e33827dd2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.029020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d5fed-22ee-4bba-aded-405e33827dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.029284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d5fed-22ee-4bba-aded-405e33827dd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.048124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.048721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.048996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.049264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.049938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.051416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.059899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.072998 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 317/616] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:31:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:41.073904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.096322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.100688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d5fed-22ee-4bba-aded-405e33827dd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.102434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d5fed-22ee-4bba-aded-405e33827dd2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.214715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23666000-311d-429f-a869-3b34ba88f3c9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.228069 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 300/617] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:31:41.228069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.228069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.228069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.245871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:41.247382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:41.260404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.261762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.261762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.261762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] PATH_INFO: `/v3/users/swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.269135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.270819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-057b4e68-33e3-4c17-bc69-d51c12915f65 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:41.285975 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:41.287161 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:41.288331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 318/618] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:41.289060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.289060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.289217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.307096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:41.308303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:41.326822 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 301/619] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:41.328336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.363966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.364583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.393975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 319/620] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:41.395408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.456365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e87f1-e739-439b-82e1-59e96e932295 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.493921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.494887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.495362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.495844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.508433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.510184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:41.526231 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:41.527280 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:41.528168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:41.528168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:41.528168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:41.530705 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 302/621] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:41.536205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.626715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.648762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d12be-dfbd-4ea3-922e-a4530cef7dfd None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.651921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfc0f6-1314-4b77-82a5-d5968eecb88f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.686195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.686977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.687261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.687531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.688348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:41.688652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.688769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.689355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.689628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.689926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.690161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.690655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:41.690991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.692405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.704079 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 303/622] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:41.705858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.713568 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 320/623] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:41.715344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.757178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.805493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955e00-5ae6-47a4-88ce-313ae16d1749 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.821019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ca9be-a3ce-4949-a439-4ad011e9864a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:41.843857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.844477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.844788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.845018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.845664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.847136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.857390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:41.858100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:41.858417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:41.858584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:41.858695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] PATH_INFO: `/v3/services/network` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:41.859338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:41.861165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:41.864227 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 304/624] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:41 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:41.864970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:41.882936 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:41.884208 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 02:31:41.885263 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:41.893308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 321/625] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:41.895147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:41.994131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d302f-59f6-434e-bba9-24ed2aae6b2b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.035345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.036077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.036470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.036749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5ec66-c8f3-419a-a603-4286bebb0f35 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.036916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.039456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.045010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.046572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:42.061103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:42.062103 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 305/626] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:42.063415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.084117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.084743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.085015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.085281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.137838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.172876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.174530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.194730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ad365-a2ad-443b-af39-99e1fe642fc9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.246570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.247611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.247952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.248305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.249005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] RBAC: Adding query filter params (name=network) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:42.249372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.250844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.255966 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 306/627] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:42.256925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.296161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 322/628] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:41 2022] GET /identity/v3/auth/tokens => generated 1112 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:31:42.296951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.299635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.362702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab09e-bc23-45d9-bb07-12ebc9818c2b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.387939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.405957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.406676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.406954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.407223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.408077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:42.408390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.410519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.418314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a65dd-e045-4850-91bf-b312ae33cf48 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.426461 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 307/629] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:42.426639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.461685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.462718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.463152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.463675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.464473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] RBAC: Adding query filter params (type=network) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:42.464958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.466741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.473275 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 323/630] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:42.474842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.549410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.551451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bcc8d-d711-494f-b3ed-23c6ca3c4810 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.588487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60fcf3-5152-487b-8ea4-66213716c875 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.594681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.595544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.596101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.596682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.607849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.609560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.624799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.625410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.625687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.626012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.626977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=fbb367d26b64430385f8032099f9e311) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:42.627288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:42.628418 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:42.629318 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:42.630222 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:42.630222 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:42.630222 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:42.630405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.632753 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 308/631] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:42.633943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.635685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 324/632] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/role_assignments?user.id=fbb367d26b64430385f8032099f9e311&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:42.638040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.672606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.808442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed14133-36cf-4c16-b69a-661c4d27e9ee None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.835309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002bdc-322e-4526-bc9c-e2d849c23caa None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:42.860870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:42.870845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.871687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.872962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.873385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.874505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:42.874976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.876818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.887604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:42.888369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:42.888739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:42.889102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:42.889951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:42.891376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:42.893440 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 325/633] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:42.900328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:42.918759 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 309/634] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:31:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:43.024508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f11ad6-afa9-4a95-b893-b404783cacdf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:43.069712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:43.070300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:43.070578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:43.070849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:43.078257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:43.079855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:43.092438 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:43.093382 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:43.094302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 326/635] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:43.101471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:43.223668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:43.245015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336de444-7852-4029-920e-a17c667a7ce9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:43.280975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:43.281596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:43.281898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:43.282170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:43.282860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:43.283162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:43.284628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93bb82-d3fb-4e57-957b-bf94de6775fd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:43.297848 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 310/636] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:43.304889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:43.325638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad033f1-7ac5-4af6-b1a4-326a8a5f436b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:43.325845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad033f1-7ac5-4af6-b1a4-326a8a5f436b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:43.326111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad033f1-7ac5-4af6-b1a4-326a8a5f436b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:43.327591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 311/637] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:43.334074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:43.334348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:43.334622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:43.359148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:43.361211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:43.368728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:43.443431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5398ae-251d-47c7-866f-5ab3b468899b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:43.453461 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 312/638] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:43 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:43.489345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:43.490011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:43.490293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:43.490562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:43.491293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=5f8edd4b12d54ce39915d2e9831b3d88) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:43.491601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:43.493045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:43.501266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 327/639] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:43 2022] GET /identity/v3/role_assignments?user.id=5f8edd4b12d54ce39915d2e9831b3d88&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:43.730897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:43.810619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:43.833794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92ee23-be33-439c-bcb2-c26ec7835a30 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:43.870119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:43.870771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:43.871110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:43.871387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:43.872288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:43.873683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:43.883679 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:43.884739 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:43.885602 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 313/640] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:43.893307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:43.996340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04eaf9-07f7-45f8-97e7-7f55715f7715 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:44.007501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:44.036365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:44.036984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:44.037289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:44.037528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:44.038187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:44.038493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:44.039864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d1bac-bedc-420b-9297-eb621e5bfab1 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:44.044977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 328/641] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:44.050991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:44.160324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213c209-eec2-407c-a4ee-9a6127f91821 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:44.194987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:44.195602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:44.195883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:44.196159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:44.196791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:44.197096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:44.198509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61c6b-0b04-4a95-a2f7-7333ad9fb4c3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:44.203463 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 314/642] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:44.247833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca649de-71e7-4e44-a50a-eafda51a248e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:44.248009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca649de-71e7-4e44-a50a-eafda51a248e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:44.248271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca649de-71e7-4e44-a50a-eafda51a248e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:44.249920 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 329/643] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:44.255678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:44.255993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:44.256246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:44.270213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:44.276677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:44.277947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:44.353717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 315/644] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:44 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:44.616389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca649de-71e7-4e44-a50a-eafda51a248e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:44.727201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca649de-71e7-4e44-a50a-eafda51a248e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:44.763349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:44.763990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:44.764268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:44.764539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:44.765125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:44.766531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:44.776042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:44.776977 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:44.777885 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 330/645] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Oct 29 02:31:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:44.783196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:44.884712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12bf63a-5bde-4f3b-8fed-348229dd8967 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:44.918765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:44.919385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:44.919661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:44.919932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:44.920560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:44.920861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:44.922282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:44.924085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:44.927366 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 316/646] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:44.933096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:44.978320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:45.042990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd191c74-ae56-4f81-a4d9-39ca379896db None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:45.081250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:45.081977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.082260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.082534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.083181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:45.083486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:45.084904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be1403-571e-4ffc-bcf5-a8c7af6be4b2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:45.090889 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 331/647] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:45.096412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:45.177703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f0054-6ce6-4348-8656-51b5bcf69691 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.177949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f0054-6ce6-4348-8656-51b5bcf69691 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.178212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f0054-6ce6-4348-8656-51b5bcf69691 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.180756 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 332/648] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:45.184611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.184890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.185159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.203588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:45.204374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b0c8-7057-4614-aa14-25e1973a2d82 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:45.204768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:45.245776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:45.246433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.246711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.247547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.249160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] RBAC: Adding query filter params (interface=public, service_id=2ed4fdef3bfb4923a362856276527fd3, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:45.249529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:45.251060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:45.261302 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 317/649] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:31:45 2022] GET /identity/v3/endpoints?service_id=2ed4fdef3bfb4923a362856276527fd3&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:45.270788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:45.289904 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 333/650] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:45.335793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:45.380257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d29a1-5012-463f-a2f0-06aac5a433cc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:45.413996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:45.414617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.414895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.415166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.415771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:45.417154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:45.422966 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 318/651] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:31:45 2022] GET /identity/v3/services => generated 1029 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:31:45.559902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:45.592953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:45.670428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e50ff-e977-4e18-88d2-b23bced0cf49 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:45.705780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:45.706842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.707422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.707909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.718646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:45.723715 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:45.724628 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:31:45.725465 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:45.728088 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 334/652] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:31:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:45.733885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:45.838115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99593090-5900-42a7-8231-e19f3764f16c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:45.867021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:45.875649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:45.876706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.877399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.878076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.878802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:45.879162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:45.880550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ca330-d72e-42b3-98f8-ab34ababc06e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:45.889360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 319/653] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Oct 29 02:31:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:45.894917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:45.927035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b018b6-0510-4cce-901e-78e8389c3ccb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.927351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b018b6-0510-4cce-901e-78e8389c3ccb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.927593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b018b6-0510-4cce-901e-78e8389c3ccb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.929209 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 320/654] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:45.934579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:45.934865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:45.935142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:45.953897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:45.955103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:45.990562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:46.000323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec2d30-ad3c-4c94-9469-f692a2d4012c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.037957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 321/655] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:46.042612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.043376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.043743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.044099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.054903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.056413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:46.070773 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:46.071726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:46.072645 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:46.072645 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:46.072645 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:46.076628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 335/656] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:46.078100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.179490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc53a4-6a39-4ed2-9000-f5eb957020d0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.200318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:46.215409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.216031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.216311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.216585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.217234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:46.217541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.218966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.231591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 322/657] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:46.236762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.344991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.350944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec22c88-7d84-45b3-9bf6-ce661a62bf66 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.389046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.389694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.390017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.390278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.399305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.400784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-907625a0-af6a-4225-b264-a764f2766558 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:46.414046 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:46.415081 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:46.416026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 336/658] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:46.416605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edca80-6aa4-4ae5-b7b6-ad51622e1fad None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.417382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edca80-6aa4-4ae5-b7b6-ad51622e1fad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.417382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edca80-6aa4-4ae5-b7b6-ad51622e1fad None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.418389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 337/659] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:46.422497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edca80-6aa4-4ae5-b7b6-ad51622e1fad None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.427240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:46.459851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d04e94-d055-4f64-8a5e-3a9b9ccb8a96 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.493103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.493735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.494039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.494313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.495017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.496273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-bf29244d-8fe9-4f5e-8a65-674051e2fb22 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:46.505485 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:46.506513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:46.510876 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 323/660] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:46.511652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.511652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.511652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.528088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:46.529257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:46.539349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edca80-6aa4-4ae5-b7b6-ad51622e1fad None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.575045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:46.583786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.584423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.584701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.584974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.585701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:46.586063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.587531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.603635 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 324/661] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:46 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:46.610826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 338/662] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:46.611863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.612274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.695870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:46.720898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85799dad-5645-4f26-ab96-5fe333221158 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.748671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8144-dd59-4bfc-9c00-8d385ec306ed None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.758022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.758726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.759487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.759487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.760192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:46.760561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.762159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.767308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 325/663] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:46.775519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.796520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.797754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.798194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.798600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.812360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.814299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.820634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:46.835780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:46.836938 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:46.838047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:46.838047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:46.838047 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:46.844944 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 339/664] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:46.847186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.893032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeb497-9600-48e5-af1d-5c919fae0522 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.927026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:46.927638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:46.927910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:46.928187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:46.928814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:46.929117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:46.930521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:46.942421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 326/665] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:46.942421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:46.966864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527556e9-8c02-4fd9-8573-f960d815c920 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:46.982844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:47.005926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:47.006934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.007387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.007857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.008720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:47.009297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:47.010921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:47.024270 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 340/666] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:47.030633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:47.076216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa0d27-85aa-46cb-9389-9bb43150b263 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:47.080580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:47.138898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:47.139825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.140537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.140808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.142050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:47.143441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:47.164601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 327/667] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:46 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:47.168468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eaa8f6-78cd-4c49-b282-98f5bdee82e3 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:47.217261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:47.217989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.218266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.218531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.226535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:47.228064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:47.241312 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:47.242309 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:47.243228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 341/668] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:47.251006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:47.368147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094a28c-0b3a-4aac-9180-3fb45e8510e4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:47.403291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:47.404014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.404353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.404683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.405407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:47.405711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:47.407184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80814bd6-76e3-416c-8a90-950409120b84 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:47.420296 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 328/669] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:47.426970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:47.459986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:47.536329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3c72c-e608-4c4b-8589-a5c2596ded59 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:47.573365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480d216-495b-468c-93ae-0f2e9839aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:47.574081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d216-495b-468c-93ae-0f2e9839aa08 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.574355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d216-495b-468c-93ae-0f2e9839aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.574671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480d216-495b-468c-93ae-0f2e9839aa08 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/fbb367d26b64430385f8032099f9e311/roles/b8216b729e1a4b9db06cd0984b0480c9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.576991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480d216-495b-468c-93ae-0f2e9839aa08 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=fbb367d26b64430385f8032099f9e311, role_id=b8216b729e1a4b9db06cd0984b0480c9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:47.578622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480d216-495b-468c-93ae-0f2e9839aa08 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:47.597362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 342/670] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:31:47 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/fbb367d26b64430385f8032099f9e311/roles/b8216b729e1a4b9db06cd0984b0480c9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:31:47.690353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1b411-075e-45e5-a896-7b81c783f4b7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.690876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1b411-075e-45e5-a896-7b81c783f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.691293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1b411-075e-45e5-a896-7b81c783f4b7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.693463 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 329/671] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:47.699192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:47.699713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:47.699713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:47.721082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:47.722655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:47.803548 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 343/672] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:48.075238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1b411-075e-45e5-a896-7b81c783f4b7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:48.099718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:48.179890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1b411-075e-45e5-a896-7b81c783f4b7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:48.214099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:48.214726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:48.214997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:48.215261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:48.215836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:48.217202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:48.225958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:48.226862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:48.227862 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 330/673] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Oct 29 02:31:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:48.233118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:48.255563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:48.335285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d3665-db55-43d4-9ecc-057fc08d78b9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:48.369345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:48.369983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:48.370259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:48.370522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:48.371140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:48.371435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:48.373113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:48.378131 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 344/674] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:48.386905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:48.472359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:48.487103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339534c-1a6e-426c-99b6-5a8bcdf0fa2a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:48.521505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:48.522159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:48.522438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:48.522710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:48.523398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:48.523700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:48.525129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a5f85-c072-4898-9ec9-9de302be625c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:48.530427 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 331/675] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:48.536295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:48.621628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:48.638328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82742ece-5b98-4f2f-be89-85a9ce9e4187 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:48.672608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f568-aac1-47ae-badb-06b3800faecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:48.673213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f568-aac1-47ae-badb-06b3800faecd None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:48.673490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f568-aac1-47ae-badb-06b3800faecd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:48.673763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f568-aac1-47ae-badb-06b3800faecd None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:48.674548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017f568-aac1-47ae-badb-06b3800faecd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:48.676057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017f568-aac1-47ae-badb-06b3800faecd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:48.697306 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 345/676] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:31:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:49.285066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15630f-a9d5-487f-b4cd-2c72d87d057b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.286120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15630f-a9d5-487f-b4cd-2c72d87d057b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.286623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15630f-a9d5-487f-b4cd-2c72d87d057b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.288451 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 332/677] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:49.294198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674fe0-0191-4c1d-b2c4-2dbda4e1b967 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.295050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674fe0-0191-4c1d-b2c4-2dbda4e1b967 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.295517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674fe0-0191-4c1d-b2c4-2dbda4e1b967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.315640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0f674fe0-0191-4c1d-b2c4-2dbda4e1b967 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:49.317427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f674fe0-0191-4c1d-b2c4-2dbda4e1b967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:49.399625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 346/678] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:49.428387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c972-0df7-4335-be1d-e37d62cf0de4 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.429014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c972-0df7-4335-be1d-e37d62cf0de4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.429487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2c972-0df7-4335-be1d-e37d62cf0de4 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.431374 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 333/679] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:49.437004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.437286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.437846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.457064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:49.458672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:49.519968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:49.527460 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 347/680] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:49.686950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2c972-0df7-4335-be1d-e37d62cf0de4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:49.795281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:49.795712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2c972-0df7-4335-be1d-e37d62cf0de4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:49.830249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a360e-cc34-4fb1-a51a-1b5b418fa4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:49.830780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a360e-cc34-4fb1-a51a-1b5b418fa4dd None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.831053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a360e-cc34-4fb1-a51a-1b5b418fa4dd None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.831346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a360e-cc34-4fb1-a51a-1b5b418fa4dd None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.832142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a360e-cc34-4fb1-a51a-1b5b418fa4dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:49.833505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a360e-cc34-4fb1-a51a-1b5b418fa4dd None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:49.853047 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 334/681] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:49 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:49.890275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee072ce-a5f6-4857-9a0d-d91c32f87663 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.890905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee072ce-a5f6-4857-9a0d-d91c32f87663 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.891413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee072ce-a5f6-4857-9a0d-d91c32f87663 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.893318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 335/682] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:49.899403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.900554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.901053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.913950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e6acd-f0b2-487b-85a6-327dfdc75248 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:49.926543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:49.928690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:49.933132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:49.960518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:49.961344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:49.961686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:49.962068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:49.962659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:49.964051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:49.974717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:49.975815 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:49.982021 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 348/683] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:49.982876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.045826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 336/684] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:50.053360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:50.108054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c61eb-822b-4a98-aee0-3b8554396c83 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.145052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.145669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.145976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.146244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.146871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:50.147170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:50.148526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:50.153679 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 349/685] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:50.159252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.267468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e39f2d-6fea-4645-9f13-6af72341c40d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.304969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.306526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.307025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.307540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.309364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.309762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:50.309876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:50.311244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:50.317149 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 337/686] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:50.323866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.329567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:50.423275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec6ea-ed6f-4816-8dec-562493756b3b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.433317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dbb5-321a-462b-9695-f766794dd146 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.444758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:50.462738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.463717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.464135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.464634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.474497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.475427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.475915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.476280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.476928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:31:50.477189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] RBAC: Adding query filter params (interface=public, service_id=e164c52d93c94794b5c32ea43667c7d4, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:50.477589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:50.479235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:31:50.483875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:50.485016 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:31:50.485860 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:50.488424 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 350/687] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:50.489966 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 338/688] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/endpoints?service_id=e164c52d93c94794b5c32ea43667c7d4&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:50.493877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.496570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.586229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:50.616489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ed53e-029f-478a-9627-30fc998ab86c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.629404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66face1-ce64-4e4b-96a4-6931393f5889 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.662691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.663345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.663998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.664283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.664956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:50.665258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:50.666682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:50.667298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.668163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.668635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.669098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.669922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:50.671502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:50.686105 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 351/690] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:50.686333 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 339/690] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:31:50.691260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.742064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:50.809476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa79169f-657d-4002-b34c-f5c0f3292de9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:50.850518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:50.851172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.851450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.851718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.865067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:50.866612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-26328d73-51b6-42ec-b195-bec3b66d713c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:50.883419 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:50.884499 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:50.885385 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:50.885385 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:50.885385 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:50.885385 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 352/691] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:50.890655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:50.923398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc2b52-21a0-43d2-b6ab-43e7a386a4f6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.923730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc2b52-21a0-43d2-b6ab-43e7a386a4f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.923945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc2b52-21a0-43d2-b6ab-43e7a386a4f6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.925456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 353/692] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:50.930705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:50.930997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:50.931256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:50.954924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:50.956504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:51.005672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b56a6b0-4e2c-40b5-93c4-91cfc1705cb0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.037583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:51.043969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.044831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.045320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.045821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.046666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:51.053823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.053961 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 354/693] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:51.054042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.064318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 340/694] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:51.071183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.097714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:51.174392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9493a8-d40b-4038-89b0-82d0854d4638 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.210139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.210757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.211038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.211306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.218804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.220304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:31:51.232428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:51.233374 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:51.234326 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 355/695] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:51.239669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.332198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.346318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ba46e-19e0-4f11-a08e-e74689216b80 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.383453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.384406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.384874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.385333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.386355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:51.386868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.388571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.407821 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 341/696] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:51.413399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.441470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:51.464609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f239c9-874e-4bdc-ab11-149a843b3f89 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.473461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:51.504247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.505235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.505704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.506203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] PATH_INFO: `/v3/services/compute` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.507010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.508587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:51.517892 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:51.519170 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:31:51.520002 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:51.527443 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 356/697] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:51.528707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.535573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e10ea-4746-4448-9d31-9dec1e868999 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.573031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.573990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.574477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.574935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.652647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1ca3-c9f8-4db7-9b34-23207c07f83a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.657679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.659161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.689536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.690512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.691025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.691500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.692374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:51.692915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.694560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.699747 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 357/698] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:51.707756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.719028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:51.725417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:51.782638 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 342/699] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 29 02:31:51.783877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:51.836368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5980bd-5f06-4b77-a9dd-aacf30919fd9 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.872873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.873995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.874466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.874926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.875737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:51.876249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.877787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.883156 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 358/700] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:51.908127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15c889-f8c8-4c43-a39f-3039da5ae19b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:51.955350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:51.956011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:51.956339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:51.956645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:51.968979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:51.970652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-425f4987-0368-46fd-9b0a-5216f82a2c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:31:51.987413 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:51.988428 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:31:51.989384 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:31:51.989384 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:31:51.989384 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:51.989384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 343/701] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:51.995801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.089939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:52.118475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec605cc-0e1f-425e-85cb-1392c3a1a2c7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:52.158721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:52.159735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.161489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5df2-5027-4aef-b9b5-279a753efa06 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.161761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5df2-5027-4aef-b9b5-279a753efa06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.162063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5df2-5027-4aef-b9b5-279a753efa06 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.163545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 344/702] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:52.163648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.163914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.164718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:52.165027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:52.166671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:52.170052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.170379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.170616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.179136 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 359/703] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:52.184661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:52.186472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.197625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:52.199651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:52.298546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b3c08-479e-4079-9e10-1719560b06d7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:52.305991 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 345/704] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:52.339281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:52.339956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.340184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.340447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.343671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:52.348549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:52.350363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:52.362399 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:52.363448 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:52.364717 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 360/705] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:52.369700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.471492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71d5a9-5e69-4bb7-a935-98cb049d83f1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:52.502423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:52.507593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:52.508626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.509262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.509844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.510865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:52.511172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:52.512610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:52.525248 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 346/706] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:52.530870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.600771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.645600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff37066-990c-4cb9-819a-ae15df28f779 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:52.687712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:52.688708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.689182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.689657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.690713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] RBAC: Adding query filter params (role.id=b8216b729e1a4b9db06cd0984b0480c9, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=fbb367d26b64430385f8032099f9e311) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:52.691264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:52.693631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:52.701079 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 361/707] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:31:52 2022] GET /identity/v3/role_assignments?user.id=fbb367d26b64430385f8032099f9e311&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=b8216b729e1a4b9db06cd0984b0480c9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:52.715786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f58b3-ba66-4b7b-a641-f5fdbcc08a9f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:52.756008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:52.757039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.757541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.758110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.758973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:52.760672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:52.771586 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:52.772686 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:52.773521 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:52.776495 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 347/708] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:52.782341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.851665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:52.904936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443fc87-f536-4dbc-b842-c23b82856ef4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:52.942573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:52.943187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.943460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.943726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.944343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:52.944640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:52.946032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaabd64-0f7a-4b13-b321-ce8e94eef903 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:52.951136 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 362/709] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:52.956856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:52.964281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02bed-0d21-4215-88bb-1be277856e74 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.964567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02bed-0d21-4215-88bb-1be277856e74 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.964847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02bed-0d21-4215-88bb-1be277856e74 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.966346 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 363/710] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:52.972034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:52.972213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:52.972412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:52.990653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:52.991864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:53.031754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:53.061781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 364/711] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:53.078415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fbaf1e-54b9-4031-a429-78f7e56131a1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.114348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.114878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.115155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.115426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.116056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:53.116361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.117738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:53.123506 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 348/712] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:53.129322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:53.191866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:53.238607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9514ec9-4b00-4c2e-95e5-f785b0928e1e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.274050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.274665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.274943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.275213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.275922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] RBAC: Adding query filter params (interface=public, service_id=de468979f54f4450a342db4acd0c60c1, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:53.276230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.277594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:53.283358 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 365/713] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:31:53 2022] GET /identity/v3/endpoints?service_id=de468979f54f4450a342db4acd0c60c1&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:31:53.289451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:53.332339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:53.404206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f20b1-e6a5-4783-b1a5-191a830a73ce None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.427340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:53.444082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f299b1-4d8f-4c2e-9477-1c6300818c1c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.444566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.444972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.445342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.445706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.446452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.449041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:53.457848 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 349/714] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:31:53 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:31:53.471245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:53.493328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.494385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.494864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.495325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.496122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.498145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:53.508955 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:53.510072 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 02:31:53.510903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:53.517939 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 366/715] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:53.520949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:53.640244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d14c7-8520-4ab7-b07b-40c91341a1ec None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.677314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.677875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.678157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.678430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.679055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:53.679356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.680719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:53.686067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 350/716] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:53.692846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:53.801456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373ede4-7431-4d99-99b3-e314d496b8e5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.838182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.838802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.839081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.839348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.839980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:53.840284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.841661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955a098-9466-4579-8271-5bfd4f248cd3 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:53.847355 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 367/717] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Oct 29 02:31:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:53.852573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:53.904017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:53.957094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd92e7-2a89-4527-9808-3ad783892b56 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:53.992043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930a1ae-d91e-4f30-abc2-60c4cc5aee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:53.992660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a1ae-d91e-4f30-abc2-60c4cc5aee7b None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:53.992939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a1ae-d91e-4f30-abc2-60c4cc5aee7b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:53.993262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930a1ae-d91e-4f30-abc2-60c4cc5aee7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:53.994028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a1ae-d91e-4f30-abc2-60c4cc5aee7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:53.995547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930a1ae-d91e-4f30-abc2-60c4cc5aee7b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:54.020422 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 351/718] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:31:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:54.177566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01bb6a-c25b-42c8-b0d0-cbfc6b27d1be None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:54.177942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01bb6a-c25b-42c8-b0d0-cbfc6b27d1be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:54.178140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01bb6a-c25b-42c8-b0d0-cbfc6b27d1be None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:54.179521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 368/719] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:54.185400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31abc-85a5-405c-b181-431fdacce387 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:54.186030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31abc-85a5-405c-b181-431fdacce387 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:54.186506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe31abc-85a5-405c-b181-431fdacce387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:54.208657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9fe31abc-85a5-405c-b181-431fdacce387 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:54.210221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9fe31abc-85a5-405c-b181-431fdacce387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:54.290630 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 352/720] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:54.569045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01bb6a-c25b-42c8-b0d0-cbfc6b27d1be None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:54.620253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:54.678576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01bb6a-c25b-42c8-b0d0-cbfc6b27d1be None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:54.713993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dc681-d222-43b0-875a-522ef5811145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:54.714606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dc681-d222-43b0-875a-522ef5811145 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:54.714883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dc681-d222-43b0-875a-522ef5811145 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:54.715154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dc681-d222-43b0-875a-522ef5811145 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:54.715817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dc681-d222-43b0-875a-522ef5811145 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:54.717181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dc681-d222-43b0-875a-522ef5811145 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:54.736374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 369/721] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:54 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:55.033281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a2d9-13ea-42e1-b6c3-53135b1192d9 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.033851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a2d9-13ea-42e1-b6c3-53135b1192d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.033851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a2d9-13ea-42e1-b6c3-53135b1192d9 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.036200 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 353/722] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:55.041719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.042046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.042324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.060759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:55.061994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:55.145957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 370/723] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:55.416778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2a2d9-13ea-42e1-b6c3-53135b1192d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:55.448671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:55.527261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2a2d9-13ea-42e1-b6c3-53135b1192d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:55.563933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:55.564784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.565210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.565742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] PATH_INFO: `/v3/services/image` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.566915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:55.568523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:55.577774 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:55.578986 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:31:55.580053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:55.587406 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 354/724] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Oct 29 02:31:55 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:55.588952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:55.622474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:55.702322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09a415-2c07-40e3-9eff-a5ee112f1baa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:55.741717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:55.742743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.743235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.743698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.744543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] RBAC: Adding query filter params (name=image) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:55.745068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:55.746657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17b91c-f885-4951-8aa8-6c55d3c88ffe None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:55.752465 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 371/725] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:55.758390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:55.838643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3b3a3-57ab-40a7-a345-182cea1c6e01 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.838979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3b3a3-57ab-40a7-a345-182cea1c6e01 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.839197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3b3a3-57ab-40a7-a345-182cea1c6e01 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.841857 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 372/726] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:55.846173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d593-3de4-40fb-8fd5-c2d7c7cfdeec None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.846419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d593-3de4-40fb-8fd5-c2d7c7cfdeec None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.846690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49d593-3de4-40fb-8fd5-c2d7c7cfdeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.863627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:55.868009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0f49d593-3de4-40fb-8fd5-c2d7c7cfdeec None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:55.869571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f49d593-3de4-40fb-8fd5-c2d7c7cfdeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:55.870135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e120-af6a-4689-a61a-78b4fbe7f795 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:55.912232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:55.912932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:55.913218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:55.913507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:55.914144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] RBAC: Adding query filter params (type=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:55.914449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:55.915984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:55.921866 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 355/727] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:31:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:55.954269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 373/728] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:56.232600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:56.253623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb238a-ac34-48ab-af83-67f01ea35874 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.253952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb238a-ac34-48ab-af83-67f01ea35874 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.254229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb238a-ac34-48ab-af83-67f01ea35874 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.255975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 374/729] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:31:56.260857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.261231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.261597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.283421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:56.285160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:56.311911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:56.344881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac219-a6b5-4b90-8e2a-b28e5b09188d None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:56.369925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 375/730] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:56.387839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:56.388842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.389337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.389830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.390616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:56.392374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:56.402678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:56.403741 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:56.404579 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:31:56.411678 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 356/731] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:56.414448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:56.521472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d04fb-a902-4238-99e7-6f6356d6dcb4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:56.555576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:56.556194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.556473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.556743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.557369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:56.557670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:56.559063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:56.568919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 376/732] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:56.570128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:56.596979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:56.634639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:56.658543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:56.686034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf4a3f-dd5d-40a4-bbd3-7260ab64effb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:56.724803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:56.725719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.726231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.726652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.727423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:56.727874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:56.729665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:56.735234 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 357/733] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:56.742343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:56.751889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884d9bf-b48b-4d3d-818d-3c072dd1578d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:56.791007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:56.791886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.792367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.792810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.793664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:56.795320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:56.798195 n-d-862964-4 devstack@keystone.service[82079]: WARNING keystone.server.flask.common [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 29 02:31:56.823265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 02:31:56.823265 n-d-862964-4 devstack@keystone.service[82079]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:31:56.823265 n-d-862964-4 devstack@keystone.service[82079]: [parameters: {'id': '8416ae77b13b4a308fd112dc0f36d7b5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 02:31:56.823265 n-d-862964-4 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8416ae77b13b4a308fd112dc0f36d7b5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8416ae77b13b4a308fd112dc0f36d7b5. Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:31:56.833727 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 02:31:56.834659 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Oct 29 02:31:56.835598 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:31:56.836481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 02:31:56.837405 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:31:56.838236 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'id': '8416ae77b13b4a308fd112dc0f36d7b5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:56.842507 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:56.844354 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8416ae77b13b4a308fd112dc0f36d7b5. Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 377/734] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Oct 29 02:31:56 2022] POST /identity/v3/projects => generated 262 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:31:56.846470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:56.863667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:56.881019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b352811-2d7f-4899-b2dc-f9783946b0b7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:56.921550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60738e5-d638-4592-891c-0c995cd95a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:56.922637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738e5-d638-4592-891c-0c995cd95a66 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.923238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738e5-d638-4592-891c-0c995cd95a66 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.923698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60738e5-d638-4592-891c-0c995cd95a66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.924726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738e5-d638-4592-891c-0c995cd95a66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:56.926629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60738e5-d638-4592-891c-0c995cd95a66 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:56.953135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:56.957151 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 358/735] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:31:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:31:56.957151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65b37-cf4c-4b8f-8797-e4cd0b981d64 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.957151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65b37-cf4c-4b8f-8797-e4cd0b981d64 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.957151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e65b37-cf4c-4b8f-8797-e4cd0b981d64 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.957151 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 359/736] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:56.962449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:56.962881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:56.963031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:56.982967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:56.984085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:56.985962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f7a59-18f6-4bb2-aacb-d6e8748ee5ec None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:57.045210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c46e0-c590-473b-9247-aec922899701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:57.045898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c46e0-c590-473b-9247-aec922899701 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:57.046178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c46e0-c590-473b-9247-aec922899701 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:57.046493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c46e0-c590-473b-9247-aec922899701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:57.056087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c46e0-c590-473b-9247-aec922899701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:57.057830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c46e0-c590-473b-9247-aec922899701 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:57.068936 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 360/737] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-440c46e0-c590-473b-9247-aec922899701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:31:57.073042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:57.073961 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:57.075497 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 378/738] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:57.080075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:57.162064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:57.194427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec1eda-2323-4989-9eee-aa3ea3bc3758 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:57.228183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:57.228794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:57.229065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:57.229334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:57.230019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:57.230313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:57.231829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:57.250141 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 361/739] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:57.339950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c46e0-c590-473b-9247-aec922899701 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:57.448196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c46e0-c590-473b-9247-aec922899701 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:57.478769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:57.484988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:57.485626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:57.485935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:57.486208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:57.486792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:57.488417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:57.497944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:57.498969 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:57.500233 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 379/740] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:31:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:57.505743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:57.625740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576f34-0253-4604-93f9-5dd6674c82a7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:57.656729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:57.662538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:57.663086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:57.663926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:57.664237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:57.664880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:57.665187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:57.666692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:57.672842 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 362/741] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:57.678647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:57.783408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebadac-5f38-4e6f-9812-c4a916baceb2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:57.819054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:57.819676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:57.819956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:57.820230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:57.820871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:57.821176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:57.822698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:57.828472 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 380/742] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:31:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:57.834514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:57.939124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479681-2b91-429e-ad69-5557f2e25c13 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:57.974156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:57.974774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:57.975056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:57.975329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:57.976036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] RBAC: Adding query filter params (interface=public, service_id=cff82aa2b60a46e28dda1d8a7245de7b, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:31:57.976344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:57.977731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badd2a77-8026-466d-9f08-dc6e4490ea0e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:57.983545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 363/743] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:31:57 2022] GET /identity/v3/endpoints?service_id=cff82aa2b60a46e28dda1d8a7245de7b&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:31:57.989062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:58.055477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:58.102930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b080035-5d21-4036-8d63-e30dc93d8130 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:58.139121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469bed-740d-40f5-9dfa-1212cb72756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:58.139830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469bed-740d-40f5-9dfa-1212cb72756c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:58.140117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469bed-740d-40f5-9dfa-1212cb72756c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:58.140385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469bed-740d-40f5-9dfa-1212cb72756c None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:58.141004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469bed-740d-40f5-9dfa-1212cb72756c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:58.142531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469bed-740d-40f5-9dfa-1212cb72756c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:58.150327 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 381/744] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:31:57 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:31:58.261309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475f03-9390-4163-a9a2-c18189cb3ffa None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:58.261892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475f03-9390-4163-a9a2-c18189cb3ffa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:58.261892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a475f03-9390-4163-a9a2-c18189cb3ffa None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:58.263681 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 364/745] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:58.270001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161441bc-4678-45f2-ac27-02a042022123 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:58.270343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161441bc-4678-45f2-ac27-02a042022123 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:58.270555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161441bc-4678-45f2-ac27-02a042022123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:58.290573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-161441bc-4678-45f2-ac27-02a042022123 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:58.292191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-161441bc-4678-45f2-ac27-02a042022123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:58.363615 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 382/746] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:58 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:58.637535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475f03-9390-4163-a9a2-c18189cb3ffa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:58.699815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:58.744149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a475f03-9390-4163-a9a2-c18189cb3ffa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:58.779167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9fcbe8-a689-4124-9fc1-3de81ee172a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:58.779785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fcbe8-a689-4124-9fc1-3de81ee172a0 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:58.780065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fcbe8-a689-4124-9fc1-3de81ee172a0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:58.780337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9fcbe8-a689-4124-9fc1-3de81ee172a0 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:58.781004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fcbe8-a689-4124-9fc1-3de81ee172a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:58.782413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9fcbe8-a689-4124-9fc1-3de81ee172a0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:58.805943 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 365/747] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:31:58 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:31:59.330872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4c21e-c282-4ee0-8e76-1e0ce61ad4a5 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:59.331447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4c21e-c282-4ee0-8e76-1e0ce61ad4a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:59.331648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4c21e-c282-4ee0-8e76-1e0ce61ad4a5 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:59.333246 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 383/748] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:59.338563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efad75-30d8-4e38-b0af-f2063008e650 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:59.338992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efad75-30d8-4e38-b0af-f2063008e650 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:59.339158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efad75-30d8-4e38-b0af-f2063008e650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:59.359065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56efad75-30d8-4e38-b0af-f2063008e650 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:59.360276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56efad75-30d8-4e38-b0af-f2063008e650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:59.437748 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 366/749] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:31:59.545916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181eac2-df27-4de7-8957-d1eddafa6799 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:59.546244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181eac2-df27-4de7-8957-d1eddafa6799 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:59.546467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181eac2-df27-4de7-8957-d1eddafa6799 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:59.550261 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 384/750] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:31:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:31:59.559550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:59.559831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:59.560099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:59.578675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:31:59.579864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:31:59.622219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:59.648153 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 367/751] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:31:59 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:31:59.717624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181eac2-df27-4de7-8957-d1eddafa6799 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:59.780321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:31:59.827086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181eac2-df27-4de7-8957-d1eddafa6799 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:31:59.862014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:31:59.862734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:31:59.863007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:31:59.863276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:31:59.863857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:31:59.865224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:31:59.874622 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:31:59.875579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:31:59.876431 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 385/752] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:31:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:31:59.881795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:31:59.922372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.004121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd1f93-dca2-4585-9ce7-35e455d7c0bc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.032588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7c792-46b1-4347-960a-c2846f6eabbd None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.049161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.049875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.050205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.050696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.051626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:00.052317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:00.052620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.054011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.061887 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 368/753] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:31:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:00.067109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.075774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.076518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.076892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.077259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.078036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.079673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.095213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 02:32:00.095213 n-d-862964-4 devstack@keystone.service[82079]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 29 02:32:00.095213 n-d-862964-4 devstack@keystone.service[82079]: [parameters: {'user_id': '3d7c01ffb75446a4a039b3e68acba4d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 29 02:32:00.095213 n-d-862964-4 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:32:00.104108 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:32:00.106078 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 02:32:00.108195 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:32:00.110188 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:32:00.111958 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:32:00.113117 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'user_id': '3d7c01ffb75446a4a039b3e68acba4d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:00.126415 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 29 02:32:00.127418 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 386/754] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Oct 29 02:31:59 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:00.129130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.130055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:00.180841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad869577-148a-4157-9b48-311807b008c1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.215880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.216607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.216946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.217272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.217996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:00.218360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.219792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.230141 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 369/755] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:32:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:00.231090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.231246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7a554a-a4cd-42be-a76a-9c93a127dd72 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.273668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.274362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.274644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.274914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.285743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.287445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:32:00.302112 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:00.303777 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 02:32:00.304970 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:00.308853 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 387/756] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:00.309950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.342130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985edfa-b018-40f6-9b21-687cdcb85e8c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.344648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:00.357127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:00.382838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.383766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.384233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.384692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.385585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] RBAC: Adding query filter params (interface=admin, service_id=de468979f54f4450a342db4acd0c60c1, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:00.386195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.387862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a2772-7eda-4a2f-9223-130f41652b39 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.393557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 370/757] 10.222.0.16 () {56 vars in 1249 bytes} [Sat Oct 29 02:32:00 2022] GET /identity/v3/endpoints?service_id=de468979f54f4450a342db4acd0c60c1&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:00.399150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f2e32-4830-493f-b9f2-8bd788e22592 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.399617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f2e32-4830-493f-b9f2-8bd788e22592 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.400045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f2e32-4830-493f-b9f2-8bd788e22592 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.401448 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 371/758] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:00.402374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f2e32-4830-493f-b9f2-8bd788e22592 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.428595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88acbbdd-8d4f-4958-b36c-25b6dc345465 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.464005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63144696-ef27-4340-8889-7c22d045983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.464614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63144696-ef27-4340-8889-7c22d045983c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.464893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63144696-ef27-4340-8889-7c22d045983c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.465161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63144696-ef27-4340-8889-7c22d045983c None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.465878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63144696-ef27-4340-8889-7c22d045983c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:00.466182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63144696-ef27-4340-8889-7c22d045983c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.467607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63144696-ef27-4340-8889-7c22d045983c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.506177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f2e32-4830-493f-b9f2-8bd788e22592 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:00.513888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 388/759] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Oct 29 02:32:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:00.513888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.513888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.513888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.531595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:00.533174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:00.560231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:00.560961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:00.561330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:00.561835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:00.562510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:00.563976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:00.573848 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 372/760] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:32:00 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:32:00.626810 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 389/761] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:00.899851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:00.932482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:01.009935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8740b5d-5db4-424e-bcbf-af28f19cc68a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.045558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.046214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.046490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.046753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] PATH_INFO: `/v3/services/compute` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.047328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.048689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-d09bf0a8-584d-4aac-9020-3cb4a66a7213 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:01.057702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:01.058675 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 02:32:01.059492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:01.061892 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 373/762] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:32:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:01.064769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.080371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792159d-2cac-4f95-b5df-1f6ffe0ff8d7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.080648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792159d-2cac-4f95-b5df-1f6ffe0ff8d7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.080922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792159d-2cac-4f95-b5df-1f6ffe0ff8d7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.082828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 374/763] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:01.088335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.088615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.088883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.096123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:01.108226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:01.109702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:01.173246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfbfc7-6436-4893-acb2-7f692dbbed5d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.189917 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 375/764] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:01 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:01.208289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.208898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.209169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.209434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.210083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] RBAC: Adding query filter params (name=compute) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:01.210383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.211752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.216688 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 390/765] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:32:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:01.222483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.251250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:01.326975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247bc91-0b18-467e-be83-3167f7397393 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.360807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.361584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.361771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.362054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.362847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:01.363149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.364520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.369547 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 376/766] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Oct 29 02:32:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:01.375551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.454064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.466820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:01.476688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200d660-bd7c-45fd-ab22-f9b9ab96aa41 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.520660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.521269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.521550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.521840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.522520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.523949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.548778 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 391/767] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:32:01 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:01.556631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:01.574097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e2289-3a14-46e4-8745-e6381de34df9 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.619225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.619887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.620162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.620428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] PATH_INFO: `/v3/services/image` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.621016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.622768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:01.632351 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:01.633416 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:01.639700 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 377/768] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Oct 29 02:32:01 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:01.642541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.758666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0149c-c5bb-4917-b874-3082867578f7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.792921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.793544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.793839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.794116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.794749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] RBAC: Adding query filter params (name=image) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:01.795048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.796488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.802008 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 392/769] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:01.807955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.910888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76beaa4f-aa0d-4921-b5c1-024e6d11f88f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:01.945613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:01.946476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:01.946910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:01.947337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:01.948093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] RBAC: Adding query filter params (type=image) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:01.948532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:01.950056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:01.960066 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 378/770] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:01.961665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:01.977853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:02.066890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee01735-eb07-4782-b510-c9d0f6c4ab6c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:02.100549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:02.101159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:02.101437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:02.101703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:02.102422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] RBAC: Adding query filter params (interface=public, service_id=9c330f7b494e4e83baf23cbeee7289b6, region_id=RegionOne) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:02.102730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:02.104077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4c0c6-f3c3-4650-b5cc-0e993c992cb8 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:02.111225 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 393/771] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:32:01 2022] GET /identity/v3/endpoints?service_id=9c330f7b494e4e83baf23cbeee7289b6&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:02.116907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:02.134327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:02.219683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00be37-d320-4f06-946e-05d36a64e134 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:02.253388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da464de1-6fbb-4593-ba20-1924696ed9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:02.254018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da464de1-6fbb-4593-ba20-1924696ed9e7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:02.254295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da464de1-6fbb-4593-ba20-1924696ed9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:02.254545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da464de1-6fbb-4593-ba20-1924696ed9e7 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:02.255140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da464de1-6fbb-4593-ba20-1924696ed9e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:02.256557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da464de1-6fbb-4593-ba20-1924696ed9e7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:02.263357 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 379/772] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:32:02 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:32:02.748255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266451a-805b-4a7b-9bec-44e665168dde None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:02.748788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266451a-805b-4a7b-9bec-44e665168dde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:02.748788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266451a-805b-4a7b-9bec-44e665168dde None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:02.750142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 394/773] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:02.755849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:02.756290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:02.756367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:02.775563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:02.776742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:02.843729 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 380/774] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:02 2022] POST /identity/v3/auth/tokens => generated 1822 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:03.106303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266451a-805b-4a7b-9bec-44e665168dde None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:03.187023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:03.213193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266451a-805b-4a7b-9bec-44e665168dde None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:03.247572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:03.248202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:03.248475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:03.248739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:03.249310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:03.250701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:03.259966 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:03.260986 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:03.262913 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 395/775] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Oct 29 02:32:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:03.267364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:03.277519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:03.369134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680b7d-13ae-453b-91b4-5174e137f85f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:03.403193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:03.403803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:03.404076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:03.404341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:03.404959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:03.405254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:03.406647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:03.416554 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 381/776] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:32:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:03.417703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:03.524205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812aa4e-dad5-4eaa-9c3a-070eddeb293b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:03.563199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:03.564798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:03.564798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:03.564798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:03.564798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:03.565326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:03.566828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498dc19-b951-4475-9d5e-fe87201d8bb4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:03.576650 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 396/777] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Oct 29 02:32:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:03.578177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:03.647144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:03.681998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adf9a0-1c85-4930-a0e5-3f24a31dbc44 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:03.718000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae62ba-849e-4c46-b6bc-0816290dafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:03.718602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae62ba-849e-4c46-b6bc-0816290dafd5 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:03.718876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae62ba-849e-4c46-b6bc-0816290dafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:03.719142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae62ba-849e-4c46-b6bc-0816290dafd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:03.719808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae62ba-849e-4c46-b6bc-0816290dafd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:03.721151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae62ba-849e-4c46-b6bc-0816290dafd5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:03.738430 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 382/778] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:32:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:03.785758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923701-66f3-4fb1-b8cb-561316ce4264 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:03.786356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923701-66f3-4fb1-b8cb-561316ce4264 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:03.786437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f923701-66f3-4fb1-b8cb-561316ce4264 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:03.787910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 397/779] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:03.793864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:03.794412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:03.794412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:03.813992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:03.815196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:03.896277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 383/780] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:03 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:04.157872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923701-66f3-4fb1-b8cb-561316ce4264 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.162053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:04.263410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f923701-66f3-4fb1-b8cb-561316ce4264 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:04.299370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e6fa9-a18f-4710-8664-d0f8d6a5f6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:04.300187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6fa9-a18f-4710-8664-d0f8d6a5f6e1 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.300463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6fa9-a18f-4710-8664-d0f8d6a5f6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.300728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e6fa9-a18f-4710-8664-d0f8d6a5f6e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.312684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e6fa9-a18f-4710-8664-d0f8d6a5f6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-540e6fa9-a18f-4710-8664-d0f8d6a5f6e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:04.317544 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:04.318596 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:04.319429 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 398/781] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:04.324771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.384873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:04.403410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4ff00-148e-4239-ad92-1af4341a5d76 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.403687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4ff00-148e-4239-ad92-1af4341a5d76 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.403955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4ff00-148e-4239-ad92-1af4341a5d76 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.405929 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 399/782] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:32:04.411537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.412014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.412269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.430504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b3e861-03ac-47be-bdbf-d019f3b0750b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:04.431432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:04.432631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:04.467487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:04.468109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.468384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.468650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.469339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:04.469621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:04.471053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:04.479265 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 384/783] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:04.484929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.496824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:04.513939 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 400/784] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:04.714447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967aaae1-293a-4b5e-89a3-2da6548eb70e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:04.734609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:04.751089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:04.751724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.751983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.752240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.762374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:04.763820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:04.771009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:32:04.778476 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:04.779442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:32:04.780335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:32:04.780335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:04.780335 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:04.780335 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 385/785] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:04.785158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.876803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be846b6-f5b3-4901-8475-2372669afe2a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:04.891211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0462d5-b7ce-4739-a020-e716d6ebea85 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:04.912020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995937a-ca23-4176-a347-089376c20967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:04.912653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995937a-ca23-4176-a347-089376c20967 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.913070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995937a-ca23-4176-a347-089376c20967 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.913338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995937a-ca23-4176-a347-089376c20967 None admin] PATH_INFO: `/v3/services/image` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.913948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995937a-ca23-4176-a347-089376c20967 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:04.915306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995937a-ca23-4176-a347-089376c20967 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f995937a-ca23-4176-a347-089376c20967 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:04.923988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:04.925024 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:04.925934 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 401/786] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:32:04.927718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:04.928331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:04.928603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:04.928867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:04.929503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:04.929819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:04.931193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:04.931445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995937a-ca23-4176-a347-089376c20967 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.943320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 386/787] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:04.948810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:04.983624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:04.993777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:05.038187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995937a-ca23-4176-a347-089376c20967 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.058341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe58c8-fc5e-4538-8020-928a7efe7208 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.070131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.070741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.071014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.071276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.071898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] RBAC: Adding query filter params (name=image) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:05.072195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.073532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.078761 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 402/788] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:05.084487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.097667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.098332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.098610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.098871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.106530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.107973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:32:05.120247 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:05.121179 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:32:05.122442 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:05.126411 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 387/789] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Oct 29 02:32:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:32:05.127169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.190780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b59cae-daf8-4bc1-879f-812c194579ae None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.217495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:05.220335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:05.229736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8690-234c-449c-8e49-4744c977143c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.230443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8690-234c-449c-8e49-4744c977143c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.230721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8690-234c-449c-8e49-4744c977143c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.230992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af8690-234c-449c-8e49-4744c977143c None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.231554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d58936-293a-4ef4-a2cc-7e9b950bc2f2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.231656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af8690-234c-449c-8e49-4744c977143c None admin] RBAC: Adding query filter params (type=image) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:05.231894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af8690-234c-449c-8e49-4744c977143c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.233434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af8690-234c-449c-8e49-4744c977143c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.239777 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 403/790] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:05.244941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8690-234c-449c-8e49-4744c977143c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.269885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.270503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.270767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.271037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.271758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:05.272057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.273478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.291545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 388/791] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Oct 29 02:32:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:05.297460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.354171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af8690-234c-449c-8e49-4744c977143c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.388630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.389238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.389514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.389782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.390474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.392156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.399979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68592742-bef4-4069-a05c-e79a4efe5387 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.422032 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 404/792] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:32:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:32:05.442119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.442773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.443044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.443295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.454871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.456415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.464301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:32:05.473446 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:05.474492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:32:05.475513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:32:05.475513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:05.475513 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:05.475513 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 389/793] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:05.480691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.529790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:05.602858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165ec19-215f-400e-b81d-8821506867e6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.642830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.643440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.643772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.644040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.644853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:05.645153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.646566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.659691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 405/794] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:05.665322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.767606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16645fd-73f8-4ce6-866c-50648e4cde68 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.802558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.803107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.803385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.803654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.811429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.812914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ac42fa15-2e4e-4dbc-a1f4-ff28e89492a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:32:05.825932 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:05.826907 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:05.833331 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 390/795] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:32:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:32:05.835555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:05.931907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ab96c-9656-4288-8063-068a12522e65 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.932457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ab96c-9656-4288-8063-068a12522e65 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.932457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ab96c-9656-4288-8063-068a12522e65 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.933786 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 391/796] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:32:05.939346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.939838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.940300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.941230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27effa8c-9fe3-4198-b25d-f2aa0ada71a4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:05.943193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:05.959669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:05.961061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:05.977854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:05.978473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:05.978745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:05.979012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:05.980006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:05.980314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:05.981755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:05.993912 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 406/797] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:32:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:06.000033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:06.021882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:06.037821 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 392/798] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:32:06.104429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dd617-50b1-448e-85f7-f717e58a9741 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:06.140745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:06.141772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:06.142274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:06.142737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/81efa701407b4cb583969bef4ad35194/roles/b8216b729e1a4b9db06cd0984b0480c9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:06.145133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=81efa701407b4cb583969bef4ad35194, role_id=b8216b729e1a4b9db06cd0984b0480c9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:06.146808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:06.162319 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 407/799] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:32:05 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/81efa701407b4cb583969bef4ad35194/roles/b8216b729e1a4b9db06cd0984b0480c9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:32:06.302725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:06.412646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e27c2-8bbf-4ef9-b885-5da8edf178b2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:06.446433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff90b0-4fbf-42f1-b206-841e0aa68703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:06.447063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff90b0-4fbf-42f1-b206-841e0aa68703 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:06.447339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff90b0-4fbf-42f1-b206-841e0aa68703 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:06.447604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff90b0-4fbf-42f1-b206-841e0aa68703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:06.448713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff90b0-4fbf-42f1-b206-841e0aa68703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:06.450168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff90b0-4fbf-42f1-b206-841e0aa68703 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:06.451929 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 393/800] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:06.457826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:06.482601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:06.568476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76e51c4-3dc7-4413-b9ac-1a6d623446c7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:06.603857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c50312-e833-4bf0-a214-f484316339c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:06.604463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50312-e833-4bf0-a214-f484316339c0 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:06.604740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50312-e833-4bf0-a214-f484316339c0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:06.605006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c50312-e833-4bf0-a214-f484316339c0 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:06.605657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50312-e833-4bf0-a214-f484316339c0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:06.607123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c50312-e833-4bf0-a214-f484316339c0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:06.640013 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 408/801] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:32:06 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:07.620937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e375-d342-496f-b571-2c4a4407ed8c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:07.621533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e375-d342-496f-b571-2c4a4407ed8c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:07.621533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3e375-d342-496f-b571-2c4a4407ed8c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:07.623303 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 394/802] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:07.628731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:07.629164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:07.629341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:07.648004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:07.649202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:07.720952 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 409/803] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:07.992984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e375-d342-496f-b571-2c4a4407ed8c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:08.057321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:08.107020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce3e375-d342-496f-b571-2c4a4407ed8c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:08.146465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:08.147089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.147352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.147618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.148288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:08.149667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:08.158520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.sql.core [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 02:32:08.158520 n-d-862964-4 devstack@keystone.service[82080]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:32:08.158520 n-d-862964-4 devstack@keystone.service[82080]: [parameters: {'id': 'a534738975314046bf8c925576f3724d', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 02:32:08.158520 n-d-862964-4 devstack@keystone.service[82080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-865c8611-b9eb-4d91-8a1a-b706141db068 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:32:08.167053 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 02:32:08.168721 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application yield resource Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise self.value Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.commit() Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 02:32:08.171005 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.flush() Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application compat.raise_( Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 02:32:08.172158 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:32:08.175582 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:32:08.177874 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [parameters: {'id': 'a534738975314046bf8c925576f3724d', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 02:32:08.179762 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:08.181325 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.182512 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 395/804] 10.222.0.16 () {60 vars in 1137 bytes} [Sat Oct 29 02:32:07 2022] POST /identity/v3/domains => generated 190 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:08.183398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:08.185292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:08.295663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016cbefd-177c-4c81-8854-2d265643ec71 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:08.317845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ce6d-49b3-459c-afdb-63aa9f533c72 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.318932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ce6d-49b3-459c-afdb-63aa9f533c72 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.318932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813ce6d-49b3-459c-afdb-63aa9f533c72 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.320123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 396/805] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:08.324990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.325236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.325521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.340057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:08.340798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.341288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.341753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.344636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:08.345793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:08.354681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:08.357233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:32:08.376751 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:08.377906 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:32:08.379247 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:32:08.379247 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:08.379247 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:08.379247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 410/806] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:08.384369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:08.423291 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 397/807] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:32:08.451939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:08.498076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a7bfa-5042-426a-8106-5ba658f72be6 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:08.532431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:08.533252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.533618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.534005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.535012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:08.535401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:08.536881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:08.551190 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 411/808] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:08.692288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:08.746544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:08.808027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9731707-d8b3-46f4-994f-fca9600c1fc4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:08.844664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84051687-cd98-4dcd-9b94-c10427cce382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:08.845576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84051687-cd98-4dcd-9b94-c10427cce382 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.846019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84051687-cd98-4dcd-9b94-c10427cce382 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.846446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84051687-cd98-4dcd-9b94-c10427cce382 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.857575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84051687-cd98-4dcd-9b94-c10427cce382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-84051687-cd98-4dcd-9b94-c10427cce382 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:08.862691 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:08.863608 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:08.864574 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 398/809] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Oct 29 02:32:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:08.869932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:08.879159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182212e9-6d50-4fcc-b732-829c14ddb950 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.880042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182212e9-6d50-4fcc-b732-829c14ddb950 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.880328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182212e9-6d50-4fcc-b732-829c14ddb950 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.881716 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 399/810] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:32:08.887316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:08.887594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:08.887863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:08.905526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:08.906812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:08.971147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef4a9b-9b72-4113-9d16-8d6e480d3890 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:08.973188 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 400/811] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:32:08.987749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:09.005337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.005975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.006253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.006521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.007181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:09.007478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.008825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.016547 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 412/812] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Oct 29 02:32:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:09.022396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.062691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:09.124638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c10d1d-bb02-49ab-adf9-2cc578737213 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.162425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.163042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.163373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.163645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.173873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.175729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:32:09.190772 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:09.191791 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:32:09.192678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:32:09.192678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:09.192678 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:09.192678 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 401/813] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:09.198080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.238450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.299852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dab0f-688e-490e-ac47-078850d75dc5 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.329205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:09.332690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.333342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.333609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.333884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.334531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:09.334853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.336211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.339425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89f720-2f13-49e4-80e0-74a54964eea1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.347667 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 413/814] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:09.353413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.375797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.376416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.376693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.376964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.378174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.379594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.381289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 402/815] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:09.386820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.392252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:09.451374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d71d1e-7219-4e3d-8fac-15a5165d8d8b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.486429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.486745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db78b88-7823-4f55-bb03-fdedae60fdb7 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.487055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.487462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.487948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] PATH_INFO: `/v3/users/nova` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.495052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.496515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:32:09.508481 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:09.509515 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:09.510495 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 414/816] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Oct 29 02:32:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:32:09.515350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.520043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.520645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.520919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.521184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.521857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.523272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.546260 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 403/817] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:32:09 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:09.740110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:09.744176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15127b9-f7ca-4a00-becb-858b643a087d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.779349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c9498-3602-4538-bee5-191177912895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.779976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c9498-3602-4538-bee5-191177912895 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.780253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c9498-3602-4538-bee5-191177912895 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.780517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c9498-3602-4538-bee5-191177912895 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:09.781236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c9498-3602-4538-bee5-191177912895 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:09.781541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c9498-3602-4538-bee5-191177912895 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:09.783005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c9498-3602-4538-bee5-191177912895 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:09.800687 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 415/818] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Oct 29 02:32:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:09.806549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:09.825358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:09.911170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551a27e-ab26-49c1-a5db-aa4c1a931fa1 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:09.945201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:09.945789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:09.946091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:09.946359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:10.013764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:10.015138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:10.031940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:10.114051 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 404/819] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:32:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:32:10.119944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c9498-3602-4538-bee5-191177912895 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:10.221964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c9498-3602-4538-bee5-191177912895 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:10.256502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:10.257125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:10.257400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:10.257667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:10.267536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:10.269165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:32:10.283490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:10.284602 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:32:10.290293 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:32:10.290293 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:32:10.290293 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:10.290293 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 416/820] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:10.290533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:10.391253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c1b09-8d30-4dfe-b609-0e03875a2055 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:10.408632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:10.427242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:10.427850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:10.428128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:10.428400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:10.429041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:10.429343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:10.430753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:10.442322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 405/821] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:10.447966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:10.460201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:10.554046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f4035d-5242-4cd6-b6f8-bb0ce32f3828 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:10.587454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:10.588077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:10.588350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:10.588614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:10.594890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:10.596311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:32:10.607537 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:10.608528 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:32:10.609428 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:10.610327 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 417/822] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:32:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:10.614670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:10.718039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f9bf37-6652-466e-b864-60ee93766db0 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:10.753080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:10.753670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:10.753972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:10.754239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:10.754911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:10.755210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:10.756613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1ffbc-be6d-415e-9242-dc99229d08e5 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:10.769209 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 406/823] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:32:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:10.775394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:10.842572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:10.878694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525aba01-70df-4d5d-9e66-ea3f243fbb5f None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:10.913310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:10.913940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:10.914212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:10.914482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:10.915191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] RBAC: Adding query filter params (role.id=b8216b729e1a4b9db06cd0984b0480c9, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=81efa701407b4cb583969bef4ad35194) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:10.915499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:10.916916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29abc5-e1df-40cf-8f9b-61c1b8698eb5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:10.922839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 418/824] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:32:10 2022] GET /identity/v3/role_assignments?user.id=81efa701407b4cb583969bef4ad35194&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=b8216b729e1a4b9db06cd0984b0480c9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:11.731554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0079-4b06-4673-a3d8-1f6a209084fb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:11.732102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0079-4b06-4673-a3d8-1f6a209084fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:11.732102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0079-4b06-4673-a3d8-1f6a209084fb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:11.733434 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 407/825] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:11.738992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:11.739450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:11.739565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:11.759885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:11.761099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:11.830658 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 419/826] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:32:12.094203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0079-4b06-4673-a3d8-1f6a209084fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:12.139630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:12.212977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0079-4b06-4673-a3d8-1f6a209084fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:12.248357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:12.248980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:12.249255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:12.249525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:12.260575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:12.265339 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:12.269836 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:12.270926 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 408/827] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:12.272545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:12.330615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:12.369789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec69f9d-ecb5-40e6-968d-cca22358e9fb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:12.410355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:12.411197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:12.411557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:12.411896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:12.412898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:12.413308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:12.415448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:12.427431 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 420/828] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:12.433403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:12.536921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:12.545070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c538f4-326a-4981-9a50-e7583cf87f3f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:12.581185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:12.582010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:12.582287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:12.582557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] PATH_INFO: `/v3/users/eb6a6ab6f4b94fac80b19dba84a1a24d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:12.595891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] RBAC: Authorizing `identity:get_user(user_id=eb6a6ab6f4b94fac80b19dba84a1a24d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:12.597469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:12.599094 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 409/829] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:12 2022] GET /identity/v3/users/eb6a6ab6f4b94fac80b19dba84a1a24d => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:12.605877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:12.718266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76cbab-f78b-4682-92b9-d26755a00d2d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:12.750237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:12.762658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d242e-8286-4f7a-a2a0-37b12acbd82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:12.763297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d242e-8286-4f7a-a2a0-37b12acbd82e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:12.763562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d242e-8286-4f7a-a2a0-37b12acbd82e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:12.763838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d242e-8286-4f7a-a2a0-37b12acbd82e None admin] PATH_INFO: `/v3/projects/a7406bec9f724001a1fec8dfd8082f91` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:12.764979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d242e-8286-4f7a-a2a0-37b12acbd82e None admin] RBAC: Authorizing `identity:get_project(project_id=a7406bec9f724001a1fec8dfd8082f91)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:12.766451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771d242e-8286-4f7a-a2a0-37b12acbd82e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:12.768087 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 421/830] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:12 2022] GET /identity/v3/projects/a7406bec9f724001a1fec8dfd8082f91 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:12.774624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:12.883544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0849b07-ab76-4a05-958b-7ab18801e27e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:12.928572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf2f01-42b9-4dfe-86f7-6eac87a98743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:12.929259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf2f01-42b9-4dfe-86f7-6eac87a98743 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:12.929537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf2f01-42b9-4dfe-86f7-6eac87a98743 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:12.929845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf2f01-42b9-4dfe-86f7-6eac87a98743 None admin] PATH_INFO: `/v3/projects/a7406bec9f724001a1fec8dfd8082f91/users/eb6a6ab6f4b94fac80b19dba84a1a24d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:12.931950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf2f01-42b9-4dfe-86f7-6eac87a98743 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7406bec9f724001a1fec8dfd8082f91, user_id=eb6a6ab6f4b94fac80b19dba84a1a24d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:12.933389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf2f01-42b9-4dfe-86f7-6eac87a98743 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:12.949491 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 410/831] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:32:12 2022] PUT /identity/v3/projects/a7406bec9f724001a1fec8dfd8082f91/users/eb6a6ab6f4b94fac80b19dba84a1a24d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:32:15.074433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899349f7-087e-4df9-9f39-442eac341a3a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:15.074994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899349f7-087e-4df9-9f39-442eac341a3a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:15.074994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899349f7-087e-4df9-9f39-442eac341a3a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:15.076319 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 422/832] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:15.083196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:15.083672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:15.083767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:15.108926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:15.110175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:15.120609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:15.185596 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 411/833] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:15.471072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899349f7-087e-4df9-9f39-442eac341a3a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:15.589778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899349f7-087e-4df9-9f39-442eac341a3a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:15.626956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:15.627574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:15.627873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:15.628139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:15.639416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:15.644210 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:15.645285 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:15.646160 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 423/834] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:32:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:15.651610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:15.754651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b033dd-bbff-48b5-82b6-3c9f08c1678c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:15.790484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:15.791073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:15.791346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:15.791613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:15.792265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:15.792561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:15.793955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:15.802049 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 412/835] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:15.808458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:15.864050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:15.911367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250012dc-1465-4bef-bcf8-3ec6995a4b0d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:15.946231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:15.946833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:15.947107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:15.947375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] PATH_INFO: `/v3/users/eb6a6ab6f4b94fac80b19dba84a1a24d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:15.948597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] RBAC: Authorizing `identity:get_user(user_id=eb6a6ab6f4b94fac80b19dba84a1a24d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:15.950049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:15.951627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 424/836] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:15 2022] GET /identity/v3/users/eb6a6ab6f4b94fac80b19dba84a1a24d => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:15.958714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:15.972867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:16.077741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bdc53-6f53-4b03-8d9e-53e45ef67fbb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:16.112722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:16.113342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:16.113569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:16.113847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:16.183733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:16.185182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:16.193936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:16.291122 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 413/837] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:32:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:32:16.298009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:16.399331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5caac8-3af3-47e4-854e-5f019c233eed None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:16.418486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:16.433768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6551-0b81-4a9f-b772-029624f62531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:16.434405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6551-0b81-4a9f-b772-029624f62531 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:16.434682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6551-0b81-4a9f-b772-029624f62531 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:16.434946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6551-0b81-4a9f-b772-029624f62531 None admin] PATH_INFO: `/v3/projects/a7406bec9f724001a1fec8dfd8082f91` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:16.436059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6551-0b81-4a9f-b772-029624f62531 None admin] RBAC: Authorizing `identity:get_project(project_id=a7406bec9f724001a1fec8dfd8082f91)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:16.437467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6551-0b81-4a9f-b772-029624f62531 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:16.439094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 425/838] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:16 2022] GET /identity/v3/projects/a7406bec9f724001a1fec8dfd8082f91 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:16.445292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:16.554118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a13c8-3e74-46c7-8426-30d61e74d6fb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:16.561882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:16.590964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:16.591555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:16.591827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:16.592094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:16.592806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=a7406bec9f724001a1fec8dfd8082f91, user.id=eb6a6ab6f4b94fac80b19dba84a1a24d) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:16.593107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:16.594554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17287fe-7494-4a36-b277-28986f75998b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:16.600392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 414/839] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:32:16 2022] GET /identity/v3/role_assignments?user.id=eb6a6ab6f4b94fac80b19dba84a1a24d&scope.project.id=a7406bec9f724001a1fec8dfd8082f91&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:18.737687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0e431-91fd-490c-ac75-2827db2f72a6 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:18.738306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0e431-91fd-490c-ac75-2827db2f72a6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:18.738306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0e431-91fd-490c-ac75-2827db2f72a6 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:18.740507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 426/840] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:18.749748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:18.750156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:18.750409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:18.770977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:18.772177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:18.841636 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 415/841] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:19.107659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0e431-91fd-490c-ac75-2827db2f72a6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:19.227846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0e431-91fd-490c-ac75-2827db2f72a6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:19.267371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a6489-9140-4e72-9c89-f13dfc8d9c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:19.267998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6489-9140-4e72-9c89-f13dfc8d9c57 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:19.268278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6489-9140-4e72-9c89-f13dfc8d9c57 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:19.268571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a6489-9140-4e72-9c89-f13dfc8d9c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:19.270004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a6489-9140-4e72-9c89-f13dfc8d9c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:19.271430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a6489-9140-4e72-9c89-f13dfc8d9c57 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:19.272977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 427/842] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:19.282441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:19.387548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:19.391030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979787af-54e3-4739-a67a-84f72bb31e48 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:19.425680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdece0-b3dc-4b8e-9133-1c4a95e5c61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:19.426304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdece0-b3dc-4b8e-9133-1c4a95e5c61c None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:19.426571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdece0-b3dc-4b8e-9133-1c4a95e5c61c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:19.426833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdece0-b3dc-4b8e-9133-1c4a95e5c61c None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:19.427468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdece0-b3dc-4b8e-9133-1c4a95e5c61c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:19.428891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdece0-b3dc-4b8e-9133-1c4a95e5c61c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:19.459191 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 416/843] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:32:19 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:21.615345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926401f-c0f0-4876-82a0-5feb1293858a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:21.616120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926401f-c0f0-4876-82a0-5feb1293858a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:21.616120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926401f-c0f0-4876-82a0-5feb1293858a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:21.618417 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 428/844] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:21.626842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:21.627293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:21.627383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:21.647241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:21.648421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:21.719627 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 417/845] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:32:21.982344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926401f-c0f0-4876-82a0-5feb1293858a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:22.046526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:22.092351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926401f-c0f0-4876-82a0-5feb1293858a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:22.127443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:22.128217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:22.128494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:22.128766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] PATH_INFO: `/v3/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:22.130230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] RBAC: Authorizing `identity:get_role(role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:22.131586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:22.132896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 429/846] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:21 2022] GET /identity/v3/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:22.139563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:22.243251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:22.260578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40218e-ce0e-4a2c-a7f8-1bade46c3b88 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:22.295634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:22.296275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:22.296546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:22.296814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] PATH_INFO: `/v3/users/41be5bec5c724bb3ac1f988019cfc15e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:22.310137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] RBAC: Authorizing `identity:get_user(user_id=41be5bec5c724bb3ac1f988019cfc15e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:22.311593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:22.313193 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 418/847] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:22 2022] GET /identity/v3/users/41be5bec5c724bb3ac1f988019cfc15e => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:22.319292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:22.426665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadd21e-8da7-4431-9999-888c9743d2e4 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:22.450098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:22.464534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b394-1c44-4e3a-b8ee-749336b99ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:22.465158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b394-1c44-4e3a-b8ee-749336b99ebe None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:22.465430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b394-1c44-4e3a-b8ee-749336b99ebe None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:22.465695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b394-1c44-4e3a-b8ee-749336b99ebe None admin] PATH_INFO: `/v3/projects/a7406bec9f724001a1fec8dfd8082f91` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:22.466893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b394-1c44-4e3a-b8ee-749336b99ebe None admin] RBAC: Authorizing `identity:get_project(project_id=a7406bec9f724001a1fec8dfd8082f91)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:22.468302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b394-1c44-4e3a-b8ee-749336b99ebe None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:22.469943 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 430/848] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:22 2022] GET /identity/v3/projects/a7406bec9f724001a1fec8dfd8082f91 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:22.476108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:22.581433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed2ee5-eb43-40e9-a5a4-4c83f124ef0a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:22.619063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23cf425-b524-4a59-a957-56709df7b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:22.620072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf425-b524-4a59-a957-56709df7b9bf None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:22.620436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf425-b524-4a59-a957-56709df7b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:22.620834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23cf425-b524-4a59-a957-56709df7b9bf None admin] PATH_INFO: `/v3/projects/a7406bec9f724001a1fec8dfd8082f91/users/41be5bec5c724bb3ac1f988019cfc15e/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:22.625422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cf425-b524-4a59-a957-56709df7b9bf None admin] RBAC: Authorizing `identity:create_grant(project_id=a7406bec9f724001a1fec8dfd8082f91, user_id=41be5bec5c724bb3ac1f988019cfc15e, role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:22.627923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23cf425-b524-4a59-a957-56709df7b9bf None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:22.643677 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 419/849] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:32:22 2022] PUT /identity/v3/projects/a7406bec9f724001a1fec8dfd8082f91/users/41be5bec5c724bb3ac1f988019cfc15e/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:32:24.741485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966520e9-43a1-4f74-ae0b-908b683514ba None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:24.742098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966520e9-43a1-4f74-ae0b-908b683514ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:24.742098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966520e9-43a1-4f74-ae0b-908b683514ba None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:24.743448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 431/850] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:24.750212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:24.750663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:24.750754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:24.759393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:24.771625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:24.772829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:24.841686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 420/851] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:25.109897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966520e9-43a1-4f74-ae0b-908b683514ba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:25.241147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966520e9-43a1-4f74-ae0b-908b683514ba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:25.276388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:25.277041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:25.277312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:25.277574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] PATH_INFO: `/v3/roles/01496d3e63b6459e87ed8315dc4b66b7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:25.279072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] RBAC: Authorizing `identity:get_role(role_id=01496d3e63b6459e87ed8315dc4b66b7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:25.280447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:25.281819 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 432/852] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:25 2022] GET /identity/v3/roles/01496d3e63b6459e87ed8315dc4b66b7 => generated 223 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:25.288764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:25.396661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda4bc2-4327-4b51-bc03-2cb1f09abfac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:25.433775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:25.434456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:25.434728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:25.434963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] PATH_INFO: `/v3/users/41be5bec5c724bb3ac1f988019cfc15e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:25.436092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] RBAC: Authorizing `identity:get_user(user_id=41be5bec5c724bb3ac1f988019cfc15e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:25.437575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:25.439223 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 421/853] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:25 2022] GET /identity/v3/users/41be5bec5c724bb3ac1f988019cfc15e => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:25.446101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:25.510165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:25.562604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d48ab-7b02-4231-a571-cf6ea41240cf None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:25.596421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:25.597019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:25.597295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:25.597562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:25.664886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:25.666286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:25.724335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:25.775668 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 433/854] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:32:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:32:25.781974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:25.785150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:25.905184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83bd63-a1e7-45de-95b0-85ebc97c157a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:25.940445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee3c6b-7802-4409-87e9-d80289b8a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:25.941003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3c6b-7802-4409-87e9-d80289b8a6ca None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:25.941283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3c6b-7802-4409-87e9-d80289b8a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:25.941555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee3c6b-7802-4409-87e9-d80289b8a6ca None admin] PATH_INFO: `/v3/projects/a7406bec9f724001a1fec8dfd8082f91` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:25.942845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3c6b-7802-4409-87e9-d80289b8a6ca None admin] RBAC: Authorizing `identity:get_project(project_id=a7406bec9f724001a1fec8dfd8082f91)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:25.944290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee3c6b-7802-4409-87e9-d80289b8a6ca None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:25.945942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 422/855] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:25 2022] GET /identity/v3/projects/a7406bec9f724001a1fec8dfd8082f91 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:25.956314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:26.057251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e0fc27-5ae1-4519-8ad0-b099f9b8cb1c None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:26.092665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:26.093249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:26.093527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:26.093788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:26.094531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] RBAC: Adding query filter params (role.id=01496d3e63b6459e87ed8315dc4b66b7, scope.project.id=a7406bec9f724001a1fec8dfd8082f91, user.id=41be5bec5c724bb3ac1f988019cfc15e) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:26.094835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:26.096246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe5d0b-bd0a-4a4d-a85b-970d9be61546 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:26.102251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 434/856] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:32:25 2022] GET /identity/v3/role_assignments?user.id=41be5bec5c724bb3ac1f988019cfc15e&scope.project.id=a7406bec9f724001a1fec8dfd8082f91&role.id=01496d3e63b6459e87ed8315dc4b66b7 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:28.227584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fde8c-0f60-45e1-883f-01920ae07fe1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:28.228440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fde8c-0f60-45e1-883f-01920ae07fe1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:28.228440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fde8c-0f60-45e1-883f-01920ae07fe1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:28.230581 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 423/857] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:28.236075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:28.236493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:28.236582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:28.256868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:28.258079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:28.276517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:28.329497 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 435/858] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:28.597307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fde8c-0f60-45e1-883f-01920ae07fe1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:28.690382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:28.725916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fde8c-0f60-45e1-883f-01920ae07fe1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:28.760886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47791595-1733-44f2-b978-784b1f0c7499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:28.761505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791595-1733-44f2-b978-784b1f0c7499 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:28.761781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791595-1733-44f2-b978-784b1f0c7499 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:28.762084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47791595-1733-44f2-b978-784b1f0c7499 None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:28.763229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791595-1733-44f2-b978-784b1f0c7499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:28.764671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47791595-1733-44f2-b978-784b1f0c7499 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:28.766258 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 424/859] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:28.772575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:28.871003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a083f-f264-40a2-bea0-264c1daf27e6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:28.906942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b0d76-de21-4cf9-a09e-9d78d282fa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:28.907553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b0d76-de21-4cf9-a09e-9d78d282fa5d None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:28.907830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b0d76-de21-4cf9-a09e-9d78d282fa5d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:28.908098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b0d76-de21-4cf9-a09e-9d78d282fa5d None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:28.908780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b0d76-de21-4cf9-a09e-9d78d282fa5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:28.910255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b0d76-de21-4cf9-a09e-9d78d282fa5d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:28.944104 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 436/860] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:32:28 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:31.101412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f0f6-154a-4d6c-abed-3ee731513c13 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:31.102407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f0f6-154a-4d6c-abed-3ee731513c13 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:31.102407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9f0f6-154a-4d6c-abed-3ee731513c13 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:31.104629 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 425/861] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:31.111000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:31.111817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:31.112031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:31.131256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:31.137048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:31.138990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:31.209251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 437/862] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:31.484089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9f0f6-154a-4d6c-abed-3ee731513c13 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:31.605697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e9f0f6-154a-4d6c-abed-3ee731513c13 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:31.651435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c055647-b19d-49b7-8efd-6ea9e7dddded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:31.652058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055647-b19d-49b7-8efd-6ea9e7dddded None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:31.652326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055647-b19d-49b7-8efd-6ea9e7dddded None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:31.652591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c055647-b19d-49b7-8efd-6ea9e7dddded None admin] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:31.653834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c055647-b19d-49b7-8efd-6ea9e7dddded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:31.655274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c055647-b19d-49b7-8efd-6ea9e7dddded None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:31.656839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 426/863] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:31.663278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:31.767152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a8b63-7a81-4559-80fc-aa8084e321ed None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:31.802056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e1f1-c1f0-4f99-ac6c-6957239dc8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:31.802649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e1f1-c1f0-4f99-ac6c-6957239dc8b4 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:31.802917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e1f1-c1f0-4f99-ac6c-6957239dc8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:31.803180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e1f1-c1f0-4f99-ac6c-6957239dc8b4 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:31.803815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e1f1-c1f0-4f99-ac6c-6957239dc8b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:31.805238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e1f1-c1f0-4f99-ac6c-6957239dc8b4 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:31.814251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:31.828102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 438/864] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:32:31 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:33.969673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740eba-429d-4cbb-aac6-9d81c2c4c10e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:33.970613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740eba-429d-4cbb-aac6-9d81c2c4c10e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:33.970613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740eba-429d-4cbb-aac6-9d81c2c4c10e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:33.972862 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 427/865] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:33.978439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:33.978879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:33.978983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:33.999745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:34.000932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:34.069476 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 439/866] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:34.335463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740eba-429d-4cbb-aac6-9d81c2c4c10e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:34.350341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:34.457344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740eba-429d-4cbb-aac6-9d81c2c4c10e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:34.495733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:34.496358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:34.496637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:34.496909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:34.509501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:34.514365 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:34.515574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:34.516880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 428/867] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:32:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:34.521916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:34.638157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da1e97-debe-4594-bec2-e22f6e283e12 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:34.661343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:34.679875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:34.680748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:34.681115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:34.681481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:34.682558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:34.682998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:34.685131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:34.694975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 440/868] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:34.700991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:34.780603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:34.821716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e05e5-b1b4-48da-a8ca-55112f85ea87 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:34.858757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:34.859370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:34.859642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:34.859905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] PATH_INFO: `/v3/users/47ed5b09b1724eda863403f794a69157` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:34.874660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] RBAC: Authorizing `identity:get_user(user_id=47ed5b09b1724eda863403f794a69157)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:34.876091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:34.877718 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 429/869] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:34 2022] GET /identity/v3/users/47ed5b09b1724eda863403f794a69157 => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:34.886375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:34.987590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1d022-b4b7-470b-bd1c-15d08fd80983 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:35.021557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169230f-3733-4075-9269-40b66b7a5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:35.022201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169230f-3733-4075-9269-40b66b7a5a2f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:35.022473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169230f-3733-4075-9269-40b66b7a5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:35.022744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169230f-3733-4075-9269-40b66b7a5a2f None admin] PATH_INFO: `/v3/projects/9130b820bfb1443e86493f330bb74d00` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:35.023880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169230f-3733-4075-9269-40b66b7a5a2f None admin] RBAC: Authorizing `identity:get_project(project_id=9130b820bfb1443e86493f330bb74d00)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:35.025289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169230f-3733-4075-9269-40b66b7a5a2f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:35.026895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 441/870] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:34 2022] GET /identity/v3/projects/9130b820bfb1443e86493f330bb74d00 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:35.033234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:35.143213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7591f-49d7-45c1-ab2e-0ac2ac199a5c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:35.167383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:35.179584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc472d64-1494-4129-a8e4-0bd0c46b2025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:35.180242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc472d64-1494-4129-a8e4-0bd0c46b2025 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:35.180521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc472d64-1494-4129-a8e4-0bd0c46b2025 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:35.180797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc472d64-1494-4129-a8e4-0bd0c46b2025 None admin] PATH_INFO: `/v3/projects/9130b820bfb1443e86493f330bb74d00/users/47ed5b09b1724eda863403f794a69157/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:35.182782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc472d64-1494-4129-a8e4-0bd0c46b2025 None admin] RBAC: Authorizing `identity:create_grant(project_id=9130b820bfb1443e86493f330bb74d00, user_id=47ed5b09b1724eda863403f794a69157, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:35.184241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc472d64-1494-4129-a8e4-0bd0c46b2025 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:35.201249 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 430/871] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:32:35 2022] PUT /identity/v3/projects/9130b820bfb1443e86493f330bb74d00/users/47ed5b09b1724eda863403f794a69157/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:32:37.311077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a89bd-7988-466e-9350-af4d36cff9f2 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:37.311749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a89bd-7988-466e-9350-af4d36cff9f2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:37.311749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a89bd-7988-466e-9350-af4d36cff9f2 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:37.312965 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 442/872] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:37.319543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:37.320314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:37.320471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:37.344736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:37.345973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:37.419390 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 431/873] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:37.683078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a89bd-7988-466e-9350-af4d36cff9f2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:37.742847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:37.796124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a89bd-7988-466e-9350-af4d36cff9f2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:37.832739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:37.833347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:37.833617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:37.833913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:37.846072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:37.850876 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:37.851992 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:37.853048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 443/874] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:37.858198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:37.964398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bd816-e11a-4d2d-a0f3-80f2afefb7f8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:37.979777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:38.005931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:38.006535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:38.006805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:38.007070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:38.007720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:38.008019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:38.009369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:38.017703 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 432/875] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:38.024454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:38.138286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba90447-06ec-4944-b12d-242423a1bd9a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:38.150911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:38.174335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:38.174953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:38.175226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:38.175501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] PATH_INFO: `/v3/users/47ed5b09b1724eda863403f794a69157` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:38.176636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] RBAC: Authorizing `identity:get_user(user_id=47ed5b09b1724eda863403f794a69157)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:38.178254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:38.179965 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 444/876] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:38 2022] GET /identity/v3/users/47ed5b09b1724eda863403f794a69157 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:38.186744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:38.300841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db03bd7-ab7b-4147-b076-890d9efc2700 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:38.347311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:38.347916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:38.348194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:38.348468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:38.396484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:38.420479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:38.421953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:38.520814 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 433/877] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:32:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:32:38.527031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:38.635834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437262f-fe2a-4d92-975c-45fd6c4b861d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:38.670654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd63a7-9668-4254-992c-a6ec9d828e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:38.671269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd63a7-9668-4254-992c-a6ec9d828e79 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:38.671547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd63a7-9668-4254-992c-a6ec9d828e79 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:38.671812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd63a7-9668-4254-992c-a6ec9d828e79 None admin] PATH_INFO: `/v3/projects/9130b820bfb1443e86493f330bb74d00` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:38.673064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd63a7-9668-4254-992c-a6ec9d828e79 None admin] RBAC: Authorizing `identity:get_project(project_id=9130b820bfb1443e86493f330bb74d00)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:38.674646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd63a7-9668-4254-992c-a6ec9d828e79 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:38.676260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 445/878] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:38 2022] GET /identity/v3/projects/9130b820bfb1443e86493f330bb74d00 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:38.683235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:38.763985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:38.789468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54d134-a958-4663-816f-b45ec6c6c620 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:38.824774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:38.825313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:38.825582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:38.825845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:38.826653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=9130b820bfb1443e86493f330bb74d00, user.id=47ed5b09b1724eda863403f794a69157) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:38.826958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:38.828380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f05d7e-341d-4b6d-bc71-ed99f48781c1 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:38.834267 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 434/879] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:32:38 2022] GET /identity/v3/role_assignments?user.id=47ed5b09b1724eda863403f794a69157&scope.project.id=9130b820bfb1443e86493f330bb74d00&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:40.936404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d5f3d-8bb0-403d-bfc4-6f6cddbca48b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:40.937233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d5f3d-8bb0-403d-bfc4-6f6cddbca48b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:40.937233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d5f3d-8bb0-403d-bfc4-6f6cddbca48b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:40.939289 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 446/880] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:40.947474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deea529-855b-49a4-9bca-3158c62dc1ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:40.947936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deea529-855b-49a4-9bca-3158c62dc1ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:40.948044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deea529-855b-49a4-9bca-3158c62dc1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:40.968305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5deea529-855b-49a4-9bca-3158c62dc1ba None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:40.969507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5deea529-855b-49a4-9bca-3158c62dc1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:41.047608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 435/881] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 29 02:32:41.318537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d5f3d-8bb0-403d-bfc4-6f6cddbca48b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:41.381571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:41.439645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d5f3d-8bb0-403d-bfc4-6f6cddbca48b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:41.483421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13253c39-7e2a-4af0-8554-f99ccfdb9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:41.484022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253c39-7e2a-4af0-8554-f99ccfdb9634 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:41.484298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253c39-7e2a-4af0-8554-f99ccfdb9634 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:41.484574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13253c39-7e2a-4af0-8554-f99ccfdb9634 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:41.485232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253c39-7e2a-4af0-8554-f99ccfdb9634 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:41.486607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13253c39-7e2a-4af0-8554-f99ccfdb9634 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:41.505153 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 447/882] 10.222.0.16 () {60 vars in 1138 bytes} [Sat Oct 29 02:32:41 2022] POST /identity/v3/domains => generated 267 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:43.663811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdd02f-12bf-44ee-b3d4-a0833dc91119 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:43.664687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdd02f-12bf-44ee-b3d4-a0833dc91119 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:43.664687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdd02f-12bf-44ee-b3d4-a0833dc91119 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:43.666896 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 436/883] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:43.676065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:43.676494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:43.676623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:43.699965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:43.701161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:43.786155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 448/884] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:44.058553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdd02f-12bf-44ee-b3d4-a0833dc91119 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:44.134571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:44.171488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdd02f-12bf-44ee-b3d4-a0833dc91119 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:44.216264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189b82a-45d7-40f5-966c-56f37ec3a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:44.216898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189b82a-45d7-40f5-966c-56f37ec3a1fc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:44.217179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189b82a-45d7-40f5-966c-56f37ec3a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:44.217449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189b82a-45d7-40f5-966c-56f37ec3a1fc None admin] PATH_INFO: `/v3/domains/01a6597a6b1b4d1eaf0692063110f8db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:44.228705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189b82a-45d7-40f5-966c-56f37ec3a1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=01a6597a6b1b4d1eaf0692063110f8db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:44.230187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189b82a-45d7-40f5-966c-56f37ec3a1fc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:44.231777 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 437/885] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Oct 29 02:32:44 2022] GET /identity/v3/domains/01a6597a6b1b4d1eaf0692063110f8db => generated 267 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:44.238125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:44.279939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:44.346082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ac74d-f2ca-4b1a-a1a8-c958f9b2021c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:44.380878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe699d8b-5038-4731-b403-96fbc93d0921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:44.381474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699d8b-5038-4731-b403-96fbc93d0921 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:44.381715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699d8b-5038-4731-b403-96fbc93d0921 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:44.382032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe699d8b-5038-4731-b403-96fbc93d0921 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:44.382676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699d8b-5038-4731-b403-96fbc93d0921 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:44.384120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe699d8b-5038-4731-b403-96fbc93d0921 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:44.413924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 449/886] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:32:44 2022] POST /identity/v3/projects => generated 361 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:46.543377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89da4-cb5c-400e-97ef-fd3194760a8a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:46.543925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89da4-cb5c-400e-97ef-fd3194760a8a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:46.543925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89da4-cb5c-400e-97ef-fd3194760a8a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:46.545728 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 438/887] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:46.553887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:46.554309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:46.554473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:46.577041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:46.578278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:46.644513 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 450/888] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:46.908247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89da4-cb5c-400e-97ef-fd3194760a8a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:47.017344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89da4-cb5c-400e-97ef-fd3194760a8a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:47.046500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:47.055385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6219c144-cc49-4e08-b660-a5c66430e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:47.056296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c144-cc49-4e08-b660-a5c66430e848 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:47.056650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c144-cc49-4e08-b660-a5c66430e848 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:47.057006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6219c144-cc49-4e08-b660-a5c66430e848 None admin] PATH_INFO: `/v3/domains/01a6597a6b1b4d1eaf0692063110f8db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:47.059016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219c144-cc49-4e08-b660-a5c66430e848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=01a6597a6b1b4d1eaf0692063110f8db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:47.061270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6219c144-cc49-4e08-b660-a5c66430e848 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:47.063730 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 439/889] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Oct 29 02:32:46 2022] GET /identity/v3/domains/01a6597a6b1b4d1eaf0692063110f8db => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:47.070440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:47.095724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:47.193179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b38933-6c0e-47cb-a30b-0e6b66f82ff4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:47.229297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf229a-b0a5-47f1-9e71-f6a22259e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:47.229914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf229a-b0a5-47f1-9e71-f6a22259e087 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:47.230316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf229a-b0a5-47f1-9e71-f6a22259e087 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:47.230584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf229a-b0a5-47f1-9e71-f6a22259e087 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:47.231220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf229a-b0a5-47f1-9e71-f6a22259e087 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:47.232725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf229a-b0a5-47f1-9e71-f6a22259e087 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:47.263927 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 451/890] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:32:47 2022] POST /identity/v3/users => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:32:49.405843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dfcbb-8f7c-4448-a103-491d3d8aca80 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:49.406442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dfcbb-8f7c-4448-a103-491d3d8aca80 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:49.406442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dfcbb-8f7c-4448-a103-491d3d8aca80 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:49.407726 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 440/891] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:49.414095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:49.414859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:49.414989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:49.438734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:49.439930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:49.512250 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 452/892] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:49.781541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dfcbb-8f7c-4448-a103-491d3d8aca80 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:49.892216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dfcbb-8f7c-4448-a103-491d3d8aca80 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:49.927453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:49.928067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:49.928332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:49.928594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:49.939733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:49.944524 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:49.945631 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:49.946776 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:32:49.949963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 441/893] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:49.951728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:49.960542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:50.055807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a7236-57d0-4f9d-8804-430a86cdedba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:50.092684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:50.093278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:50.093552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:50.093839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:50.094477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:50.094771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:50.096156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:50.104956 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 453/894] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:32:50.111696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:50.175086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:50.231206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911598a-bb80-4f18-a3ec-6f3907fe52e5 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:50.271273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:50.271888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:50.272161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:50.272428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] PATH_INFO: `/v3/users/bca968e58508476dba0309a8d331712d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:50.286087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] RBAC: Authorizing `identity:get_user(user_id=bca968e58508476dba0309a8d331712d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:50.287524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:50.289110 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 442/895] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:50 2022] GET /identity/v3/users/bca968e58508476dba0309a8d331712d => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:50.297838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:50.364788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:50.402632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c6add-8ce2-4be5-a2fc-8e19ee845a6d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:50.436703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ad440-8ac4-4b87-b9ce-b04006bdd433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:50.437319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ad440-8ac4-4b87-b9ce-b04006bdd433 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:50.437580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ad440-8ac4-4b87-b9ce-b04006bdd433 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:50.437857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ad440-8ac4-4b87-b9ce-b04006bdd433 None admin] PATH_INFO: `/v3/projects/fd0d3731e78f4bdeb6de691b1fe5e54e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:50.439046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ad440-8ac4-4b87-b9ce-b04006bdd433 None admin] RBAC: Authorizing `identity:get_project(project_id=fd0d3731e78f4bdeb6de691b1fe5e54e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:50.440538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ad440-8ac4-4b87-b9ce-b04006bdd433 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:50.442194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 454/896] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:50 2022] GET /identity/v3/projects/fd0d3731e78f4bdeb6de691b1fe5e54e => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:50.448960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:50.572883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4bdb-25a6-494b-8aaf-b1598a7d6623 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:50.589626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:50.609465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e59c7-a0b2-4620-b910-5abf5ab8e8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:50.610162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e59c7-a0b2-4620-b910-5abf5ab8e8a4 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:50.610436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e59c7-a0b2-4620-b910-5abf5ab8e8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:50.610703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e59c7-a0b2-4620-b910-5abf5ab8e8a4 None admin] PATH_INFO: `/v3/projects/fd0d3731e78f4bdeb6de691b1fe5e54e/users/bca968e58508476dba0309a8d331712d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:50.612728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e59c7-a0b2-4620-b910-5abf5ab8e8a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=fd0d3731e78f4bdeb6de691b1fe5e54e, user_id=bca968e58508476dba0309a8d331712d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:50.614197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e59c7-a0b2-4620-b910-5abf5ab8e8a4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:50.629145 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 443/897] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:32:50 2022] PUT /identity/v3/projects/fd0d3731e78f4bdeb6de691b1fe5e54e/users/bca968e58508476dba0309a8d331712d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:32:52.734765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f10a9-b284-471f-8213-764bd9347b59 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:52.735321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f10a9-b284-471f-8213-764bd9347b59 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:52.735321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f10a9-b284-471f-8213-764bd9347b59 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:52.736718 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 455/898] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:32:52.743321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:52.744038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:52.744210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:52.767336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:32:52.768586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:32:52.850406 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 444/899] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:32:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:32:53.125870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f10a9-b284-471f-8213-764bd9347b59 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:53.237859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f10a9-b284-471f-8213-764bd9347b59 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:53.283460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:53.284079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:53.284353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:53.284619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:53.287341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:53.296735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:32:53.301539 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:32:53.302624 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:32:53.303828 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 456/900] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:32:53.311348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:53.418898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef719519-1c0d-4059-9adc-f49b517e8c7e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:53.426051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:53.456914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:53.457518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:53.457795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:53.458099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:53.458757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:53.459060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:53.460444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:53.468259 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 445/901] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:53.475048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:53.595737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4c0ce-ac0e-4800-a3bb-ee7924d32460 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:53.636319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:53.636948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:53.637222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:53.637493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] PATH_INFO: `/v3/users/bca968e58508476dba0309a8d331712d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:53.638658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] RBAC: Authorizing `identity:get_user(user_id=bca968e58508476dba0309a8d331712d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:53.640129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:53.641721 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 457/902] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Oct 29 02:32:53 2022] GET /identity/v3/users/bca968e58508476dba0309a8d331712d => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:53.648074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:53.760642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eafb8-8eb6-483e-ad20-c43bf21d2587 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:53.795060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:53.795650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:53.795924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:53.796186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:53.830455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:53.864600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:53.866066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:53.963779 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 446/903] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:32:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:32:53.969993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:54.035145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:54.076103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd8a6f-5cc8-48b9-9996-d3151803736d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:54.110667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a3f8a-9056-4c7c-8f16-f9101e384f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:54.111303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a3f8a-9056-4c7c-8f16-f9101e384f44 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:54.111643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a3f8a-9056-4c7c-8f16-f9101e384f44 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:54.111915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a3f8a-9056-4c7c-8f16-f9101e384f44 None admin] PATH_INFO: `/v3/projects/fd0d3731e78f4bdeb6de691b1fe5e54e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:54.113145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a3f8a-9056-4c7c-8f16-f9101e384f44 None admin] RBAC: Authorizing `identity:get_project(project_id=fd0d3731e78f4bdeb6de691b1fe5e54e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:54.114594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a3f8a-9056-4c7c-8f16-f9101e384f44 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:54.116195 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 458/904] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Oct 29 02:32:53 2022] GET /identity/v3/projects/fd0d3731e78f4bdeb6de691b1fe5e54e => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:32:54.123587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:32:54.195113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:32:54.231641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44127ccc-1f12-456e-8a3f-655f8f60fedb None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:32:54.266542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:32:54.267142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:32:54.267421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:32:54.267735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:32:54.268452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=fd0d3731e78f4bdeb6de691b1fe5e54e, user.id=bca968e58508476dba0309a8d331712d) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:32:54.268760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:32:54.270217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f792a13-d394-4121-adb7-0b41b08a32c7 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:32:54.276033 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 447/905] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:32:54 2022] GET /identity/v3/role_assignments?user.id=bca968e58508476dba0309a8d331712d&scope.project.id=fd0d3731e78f4bdeb6de691b1fe5e54e&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:04.105527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=34 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:04.273397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=34 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:49.651379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf1038-3049-4bcb-881a-2a0f9af2c993 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:49.651982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf1038-3049-4bcb-881a-2a0f9af2c993 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:49.651982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf1038-3049-4bcb-881a-2a0f9af2c993 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:49.653252 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 459/906] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:33:49.659858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:49.662037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:49.662037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:49.680218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:33:49.681459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:33:49.772136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 448/907] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:33:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:33:50.067395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf1038-3049-4bcb-881a-2a0f9af2c993 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:50.191034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf1038-3049-4bcb-881a-2a0f9af2c993 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:50.234950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:50.235668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:50.236002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:50.236668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:50.256014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:50.258342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:33:50.281233 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:50.282366 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:33:50.287045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:33:50.287045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:50.287045 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:33:50.287045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 460/908] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:33:50.289270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:50.407914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d583eb-8b5f-4ad7-b9e3-eb8fc25eba67 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:50.442408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:50.452415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:50.453056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:50.453335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:50.453607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:50.454328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:50.454683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:50.456302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c47d-447e-46b8-98d4-7b49ab29cc93 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:50.476429 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 449/909] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:50.478149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:50.556033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:50.627681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8a2b9-9247-4b64-95e3-3c271d8823f0 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:50.669210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d137a1-cdb4-4ca1-b602-dc5eef602852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:50.670021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d137a1-cdb4-4ca1-b602-dc5eef602852 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:50.670021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d137a1-cdb4-4ca1-b602-dc5eef602852 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:50.670330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d137a1-cdb4-4ca1-b602-dc5eef602852 None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:50.670960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d137a1-cdb4-4ca1-b602-dc5eef602852 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:50.672409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d137a1-cdb4-4ca1-b602-dc5eef602852 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:50.699595 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 461/910] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Oct 29 02:33:50 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:33:53.190528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcf50-aa25-4c2f-821c-beeb1e97e457 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:53.191175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcf50-aa25-4c2f-821c-beeb1e97e457 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:53.191175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dcf50-aa25-4c2f-821c-beeb1e97e457 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:53.192786 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 450/911] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:33:53.199784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:53.200253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:53.200326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:53.225717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:33:53.227004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:33:53.328284 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 462/912] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:33:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:33:53.633596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dcf50-aa25-4c2f-821c-beeb1e97e457 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:53.763077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dcf50-aa25-4c2f-821c-beeb1e97e457 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:53.805917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:53.806622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:53.806902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:53.807258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] PATH_INFO: `/v3/roles/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:53.819953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:33:53.824655 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:53.825759 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:33:53.826890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 451/913] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:33:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:33:53.836852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:53.892881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:53.964041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cab272-03a4-4904-8b38-11b7e5e40db0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:54.005071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:54.008323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:54.008609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:54.008883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:54.009569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] RBAC: Adding query filter params (name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:54.009903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:54.011328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:54.021090 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 463/914] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:33:54.027725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:54.086419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:54.145184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe0878-6d60-4deb-b207-d10aab66532f None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:54.181421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:54.182086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:54.182368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:54.182636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:54.192842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:54.194348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:33:54.216828 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:54.218234 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:33:54.219383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:33:54.219383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:54.219383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:33:54.219383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 452/915] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:54.226314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:54.339738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:54.342879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef843348-a350-44fb-97f9-18e174ff1f80 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:54.380628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:54.381237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:54.381501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:54.381841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:54.382473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:54.382890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:54.384226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:54.396873 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 464/916] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:54.402893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:54.518886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a09461-8c35-4f0f-8ab3-1b3831091947 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:54.520524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:54.562066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:54.562714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:54.562993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:54.565847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] PATH_INFO: `/v3/users/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:54.571486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:54.572959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:33:54.585220 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:54.586317 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:33:54.587841 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:33:54.591559 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 453/917] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:54.592310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:54.701044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718cbb5-93c4-4ce9-8555-9dfc326ff8a7 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:54.735658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:54.736814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:54.737283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:54.737756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:54.738762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:54.739310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:54.741356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:54.761958 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 465/918] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Oct 29 02:33:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:33:54.767696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:54.878863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00fd8f-da1c-42f6-ad83-64387387184b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:54.930981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:54.931843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:54.932120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:54.932585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:54.945920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:54.947615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:33:54.963278 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:54.969297 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:33:54.970695 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:33:54.970695 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:54.970695 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:33:54.970695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 454/919] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:54.970988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:54.991496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:55.088204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b02ba-24b6-4ba3-93f8-7f66cfe6b7ef None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:55.126372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:55.127031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:55.127303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:55.127566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:55.128206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:55.128502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:55.129985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:55.145584 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 466/920] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:55.152934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:55.172730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:55.274767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264f7a8-180c-4eb5-a36c-f8be4690705b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:55.327678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:55.328328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:55.328603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:55.328871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:55.337128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:55.339159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:33:55.353540 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:55.354731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:33:55.355654 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 455/921] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:55.361595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:55.453206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:55.478153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ea49-ff9a-4950-a6cc-c8dceae57437 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:55.516377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:55.517063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:55.517418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:55.517692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:55.518690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:55.519101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:55.520488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e02a8-9a88-4bc6-8352-9e5a526b24f5 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:55.533474 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 467/922] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:55.539537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:55.620269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:55.647253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c29837-e659-4057-aaab-cec3014055b2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:55.680975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25dc54-e95d-4869-9829-10b2ff942362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:55.681648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25dc54-e95d-4869-9829-10b2ff942362 None admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:55.681966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25dc54-e95d-4869-9829-10b2ff942362 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:55.682237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25dc54-e95d-4869-9829-10b2ff942362 None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/b6ca3aaf505f4d76bae1ad093ddb64f5/roles/029c7be686a84a9686fb6f8fa393a4c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:55.697520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25dc54-e95d-4869-9829-10b2ff942362 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=b6ca3aaf505f4d76bae1ad093ddb64f5, role_id=029c7be686a84a9686fb6f8fa393a4c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:55.699014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25dc54-e95d-4869-9829-10b2ff942362 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:55.714520 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 456/923] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:33:55 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/b6ca3aaf505f4d76bae1ad093ddb64f5/roles/029c7be686a84a9686fb6f8fa393a4c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:33:57.894531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593a2bc-4eb9-4fae-bbea-01bc2d0c8c8f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:57.895094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593a2bc-4eb9-4fae-bbea-01bc2d0c8c8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:57.895094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593a2bc-4eb9-4fae-bbea-01bc2d0c8c8f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:57.896334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 468/924] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:33:57.901840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:57.902242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:57.902418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:57.921625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:33:57.922913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:33:57.993056 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 457/925] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:33:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:33:58.257137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593a2bc-4eb9-4fae-bbea-01bc2d0c8c8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:58.365022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593a2bc-4eb9-4fae-bbea-01bc2d0c8c8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:58.404140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:58.405113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:58.405393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:58.405878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] PATH_INFO: `/v3/roles/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:58.414811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:58.420074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:33:58.426811 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:58.427965 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:33:58.428854 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 469/926] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Oct 29 02:33:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:58.435513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:58.493730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:58.541591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892fc8b-579f-486b-a182-ddc30debc05e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:58.583655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:58.584262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:58.584540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:58.584806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:58.585467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:58.585773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:58.587182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:58.595743 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 458/927] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Oct 29 02:33:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:58.601663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:58.706967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2145406d-a69b-46b3-a7d0-34498f0698de None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:58.744483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:58.745149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:58.745429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:58.745697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:58.757547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:58.759040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:33:58.773834 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:58.774988 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:33:58.776616 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:33:58.776616 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:58.776616 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:33:58.776616 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 470/928] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:58.780922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:58.891866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03818bd4-c7b7-4b20-b528-1e538c6a8fb4 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:58.910997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:58.930485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:58.931103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:58.931383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:58.931711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:58.932305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:58.932603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:58.934004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:58.948500 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 459/929] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:33:58.954473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:59.011851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:59.067751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0f87-1890-43b9-bf40-9b2782067c2a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:59.104233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:59.105114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:59.105471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:59.105920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:59.114680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:59.116158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:33:59.128863 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:59.130369 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:33:59.131467 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 471/930] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:59.136562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:59.256236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6da21e-c4d4-424c-b59e-0877690388d2 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:59.293423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:59.294087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:59.294351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:59.294593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:59.295307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:59.295625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:59.297043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:59.314864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 460/931] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Oct 29 02:33:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:33:59.321157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:59.429435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191014f5-f6cf-41ba-afc7-1dc0b3e00c64 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:59.440068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:59.467104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:59.467758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:59.468044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:59.468298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:59.535064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:59.536498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:59.634749 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 472/932] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:33:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:33:59.640718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:59.677404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:59.756675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2493e7f-87dd-4d67-bdaf-90eb67bbc87b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:59.795080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:59.795685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:59.795963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:59.796233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:59.807944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:59.810323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:33:59.825956 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:33:59.826974 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:33:59.827975 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:33:59.827975 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:33:59.827975 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:33:59.827975 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 461/933] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:33:59.832946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:33:59.844843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:33:59.940659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a19a38-7a05-46ea-9b55-83f4b124c829 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:33:59.977561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:33:59.978261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:33:59.978458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:33:59.978753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:33:59.979514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:33:59.979924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:33:59.981483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:33:59.994292 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 473/934] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:00.000487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:00.088236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:00.102971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e6d8c-2c51-4f3a-82e8-9347d374cfcc None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:00.138778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:00.139424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:00.139699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:00.139964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:00.146908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:00.148364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:34:00.159837 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:00.160725 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:00.161623 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 462/935] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:00.167208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:00.256756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:00.291618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb05c97-73a8-46e9-950a-1df3f2fd9570 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:00.325883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:00.326489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:00.326762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:00.327024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:00.327703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:00.328003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:00.329428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beafb42-3e8e-4f66-ae5e-4b195ac98aac None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:00.342826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 474/936] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:00.349362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:00.458325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930290a5-6d2d-4f76-a7bc-6cfcd417c719 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:00.495953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:00.496565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:00.496846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:00.497118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:00.498181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] RBAC: Adding query filter params (role.id=029c7be686a84a9686fb6f8fa393a4c1, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=b6ca3aaf505f4d76bae1ad093ddb64f5) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:00.498489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:00.499921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28938965-9908-4556-8df1-114eb7f3fe81 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:00.506671 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 463/937] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:34:00 2022] GET /identity/v3/role_assignments?user.id=b6ca3aaf505f4d76bae1ad093ddb64f5&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=029c7be686a84a9686fb6f8fa393a4c1 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:02.710322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e614-9ca7-4275-84a8-fdbec818d386 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:02.710921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e614-9ca7-4275-84a8-fdbec818d386 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:02.710921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5e614-9ca7-4275-84a8-fdbec818d386 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:02.712745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 475/938] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:34:02.718221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:02.718714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:02.718895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:02.739280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:34:02.740474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:34:02.743682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:02.810821 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 464/939] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:34:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:34:03.096536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e614-9ca7-4275-84a8-fdbec818d386 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:03.217941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5e614-9ca7-4275-84a8-fdbec818d386 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:03.256922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:03.264869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:03.265640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:03.265958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:03.266223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:03.278623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:34:03.285136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:03.286143 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:03.287040 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 476/940] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 02:34:03.293560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:03.405501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728cdd45-a558-42cf-a758-7de24649fb0b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:03.441384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:03.442109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:03.442396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:03.442800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:03.443488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:03.443864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:03.445381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:03.454809 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 465/941] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:03.461233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:03.578643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2854-e294-4910-a7c3-07f3dcb45e2b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:03.617708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:03.618499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:03.618989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:03.619317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:03.631673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:03.633208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:34:03.649996 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:03.651582 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:34:03.653227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:34:03.653227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:03.653227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:03.653227 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 477/942] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:03.658621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:03.661882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:03.771534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d6dd2-8e5a-4f39-a208-ff9421ad6668 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:03.808612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:03.809224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:03.809525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:03.809791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:03.810451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:03.810792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:03.812154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:03.825691 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 466/943] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:03.832449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:03.879939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:03.958780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ae1ff-7c04-483c-98af-00aed1c18e2e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:03.995862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:03.996497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:03.996774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:03.997043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:04.005575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:04.007283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:34:04.019375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:04.020478 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:04.021603 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 478/944] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:34:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:04.026536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:04.090706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:04.133084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2c410-b50b-4d51-a6ac-a80af1fd3977 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:04.173647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:04.174452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:04.174700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:04.175016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:04.175908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:04.176272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:04.178011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:04.199556 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 467/945] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Oct 29 02:34:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:04.206070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:04.312106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4171bd7-2a05-434b-9d26-e7b4fccb5164 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:04.313635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:04.349094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:04.349820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:04.350141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:04.350411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:04.364221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:04.365785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:34:04.381199 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:04.387779 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:34:04.389032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:34:04.389032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:04.389032 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:04.389032 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 479/946] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:04.389325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:04.496102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c279d85-329d-405f-889e-1bc33b6b22ee None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:04.517934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:04.534233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:04.534845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:04.535116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:04.535418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:04.536021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:04.536323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:04.537690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:04.552238 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 468/947] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:04.558521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:04.665348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff1d1d-c326-4a6f-8bdd-b1a1a5be954b None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:04.706617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:04.707222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:04.707494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:04.707787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:04.714722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:04.716131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:34:04.727217 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:04.728111 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:04.729003 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 480/948] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:04.735661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:04.842455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba6d37-130d-469a-a7ea-0de172ffd474 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:04.879882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:04.880549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:04.880847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:04.881096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:04.881823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:04.882138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:04.883594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3d6b1-701b-4590-8368-2cae8c6bbfcc None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:04.896055 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 469/949] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:04.902196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:04.919872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:05.012028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468aef6-29cd-495d-98df-6d319c7f8e0d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:05.049661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4d314-c682-4506-a4b8-a4a0214a3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:05.050500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d314-c682-4506-a4b8-a4a0214a3b9c None admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:05.050858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d314-c682-4506-a4b8-a4a0214a3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:05.051157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4d314-c682-4506-a4b8-a4a0214a3b9c None admin] PATH_INFO: `/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/b6ca3aaf505f4d76bae1ad093ddb64f5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:05.053422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4d314-c682-4506-a4b8-a4a0214a3b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=5b35131b35f2480ca98805b81ea3f741, user_id=b6ca3aaf505f4d76bae1ad093ddb64f5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:05.055235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d4d314-c682-4506-a4b8-a4a0214a3b9c None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:05.070725 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 481/950] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Oct 29 02:34:04 2022] PUT /identity/v3/projects/5b35131b35f2480ca98805b81ea3f741/users/b6ca3aaf505f4d76bae1ad093ddb64f5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:34:07.479734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c00ab-77d6-466e-b520-c6e4b3da82d8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:07.480296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c00ab-77d6-466e-b520-c6e4b3da82d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:07.480296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c00ab-77d6-466e-b520-c6e4b3da82d8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:07.481770 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 470/951] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:34:07.488214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:07.488669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:07.488906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:07.508539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:34:07.509742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:34:07.589842 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 482/952] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:34:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:34:07.900919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c00ab-77d6-466e-b520-c6e4b3da82d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:07.947123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:08.015619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c00ab-77d6-466e-b520-c6e4b3da82d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:08.053857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:08.054502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:08.054795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:08.055088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:08.066078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 29 02:34:08.071532 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:08.072493 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:08.073308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 471/953] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Oct 29 02:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:08.079646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:08.083717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:08.183302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e0526-237e-4f05-9b4a-ce615be75d22 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:08.221558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:08.222265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:08.222549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:08.222882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:08.223552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] RBAC: Adding query filter params (name=admin) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:08.223855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:08.225443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:08.234399 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 483/954] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Oct 29 02:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:08.242792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:08.357780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:08.361933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab784d-1cd8-4eb6-bb58-14d2118c7098 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:08.404852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:08.405719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:08.406265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:08.406684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:08.419322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:08.420886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:34:08.436814 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:08.438180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:34:08.439470 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:34:08.439470 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:08.439470 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:08.439470 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 472/955] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:08.444149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:08.512510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:08.553084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606bf84-dddd-4719-b0ab-7ea3b763d574 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:08.591294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:08.592222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:08.592523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:08.592802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:08.593432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:08.593728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:08.595284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:08.610380 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 484/956] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:34:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:08.617403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:08.727631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97991bb-06d2-4371-9b9c-b4a107ee299a None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:08.762734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:08.763365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:08.763660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:08.763926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:08.774097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:08.775731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 02:34:08.789059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:08.790289 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:08.794662 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 473/957] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:34:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:08.796852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:08.920788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22026c0c-396e-42b3-9496-20084bb6def2 None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:08.955306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:08.966646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:08.967294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:08.967578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:08.967855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:08.968617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:08.968926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:08.970634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:08.990502 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 485/958] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Oct 29 02:34:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:08.998427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:09.018079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:09.119466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f5e5d-d239-43dc-8b02-4855b1328e64 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:09.163246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:09.164266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:09.164748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:09.165302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:09.271840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:09.274739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:09.293602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:09.407604 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 474/959] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Oct 29 02:34:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 29 02:34:09.413659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:09.543554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02729437-dec8-49ba-bc74-99f5af0fad0d None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:09.585915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:09.586591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:09.586870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:09.587139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:09.598184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:09.599840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 02:34:09.616817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:09.617943 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 29 02:34:09.618974 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 02:34:09.618974 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 02:34:09.618974 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:09.618974 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 486/960] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:09.624807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:09.744122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb8a7f-997f-4456-bfd7-4cc86366575e None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:09.763768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:09.791260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:09.791893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:09.792158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:09.792423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:09.793084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:09.793387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:09.794906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:09.808107 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 475/961] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Oct 29 02:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:09.814477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:09.851963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:09.923468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344696c4-c028-4b26-a825-424d9a04c4cb None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:09.960216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:09.960862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:09.961132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:09.961402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] PATH_INFO: `/v3/projects/service` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:09.968781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:09.970355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 29 02:34:09.982383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:09.983490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:34:09.989642 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 487/962] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Oct 29 02:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:09.990296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:10.100212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcc108-dfa4-41eb-869a-23109ce61789 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:10.137475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:10.138129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:10.138403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:10.138673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:10.139358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:10.139662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:10.141113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf786dc-437f-4b26-98d8-bb339b4e3d4a None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:10.154293 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 476/963] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Oct 29 02:34:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:10.160756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:10.269410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:10.276052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3ba84-b90f-4185-95cf-ebf67b70404a None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:10.310574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:10.311203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:10.311478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:10.311744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:10.312468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] RBAC: Adding query filter params (role.id=7cfb0f87b5f748c9a420873e8002b480, scope.project.id=5b35131b35f2480ca98805b81ea3f741, user.id=b6ca3aaf505f4d76bae1ad093ddb64f5) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:10.312770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:10.314327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b382826-3544-4de3-a216-abea6972ed78 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:10.320302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 488/964] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Oct 29 02:34:10 2022] GET /identity/v3/role_assignments?user.id=b6ca3aaf505f4d76bae1ad093ddb64f5&scope.project.id=5b35131b35f2480ca98805b81ea3f741&role.id=7cfb0f87b5f748c9a420873e8002b480 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:12.429460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a5faf-6e5d-44dd-8e17-92be877ac7ef None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:12.430082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a5faf-6e5d-44dd-8e17-92be877ac7ef None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:12.430082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a5faf-6e5d-44dd-8e17-92be877ac7ef None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:12.431350 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 477/965] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:34:12.440203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:12.440913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:12.441065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:12.465589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:34:12.466853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:34:12.538300 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 489/966] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:34:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:34:12.801488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a5faf-6e5d-44dd-8e17-92be877ac7ef None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:12.843054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:12.915779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a5faf-6e5d-44dd-8e17-92be877ac7ef None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:12.950843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:12.951465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:12.951737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:12.952006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] PATH_INFO: `/v3/services/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:12.952575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:12.953982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:12.963148 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:12.966019 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:12.967512 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 478/967] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:34:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:12.972539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:13.063803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:13.074580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b4b2b-105d-4210-85ca-565634364ee9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:13.109210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:13.109843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:13.110104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:13.110397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:13.111113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] RBAC: Adding query filter params (name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:13.111414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:13.112775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d60c4-f486-4f91-a0cf-d978e4b2053f None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:13.117859 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 490/968] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Oct 29 02:34:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:13.124795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:13.235728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:13.243645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d953f-73c9-43d9-a35e-1d1c6250700b None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:13.282072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:13.283133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:13.283437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:13.283805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:13.284613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] RBAC: Adding query filter params (type=placement) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:13.284916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:13.286319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935f9c9d-9c71-4bac-9486-24951339f771 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:13.291011 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 479/969] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Oct 29 02:34:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:15.440587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d19cc-cf6f-426a-a369-2f75511e9663 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:15.441146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d19cc-cf6f-426a-a369-2f75511e9663 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:15.441146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d19cc-cf6f-426a-a369-2f75511e9663 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:15.442557 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 491/970] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:34:15.449125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b0d5-1a5e-41cd-a6f4-e0e3eb1292ff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:15.449587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b0d5-1a5e-41cd-a6f4-e0e3eb1292ff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:15.449691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed9b0d5-1a5e-41cd-a6f4-e0e3eb1292ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:15.471998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5ed9b0d5-1a5e-41cd-a6f4-e0e3eb1292ff None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:34:15.473185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ed9b0d5-1a5e-41cd-a6f4-e0e3eb1292ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:34:15.544291 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 480/971] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:34:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:34:15.811505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d19cc-cf6f-426a-a369-2f75511e9663 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:15.920679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d19cc-cf6f-426a-a369-2f75511e9663 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:15.958435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1f2dc-e5ed-4586-b66b-599bab180c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:15.959034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f2dc-e5ed-4586-b66b-599bab180c55 None admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:15.959310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f2dc-e5ed-4586-b66b-599bab180c55 None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:15.959576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1f2dc-e5ed-4586-b66b-599bab180c55 None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:15.960212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f2dc-e5ed-4586-b66b-599bab180c55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:15.961578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1f2dc-e5ed-4586-b66b-599bab180c55 None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:15.979146 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 492/972] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Oct 29 02:34:15 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:34:18.128929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ea9f7-49e3-497e-9f0c-c7f3fbc9eecb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:18.129855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ea9f7-49e3-497e-9f0c-c7f3fbc9eecb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:18.129855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0ea9f7-49e3-497e-9f0c-c7f3fbc9eecb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:18.131995 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 481/973] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:34:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:34:18.138375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:18.139092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:18.139253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:18.165522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:34:18.166746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:34:18.176145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:18.250531 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 493/974] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:34:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:34:18.517778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ea9f7-49e3-497e-9f0c-c7f3fbc9eecb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:18.627868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:18.641305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0ea9f7-49e3-497e-9f0c-c7f3fbc9eecb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:18.679663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:18.680282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:18.680561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:18.680827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] PATH_INFO: `/v3/services/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:18.681406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:18.682811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:18.691997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:18.692997 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:18.694029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 482/975] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:34:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:18.700293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:18.803032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47446ecd-77ba-4929-8423-7f94865c17c3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:18.838499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:18.839097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:18.839372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:18.839635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:18.840260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:18.840566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:18.841965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:18.847266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 494/976] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Oct 29 02:34:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:18.853521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:18.959578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d30c8d-57e9-4fea-a377-c0d9f197d58c None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:18.994770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:18.995372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:18.995649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:18.995922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:18.996617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] RBAC: Adding query filter params (interface=public, service_id=77953e1d5cfd40a08b068d7d77a7755b, region_id=RegionOne) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:18.996926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:18.998652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153fdd3-e38b-4575-a58b-bc896bad9977 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:19.003962 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 483/977] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Oct 29 02:34:18 2022] GET /identity/v3/endpoints?service_id=77953e1d5cfd40a08b068d7d77a7755b&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:19.010504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:19.016566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:19.127092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558b3e5-9278-4b8e-8b80-7cd8e624325e None admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:19.161848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275413a7-67d0-4fdb-9305-b10268b568ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:19.162452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275413a7-67d0-4fdb-9305-b10268b568ca None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:19.162686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275413a7-67d0-4fdb-9305-b10268b568ca None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:19.162951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275413a7-67d0-4fdb-9305-b10268b568ca None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:19.163537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275413a7-67d0-4fdb-9305-b10268b568ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:19.164887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275413a7-67d0-4fdb-9305-b10268b568ca None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:19.172240 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 495/978] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Oct 29 02:34:19 2022] GET /identity/v3/services => generated 2191 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:34:21.320816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89775a6-f8e4-4c7f-bce4-1121e0558c20 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:21.321415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89775a6-f8e4-4c7f-bce4-1121e0558c20 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:21.321415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89775a6-f8e4-4c7f-bce4-1121e0558c20 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:21.322714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 484/979] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:34:21.328923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:21.329600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:21.329705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:21.354210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:34:21.355392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:34:21.419349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:21.425526 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 496/980] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:34:21 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 02:34:21.686917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89775a6-f8e4-4c7f-bce4-1121e0558c20 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:21.709466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:21.794990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89775a6-f8e4-4c7f-bce4-1121e0558c20 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:21.833883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:21.834818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:21.835205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:21.835587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:21.836472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:21.838703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:34:21.850863 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:34:21.851946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:34:21.852854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 485/981] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Oct 29 02:34:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:34:21.858324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:21.960965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec71b9-9bc4-47e5-8f0a-a6c6c86cacfd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:21.998121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:21.998724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:21.999001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:21.999271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:21.999890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] RBAC: Adding query filter params (name=placement) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:34:22.000196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:22.001612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6600bf-774b-4af4-9974-e647319dd77e None admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:22.006886 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 497/982] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Oct 29 02:34:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:34:22.013318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:34:22.105983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:22.125114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2513e5-8bfa-4aab-acc7-0101e5ae38c3 None admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:34:22.160236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b12488-9d98-4568-9055-8cdaefe98153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:34:22.160845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b12488-9d98-4568-9055-8cdaefe98153 None admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:34:22.161125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b12488-9d98-4568-9055-8cdaefe98153 None admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:34:22.161388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b12488-9d98-4568-9055-8cdaefe98153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:34:22.162089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b12488-9d98-4568-9055-8cdaefe98153 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:34:22.163462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b12488-9d98-4568-9055-8cdaefe98153 None admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:34:22.186014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 486/983] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:34:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:34:32.003714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=69 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:34:32.181854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:26.667759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b4f7-a171-4a1f-8cae-e3c241fc1751 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:26.668266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b4f7-a171-4a1f-8cae-e3c241fc1751 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:26.668266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721b4f7-a171-4a1f-8cae-e3c241fc1751 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:26.669642 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 498/984] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:26.675085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea17e7-133c-4b6f-91a7-4598e00994a2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:26.675495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea17e7-133c-4b6f-91a7-4598e00994a2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:26.675672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea17e7-133c-4b6f-91a7-4598e00994a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:26.820111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dfea17e7-133c-4b6f-91a7-4598e00994a2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:26.821967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfea17e7-133c-4b6f-91a7-4598e00994a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:26.932280 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 487/985] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:27.222688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed83cc-6038-4981-a642-464a104de5e8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:27.223335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed83cc-6038-4981-a642-464a104de5e8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:27.223765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed83cc-6038-4981-a642-464a104de5e8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:27.225494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 499/986] 10.222.0.16 () {54 vars in 965 bytes} [Sat Oct 29 02:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:27.232065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e06760-5a2d-4f7d-bb22-58dfb204a7c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:27.232739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e06760-5a2d-4f7d-bb22-58dfb204a7c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:27.233203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e06760-5a2d-4f7d-bb22-58dfb204a7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:27.337767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56e06760-5a2d-4f7d-bb22-58dfb204a7c7 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:27.339400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56e06760-5a2d-4f7d-bb22-58dfb204a7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:27.365089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:27.443751 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 488/987] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Oct 29 02:35:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:35:27.454731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed83cc-6038-4981-a642-464a104de5e8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:27.456487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26ed83cc-6038-4981-a642-464a104de5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:27.595983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed83cc-6038-4981-a642-464a104de5e8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:27.690015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:27.691331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:27.691775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:27.692184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:27.693961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:27.759652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:27.820727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:27.822712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370c4c4-5ca6-4160-96ee-8f17e180feb1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:27.844564 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 500/988] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:30.292473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284409-473f-4a4b-a989-4efebf69d0c3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:30.293047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284409-473f-4a4b-a989-4efebf69d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:30.293047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8284409-473f-4a4b-a989-4efebf69d0c3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:30.294392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 489/989] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:30.299777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819deb4-2e31-4471-b6e1-5427a3d10c12 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:30.300215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819deb4-2e31-4471-b6e1-5427a3d10c12 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:30.300444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819deb4-2e31-4471-b6e1-5427a3d10c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:30.385762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d819deb4-2e31-4471-b6e1-5427a3d10c12 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:30.387087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d819deb4-2e31-4471-b6e1-5427a3d10c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:30.481662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 501/990] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:30.789716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284409-473f-4a4b-a989-4efebf69d0c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:30.792231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8284409-473f-4a4b-a989-4efebf69d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:30.913960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8284409-473f-4a4b-a989-4efebf69d0c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:31.001418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:31.003977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:31.004641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:31.004927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:31.005223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:31.007788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:31.126592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:31.127934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3ba68-0799-45b2-a612-b769921f2fbb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:31.147098 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 490/991] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:33.582887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef74b-05fc-44cd-a141-f6c1195fdaad None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:33.583427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef74b-05fc-44cd-a141-f6c1195fdaad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:33.583427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef74b-05fc-44cd-a141-f6c1195fdaad None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:33.584784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 502/992] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:33.590165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c066f-983f-4c03-b1f8-c64bea672582 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:33.590596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c066f-983f-4c03-b1f8-c64bea672582 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:33.590688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c066f-983f-4c03-b1f8-c64bea672582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:33.670508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-990c066f-983f-4c03-b1f8-c64bea672582 None None] MFA Rules not processed for user `62c7aa43a9fd41578b1c632db7d55d19`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:33.671737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-990c066f-983f-4c03-b1f8-c64bea672582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:33.726485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:33.773253 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 491/993] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:34.054696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef74b-05fc-44cd-a141-f6c1195fdaad None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:34.056246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b5ef74b-05fc-44cd-a141-f6c1195fdaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:34.066928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:34.170446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef74b-05fc-44cd-a141-f6c1195fdaad None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:34.256094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:34.256692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:34.256970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:34.257236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:34.258870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:34.325460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:34.381697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:34.383202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f6dc-4b8d-4dd0-add2-b152854658d6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:34.401775 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 503/994] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:37.114601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cc845-1dd9-4566-9299-c8a57ea84b9f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:37.115179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cc845-1dd9-4566-9299-c8a57ea84b9f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:37.115179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cc845-1dd9-4566-9299-c8a57ea84b9f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:37.116507 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 492/995] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:37.121930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998d31-731d-443c-877a-a64b86045669 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:37.122362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998d31-731d-443c-877a-a64b86045669 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:37.122455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85998d31-731d-443c-877a-a64b86045669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:37.189711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85998d31-731d-443c-877a-a64b86045669 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:37.191027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85998d31-731d-443c-877a-a64b86045669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:37.289321 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 504/996] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:37.597244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cbe09-7b9b-4862-9ca9-7537c2bcee9d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:37.597485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cbe09-7b9b-4862-9ca9-7537c2bcee9d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:37.597765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cbe09-7b9b-4862-9ca9-7537c2bcee9d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:37.599163 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 493/997] 10.222.0.16 () {54 vars in 965 bytes} [Sat Oct 29 02:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:37.605070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66f430-e6f7-4ede-959c-0afc4bd4ca3d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:37.605357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66f430-e6f7-4ede-959c-0afc4bd4ca3d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:37.605627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66f430-e6f7-4ede-959c-0afc4bd4ca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:37.629044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:37.685384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4e66f430-e6f7-4ede-959c-0afc4bd4ca3d None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:37.686635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e66f430-e6f7-4ede-959c-0afc4bd4ca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:37.776953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 505/998] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Oct 29 02:35:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:37.787951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cbe09-7b9b-4862-9ca9-7537c2bcee9d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:37.789495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b5cbe09-7b9b-4862-9ca9-7537c2bcee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:37.907246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cbe09-7b9b-4862-9ca9-7537c2bcee9d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:37.982398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:37.983002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:37.983273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:37.983542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:37.985244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:37.993395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:38.108444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:38.109869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832216c7-76fa-4dd1-af47-e166bc2f97f7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:38.128476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 494/999] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:41.396434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be79f77-0d90-49b5-bb01-7534bb16ee6d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:41.397035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be79f77-0d90-49b5-bb01-7534bb16ee6d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:41.397035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be79f77-0d90-49b5-bb01-7534bb16ee6d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:41.398402 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 506/1000] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:41.403872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ffce-1246-41cc-84e0-77e4c4058902 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:41.404279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ffce-1246-41cc-84e0-77e4c4058902 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:41.404395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ffce-1246-41cc-84e0-77e4c4058902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:41.480987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dda8ffce-1246-41cc-84e0-77e4c4058902 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:41.482364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dda8ffce-1246-41cc-84e0-77e4c4058902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:41.557564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:41.604674 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 495/1001] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:41.884355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be79f77-0d90-49b5-bb01-7534bb16ee6d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:41.885931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3be79f77-0d90-49b5-bb01-7534bb16ee6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:41.994114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be79f77-0d90-49b5-bb01-7534bb16ee6d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:42.007906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:42.072840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:42.073569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:42.073832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:42.074135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:42.075747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:42.190806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:42.192241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67c7b7-f0ab-481f-ae2c-23983a358172 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:42.212483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 507/1002] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:44.394518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee903a1-ccfd-48cb-9f41-2589afd0cc61 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:44.395074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee903a1-ccfd-48cb-9f41-2589afd0cc61 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:44.395074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee903a1-ccfd-48cb-9f41-2589afd0cc61 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:44.396656 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 496/1003] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:44.402054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206d9b-a83f-46ba-8f4e-2c17bf4bdf4c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:44.402496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206d9b-a83f-46ba-8f4e-2c17bf4bdf4c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:44.402758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77206d9b-a83f-46ba-8f4e-2c17bf4bdf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:44.456947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:44.476250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-77206d9b-a83f-46ba-8f4e-2c17bf4bdf4c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:44.477454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77206d9b-a83f-46ba-8f4e-2c17bf4bdf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:44.577374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 508/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:44.854481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee903a1-ccfd-48cb-9f41-2589afd0cc61 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:44.856071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ee903a1-ccfd-48cb-9f41-2589afd0cc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:44.962334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee903a1-ccfd-48cb-9f41-2589afd0cc61 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:45.041007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:45.041632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:45.041934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:45.042203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:45.043920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:45.061886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:45.154630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:45.155990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d63b00-837a-4edc-83a2-d0fb4d833bbb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:45.175001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 497/1005] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:47.401454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec745-35da-4edd-8406-2c12fe13d880 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:47.402335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec745-35da-4edd-8406-2c12fe13d880 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:47.402335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ec745-35da-4edd-8406-2c12fe13d880 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:47.404373 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 509/1006] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:47.410974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4fb0-8f7a-4505-a2f6-85f563b0733f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:47.411422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4fb0-8f7a-4505-a2f6-85f563b0733f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:47.411517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d4fb0-8f7a-4505-a2f6-85f563b0733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:47.486122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9c3d4fb0-8f7a-4505-a2f6-85f563b0733f None None] MFA Rules not processed for user `62c7aa43a9fd41578b1c632db7d55d19`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:47.487329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c3d4fb0-8f7a-4505-a2f6-85f563b0733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:47.560329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:47.594670 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 498/1007] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:35:47.872591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ec745-35da-4edd-8406-2c12fe13d880 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:47.874462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-115ec745-35da-4edd-8406-2c12fe13d880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:47.992634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ec745-35da-4edd-8406-2c12fe13d880 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:48.014510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:48.068858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:48.069466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:48.069741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:48.070027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:48.071603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:48.182448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:48.183869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95262355-3f5b-406e-9e7f-402c9c60599d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:48.202234 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 510/1008] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:50.594087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720afb2-9108-40e5-b694-12906e5a96a0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:50.594945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720afb2-9108-40e5-b694-12906e5a96a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:50.594945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720afb2-9108-40e5-b694-12906e5a96a0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:50.596854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 499/1009] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:50.602202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f71a-80ef-404a-a6e0-bb5f1b929df9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:50.602648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f71a-80ef-404a-a6e0-bb5f1b929df9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:50.602750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f71a-80ef-404a-a6e0-bb5f1b929df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:50.675910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:50.678741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-95e6f71a-80ef-404a-a6e0-bb5f1b929df9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:50.680685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95e6f71a-80ef-404a-a6e0-bb5f1b929df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:50.782044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 511/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:51.077089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720afb2-9108-40e5-b694-12906e5a96a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:51.080082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f720afb2-9108-40e5-b694-12906e5a96a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:51.199527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720afb2-9108-40e5-b694-12906e5a96a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:51.286848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:51.287460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:51.287732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:51.287998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:51.289592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:51.316840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:51.412164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:51.413522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebf32f-1b04-4169-8baa-1aa155a84989 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:51.433497 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 500/1011] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:53.627711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158250-163b-4600-a4e3-15285d2d89c1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:53.628271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158250-163b-4600-a4e3-15285d2d89c1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:53.628271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25158250-163b-4600-a4e3-15285d2d89c1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:53.630413 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 512/1012] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:53.638271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767272-ba19-4fbf-a37e-51dec3b9fbf4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:53.638720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767272-ba19-4fbf-a37e-51dec3b9fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:53.638809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c767272-ba19-4fbf-a37e-51dec3b9fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:53.709432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1c767272-ba19-4fbf-a37e-51dec3b9fbf4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:53.710676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c767272-ba19-4fbf-a37e-51dec3b9fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:53.788920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:53.814291 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 501/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:35:54.096820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158250-163b-4600-a4e3-15285d2d89c1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:54.098410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-25158250-163b-4600-a4e3-15285d2d89c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:54.216593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25158250-163b-4600-a4e3-15285d2d89c1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:54.249375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:54.296817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:54.297523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:54.297827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:54.298100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:54.299685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:54.419502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:54.420937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15051c77-6bcc-4132-be2f-e7a54c4982cc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:54.439828 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 513/1014] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:35:56.923094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c193-1d67-414e-856c-9b1c2e9c3147 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:56.924222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c193-1d67-414e-856c-9b1c2e9c3147 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:56.924222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c193-1d67-414e-856c-9b1c2e9c3147 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:56.926142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 502/1015] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:35:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:35:56.935028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeed7d-e120-4f83-9fae-8daae81e4836 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:56.935728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeed7d-e120-4f83-9fae-8daae81e4836 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:56.935881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aeed7d-e120-4f83-9fae-8daae81e4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:57.007098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d1aeed7d-e120-4f83-9fae-8daae81e4836 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:35:57.008301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1aeed7d-e120-4f83-9fae-8daae81e4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:57.017456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:57.118326 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 514/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:35:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:35:57.402679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c193-1d67-414e-856c-9b1c2e9c3147 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:35:57.404239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2da8c193-1d67-414e-856c-9b1c2e9c3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:57.519389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c193-1d67-414e-856c-9b1c2e9c3147 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:35:57.594008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:35:57.594681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:35:57.594951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:35:57.595220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:35:57.596813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:35:57.636615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:35:57.715462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:35:57.716952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec6c63-ea85-4e4d-9796-21b4d9dd4d67 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:35:57.736135 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 503/1017] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:35:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:36:01.890098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed601070-e472-4c4e-93b8-5e0d43108612 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:01.890641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed601070-e472-4c4e-93b8-5e0d43108612 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:01.890641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed601070-e472-4c4e-93b8-5e0d43108612 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:01.892142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 515/1018] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:01.897538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc997c6-aeb7-49b5-a2c9-0184d393d372 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:01.898008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc997c6-aeb7-49b5-a2c9-0184d393d372 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:01.898286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc997c6-aeb7-49b5-a2c9-0184d393d372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:01.964614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8fc997c6-aeb7-49b5-a2c9-0184d393d372 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:01.965826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fc997c6-aeb7-49b5-a2c9-0184d393d372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:02.050982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:02.063008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 504/1019] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:02.340521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed601070-e472-4c4e-93b8-5e0d43108612 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:02.342096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed601070-e472-4c4e-93b8-5e0d43108612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:02.449663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed601070-e472-4c4e-93b8-5e0d43108612 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:02.488271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:02.526993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:02.527624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:02.527899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:02.528132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:02.529718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:02.642218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:02.643666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d7697a-b97d-451e-9705-32490c676343 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:02.663201 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 516/1020] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:05.394851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b55f9-f4a7-41ac-b02c-8bd0bc51043b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:05.395384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b55f9-f4a7-41ac-b02c-8bd0bc51043b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:05.395384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b55f9-f4a7-41ac-b02c-8bd0bc51043b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:05.396612 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 505/1021] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:05.401976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0462b4-829b-4319-924f-5b0f922cad48 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:05.402428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0462b4-829b-4319-924f-5b0f922cad48 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:05.402542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0462b4-829b-4319-924f-5b0f922cad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:05.469016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4c0462b4-829b-4319-924f-5b0f922cad48 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:05.470251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c0462b4-829b-4319-924f-5b0f922cad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:05.488904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:05.571389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 517/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:05.850735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b55f9-f4a7-41ac-b02c-8bd0bc51043b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:05.852293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa8b55f9-f4a7-41ac-b02c-8bd0bc51043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:05.964462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b55f9-f4a7-41ac-b02c-8bd0bc51043b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:06.041642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:06.042279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:06.042550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:06.043217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:06.044790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:06.091202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:06.160807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:06.161535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd6e4bb-2a15-4193-be58-7234ccf01772 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:06.180199 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 506/1023] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:10.366824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751beee-5f06-430a-a14d-986399e80ea7 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:10.367364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751beee-5f06-430a-a14d-986399e80ea7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:10.367364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751beee-5f06-430a-a14d-986399e80ea7 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:10.368644 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 518/1024] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:10.374449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9712f-920c-4683-8d31-a0a1113a807c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:10.374885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9712f-920c-4683-8d31-a0a1113a807c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:10.374969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9712f-920c-4683-8d31-a0a1113a807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:10.449729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bcd9712f-920c-4683-8d31-a0a1113a807c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:10.451013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bcd9712f-920c-4683-8d31-a0a1113a807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:10.555984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:10.561944 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 507/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:10.861197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751beee-5f06-430a-a14d-986399e80ea7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:10.863552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a751beee-5f06-430a-a14d-986399e80ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:11.002420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a751beee-5f06-430a-a14d-986399e80ea7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:11.073990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:11.109277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:11.109996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:11.110272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:11.110543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:11.112171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:11.246037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:11.247471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7e052-29c8-40c4-854a-13777b0ddf64 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:11.267823 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 519/1026] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:16.252735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c328f9-346e-47e9-8431-4d619e7c35c0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:16.253214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c328f9-346e-47e9-8431-4d619e7c35c0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:16.253326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c328f9-346e-47e9-8431-4d619e7c35c0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:16.255742 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 508/1027] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:36:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:16.260825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06db17-0dd2-4664-9325-99ea6fb1f83a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:16.261589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06db17-0dd2-4664-9325-99ea6fb1f83a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:16.262055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06db17-0dd2-4664-9325-99ea6fb1f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:16.417703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4b06db17-0dd2-4664-9325-99ea6fb1f83a None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:16.419027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b06db17-0dd2-4664-9325-99ea6fb1f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:16.454538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:16.562348 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 520/1028] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:36:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:20.579970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5e2b2-4be3-4b1c-bd8c-d979cedf929a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:20.580535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5e2b2-4be3-4b1c-bd8c-d979cedf929a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:20.580535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5e2b2-4be3-4b1c-bd8c-d979cedf929a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:20.582014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 509/1029] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:20.587142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14750fa-1857-4e6a-ad03-2919164f9143 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:20.587597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14750fa-1857-4e6a-ad03-2919164f9143 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:20.587878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14750fa-1857-4e6a-ad03-2919164f9143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:20.667530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d14750fa-1857-4e6a-ad03-2919164f9143 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:20.668819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d14750fa-1857-4e6a-ad03-2919164f9143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:20.741493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:20.780164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 521/1030] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:36:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:22.169645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e7033-92b8-47b8-b61c-157e1ff1b489 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:22.170212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e7033-92b8-47b8-b61c-157e1ff1b489 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:22.170212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e7033-92b8-47b8-b61c-157e1ff1b489 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:22.171457 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 510/1031] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:22.176590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98d2d-3d4b-453e-9011-964acb9dbf5b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:22.177002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98d2d-3d4b-453e-9011-964acb9dbf5b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:22.177255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d98d2d-3d4b-453e-9011-964acb9dbf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:22.258357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-42d98d2d-3d4b-453e-9011-964acb9dbf5b None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:22.259576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-42d98d2d-3d4b-453e-9011-964acb9dbf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:22.367669 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 522/1032] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:36:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:25.843635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465db0-d59b-4524-b658-2c6d73e2415c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:25.844749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465db0-d59b-4524-b658-2c6d73e2415c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:25.845246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb465db0-d59b-4524-b658-2c6d73e2415c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:25.846864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 511/1033] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:25.852686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a08a4-c809-4d3f-892a-581999b6c3a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:25.853587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a08a4-c809-4d3f-892a-581999b6c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:25.854214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a08a4-c809-4d3f-892a-581999b6c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:25.893433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:25.927745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e0a08a4-c809-4d3f-892a-581999b6c3a1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:25.928939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e0a08a4-c809-4d3f-892a-581999b6c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:26.037839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 523/1034] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:26.337487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822e92-f576-48cf-80aa-5cd7ef24af27 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:26.338100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822e92-f576-48cf-80aa-5cd7ef24af27 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:26.338929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e822e92-f576-48cf-80aa-5cd7ef24af27 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:26.340638 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 512/1035] 10.222.0.16 () {54 vars in 961 bytes} [Sat Oct 29 02:36:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:26.348297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173c72-412d-4f4f-8cba-fbfb982e2187 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:26.349155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173c72-412d-4f4f-8cba-fbfb982e2187 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:26.349637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173c72-412d-4f4f-8cba-fbfb982e2187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:26.440259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-97173c72-412d-4f4f-8cba-fbfb982e2187 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:26.441514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97173c72-412d-4f4f-8cba-fbfb982e2187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:26.492653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:26.567813 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 524/1036] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 02:36:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:26.576304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822e92-f576-48cf-80aa-5cd7ef24af27 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:26.578113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e822e92-f576-48cf-80aa-5cd7ef24af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:26.739646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e822e92-f576-48cf-80aa-5cd7ef24af27 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:26.834908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:26.877346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:26.878122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:26.878490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:26.878865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:26.880534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:26.984544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:26.986428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c117c-804d-4cb8-9f69-7d0ceac98a8b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:27.006813 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 513/1037] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:29.375048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22219c-810d-48c4-bd0f-6f8e6bc7d1b1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:29.375566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22219c-810d-48c4-bd0f-6f8e6bc7d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:29.375566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22219c-810d-48c4-bd0f-6f8e6bc7d1b1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:29.377006 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 525/1038] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:29.383035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50363d51-f665-4056-a8db-5483517792af None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:29.383478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50363d51-f665-4056-a8db-5483517792af None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:29.383478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50363d51-f665-4056-a8db-5483517792af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:29.455739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-50363d51-f665-4056-a8db-5483517792af None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:29.456936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50363d51-f665-4056-a8db-5483517792af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:29.496447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:29.572634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 514/1039] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:29.859171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22219c-810d-48c4-bd0f-6f8e6bc7d1b1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:29.860895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d22219c-810d-48c4-bd0f-6f8e6bc7d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:30.032286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22219c-810d-48c4-bd0f-6f8e6bc7d1b1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:30.044176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:30.165875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:30.166476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:30.166748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:30.167014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:30.168611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:30.262204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:30.264197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4a85e-c090-4063-acc3-04a9bad11d73 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:30.282198 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 526/1040] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:32.752674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a4fa6-21e6-4780-929b-800910ad6407 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:32.753572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a4fa6-21e6-4780-929b-800910ad6407 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:32.753839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a4fa6-21e6-4780-929b-800910ad6407 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:32.755444 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 515/1041] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:32.761022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80d49-c6fe-427a-a1d6-6090ec4cbf4d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:32.761481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80d49-c6fe-427a-a1d6-6090ec4cbf4d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:32.761559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80d49-c6fe-427a-a1d6-6090ec4cbf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:32.777096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:32.834253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bdb80d49-c6fe-427a-a1d6-6090ec4cbf4d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:32.835697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdb80d49-c6fe-427a-a1d6-6090ec4cbf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:32.956490 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 527/1042] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:36:33.246668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b77b6-bed7-4641-aedc-dda010bf67a3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:33.246932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b77b6-bed7-4641-aedc-dda010bf67a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:33.247372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b77b6-bed7-4641-aedc-dda010bf67a3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:33.249195 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 516/1043] 10.222.0.16 () {54 vars in 961 bytes} [Sat Oct 29 02:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:33.254993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43499bdc-b78c-494e-b29d-a6c34e93c9a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:33.255396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43499bdc-b78c-494e-b29d-a6c34e93c9a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:33.255725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43499bdc-b78c-494e-b29d-a6c34e93c9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:33.350392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-43499bdc-b78c-494e-b29d-a6c34e93c9a0 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:33.351727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43499bdc-b78c-494e-b29d-a6c34e93c9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:33.389778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:33.522113 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 528/1044] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 02:36:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:33.524664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b77b6-bed7-4641-aedc-dda010bf67a3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:33.526232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c8b77b6-bed7-4641-aedc-dda010bf67a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:33.725559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b77b6-bed7-4641-aedc-dda010bf67a3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:33.755675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:33.885848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:33.887948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:33.888250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:33.888526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:33.890269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:34.009065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:34.011673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95e97c-79ee-4076-9909-a6dc2d68bd96 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:34.036752 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 517/1045] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:36.455496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb3f5-84fc-4209-9bda-e43fc5f3f839 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:36.456380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb3f5-84fc-4209-9bda-e43fc5f3f839 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:36.456805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb3f5-84fc-4209-9bda-e43fc5f3f839 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:36.462557 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 529/1046] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:36.464460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fcea7-9859-4925-ad7b-298618bf340c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:36.464882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fcea7-9859-4925-ad7b-298618bf340c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:36.465191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36fcea7-9859-4925-ad7b-298618bf340c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:36.498657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:36.541507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b36fcea7-9859-4925-ad7b-298618bf340c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:36.543126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b36fcea7-9859-4925-ad7b-298618bf340c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:36.655666 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 518/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:36:36.949852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb3f5-84fc-4209-9bda-e43fc5f3f839 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:36.951382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-549cb3f5-84fc-4209-9bda-e43fc5f3f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:37.196457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:37.209422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb3f5-84fc-4209-9bda-e43fc5f3f839 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:37.445998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:37.450285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:37.450702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:37.451080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:37.453744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:37.604133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:37.606263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c769c2-6d00-444f-a003-223f97afb826 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:37.627564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:37.633450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 530/1048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:37.918206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9697-2d09-4550-b031-dce57e7e4e86 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:37.918727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9697-2d09-4550-b031-dce57e7e4e86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:37.918727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c9697-2d09-4550-b031-dce57e7e4e86 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:37.919970 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 519/1049] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:37.925622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ade76-2d1d-4343-aec8-4f060e313867 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:37.925911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ade76-2d1d-4343-aec8-4f060e313867 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:37.926380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ade76-2d1d-4343-aec8-4f060e313867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:37.995473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d6ade76-2d1d-4343-aec8-4f060e313867 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:37.996681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d6ade76-2d1d-4343-aec8-4f060e313867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:38.097139 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 531/1050] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:38.435321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d3ba-781e-400d-95eb-e561f4aaf236 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:38.435679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d3ba-781e-400d-95eb-e561f4aaf236 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:38.436016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371d3ba-781e-400d-95eb-e561f4aaf236 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:38.437641 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 520/1051] 10.222.0.16 () {54 vars in 963 bytes} [Sat Oct 29 02:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:38.442879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca5a7-4bdc-4610-a56a-aa125bc752eb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:38.443286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca5a7-4bdc-4610-a56a-aa125bc752eb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:38.443674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aca5a7-4bdc-4610-a56a-aa125bc752eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:38.525256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f4aca5a7-4bdc-4610-a56a-aa125bc752eb None None] MFA Rules not processed for user `8e709a640a524fd0a3e272d397c75e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:38.526862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f4aca5a7-4bdc-4610-a56a-aa125bc752eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:38.561065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:38.623808 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 532/1052] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Oct 29 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:38.631637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d3ba-781e-400d-95eb-e561f4aaf236 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:38.633281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8371d3ba-781e-400d-95eb-e561f4aaf236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:38.742781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371d3ba-781e-400d-95eb-e561f4aaf236 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:38.746903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:38.826890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:38.827761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:38.828304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:38.828591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:38.830462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:38.949158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:38.950762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaa9b5b-a896-4d3f-90de-6fd46a43cfb7 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:38.971187 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 521/1053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:39.878792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f5db-0fd0-46b7-ae97-4889be5f266d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:39.879311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f5db-0fd0-46b7-ae97-4889be5f266d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:39.879572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f5db-0fd0-46b7-ae97-4889be5f266d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:39.881218 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 533/1054] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:39.886602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b9dd6-0a16-4b88-a881-ed1ca6003226 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:39.887049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b9dd6-0a16-4b88-a881-ed1ca6003226 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:39.887474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b9dd6-0a16-4b88-a881-ed1ca6003226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:39.932927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:39.959658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ca1b9dd6-0a16-4b88-a881-ed1ca6003226 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:39.960878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca1b9dd6-0a16-4b88-a881-ed1ca6003226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:40.062219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 522/1055] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:40.348186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f5db-0fd0-46b7-ae97-4889be5f266d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:40.349702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ef0f5db-0fd0-46b7-ae97-4889be5f266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:40.509853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f5db-0fd0-46b7-ae97-4889be5f266d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:40.542932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:40.649603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:40.650337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:40.650619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:40.650897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:40.652544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:40.758085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:40.759914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30349-d053-4812-83b3-a717d318d4a6 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:40.783143 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 534/1056] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:43.076557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b3a11-b9d7-4d2c-b683-501eb3e3c7c3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:43.077736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b3a11-b9d7-4d2c-b683-501eb3e3c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:43.078271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b3a11-b9d7-4d2c-b683-501eb3e3c7c3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:43.086545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2513b-1416-47f5-9d9a-9247c0fddf03 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:43.087460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2513b-1416-47f5-9d9a-9247c0fddf03 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:43.087963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2513b-1416-47f5-9d9a-9247c0fddf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:43.092726 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 523/1057] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:43 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:43.134461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:43.166104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f7b2513b-1416-47f5-9d9a-9247c0fddf03 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:43.167316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7b2513b-1416-47f5-9d9a-9247c0fddf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:43.287997 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 535/1058] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:43.568808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b3a11-b9d7-4d2c-b683-501eb3e3c7c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:43.570609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df4b3a11-b9d7-4d2c-b683-501eb3e3c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:43.693393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:43.741076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b3a11-b9d7-4d2c-b683-501eb3e3c7c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:43.878841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:43.879600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:43.879885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:43.880159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:43.882133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:43.974962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:43.995109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:43.996821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183cf01b-0ece-41a2-93bb-4f941919a123 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:44.030160 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 524/1059] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:46.281519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf366-7180-4680-8bee-d145bacd2715 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:46.282176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf366-7180-4680-8bee-d145bacd2715 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:46.282176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf366-7180-4680-8bee-d145bacd2715 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:46.283666 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 536/1060] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:46.288938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb714-ab89-43e5-ab60-6a6c31d3f059 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:46.289413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb714-ab89-43e5-ab60-6a6c31d3f059 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:46.289413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbb714-ab89-43e5-ab60-6a6c31d3f059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:46.371675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-32dbb714-ab89-43e5-ab60-6a6c31d3f059 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:46.373272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-32dbb714-ab89-43e5-ab60-6a6c31d3f059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:46.477145 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 525/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:46.770741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf366-7180-4680-8bee-d145bacd2715 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:46.772342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9faf366-7180-4680-8bee-d145bacd2715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:46.889328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:46.932656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf366-7180-4680-8bee-d145bacd2715 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:47.062839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:47.063477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:47.063754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:47.064021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:47.065626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:47.153671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:47.177866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:47.180413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f215d9-6814-44db-8265-874df35e31a9 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:47.207303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 537/1062] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:49.574697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0d3a-4afd-4825-8410-e484baf59199 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:49.575409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0d3a-4afd-4825-8410-e484baf59199 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:49.575409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a0d3a-4afd-4825-8410-e484baf59199 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:49.577117 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 526/1063] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:49.583494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344cec-db30-4f7d-bfe0-2af6a52d04b0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:49.583980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344cec-db30-4f7d-bfe0-2af6a52d04b0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:49.583980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a344cec-db30-4f7d-bfe0-2af6a52d04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:49.656163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7a344cec-db30-4f7d-bfe0-2af6a52d04b0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:49.657374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a344cec-db30-4f7d-bfe0-2af6a52d04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:49.765898 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 538/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:50.082498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0d3a-4afd-4825-8410-e484baf59199 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:50.084612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-273a0d3a-4afd-4825-8410-e484baf59199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:50.145829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:50.241116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a0d3a-4afd-4825-8410-e484baf59199 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:50.353163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:50.353690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:50.354020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:50.354285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:50.355929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:50.371011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:50.455030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:50.456694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1908ef-9f7e-402d-91da-0dcb9237d210 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:50.475765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 527/1065] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:52.918805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54238b-9ee9-49a8-956d-27e58ec3b324 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:52.919470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54238b-9ee9-49a8-956d-27e58ec3b324 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:52.919614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54238b-9ee9-49a8-956d-27e58ec3b324 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:52.922192 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 539/1066] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:52.931119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8cd76-fe5e-4440-a88c-ea929de5bd98 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:52.931598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8cd76-fe5e-4440-a88c-ea929de5bd98 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:52.931861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8cd76-fe5e-4440-a88c-ea929de5bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:53.020459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-79a8cd76-fe5e-4440-a88c-ea929de5bd98 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:53.022074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79a8cd76-fe5e-4440-a88c-ea929de5bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:53.125288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:53.137400 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 528/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:53.435162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54238b-9ee9-49a8-956d-27e58ec3b324 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:53.436733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b54238b-9ee9-49a8-956d-27e58ec3b324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:53.500763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:53.603564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54238b-9ee9-49a8-956d-27e58ec3b324 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:53.726209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66688396-c200-467b-a775-56643830d004 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:53.726840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66688396-c200-467b-a775-56643830d004 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:53.727114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66688396-c200-467b-a775-56643830d004 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:53.727379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66688396-c200-467b-a775-56643830d004 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:53.729133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66688396-c200-467b-a775-56643830d004 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:53.743271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:53.835795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66688396-c200-467b-a775-56643830d004 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:53.837327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66688396-c200-467b-a775-56643830d004 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:53.856924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 540/1068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:56.417387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89880ae-45b5-4bf7-b72b-0e5918af057d None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:56.418051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89880ae-45b5-4bf7-b72b-0e5918af057d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:56.418051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89880ae-45b5-4bf7-b72b-0e5918af057d None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:56.419695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 529/1069] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:56.425068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7f64-d725-4be2-b22d-d28b7d05ab9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:56.425552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7f64-d725-4be2-b22d-d28b7d05ab9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:56.425648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7f64-d725-4be2-b22d-d28b7d05ab9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:56.493380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4cdd7f64-d725-4be2-b22d-d28b7d05ab9b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:56.494624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4cdd7f64-d725-4be2-b22d-d28b7d05ab9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:56.587569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:56.600361 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 541/1070] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:56.887070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89880ae-45b5-4bf7-b72b-0e5918af057d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:56.888652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d89880ae-45b5-4bf7-b72b-0e5918af057d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:57.042902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89880ae-45b5-4bf7-b72b-0e5918af057d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:57.106960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:57.161615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:57.162231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:57.162505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:57.162773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:57.164365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:57.256593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:57.258289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d07f6b-9d9c-4d1b-9533-860374fa793e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:57.276789 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 530/1071] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:58.406577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdbea8-9cdf-442b-a8ef-0b6faf336854 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:58.407172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdbea8-9cdf-442b-a8ef-0b6faf336854 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:58.407172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdbea8-9cdf-442b-a8ef-0b6faf336854 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:58.408483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 542/1072] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:58.414083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c764-2bc5-4bef-b4a9-63f0f8fcdf10 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:58.414532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c764-2bc5-4bef-b4a9-63f0f8fcdf10 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:58.414647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9c764-2bc5-4bef-b4a9-63f0f8fcdf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:58.482357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-75d9c764-2bc5-4bef-b4a9-63f0f8fcdf10 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:58.483579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75d9c764-2bc5-4bef-b4a9-63f0f8fcdf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:58.513152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:58.596344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 531/1073] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:58.896635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd3a8-3d48-493a-a5c0-c167e73230f9 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:58.896934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd3a8-3d48-493a-a5c0-c167e73230f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:58.897201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66cd3a8-3d48-493a-a5c0-c167e73230f9 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:58.898584 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 543/1074] 10.222.0.16 () {54 vars in 962 bytes} [Sat Oct 29 02:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:58.903901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacf7cb-5e59-4c55-b188-4c131ce9a82b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:58.904267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacf7cb-5e59-4c55-b188-4c131ce9a82b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:58.904608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacf7cb-5e59-4c55-b188-4c131ce9a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:58.984391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5cacf7cb-5e59-4c55-b188-4c131ce9a82b None None] MFA Rules not processed for user `e800c060beb045008c905a591d290cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:58.985605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5cacf7cb-5e59-4c55-b188-4c131ce9a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:59.062168 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 532/1075] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Oct 29 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:59.070179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd3a8-3d48-493a-a5c0-c167e73230f9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:59.071700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c66cd3a8-3d48-493a-a5c0-c167e73230f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:59.176434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66cd3a8-3d48-493a-a5c0-c167e73230f9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:36:59.251860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:36:59.252489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:59.252768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:59.253041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:59.254829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:59.298448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:59.374318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:36:59.375666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c963b63-c8ec-425b-904a-9d17354da266 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:36:59.394592 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 544/1076] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:36:59.459021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b406c2-b3e7-4654-a108-039dad0ee2d4 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:59.459636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b406c2-b3e7-4654-a108-039dad0ee2d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:59.459636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b406c2-b3e7-4654-a108-039dad0ee2d4 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:59.461082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 533/1077] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:36:59.466530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02b52-a7db-452c-a2eb-022237d22d99 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:36:59.466996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02b52-a7db-452c-a2eb-022237d22d99 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:36:59.467088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02b52-a7db-452c-a2eb-022237d22d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:36:59.533826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b5f02b52-a7db-452c-a2eb-022237d22d99 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:36:59.535019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5f02b52-a7db-452c-a2eb-022237d22d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:59.646922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:36:59.651157 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 545/1078] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:36:59.935010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b406c2-b3e7-4654-a108-039dad0ee2d4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:36:59.936588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40b406c2-b3e7-4654-a108-039dad0ee2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:36:59.965246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:00.101079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b406c2-b3e7-4654-a108-039dad0ee2d4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:00.140710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffbad8-5e96-4dc2-b9ce-6a9596f92619 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:00.140992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffbad8-5e96-4dc2-b9ce-6a9596f92619 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:00.141257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffbad8-5e96-4dc2-b9ce-6a9596f92619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:00.199998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:00.208367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fffbad8-5e96-4dc2-b9ce-6a9596f92619 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:00.209788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fffbad8-5e96-4dc2-b9ce-6a9596f92619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:00.221031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:00.221656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:00.221967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:00.222239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:00.223855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:00.299477 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 546/1079] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:37:00.319592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:00.321273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf588626-b085-4c21-a2fc-129d35b92611 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:00.340304 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 534/1080] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:00.341940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ba791-7e59-44e4-a5c2-ac7af9b6058e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:00.342228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ba791-7e59-44e4-a5c2-ac7af9b6058e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:00.342499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ba791-7e59-44e4-a5c2-ac7af9b6058e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:00.344043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 547/1081] 10.222.0.16 () {54 vars in 943 bytes} [Sat Oct 29 02:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:00.350233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65ec92-cdfb-48ed-b1cf-0049a94f71e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:00.350511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65ec92-cdfb-48ed-b1cf-0049a94f71e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:00.351022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65ec92-cdfb-48ed-b1cf-0049a94f71e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:00.437547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8f65ec92-cdfb-48ed-b1cf-0049a94f71e0 None None] MFA Rules not processed for user `5f8edd4b12d54ce39915d2e9831b3d88`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:00.438846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f65ec92-cdfb-48ed-b1cf-0049a94f71e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:00.495785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:00.560231 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 535/1082] 10.222.0.16 () {58 vars in 1040 bytes} [Sat Oct 29 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:00.569726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ba791-7e59-44e4-a5c2-ac7af9b6058e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:00.571303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cc1ba791-7e59-44e4-a5c2-ac7af9b6058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:00.657976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:00.709955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ba791-7e59-44e4-a5c2-ac7af9b6058e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:00.818034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:00.818560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:00.818833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:00.819099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:00.820722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:00.894493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:00.907234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:00.908861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ddc07-13c6-4a17-bce6-175840d62f57 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:00.917258 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 548/1083] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:37:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:37:02.565017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f3607-59cc-4bba-ae10-9d94f5f11b35 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:02.565506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f3607-59cc-4bba-ae10-9d94f5f11b35 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:02.565602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f3607-59cc-4bba-ae10-9d94f5f11b35 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:02.569905 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 536/1084] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:02.572210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af3b98-0c6e-413f-8167-3a0071c605fb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:02.572636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af3b98-0c6e-413f-8167-3a0071c605fb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:02.572729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af3b98-0c6e-413f-8167-3a0071c605fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:02.645516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-22af3b98-0c6e-413f-8167-3a0071c605fb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:02.646784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22af3b98-0c6e-413f-8167-3a0071c605fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:02.754814 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 549/1085] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:03.040953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f3607-59cc-4bba-ae10-9d94f5f11b35 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:03.042684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d40f3607-59cc-4bba-ae10-9d94f5f11b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:03.207337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f3607-59cc-4bba-ae10-9d94f5f11b35 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:03.231205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:03.331832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:03.332854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:03.333127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:03.333394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:03.335041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:03.437120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:03.438860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989635ad-fccb-47bc-8459-9137cb97884d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:03.459847 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 537/1086] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:12.753288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=71 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:13.455470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:23.899457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a8fe-513c-4d52-9d11-205757fde490 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:23.900061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a8fe-513c-4d52-9d11-205757fde490 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:23.900061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a8fe-513c-4d52-9d11-205757fde490 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:23.901303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 550/1087] 10.222.0.16 () {54 vars in 918 bytes} [Sat Oct 29 02:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:23.906816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb402f-b489-463c-938c-17f9b70770af None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:23.907268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb402f-b489-463c-938c-17f9b70770af None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:23.907378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb402f-b489-463c-938c-17f9b70770af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:23.984746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-29cb402f-b489-463c-938c-17f9b70770af None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:23.985987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29cb402f-b489-463c-938c-17f9b70770af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:24.102886 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 538/1088] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Oct 29 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:24.117471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1957ec-fa57-4fcf-b005-03cafba8e363 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:24.117748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1957ec-fa57-4fcf-b005-03cafba8e363 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:24.118057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1957ec-fa57-4fcf-b005-03cafba8e363 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:24.119405 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 551/1089] 10.222.0.16 () {54 vars in 918 bytes} [Sat Oct 29 02:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:24.124386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926410-9d4f-4381-9edc-7c4d90b2b09b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:24.124670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926410-9d4f-4381-9edc-7c4d90b2b09b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:24.124938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926410-9d4f-4381-9edc-7c4d90b2b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:24.197816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:24.200421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-69926410-9d4f-4381-9edc-7c4d90b2b09b None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:24.202372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69926410-9d4f-4381-9edc-7c4d90b2b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:24.320679 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 539/1090] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Oct 29 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:26.891174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d4df-fcb9-4258-b0d7-2f1fd1635576 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:26.891767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d4df-fcb9-4258-b0d7-2f1fd1635576 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:26.891767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9d4df-fcb9-4258-b0d7-2f1fd1635576 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:26.893049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 552/1091] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:26.898758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca0a8-002a-4f3b-b553-5af7cb5cce0d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:26.899209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca0a8-002a-4f3b-b553-5af7cb5cce0d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:26.899339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aca0a8-002a-4f3b-b553-5af7cb5cce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:26.968386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-99aca0a8-002a-4f3b-b553-5af7cb5cce0d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:26.969566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99aca0a8-002a-4f3b-b553-5af7cb5cce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:27.025562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:27.068459 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 540/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:27.349575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d4df-fcb9-4258-b0d7-2f1fd1635576 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:27.351633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6e9d4df-fcb9-4258-b0d7-2f1fd1635576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:27.513548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9d4df-fcb9-4258-b0d7-2f1fd1635576 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:27.593576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:27.634045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:27.634657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:27.634931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:27.635200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:27.636797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:27.729420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:27.731042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d2044-7221-46b9-b07d-256015c5ca3c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:27.749276 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 553/1093] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:28.886407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821be73a-eace-405e-81a9-5708e4c48294 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:28.887003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821be73a-eace-405e-81a9-5708e4c48294 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:28.887003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821be73a-eace-405e-81a9-5708e4c48294 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:28.888297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 541/1094] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:28.894201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d5ea-9b24-4db3-b134-e61a0325b9c1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:28.894674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d5ea-9b24-4db3-b134-e61a0325b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:28.894769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682d5ea-9b24-4db3-b134-e61a0325b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:28.977777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b682d5ea-9b24-4db3-b134-e61a0325b9c1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:28.979056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b682d5ea-9b24-4db3-b134-e61a0325b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:29.008470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:29.092176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 554/1095] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:29.250458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821be73a-eace-405e-81a9-5708e4c48294 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:29.252725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-821be73a-eace-405e-81a9-5708e4c48294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:29.414106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821be73a-eace-405e-81a9-5708e4c48294 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:29.454876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:29.528784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:29.529389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:29.529663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:29.529960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:29.531571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:29.623788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:29.625374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6257238-bc25-4f11-be16-ef5f360dc9e4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:29.643317 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 542/1096] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:30.753739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ef44-62b0-40ae-a8de-8670f363329d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:30.754363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ef44-62b0-40ae-a8de-8670f363329d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:30.754363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ef44-62b0-40ae-a8de-8670f363329d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:30.755566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 555/1097] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:30.761385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7972dd-eaa8-4722-b2ba-e24a29e15d07 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:30.762130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7972dd-eaa8-4722-b2ba-e24a29e15d07 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:30.762359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7972dd-eaa8-4722-b2ba-e24a29e15d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:30.827810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:30.850941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9d7972dd-eaa8-4722-b2ba-e24a29e15d07 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:30.852157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d7972dd-eaa8-4722-b2ba-e24a29e15d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:30.949582 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 543/1098] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:31.102942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15ef44-62b0-40ae-a8de-8670f363329d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:31.104362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c15ef44-62b0-40ae-a8de-8670f363329d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:31.262081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15ef44-62b0-40ae-a8de-8670f363329d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:31.275680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:31.383275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:31.383792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:31.384059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:31.384326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:31.386205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:31.478046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:31.479615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7df79-5678-4c7e-9c74-21ccea861055 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:31.504240 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 556/1099] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:32.606931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75c86-2033-4041-8cbc-7091d1413e79 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:32.607746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75c86-2033-4041-8cbc-7091d1413e79 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:32.607746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75c86-2033-4041-8cbc-7091d1413e79 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:32.609949 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 544/1100] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:32.615935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944034-9b62-4c8e-89ae-d22173ddc019 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:32.616408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944034-9b62-4c8e-89ae-d22173ddc019 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:32.616548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba944034-9b62-4c8e-89ae-d22173ddc019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:32.646303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:32.705293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba944034-9b62-4c8e-89ae-d22173ddc019 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:32.706553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba944034-9b62-4c8e-89ae-d22173ddc019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:32.804767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 557/1101] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:32.955652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b75c86-2033-4041-8cbc-7091d1413e79 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:32.958187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26b75c86-2033-4041-8cbc-7091d1413e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:33.103975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:33.145940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b75c86-2033-4041-8cbc-7091d1413e79 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:33.269852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:33.270487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:33.270759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:33.271030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:33.272673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:33.354250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:33.368286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:33.369899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0d201-08c0-458e-b7a0-3b3397f60685 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:33.388823 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 545/1102] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:34.488001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506d1e8-b567-403d-af84-66c2a5a33d04 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:34.488487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506d1e8-b567-403d-af84-66c2a5a33d04 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:34.488585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506d1e8-b567-403d-af84-66c2a5a33d04 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:34.490752 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 558/1103] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:34.496904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9bef-f8dd-4eba-9e43-330eb2cb9279 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:34.497348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9bef-f8dd-4eba-9e43-330eb2cb9279 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:34.497440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f9bef-f8dd-4eba-9e43-330eb2cb9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:34.578683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9f7f9bef-f8dd-4eba-9e43-330eb2cb9279 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:34.579918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f7f9bef-f8dd-4eba-9e43-330eb2cb9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:34.682835 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 546/1104] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:34.831228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506d1e8-b567-403d-af84-66c2a5a33d04 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:34.833685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5506d1e8-b567-403d-af84-66c2a5a33d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:34.922915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:34.989510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506d1e8-b567-403d-af84-66c2a5a33d04 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:35.121653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:35.122222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:35.122498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:35.122764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:35.124694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:35.179661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:35.223916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:35.225542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab156ec-9f0a-485e-98c3-27f8abc555fd service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:35.244333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 559/1105] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:36.291187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0abf-2d15-4962-9aa9-2a3cee1df14c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:36.291787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0abf-2d15-4962-9aa9-2a3cee1df14c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:36.291787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0abf-2d15-4962-9aa9-2a3cee1df14c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:36.293065 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 547/1106] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:36.299194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a905-d71b-4eb1-8653-5aa800864d5f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:36.299894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a905-d71b-4eb1-8653-5aa800864d5f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:36.300117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671a905-d71b-4eb1-8653-5aa800864d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:36.387358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4671a905-d71b-4eb1-8653-5aa800864d5f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:36.389132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4671a905-d71b-4eb1-8653-5aa800864d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:36.491369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 560/1107] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:36.644361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0abf-2d15-4962-9aa9-2a3cee1df14c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:36.646752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25be0abf-2d15-4962-9aa9-2a3cee1df14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:36.698901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:36.799353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0abf-2d15-4962-9aa9-2a3cee1df14c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:36.918101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:36.918622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:36.918895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:36.919158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:36.920742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:36.927859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:37.026153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:37.027746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872e1e-0fbf-45a4-869b-2c30551eafaa service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:37.046612 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 548/1108] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:38.086902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0cf9-16eb-43b8-92e0-39dcead1b5e1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:38.087521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0cf9-16eb-43b8-92e0-39dcead1b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:38.087521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce0cf9-16eb-43b8-92e0-39dcead1b5e1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:38.088846 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 561/1109] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:38.094861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc7040-a877-4422-bf10-debe1dea3928 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:38.095536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc7040-a877-4422-bf10-debe1dea3928 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:38.095745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc7040-a877-4422-bf10-debe1dea3928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:38.180696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-befc7040-a877-4422-bf10-debe1dea3928 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:38.181922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-befc7040-a877-4422-bf10-debe1dea3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:38.254861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:38.286351 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 549/1110] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:38.435774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0cf9-16eb-43b8-92e0-39dcead1b5e1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:38.437215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37ce0cf9-16eb-43b8-92e0-39dcead1b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:38.456623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:38.595964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce0cf9-16eb-43b8-92e0-39dcead1b5e1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:38.685643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:38.713162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:38.713771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:38.714106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:38.714374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:38.715963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:38.808530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:38.810152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d11922-3de7-4685-90ce-577d607b5534 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:38.828119 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 562/1111] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:39.865294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948287c-19d5-42d5-8d87-ace99edf718f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:39.866214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948287c-19d5-42d5-8d87-ace99edf718f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:39.866214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948287c-19d5-42d5-8d87-ace99edf718f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:39.868059 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 550/1112] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:39.876680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6bcd5-0b88-4850-87b3-cb3f710ec5ed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:39.877400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6bcd5-0b88-4850-87b3-cb3f710ec5ed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:39.877591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6bcd5-0b88-4850-87b3-cb3f710ec5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:39.957555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-17f6bcd5-0b88-4850-87b3-cb3f710ec5ed None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:39.958804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17f6bcd5-0b88-4850-87b3-cb3f710ec5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:40.002714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:40.061936 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 563/1113] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:40.215439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948287c-19d5-42d5-8d87-ace99edf718f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:40.218381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5948287c-19d5-42d5-8d87-ace99edf718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:40.380467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948287c-19d5-42d5-8d87-ace99edf718f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:40.438178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:40.502806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:40.503424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:40.503698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:40.503954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:40.505543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:40.603156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:40.604747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dcd93b-4204-459c-ac4f-6394914b881d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:40.624605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 551/1114] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:41.667861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0aa8-f685-4cc8-94d8-56af0919e43f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:41.668459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0aa8-f685-4cc8-94d8-56af0919e43f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:41.668459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a0aa8-f685-4cc8-94d8-56af0919e43f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:41.669764 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 564/1115] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:41.674958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471acf4-1232-4eca-86ef-19aaf321d792 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:41.675368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471acf4-1232-4eca-86ef-19aaf321d792 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:41.675448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471acf4-1232-4eca-86ef-19aaf321d792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:41.754926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c471acf4-1232-4eca-86ef-19aaf321d792 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:41.756147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c471acf4-1232-4eca-86ef-19aaf321d792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:41.758261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:41.852960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 552/1116] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:42.003779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a0aa8-f685-4cc8-94d8-56af0919e43f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:42.005368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-802a0aa8-f685-4cc8-94d8-56af0919e43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:42.162631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a0aa8-f685-4cc8-94d8-56af0919e43f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:42.190365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:42.286831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:42.287349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:42.287631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:42.287903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:42.289528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:42.392087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:42.393663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d01ac-5848-447f-97a8-0de0df1e2f04 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:42.411902 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 565/1117] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:44.457836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d64b2-7252-4401-ab67-5fc067b3a445 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:44.458544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d64b2-7252-4401-ab67-5fc067b3a445 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:44.458544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d64b2-7252-4401-ab67-5fc067b3a445 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:44.459932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 553/1118] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:44.466218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d948c-9acb-4fe6-a5f1-99067021a4ce None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:44.466683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d948c-9acb-4fe6-a5f1-99067021a4ce None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:44.467323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d948c-9acb-4fe6-a5f1-99067021a4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:44.511631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:44.538186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-218d948c-9acb-4fe6-a5f1-99067021a4ce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:44.539455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-218d948c-9acb-4fe6-a5f1-99067021a4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:44.640771 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 566/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:44.923166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d64b2-7252-4401-ab67-5fc067b3a445 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:44.924723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e95d64b2-7252-4401-ab67-5fc067b3a445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:45.032531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d64b2-7252-4401-ab67-5fc067b3a445 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:45.066704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:45.109123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:45.109727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:45.110028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:45.110297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:45.111896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:45.227333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:45.228813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9bd87-611d-4140-9cdf-0015958e6082 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:45.248485 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 554/1120] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:47.519633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e96d6-f9d7-4bfe-b08d-f156f651dbae None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:47.520237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e96d6-f9d7-4bfe-b08d-f156f651dbae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:47.520237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e96d6-f9d7-4bfe-b08d-f156f651dbae None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:47.522247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 567/1121] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:47.530709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e87eb-e053-4ca1-aa17-fd36ff90ea5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:47.531132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e87eb-e053-4ca1-aa17-fd36ff90ea5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:47.531270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e87eb-e053-4ca1-aa17-fd36ff90ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:47.606354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c67e87eb-e053-4ca1-aa17-fd36ff90ea5d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:47.607585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c67e87eb-e053-4ca1-aa17-fd36ff90ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:47.621150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:47.710074 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 555/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:47.993229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e96d6-f9d7-4bfe-b08d-f156f651dbae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:47.995770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-484e96d6-f9d7-4bfe-b08d-f156f651dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:48.115496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e96d6-f9d7-4bfe-b08d-f156f651dbae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:48.129485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:48.200377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:48.200994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:48.201272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:48.201539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:48.203170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:48.317959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:48.319381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd8877-da90-4e9d-9554-d7021ba835fe service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:48.338095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 568/1123] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:50.797228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235a7cd-f0ad-48e0-8838-ffa97b1a3cc3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:50.797783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235a7cd-f0ad-48e0-8838-ffa97b1a3cc3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:50.797783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235a7cd-f0ad-48e0-8838-ffa97b1a3cc3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:50.799060 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 556/1124] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:50.805846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75072c88-4de3-4d36-a8f7-8416fef05782 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:50.806715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75072c88-4de3-4d36-a8f7-8416fef05782 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:50.806715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75072c88-4de3-4d36-a8f7-8416fef05782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:50.864342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:50.883804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-75072c88-4de3-4d36-a8f7-8416fef05782 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:50.885031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-75072c88-4de3-4d36-a8f7-8416fef05782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:50.986764 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 569/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:51.271937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235a7cd-f0ad-48e0-8838-ffa97b1a3cc3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:51.273547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7235a7cd-f0ad-48e0-8838-ffa97b1a3cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:51.395544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235a7cd-f0ad-48e0-8838-ffa97b1a3cc3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:51.437454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:51.472758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:51.473359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:51.473633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:51.473933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:51.475765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:51.596676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:51.598143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb8dd4-91e9-4bc6-aa01-f5de637ebbae service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:51.616671 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 557/1126] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:53.899100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faca94-ab21-4ac5-8057-bcbd3a07545c None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:53.900797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faca94-ab21-4ac5-8057-bcbd3a07545c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:53.900797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1faca94-ab21-4ac5-8057-bcbd3a07545c None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:53.901944 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 570/1127] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:53.911089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824a63-534d-42c0-815a-14b2eda4bdfa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:53.911514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824a63-534d-42c0-815a-14b2eda4bdfa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:53.911827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824a63-534d-42c0-815a-14b2eda4bdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:53.982234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b4824a63-534d-42c0-815a-14b2eda4bdfa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:53.983442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b4824a63-534d-42c0-815a-14b2eda4bdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:54.007107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:54.098727 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 558/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:54.387970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faca94-ab21-4ac5-8057-bcbd3a07545c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:54.390450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1faca94-ab21-4ac5-8057-bcbd3a07545c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:54.502044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1faca94-ab21-4ac5-8057-bcbd3a07545c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:54.522882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:54.580266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:54.580886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:54.581158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:54.581425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:54.583070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:54.699026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:54.700495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28cf1e-3650-470e-948e-2b75aeca111e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:54.719923 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 571/1129] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:56.891009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98094-902e-4bf6-8279-60774bcf7f38 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:56.891775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98094-902e-4bf6-8279-60774bcf7f38 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:56.891775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c98094-902e-4bf6-8279-60774bcf7f38 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:56.893936 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 559/1130] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:56.902501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13454e-1b49-4fa0-ab9d-31a698c7d818 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:56.902987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13454e-1b49-4fa0-ab9d-31a698c7d818 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:56.903084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13454e-1b49-4fa0-ab9d-31a698c7d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:56.972499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:56.975552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a13454e-1b49-4fa0-ab9d-31a698c7d818 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:56.977192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a13454e-1b49-4fa0-ab9d-31a698c7d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:57.078426 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 572/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:37:57.355582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98094-902e-4bf6-8279-60774bcf7f38 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:37:57.358158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80c98094-902e-4bf6-8279-60774bcf7f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:57.468655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c98094-902e-4bf6-8279-60774bcf7f38 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:37:57.526035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:37:57.553044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:37:57.554081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:57.554330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:57.554633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:57.556372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:37:57.671881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:37:57.673260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc5ecc8-bded-48b8-a7dc-502cf7976f85 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:37:57.691436 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 560/1132] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:37:59.900242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3ee7-8fce-4010-a2a7-2aece9ae3a42 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:59.900826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3ee7-8fce-4010-a2a7-2aece9ae3a42 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:59.900826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3ee7-8fce-4010-a2a7-2aece9ae3a42 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:59.902075 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 573/1133] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:37:59.907670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b058f9-3e95-41c3-90c0-2fa0d7d500cc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:37:59.908128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b058f9-3e95-41c3-90c0-2fa0d7d500cc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:37:59.908230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b058f9-3e95-41c3-90c0-2fa0d7d500cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:37:59.977781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e1b058f9-3e95-41c3-90c0-2fa0d7d500cc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:37:59.979022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1b058f9-3e95-41c3-90c0-2fa0d7d500cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:00.009496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:00.082720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 561/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:00.364308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3ee7-8fce-4010-a2a7-2aece9ae3a42 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:00.366587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4cdf3ee7-8fce-4010-a2a7-2aece9ae3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:00.474424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3ee7-8fce-4010-a2a7-2aece9ae3a42 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:00.506505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:00.554241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:00.554852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:00.555125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:00.555392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:00.557072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:00.670868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:00.672249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b7d3b-792c-4f41-80e4-b38c76b85dd7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:00.690542 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 574/1135] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:02.902849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e6fc2-93d2-4007-8ee3-ae7b2687cce1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:02.903643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e6fc2-93d2-4007-8ee3-ae7b2687cce1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:02.903901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e6fc2-93d2-4007-8ee3-ae7b2687cce1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:02.905995 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:38:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:02.914120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7daa6-22c4-40cc-9098-02f3178330de None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:02.914540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7daa6-22c4-40cc-9098-02f3178330de None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:02.914647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7daa6-22c4-40cc-9098-02f3178330de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:02.984194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-07f7daa6-22c4-40cc-9098-02f3178330de None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:02.985420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07f7daa6-22c4-40cc-9098-02f3178330de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:02.994847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:03.087628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:03.372480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e6fc2-93d2-4007-8ee3-ae7b2687cce1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:03.374391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed2e6fc2-93d2-4007-8ee3-ae7b2687cce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:03.489086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e6fc2-93d2-4007-8ee3-ae7b2687cce1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:03.557796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:03.578518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:03.579136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:03.579408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:03.579676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:03.581294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:03.695266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:03.696606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c77a0-5536-4ade-a63a-93a8b6aad6ba service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:03.715160 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 563/1138] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:05.895082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae743f3-b8db-4d5a-89f1-e90811984d3d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:05.895642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae743f3-b8db-4d5a-89f1-e90811984d3d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:05.895642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae743f3-b8db-4d5a-89f1-e90811984d3d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:05.897374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:05.905222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b3ae4-14b0-42e4-a97a-c37268ec7d94 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:05.905676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b3ae4-14b0-42e4-a97a-c37268ec7d94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:05.905784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b3ae4-14b0-42e4-a97a-c37268ec7d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:05.974287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-587b3ae4-14b0-42e4-a97a-c37268ec7d94 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:05.975643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-587b3ae4-14b0-42e4-a97a-c37268ec7d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:06.015722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:06.077674 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:06.357694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae743f3-b8db-4d5a-89f1-e90811984d3d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:06.359292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bae743f3-b8db-4d5a-89f1-e90811984d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:06.469467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae743f3-b8db-4d5a-89f1-e90811984d3d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:06.509467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:06.546950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:06.547590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:06.547868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:06.548137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:06.549822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:06.670850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:06.672240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05060d5d-0d97-43c1-8292-f29dff39b494 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:06.693468 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 577/1141] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:08.888378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887075-4134-4491-8067-3209b8bea413 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:08.888930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887075-4134-4491-8067-3209b8bea413 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:08.888930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce887075-4134-4491-8067-3209b8bea413 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:08.890325 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 565/1142] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:08.896740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4cbf-846f-42c1-bef2-21bcb0a43d46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:08.897224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4cbf-846f-42c1-bef2-21bcb0a43d46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:08.897322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4cbf-846f-42c1-bef2-21bcb0a43d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:08.972361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-75cb4cbf-846f-42c1-bef2-21bcb0a43d46 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:08.973599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-75cb4cbf-846f-42c1-bef2-21bcb0a43d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:08.994920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:09.084840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 578/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:09.365952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887075-4134-4491-8067-3209b8bea413 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:09.367510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce887075-4134-4491-8067-3209b8bea413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:09.474904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce887075-4134-4491-8067-3209b8bea413 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:09.543213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:09.550215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:09.550825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:09.551097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:09.551364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:09.552990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:09.664168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:09.665508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a190-01d2-4daa-addc-a065d74d662b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:09.683194 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 566/1144] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:11.832775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe207-5868-4461-8826-ee4e1365dbd8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:11.833444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe207-5868-4461-8826-ee4e1365dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:11.833444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefe207-5868-4461-8826-ee4e1365dbd8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:11.836598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:38:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:11.843406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cecc-40f7-44de-8346-b1bdb025220c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:11.844016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cecc-40f7-44de-8346-b1bdb025220c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:11.844345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cecc-40f7-44de-8346-b1bdb025220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:11.943181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-93b3cecc-40f7-44de-8346-b1bdb025220c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:11.945248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93b3cecc-40f7-44de-8346-b1bdb025220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:12.009157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:12.067560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:12.370036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe207-5868-4461-8826-ee4e1365dbd8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:12.371621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5cefe207-5868-4461-8826-ee4e1365dbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:12.494920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefe207-5868-4461-8826-ee4e1365dbd8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:12.550355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:12.578020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:12.578635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:12.578915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:12.579187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:12.580795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:12.697557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:12.699077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4773f9a-f999-400b-a27b-7bc4aad157fd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:12.717683 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 580/1147] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:22.066007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=22 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:22.715437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=66 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:32.480290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a744-e473-4754-8df9-7f9064264de0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:32.481229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a744-e473-4754-8df9-7f9064264de0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:32.481229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a744-e473-4754-8df9-7f9064264de0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:32.483401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 568/1148] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:32.492572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc71e6-81b9-4caa-9cfa-ba66d3338e99 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:32.493349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc71e6-81b9-4caa-9cfa-ba66d3338e99 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:32.493521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc71e6-81b9-4caa-9cfa-ba66d3338e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:32.570761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01dc71e6-81b9-4caa-9cfa-ba66d3338e99 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:32.571996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01dc71e6-81b9-4caa-9cfa-ba66d3338e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:32.670274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 581/1149] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:32.966408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a752-cc6f-4ad3-b49a-65210b6d44f8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:32.966885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a752-cc6f-4ad3-b49a-65210b6d44f8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:32.967269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35a752-cc6f-4ad3-b49a-65210b6d44f8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:32.969364 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 569/1150] 10.222.0.16 () {54 vars in 962 bytes} [Sat Oct 29 02:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:32.976545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c58db-f85f-4381-9da9-65d7b0b18755 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:32.976831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c58db-f85f-4381-9da9-65d7b0b18755 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:32.977108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c58db-f85f-4381-9da9-65d7b0b18755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:33.055898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-037c58db-f85f-4381-9da9-65d7b0b18755 None None] MFA Rules not processed for user `e800c060beb045008c905a591d290cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:33.057115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-037c58db-f85f-4381-9da9-65d7b0b18755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:33.079565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:33.144790 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 582/1151] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Oct 29 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:38:33.153127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a752-cc6f-4ad3-b49a-65210b6d44f8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:33.154701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c35a752-cc6f-4ad3-b49a-65210b6d44f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:33.261643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35a752-cc6f-4ad3-b49a-65210b6d44f8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:33.336509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:33.337120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:33.337395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:33.337661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:33.339337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:33.395543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:33.455374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:33.456838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f595f-597d-419d-be62-d5033012c620 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:33.475952 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 570/1152] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:35.686350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fe49-a3d2-4c5e-bd2d-4858a31ed99d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:35.687244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fe49-a3d2-4c5e-bd2d-4858a31ed99d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:35.687244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7fe49-a3d2-4c5e-bd2d-4858a31ed99d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:35.689339 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 583/1153] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:35.698311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9df5-07d0-4ac0-9141-3b24ee9aa4b9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:35.698764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9df5-07d0-4ac0-9141-3b24ee9aa4b9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:35.698873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9df5-07d0-4ac0-9141-3b24ee9aa4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:35.772347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e04a9df5-07d0-4ac0-9141-3b24ee9aa4b9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:35.773600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e04a9df5-07d0-4ac0-9141-3b24ee9aa4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:35.874811 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 571/1154] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:36.148144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fe49-a3d2-4c5e-bd2d-4858a31ed99d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:36.149583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fbd7fe49-a3d2-4c5e-bd2d-4858a31ed99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:36.293456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7fe49-a3d2-4c5e-bd2d-4858a31ed99d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:36.352716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:36.396642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:36.397268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:36.397528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:36.397792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:36.398493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:36.399556 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:38:36.399556 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:38:36.399556 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:38:36.400693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a9332-21aa-4aed-ac46-1a43c65c20be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:36.420408 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 584/1155] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Oct 29 02:38:36 2022] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:38:38.578660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b063-ba5b-409d-aac8-3d9d74d14244 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:38.579160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b063-ba5b-409d-aac8-3d9d74d14244 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:38.579160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a5b063-ba5b-409d-aac8-3d9d74d14244 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:38.580550 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 572/1156] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:38.586263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb26ac-404c-48fa-9e91-c87a7f575565 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:38.586736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb26ac-404c-48fa-9e91-c87a7f575565 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:38.586850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb26ac-404c-48fa-9e91-c87a7f575565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:38.654220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fccb26ac-404c-48fa-9e91-c87a7f575565 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:38.655478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fccb26ac-404c-48fa-9e91-c87a7f575565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:38.761039 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 585/1157] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:39.060035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b063-ba5b-409d-aac8-3d9d74d14244 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:39.062657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3a5b063-ba5b-409d-aac8-3d9d74d14244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:39.074633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:39.219813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a5b063-ba5b-409d-aac8-3d9d74d14244 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:39.312614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:39.346906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:39.347514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:39.347784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:39.348042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:39.349627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:39.442804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:39.444409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c0196-db8a-4173-8fa4-a28dd1c105bb service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:39.463381 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 573/1158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:41.816463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e940e8-8188-4807-95ab-e5c328dce222 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:41.817059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e940e8-8188-4807-95ab-e5c328dce222 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:41.817059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e940e8-8188-4807-95ab-e5c328dce222 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:41.818444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 586/1159] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:41.824138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea756-99d9-4a55-8a3d-3c803588037b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:41.824631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea756-99d9-4a55-8a3d-3c803588037b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:41.824631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea756-99d9-4a55-8a3d-3c803588037b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:41.891962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6aea756-99d9-4a55-8a3d-3c803588037b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:41.893159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6aea756-99d9-4a55-8a3d-3c803588037b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:41.943401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:41.995877 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 574/1160] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:42.284649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e940e8-8188-4807-95ab-e5c328dce222 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:42.287214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0e940e8-8188-4807-95ab-e5c328dce222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:42.314473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:42.396871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e940e8-8188-4807-95ab-e5c328dce222 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:42.476574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:42.477200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:42.477472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:42.477738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:42.479413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:42.572199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:42.609200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:42.610659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f86dd-1850-4075-a627-ccfbc876229e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:42.629591 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 587/1161] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:44.821294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671fc19-a6a8-48d1-b82c-044145243775 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:44.821863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671fc19-a6a8-48d1-b82c-044145243775 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:44.821863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671fc19-a6a8-48d1-b82c-044145243775 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:44.823124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 575/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:44.829342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502870e3-4416-4dfd-93a1-63101360d9d1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:44.830092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502870e3-4416-4dfd-93a1-63101360d9d1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:44.830287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502870e3-4416-4dfd-93a1-63101360d9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:44.902557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-502870e3-4416-4dfd-93a1-63101360d9d1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:44.903828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-502870e3-4416-4dfd-93a1-63101360d9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:45.006483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 588/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:45.297037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671fc19-a6a8-48d1-b82c-044145243775 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:45.299611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e671fc19-a6a8-48d1-b82c-044145243775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:45.424969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671fc19-a6a8-48d1-b82c-044145243775 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:45.502338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:45.503767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:45.504373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:45.504650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:45.505049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:45.507196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:45.617310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:45.618853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb138f82-7696-4e55-b725-b436b5aac47b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:45.637812 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 576/1164] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:47.872027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224a55-a2f0-4b3e-a7ed-9d87bbd04c5e None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:47.872917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224a55-a2f0-4b3e-a7ed-9d87bbd04c5e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:47.872917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe224a55-a2f0-4b3e-a7ed-9d87bbd04c5e None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:47.874269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 589/1165] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:47.879914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a2173-2846-49c1-921c-2a7683bf4da8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:47.880374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a2173-2846-49c1-921c-2a7683bf4da8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:47.880614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a2173-2846-49c1-921c-2a7683bf4da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:47.954415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-162a2173-2846-49c1-921c-2a7683bf4da8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:47.955629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-162a2173-2846-49c1-921c-2a7683bf4da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:48.013313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:48.058961 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 577/1166] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:48.351104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224a55-a2f0-4b3e-a7ed-9d87bbd04c5e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:48.353351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe224a55-a2f0-4b3e-a7ed-9d87bbd04c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:48.393951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:48.465816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe224a55-a2f0-4b3e-a7ed-9d87bbd04c5e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:48.544618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:48.545232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:48.545512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:48.545778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:48.547415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:48.630965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:48.661165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:48.662634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f375de61-9161-4595-97bb-37a02eea4168 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:48.681849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 590/1167] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:38:51.018100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c6c6-2b55-4abe-8efd-be12bbeb98c3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:51.018696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c6c6-2b55-4abe-8efd-be12bbeb98c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:51.018696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c6c6-2b55-4abe-8efd-be12bbeb98c3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:51.020026 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 578/1168] 10.222.0.16 () {54 vars in 927 bytes} [Sat Oct 29 02:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:38:51.026678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da8a2c-67a6-48d1-b0ef-2ad83f7abb20 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:51.027408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da8a2c-67a6-48d1-b0ef-2ad83f7abb20 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:51.027553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da8a2c-67a6-48d1-b0ef-2ad83f7abb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:51.099514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-67da8a2c-67a6-48d1-b0ef-2ad83f7abb20 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:38:51.100730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67da8a2c-67a6-48d1-b0ef-2ad83f7abb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:51.204808 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 591/1169] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Oct 29 02:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:38:51.493618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476c6c6-2b55-4abe-8efd-be12bbeb98c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:38:51.496360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0476c6c6-2b55-4abe-8efd-be12bbeb98c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:51.614357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476c6c6-2b55-4abe-8efd-be12bbeb98c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:38:51.703023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:38:51.703632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:38:51.703913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:38:51.704263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:38:51.705968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:38:51.715270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:38:51.818308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:38:51.819648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152f779-139b-4716-955f-91be7369deb6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:38:51.843299 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 579/1170] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:39:01.203134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:39:01.839077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=50 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:08.382364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:08.383012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:08.383012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:08.467452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:40:08.468664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:08.572050 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 592/1171] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:40:08.580201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:08.580745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:08.580883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:08.656978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:40:08.658137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:08.758392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 580/1172] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:40:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:40:08.763176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:08.764400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:08.776145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9fe85-2554-4e9e-bfcc-716bf865e706 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:08.840701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:08.879471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:08.880077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:08.880349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:08.880613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:08.881253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:40:08.881552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:08.882593 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:40:08.882593 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:40:08.882593 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:40:08.883504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:08.894938 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 593/1173] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:40:08.904566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:08.915392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8eb83-ce3d-4b12-b9bd-5e266b73aee8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:08.982468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:09.021638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:09.022279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.022554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.022818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.023441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:09.024456 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:40:09.024456 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:40:09.024456 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:40:09.025650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:09.095720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 581/1174] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:40:08 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:40:09.100256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:09.101778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:09.137499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b1a80-ab50-4b1c-aa2f-7a7c9e2273ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:09.253399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:09.254024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.254296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.254557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.255173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:09.256170 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:40:09.256170 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:40:09.256170 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:40:09.257368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:09.301335 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 594/1175] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:40:09 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:40:09.305626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:09.307246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:09.370561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a07c-4259-4e80-a935-a60c604e8776 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:09.454906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:09.466757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:09.467377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.467656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.467926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.468570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:09.470210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:09.483250 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 582/1176] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:40:09.487540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:09.489102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:09.501229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b9775-e1ad-4301-b2c3-9aed8461fd00 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:09.528131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:09.599655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e4efb-0196-44b0-b553-2ed3d94192da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:09.600278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e4efb-0196-44b0-b553-2ed3d94192da admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.600549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e4efb-0196-44b0-b553-2ed3d94192da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.600814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e4efb-0196-44b0-b553-2ed3d94192da admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.601461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e4efb-0196-44b0-b553-2ed3d94192da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:09.603146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e4efb-0196-44b0-b553-2ed3d94192da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:09.615796 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 595/1177] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:40:09.620169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:09.622052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:09.656637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd9aa1-e0fe-40ba-afc1-2a3b1682efaf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:09.760299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537c813c-146e-4cb6-89b9-1b01f3c1bdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:09.760965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c813c-146e-4cb6-89b9-1b01f3c1bdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.761232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c813c-146e-4cb6-89b9-1b01f3c1bdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.761506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537c813c-146e-4cb6-89b9-1b01f3c1bdc2 admin admin] PATH_INFO: `/v3/projects/ea2fb4e7ceba4344bee581a8887a8354/users/9afc4c71f70943feaf8be71d96871612/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.784884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c813c-146e-4cb6-89b9-1b01f3c1bdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2fb4e7ceba4344bee581a8887a8354, user_id=9afc4c71f70943feaf8be71d96871612, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:09.787481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537c813c-146e-4cb6-89b9-1b01f3c1bdc2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:09.814191 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 583/1178] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:40:09 2022] PUT /identity/v3/projects/ea2fb4e7ceba4344bee581a8887a8354/users/9afc4c71f70943feaf8be71d96871612/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:40:09.825715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9752ae-a405-4a0f-a1e6-d2a51c91a524 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.826028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9752ae-a405-4a0f-a1e6-d2a51c91a524 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.826298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9752ae-a405-4a0f-a1e6-d2a51c91a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.886405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ca9752ae-a405-4a0f-a1e6-d2a51c91a524 None None] MFA Rules not processed for user `9afc4c71f70943feaf8be71d96871612`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:40:09.887624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca9752ae-a405-4a0f-a1e6-d2a51c91a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:09.976371 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 596/1179] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:40:09.990132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c61bc-190d-457c-ad2f-ed9f7ed0f909 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.990452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c61bc-190d-457c-ad2f-ed9f7ed0f909 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.990727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c61bc-190d-457c-ad2f-ed9f7ed0f909 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:09.992114 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 584/1180] 10.222.0.16 () {54 vars in 963 bytes} [Sat Oct 29 02:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:40:09.997344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5ddfa-1e5f-4cda-958d-63e69eb982c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:09.997623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5ddfa-1e5f-4cda-958d-63e69eb982c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:09.997927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5ddfa-1e5f-4cda-958d-63e69eb982c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:10.030166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:10.078205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ede5ddfa-1e5f-4cda-958d-63e69eb982c7 None None] MFA Rules not processed for user `8e709a640a524fd0a3e272d397c75e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:40:10.079351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ede5ddfa-1e5f-4cda-958d-63e69eb982c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:10.173282 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 597/1181] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Oct 29 02:40:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:40:10.181284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c61bc-190d-457c-ad2f-ed9f7ed0f909 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:10.182893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-148c61bc-190d-457c-ad2f-ed9f7ed0f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:10.240217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:10.297058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c61bc-190d-457c-ad2f-ed9f7ed0f909 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:10.375149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:10.375681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:10.375954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:10.376228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:10.377962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:10.482373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:10.483811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:10.487561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:10.504202 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 585/1182] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:40:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:40:10.549520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43bc35-3c76-4e23-98cc-3d03b5ab8a47 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:10.549988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43bc35-3c76-4e23-98cc-3d03b5ab8a47 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:10.550117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43bc35-3c76-4e23-98cc-3d03b5ab8a47 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:10.551408 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 598/1183] 10.222.0.16 () {52 vars in 830 bytes} [Sat Oct 29 02:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:40:10.555332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:10.556571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:10.661412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcafeb1-6adf-486b-a30d-01026afd9d9f service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:10.761899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:10.762604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:10.762941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:10.763288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] PATH_INFO: `/v3/users/9afc4c71f70943feaf8be71d96871612` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:10.778774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afc4c71f70943feaf8be71d96871612)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:10.779803 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:40:10.779803 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:40:10.779803 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:40:10.781029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:10.791552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:10.853745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afc4c71f70943feaf8be71d96871612'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:10.864804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afc4c71f70943feaf8be71d96871612'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:10.864804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afc4c71f70943feaf8be71d96871612'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:10.882219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afc4c71f70943feaf8be71d96871612'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:10.883011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afc4c71f70943feaf8be71d96871612'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:10.916302 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 586/1184] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:40:10 2022] DELETE /identity/v3/users/9afc4c71f70943feaf8be71d96871612 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:40:10.920947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:10.921236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:10.921516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:10.988367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:40:10.989591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:11.067720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:11.081818 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 599/1185] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:40:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:40:11.092649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:11.093939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:11.204600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc07fe-dd7c-49ab-b152-98f55a6362eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:11.263654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:11.284911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:11.285534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:11.285825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:11.286127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:11.287771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:11.409059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:11.410537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ea814-6833-4838-b153-d2576c91f52a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:11.428874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 587/1186] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:40:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:40:11.799321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:40:11.800562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:40:11.812251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223fb81-4038-4b9c-8f80-28e2deeaba48 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:40:11.917522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:40:11.918195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:40:11.918475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:40:11.918767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] PATH_INFO: `/v3/projects/ea2fb4e7ceba4344bee581a8887a8354` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:40:11.930263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2fb4e7ceba4344bee581a8887a8354)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:40:11.931322 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:40:11.931322 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:40:11.931322 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:40:11.932544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:40:11.998490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2fb4e7ceba4344bee581a8887a8354', 'request_id': 'req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:12.013222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2fb4e7ceba4344bee581a8887a8354', 'request_id': 'req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:12.020147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2fb4e7ceba4344bee581a8887a8354', 'request_id': 'req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:12.051524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] The token cache is being invalidate because project ea2fb4e7ceba4344bee581a8887a8354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:40:12.051819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:12.052361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a23c7ba6-5552-4008-a83c-32fb68c7cdc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:40:12.053711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 600/1187] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:40:11 2022] DELETE /identity/v3/projects/ea2fb4e7ceba4344bee581a8887a8354 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:40:21.427015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=62 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:40:22.049159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:43:12.705144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76658-04db-4de4-aed9-9b36973f6727 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:12.705640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76658-04db-4de4-aed9-9b36973f6727 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:12.705640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76658-04db-4de4-aed9-9b36973f6727 None None] PATH_INFO: `/v3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:12.707063 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 588/1188] 10.222.0.50 () {54 vars in 925 bytes} [Sat Oct 29 02:43:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:43:12.735644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af9e7-a4bc-48a1-850c-48d1e828513d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:12.736142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af9e7-a4bc-48a1-850c-48d1e828513d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:12.736244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393af9e7-a4bc-48a1-850c-48d1e828513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:12.822490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-393af9e7-a4bc-48a1-850c-48d1e828513d None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:12.823646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-393af9e7-a4bc-48a1-850c-48d1e828513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:12.944228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 601/1189] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 29 02:43:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:16.700078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5278f-560d-440c-8b7e-dc082f891a45 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:16.700604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5278f-560d-440c-8b7e-dc082f891a45 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:16.700604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5278f-560d-440c-8b7e-dc082f891a45 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:16.702046 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 589/1190] 10.222.0.16 () {54 vars in 961 bytes} [Sat Oct 29 02:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:43:16.707597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18524d9-7816-490b-9a25-b8756e866181 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:16.708262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18524d9-7816-490b-9a25-b8756e866181 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:16.708262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18524d9-7816-490b-9a25-b8756e866181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:16.730963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e18524d9-7816-490b-9a25-b8756e866181 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:16.732276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e18524d9-7816-490b-9a25-b8756e866181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:16.741755 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 602/1191] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 02:43:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:16.750232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5278f-560d-440c-8b7e-dc082f891a45 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:43:16.769891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5278f-560d-440c-8b7e-dc082f891a45 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:43:16.775267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a140f8-d486-47f5-830a-91eb979d22d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:43:16.775881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a140f8-d486-47f5-830a-91eb979d22d9 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:16.776159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a140f8-d486-47f5-830a-91eb979d22d9 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:16.776432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a140f8-d486-47f5-830a-91eb979d22d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:16.785393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a140f8-d486-47f5-830a-91eb979d22d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:43:16.787109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a140f8-d486-47f5-830a-91eb979d22d9 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:43:16.797297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 590/1192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:43:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:43:17.553559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0894e-1382-4816-8b2a-eda415366a35 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:17.553831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0894e-1382-4816-8b2a-eda415366a35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:17.554038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0894e-1382-4816-8b2a-eda415366a35 None None] PATH_INFO: `/v3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:17.555543 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 603/1193] 10.222.0.18 () {54 vars in 925 bytes} [Sat Oct 29 02:43:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:43:17.564251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872be62-0f0e-4184-b257-e1977d473c3d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:17.564671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872be62-0f0e-4184-b257-e1977d473c3d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:17.565089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872be62-0f0e-4184-b257-e1977d473c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:17.587938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f872be62-0f0e-4184-b257-e1977d473c3d None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:17.589176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f872be62-0f0e-4184-b257-e1977d473c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:17.600219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 591/1194] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Oct 29 02:43:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:26.039049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79d413-24a2-46aa-aedb-8436dcc55133 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:26.039604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79d413-24a2-46aa-aedb-8436dcc55133 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:26.039604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79d413-24a2-46aa-aedb-8436dcc55133 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:26.040940 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 604/1195] 10.222.0.16 () {54 vars in 961 bytes} [Sat Oct 29 02:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:43:26.046263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630851-c886-4839-8501-478ee7e2f718 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:26.046745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630851-c886-4839-8501-478ee7e2f718 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:26.046745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25630851-c886-4839-8501-478ee7e2f718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:26.067847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-25630851-c886-4839-8501-478ee7e2f718 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:26.069092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25630851-c886-4839-8501-478ee7e2f718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:26.078419 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 592/1196] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 02:43:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:26.086315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79d413-24a2-46aa-aedb-8436dcc55133 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:43:26.101134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79d413-24a2-46aa-aedb-8436dcc55133 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:43:26.106923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b610e-febc-47f3-85cb-77f6efce442e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:43:26.107518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b610e-febc-47f3-85cb-77f6efce442e service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:26.107804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b610e-febc-47f3-85cb-77f6efce442e service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:26.108069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b610e-febc-47f3-85cb-77f6efce442e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:26.117092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b610e-febc-47f3-85cb-77f6efce442e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:43:26.118699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b610e-febc-47f3-85cb-77f6efce442e service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:43:26.129008 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 605/1197] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:43:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:43:36.062824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:43:36.124948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:43:48.758513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62719ed-4b87-491c-a1f6-01652bf94a41 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:48.759323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62719ed-4b87-491c-a1f6-01652bf94a41 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:48.759323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62719ed-4b87-491c-a1f6-01652bf94a41 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:48.761609 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 593/1198] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:43:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:43:48.766911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947831-93b3-4d5a-8c14-9bee39c3622c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:48.767361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947831-93b3-4d5a-8c14-9bee39c3622c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:48.767465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80947831-93b3-4d5a-8c14-9bee39c3622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:48.831260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-80947831-93b3-4d5a-8c14-9bee39c3622c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:48.832390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-80947831-93b3-4d5a-8c14-9bee39c3622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:48.924093 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 606/1199] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:49.085761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62719ed-4b87-491c-a1f6-01652bf94a41 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:43:49.087890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a62719ed-4b87-491c-a1f6-01652bf94a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:49.204678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62719ed-4b87-491c-a1f6-01652bf94a41 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:43:49.211144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450a908-b5d1-46df-9d47-db888e4146ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:43:49.211749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a908-b5d1-46df-9d47-db888e4146ff service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:49.212026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a908-b5d1-46df-9d47-db888e4146ff service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:49.212292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450a908-b5d1-46df-9d47-db888e4146ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:49.220335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450a908-b5d1-46df-9d47-db888e4146ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:43:49.221945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450a908-b5d1-46df-9d47-db888e4146ff service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:43:49.231303 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 594/1200] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:43:50.291333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77bc10-8b2f-4123-a6ab-b81be01b9282 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:50.291930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77bc10-8b2f-4123-a6ab-b81be01b9282 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:50.291930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf77bc10-8b2f-4123-a6ab-b81be01b9282 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:50.293251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 607/1201] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 29 02:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:43:50.299314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b91f-90f6-4ee1-8db0-f95b7d751486 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:50.299753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b91f-90f6-4ee1-8db0-f95b7d751486 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:50.299879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38b91f-90f6-4ee1-8db0-f95b7d751486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:50.321474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d38b91f-90f6-4ee1-8db0-f95b7d751486 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:50.322755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d38b91f-90f6-4ee1-8db0-f95b7d751486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:50.331032 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 595/1202] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 29 02:43:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:50.484557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77bc10-8b2f-4123-a6ab-b81be01b9282 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:43:50.510296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf77bc10-8b2f-4123-a6ab-b81be01b9282 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:43:50.517238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7611266-a6b6-41f1-86e9-46cadd9ca18b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:43:50.517834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611266-a6b6-41f1-86e9-46cadd9ca18b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:50.518126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611266-a6b6-41f1-86e9-46cadd9ca18b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:50.518403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7611266-a6b6-41f1-86e9-46cadd9ca18b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:50.526889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7611266-a6b6-41f1-86e9-46cadd9ca18b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:43:50.528468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7611266-a6b6-41f1-86e9-46cadd9ca18b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:43:50.538222 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 608/1203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:43:54.848347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145a81-8c5a-42a2-a726-fbbcd75b9564 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:54.849204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145a81-8c5a-42a2-a726-fbbcd75b9564 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:54.849204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25145a81-8c5a-42a2-a726-fbbcd75b9564 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:54.851183 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 596/1204] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:43:54.859808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0e6ab-c9f3-4f6d-8ae9-99750ca289f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:54.860268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0e6ab-c9f3-4f6d-8ae9-99750ca289f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:54.860368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0e6ab-c9f3-4f6d-8ae9-99750ca289f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:54.890061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-53a0e6ab-c9f3-4f6d-8ae9-99750ca289f9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:54.891621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53a0e6ab-c9f3-4f6d-8ae9-99750ca289f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:54.905170 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 609/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:55.193858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145a81-8c5a-42a2-a726-fbbcd75b9564 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:43:55.195949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25145a81-8c5a-42a2-a726-fbbcd75b9564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:55.282132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25145a81-8c5a-42a2-a726-fbbcd75b9564 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:43:55.286181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811a8b7-f3f3-4d9b-9203-d3c7166b583d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:43:55.286813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811a8b7-f3f3-4d9b-9203-d3c7166b583d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:55.287087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811a8b7-f3f3-4d9b-9203-d3c7166b583d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:55.287359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811a8b7-f3f3-4d9b-9203-d3c7166b583d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:55.296755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811a8b7-f3f3-4d9b-9203-d3c7166b583d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:43:55.298233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811a8b7-f3f3-4d9b-9203-d3c7166b583d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:43:55.307951 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 597/1206] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:43:57.427859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b6e3b-41f3-4c1e-b8b2-82f21dd21a64 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:57.428798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b6e3b-41f3-4c1e-b8b2-82f21dd21a64 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:57.428798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b6e3b-41f3-4c1e-b8b2-82f21dd21a64 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:57.430937 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 610/1207] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 29 02:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:43:57.439903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3349-bd79-4608-bfde-eb1023b3b47f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:57.440343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3349-bd79-4608-bfde-eb1023b3b47f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:57.440448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b3349-bd79-4608-bfde-eb1023b3b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:57.462345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f23b3349-bd79-4608-bfde-eb1023b3b47f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:43:57.463554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f23b3349-bd79-4608-bfde-eb1023b3b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:43:57.472790 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 598/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 29 02:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:43:57.762105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b6e3b-41f3-4c1e-b8b2-82f21dd21a64 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:43:57.777896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b6e3b-41f3-4c1e-b8b2-82f21dd21a64 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:43:57.782102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d5f75-2cc5-40b4-bbf5-db9ab4f85de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:43:57.782757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5f75-2cc5-40b4-bbf5-db9ab4f85de7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:43:57.783057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5f75-2cc5-40b4-bbf5-db9ab4f85de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:43:57.783322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d5f75-2cc5-40b4-bbf5-db9ab4f85de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:43:57.793030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5f75-2cc5-40b4-bbf5-db9ab4f85de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:43:57.794541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d5f75-2cc5-40b4-bbf5-db9ab4f85de7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:43:57.804245 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 611/1209] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:44:07.457456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:44:07.799866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=65 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:44:50.697403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4111f0-6ee1-401f-9ceb-63d9a3f35bce None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:44:50.698040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4111f0-6ee1-401f-9ceb-63d9a3f35bce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:44:50.698040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4111f0-6ee1-401f-9ceb-63d9a3f35bce None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:44:50.699627 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 599/1210] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:44:50.704992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809d1c-13b8-42f0-8392-ada505e3d09a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:44:50.705460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809d1c-13b8-42f0-8392-ada505e3d09a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:44:50.705733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95809d1c-13b8-42f0-8392-ada505e3d09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:44:50.730048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-95809d1c-13b8-42f0-8392-ada505e3d09a None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:44:50.731292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95809d1c-13b8-42f0-8392-ada505e3d09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:44:50.740711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 612/1211] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:00.724466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:22.185229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d444b31-ee8b-4df6-9040-55fd4c9c3c65 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.185895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d444b31-ee8b-4df6-9040-55fd4c9c3c65 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.185895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d444b31-ee8b-4df6-9040-55fd4c9c3c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.211749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5d444b31-ee8b-4df6-9040-55fd4c9c3c65 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.212981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d444b31-ee8b-4df6-9040-55fd4c9c3c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.223950 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 600/1212] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:22.235549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.236621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.237155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.268952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.271595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.286071 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 613/1213] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:22.288954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91fdc-b89f-4634-b1bd-c337090a2a67 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.289256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91fdc-b89f-4634-b1bd-c337090a2a67 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.289613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea91fdc-b89f-4634-b1bd-c337090a2a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.294300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.311540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15265-5ab0-40ba-8416-83447481e144 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.318240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7ea91fdc-b89f-4634-b1bd-c337090a2a67 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.319919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ea91fdc-b89f-4634-b1bd-c337090a2a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.324340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.325025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.325293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.325565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.329831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:22.329831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.329831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.335549 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 601/1214] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.346828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.347505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.348002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.349953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 614/1215] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:45:22.360859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.377892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660000eb-b995-4e4d-87ed-56448232dd87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.379451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.380972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.386541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:45:22.389826 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:45:22.390762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.395222 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 602/1216] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:22.400478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.415951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dd59e-3f03-424e-be5e-febbe6efab6f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.421960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.423000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.423650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.424258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.425195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:22.425732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.426990 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:45:22.426990 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:45:22.426990 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:45:22.428265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.450209 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 603/1217] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:22.454571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.469867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b4b13-4b23-402a-b5b4-83e4d17be617 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.475661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.476634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.477140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.477641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.478562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.480901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.491515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 615/1218] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:22.498876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.529991 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 604/1219] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:22.534829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.660848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86041a-49ca-418e-8469-1c13c854e050 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.702861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e698f9-1737-434b-ba0f-e1ac98d8fe38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.718798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.719689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.719981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.720253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.720895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.721977 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:45:22.721977 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:45:22.721977 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:45:22.723368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677df0ee-41ae-4d58-9515-22236306b1c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.770946 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 605/1220] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:22.774821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118bd6-7545-4ebc-b685-00a2a10402f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.775107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118bd6-7545-4ebc-b685-00a2a10402f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.775379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df118bd6-7545-4ebc-b685-00a2a10402f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.789138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47280c65-a3df-4b4e-85c3-99557aed1316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.789691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47280c65-a3df-4b4e-85c3-99557aed1316 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.790070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47280c65-a3df-4b4e-85c3-99557aed1316 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.790343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47280c65-a3df-4b4e-85c3-99557aed1316 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.791079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47280c65-a3df-4b4e-85c3-99557aed1316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.792980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47280c65-a3df-4b4e-85c3-99557aed1316 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.804994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df118bd6-7545-4ebc-b685-00a2a10402f2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.817964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df118bd6-7545-4ebc-b685-00a2a10402f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.835311 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 616/1221] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/users => generated 292 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:22.836393 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 606/1222] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.836654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2cfa6-a188-4edd-ab71-cae5870d7602 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.836943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2cfa6-a188-4edd-ab71-cae5870d7602 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.837277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2cfa6-a188-4edd-ab71-cae5870d7602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.837661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.837981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.838259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.865997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.867228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.872807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-85c2cfa6-a188-4edd-ab71-cae5870d7602 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.874016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-85c2cfa6-a188-4edd-ab71-cae5870d7602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.877091 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 607/1223] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.878031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.887837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3bcf9-79d9-49be-ac04-832959f1e36d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.889374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 617/1224] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.890813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5dde-ef92-494a-adb0-113fc8a250a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.891097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5dde-ef92-494a-adb0-113fc8a250a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.891370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda5dde-ef92-494a-adb0-113fc8a250a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.900354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.900971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.901242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.901503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.902229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.904185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.913109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dbda5dde-ef92-494a-adb0-113fc8a250a7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.914379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dbda5dde-ef92-494a-adb0-113fc8a250a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.916859 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 608/1225] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:22.917658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:22.925092 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 618/1226] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.926539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6376da-b013-47fd-a6cd-d487635f3188 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.926825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6376da-b013-47fd-a6cd-d487635f3188 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.927096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6376da-b013-47fd-a6cd-d487635f3188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.937774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aeafe-8a89-4157-9c01-5a36862f5f86 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:22.942429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705708f-8f76-4f8a-80ad-1b43be42db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:22.943042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705708f-8f76-4f8a-80ad-1b43be42db72 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.943317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705708f-8f76-4f8a-80ad-1b43be42db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.943588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705708f-8f76-4f8a-80ad-1b43be42db72 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.944279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705708f-8f76-4f8a-80ad-1b43be42db72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:22.945919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705708f-8f76-4f8a-80ad-1b43be42db72 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:22.946725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e6376da-b013-47fd-a6cd-d487635f3188 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.947931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e6376da-b013-47fd-a6cd-d487635f3188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.956132 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 619/1227] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.962081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 609/1228] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:22.962081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe39a9-0af1-4bd4-abe3-ae54a7cf3402 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.962081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe39a9-0af1-4bd4-abe3-ae54a7cf3402 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.962081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe39a9-0af1-4bd4-abe3-ae54a7cf3402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.962400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4274a-4c38-45bd-8d16-5edd28fb7ca6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.962682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4274a-4c38-45bd-8d16-5edd28fb7ca6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.962930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4274a-4c38-45bd-8d16-5edd28fb7ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.977683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6bbe39a9-0af1-4bd4-abe3-ae54a7cf3402 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.979084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bbe39a9-0af1-4bd4-abe3-ae54a7cf3402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.982447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3ff4274a-4c38-45bd-8d16-5edd28fb7ca6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:22.983618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ff4274a-4c38-45bd-8d16-5edd28fb7ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:22.987246 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 610/1229] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.988539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.988820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.989147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:22.991396 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 620/1230] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:22.992567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1057701-26be-4aee-83a5-5cc50591e0aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:22.992847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1057701-26be-4aee-83a5-5cc50591e0aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:22.993117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1057701-26be-4aee-83a5-5cc50591e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.009382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.010626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.012505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c1057701-26be-4aee-83a5-5cc50591e0aa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.013661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1057701-26be-4aee-83a5-5cc50591e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.018775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 611/1231] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.019688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.027015 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 621/1232] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.027015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.027015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.027015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.033075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c87fd2-3d1a-4796-8a81-784ea2700b0e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.038077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932c387-0749-4a40-9ec3-2fcf74363688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.038684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932c387-0749-4a40-9ec3-2fcf74363688 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.038957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932c387-0749-4a40-9ec3-2fcf74363688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.039276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932c387-0749-4a40-9ec3-2fcf74363688 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.039864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932c387-0749-4a40-9ec3-2fcf74363688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.041470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932c387-0749-4a40-9ec3-2fcf74363688 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.042305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.043542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.051360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 622/1233] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.054825 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 612/1234] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:23.054954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.055062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.055062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.055062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.064919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90446000-db49-4338-b89e-ce0d4be08bae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.070382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b2c5e-cc9d-43b2-89b9-66c32117d55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.070977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2c5e-cc9d-43b2-89b9-66c32117d55d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.071254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2c5e-cc9d-43b2-89b9-66c32117d55d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.071511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b2c5e-cc9d-43b2-89b9-66c32117d55d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.072138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2c5e-cc9d-43b2-89b9-66c32117d55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.073199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.073735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b2c5e-cc9d-43b2-89b9-66c32117d55d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.074418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.075255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.083179 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 613/1235] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.084228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.089507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 623/1236] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:23.089507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.089507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.089507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.094279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e960-643b-420c-b6fd-d4f5a6e75b59 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.099150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.099752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.100030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.100301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.100942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:23.101249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.102892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.107786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.109004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.114768 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 614/1237] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:23.115570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.117439 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 624/1238] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.118316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.131147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd56c60-3be4-4fb2-b45b-3bee773d958b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.131303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb9eb6-a086-4ce6-b17e-0fa80b86d150 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.135701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.136300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.136501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.136652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.136844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.137318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.137577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:23.137691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.137872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.137991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.138530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:23.138828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.139509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.140407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.151344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 615/1239] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:23.152930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.161514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 625/1240] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:23.161514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.161767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.164727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a02b0-424b-48a7-9eac-9d82744eccd4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.170033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.170695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.170976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.171250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] PATH_INFO: `/v3/projects/013e7f18496749fb9525e0303e688964/users/1e835f57621f46719369731607bebb1f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.171425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782866b-7a77-4da9-b142-fa3307e03e51 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.176039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.176635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.176906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.177179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.177825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:23.178132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.179711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.185959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=013e7f18496749fb9525e0303e688964, user_id=1e835f57621f46719369731607bebb1f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.188493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.192064 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 626/1241] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:23.192885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.202977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ab304-ac50-498b-9e65-712194b16c37 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.204029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 616/1242] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:23 2022] PUT /identity/v3/projects/013e7f18496749fb9525e0303e688964/users/1e835f57621f46719369731607bebb1f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:23.207589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.261545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.262309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.262716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.262988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.263624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:23.263939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.265531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.266522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cc69c-0257-45e0-b23d-18ae95506e7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.271986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.272691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.272935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.273223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] PATH_INFO: `/v3/projects/ce1981c2ab5d48e99b9b1ca83ad39a45/users/b7c5ded2f3e64c2da5fd7c556a275b6f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.277479 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 627/1243] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:23.278380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.289401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1981c2ab5d48e99b9b1ca83ad39a45, user_id=b7c5ded2f3e64c2da5fd7c556a275b6f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.292062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.295161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60408a6c-03dc-470f-8af7-f1db14293f3e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.301113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.301739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.302051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.302332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.302991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:23.303299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.305186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.307758 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 617/1244] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:23 2022] PUT /identity/v3/projects/ce1981c2ab5d48e99b9b1ca83ad39a45/users/b7c5ded2f3e64c2da5fd7c556a275b6f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:23.308523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.329714 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 628/1245] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:23.330883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.341662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb94ba9-c7f4-4496-82db-d2cb0ff58b89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.381282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fc2ac-7ca1-4069-be1a-899da08e3a7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.386064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.386663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.387014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.387386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.388099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.390561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.398366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.398987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.399269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.399542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.400178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.402115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.417121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 618/1246] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.418033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.432820 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 629/1247] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.433640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.464622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.470916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.487400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e14ac1-ba41-4d64-9a57-568b0c76c31e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.498183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848516a6-28bd-4fe0-9e69-f8894069f216 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.503140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca3b2-02de-4738-8566-f8fe9ff024b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.503789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca3b2-02de-4738-8566-f8fe9ff024b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.504066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca3b2-02de-4738-8566-f8fe9ff024b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.504332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca3b2-02de-4738-8566-f8fe9ff024b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.504960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ca3b2-02de-4738-8566-f8fe9ff024b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.506963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ca3b2-02de-4738-8566-f8fe9ff024b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.538516 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 630/1248] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.538516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52b4e-cf95-4bdc-9195-c05a64736f67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.538516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52b4e-cf95-4bdc-9195-c05a64736f67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.538516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c52b4e-cf95-4bdc-9195-c05a64736f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.551459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.551992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.552331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.552535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.553172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.555141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.556941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98c52b4e-cf95-4bdc-9195-c05a64736f67 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.558883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98c52b4e-cf95-4bdc-9195-c05a64736f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.586735 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 619/1249] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.586735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.619048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 631/1250] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.620617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.620894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.621158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.649251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] MFA Rules not processed for user `b7c5ded2f3e64c2da5fd7c556a275b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:23.650598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03b270-3f2d-4e71-9a4e-a8f8d154e4fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.650750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:23.656436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.657055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.657358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.657634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.658330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.661104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.689528 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 620/1251] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.690369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.717142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 632/1252] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:23.721569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.732620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a763fd-06b6-4d41-ac99-298fc08ddcbd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.754916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d35d3-9026-4460-9180-709294c24c46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.759968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.760577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.760856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.761127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.761751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.764079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.773470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.773703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:23.790346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.790961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.791234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.791503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.792180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.794702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.794832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 621/1253] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.795501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.817438 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 633/1254] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.818265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.828083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062779a2-aa88-4304-ba74-e714ec39a0b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.858649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b96b-eebd-42b5-91a6-db772592bebe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.863172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.863779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.864052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.864324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.864948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.866893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.884373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.885075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.885357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.885621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.886287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.888518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.890959 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 622/1255] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.891767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.901846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7bb82-0b9e-41fa-a945-4fe0839a9a71 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.907614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.908253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.908533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.908805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.909428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.911392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.916317 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 634/1256] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.916317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.933849 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 623/1257] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.934785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.944459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef38d2e-75a1-498e-865e-d0417affea45 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.949729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.950784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.950784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.951027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.951505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.953404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.975383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994aa19-1a12-4236-826f-84bf71e863d1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.978737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 624/1258] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:23.978737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:23.979470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.980152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.980499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.981060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.986002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e9be1-f0cf-4daa-8385-08e9024b9a6f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:23.990191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.990494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:23.991075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:23.991346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:23.991618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:23.991743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:23.992229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:23.994139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.001378 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 635/1259] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:24.002258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.011675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7beefc9-3da4-4064-9229-6658cac908e8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.016966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.017586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.017925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.018338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.019105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.021070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.027916 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 625/1260] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:23 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:24.027916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.047837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 636/1261] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:24 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:24.047837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.058105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf6d39-124c-46b7-b394-fd45d91007c9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.101796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b650291-9f27-4b2d-9c52-a8da8fc0f2c6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.107169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.107905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.108250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.108581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.109347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.111372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.116054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:24.126219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 626/1262] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.126991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.135896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.136614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.137048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.137389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.138125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.138798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddb3c9-c394-4b83-a593-961b6018e1f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.139860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.144067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.144697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.144976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.145246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.145926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.147756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.151966 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 637/1263] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.152920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.159710 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 627/1264] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.161036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.163626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48763ee2-dca7-4bbc-9a29-db45386d715e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.168292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.168979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.169328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.169658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.170459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.172125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.173244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd6bdb7-a606-48e1-acee-5747307ac810 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.178869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.179498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.180079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.180392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.181070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.182987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.183132 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 638/1265] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.184158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.186436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:24.196363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d784e5b-82f9-4d3c-9c81-2a44e743f535 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.201556 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 628/1266] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.202337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.202907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.203041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.203253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.203565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.204443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.206520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.213719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e825d-204c-49b8-857b-09da49183bcd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.220455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.221105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.221482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.221920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.222819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.225361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.231279 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 639/1267] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:24 2022] POST /identity/v3/users => generated 298 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:24.234836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.241308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 629/1268] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.241308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.246303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13ca6d-ef0b-4c65-813e-a65fb6687367 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.251856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.252648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.252908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b761c42-47fa-4841-a50c-14997d314859 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.253089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.253365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.254437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.256114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.258067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.258679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.258954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.259223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.259861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.261451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.270527 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 640/1269] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.272068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.275615 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 630/1270] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.275615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.284220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de576dc6-b871-4f79-9153-257a66d32922 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.289918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.290525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.290801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.291202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.291969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.292648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8524c-bb58-4cb2-86cf-fbcb8fc7c03b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.293535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.299966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.300793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.301257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.302284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.303768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.305875 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 631/1271] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.305875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.311124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.317120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91925c-a983-4fc8-8cb9-6bd6a2488470 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.323317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.324020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.324432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.324795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.325530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.327331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.337377 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 641/1272] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.337377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.341535 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 632/1273] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.341535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.347808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296f00e-ac42-4a4a-9f09-d7099debc8af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.349719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2108e4-4131-4745-9697-35b8e91dcae8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.352528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.353188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.353478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.353840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.354465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.354978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.355756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.355911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.356183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.356294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.356889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.358572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.372290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 633/1274] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.372290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.372556 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 642/1275] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:24.372859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.383369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcaed6-276c-44a6-9683-3f1f43b09060 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.383942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fe2b0-63a3-457e-a487-702a2cad8217 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.388699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.388864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.389398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.389514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.389678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.389785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.389981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] PATH_INFO: `/v3/projects/67ea773130ed4742915da0d5abf84f3a/users/255cc5a6e9584a1f94b290b617cad351/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.390229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] PATH_INFO: `/v3/projects/24a3d738a21746bd996db6a866ff6e7b/users/52e91da7b94f490faf595d5de7818ac1/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.408417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ea773130ed4742915da0d5abf84f3a, user_id=255cc5a6e9584a1f94b290b617cad351, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.411413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.411562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24a3d738a21746bd996db6a866ff6e7b, user_id=52e91da7b94f490faf595d5de7818ac1, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.414281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.429908 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 634/1276] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/67ea773130ed4742915da0d5abf84f3a/users/255cc5a6e9584a1f94b290b617cad351/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.429908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.433582 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 643/1277] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/24a3d738a21746bd996db6a866ff6e7b/users/52e91da7b94f490faf595d5de7818ac1/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.434456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.514775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d3430-becd-4b08-9524-d49d3876396d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.520262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.521019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.521365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.521707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] PATH_INFO: `/v3/projects/2504c8ae592e45c4a9650b492d6ed747/users/a66a1a17d4654203a88f77f485dc865e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.523032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65848425-e494-412d-88a1-301fcb1be280 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.529047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.530205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.530729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.531201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] PATH_INFO: `/v3/projects/0e5b07bd1bf54af9b3883a471080c513/users/140b06bbda1e43c2a2ca742b67a30429/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.541262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2504c8ae592e45c4a9650b492d6ed747, user_id=a66a1a17d4654203a88f77f485dc865e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.548909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.552835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5b07bd1bf54af9b3883a471080c513, user_id=140b06bbda1e43c2a2ca742b67a30429, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.555729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.571500 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 635/1278] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/2504c8ae592e45c4a9650b492d6ed747/users/a66a1a17d4654203a88f77f485dc865e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.572444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.574028 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 644/1279] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/0e5b07bd1bf54af9b3883a471080c513/users/140b06bbda1e43c2a2ca742b67a30429/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.575407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.639609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:24.661319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57af90-4ef0-41a2-9120-ccda7060cf77 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.662727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b44d5b-1bfa-485d-8606-8b2dffa0ad32 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.666432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aa9d5-93fc-40ed-96fc-d50c55905627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.667318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aa9d5-93fc-40ed-96fc-d50c55905627 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.667606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aa9d5-93fc-40ed-96fc-d50c55905627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.667880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aa9d5-93fc-40ed-96fc-d50c55905627 admin admin] PATH_INFO: `/v3/projects/688d12b0098c4c7abb86c2deed084e6e/users/2323686003f44c3ab2ac43df77af2a27/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.668063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.669017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.669384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.669748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] PATH_INFO: `/v3/projects/c99adc3c9ecb46309e23f220a6cedb49/users/13ce3ca31f154e95850d3b4aacca4207/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.672221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:24.687743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4aa9d5-93fc-40ed-96fc-d50c55905627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688d12b0098c4c7abb86c2deed084e6e, user_id=2323686003f44c3ab2ac43df77af2a27, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.688288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99adc3c9ecb46309e23f220a6cedb49, user_id=13ce3ca31f154e95850d3b4aacca4207, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.691234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.691382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4aa9d5-93fc-40ed-96fc-d50c55905627 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.708051 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 636/1280] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/c99adc3c9ecb46309e23f220a6cedb49/users/13ce3ca31f154e95850d3b4aacca4207/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.711441 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 645/1281] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/688d12b0098c4c7abb86c2deed084e6e/users/2323686003f44c3ab2ac43df77af2a27/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.711776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:24.712783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeafd6d-1dfb-4a9d-b256-2deab91f9001 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.713067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeafd6d-1dfb-4a9d-b256-2deab91f9001 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.713344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeafd6d-1dfb-4a9d-b256-2deab91f9001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.745652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5aeafd6d-1dfb-4a9d-b256-2deab91f9001 None None] MFA Rules not processed for user `255cc5a6e9584a1f94b290b617cad351`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:24.747111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aeafd6d-1dfb-4a9d-b256-2deab91f9001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:24.795027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c641097-4186-46f8-9d92-8f2dbe5dbb68 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:24.833301 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 646/1282] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:24.835904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9be3-9add-4edf-b63a-9a732a6404f2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.836290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9be3-9add-4edf-b63a-9a732a6404f2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.836633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc9be3-9add-4edf-b63a-9a732a6404f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.861744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a5562-42c0-442b-876d-05dc5455b683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:24.862587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5562-42c0-442b-876d-05dc5455b683 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.862967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5562-42c0-442b-876d-05dc5455b683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.863336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5562-42c0-442b-876d-05dc5455b683 admin admin] PATH_INFO: `/v3/projects/76fbd82349a340f1aeb7081c165b949c/users/0c3b35074ab0449d89c7a27bd87658fb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.869731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e2cc9be3-9add-4edf-b63a-9a732a6404f2 None None] MFA Rules not processed for user `52e91da7b94f490faf595d5de7818ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:24.871577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e2cc9be3-9add-4edf-b63a-9a732a6404f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:24.884558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a5562-42c0-442b-876d-05dc5455b683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fbd82349a340f1aeb7081c165b949c, user_id=0c3b35074ab0449d89c7a27bd87658fb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:24.890356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a5562-42c0-442b-876d-05dc5455b683 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:24.920650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 637/1283] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:24 2022] PUT /identity/v3/projects/76fbd82349a340f1aeb7081c165b949c/users/0c3b35074ab0449d89c7a27bd87658fb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:24.920650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.920650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.920650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:24.953400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] MFA Rules not processed for user `a66a1a17d4654203a88f77f485dc865e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:24.954944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:24.963098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 647/1284] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:24.964700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432ff69-22f5-484f-897d-a2c0c87b2fb5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:24.965013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432ff69-22f5-484f-897d-a2c0c87b2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:24.965288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432ff69-22f5-484f-897d-a2c0c87b2fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.016931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c432ff69-22f5-484f-897d-a2c0c87b2fb5 None None] MFA Rules not processed for user `140b06bbda1e43c2a2ca742b67a30429`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:25.018935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c432ff69-22f5-484f-897d-a2c0c87b2fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:25.033647 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 638/1285] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:25.034757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.038779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:25.073542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:25.118021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168c515-5133-4f88-9f7c-5c927e26c68d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.124547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.125335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.125978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.126408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.127069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.129726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.135874 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 648/1286] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:25.137836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.138206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.138558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.147674 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 639/1287] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:25.148803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.164204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570eff98-378c-4a07-aa7d-ab828782095c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.173857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72392cc9-6158-4649-9d73-d3bdd6878b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.174519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72392cc9-6158-4649-9d73-d3bdd6878b34 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.174855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72392cc9-6158-4649-9d73-d3bdd6878b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.175295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72392cc9-6158-4649-9d73-d3bdd6878b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.176277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72392cc9-6158-4649-9d73-d3bdd6878b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.177381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] MFA Rules not processed for user `13ce3ca31f154e95850d3b4aacca4207`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:25.178459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72392cc9-6158-4649-9d73-d3bdd6878b34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.179122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:25.212648 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 640/1288] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.213973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.214395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.214946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.253718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] MFA Rules not processed for user `0c3b35074ab0449d89c7a27bd87658fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:25.254846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:25.262130 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 649/1289] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:25.263300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.278793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa59d1b-70a4-4c68-9d91-f413a9c147db None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.348884 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 641/1290] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:25.348884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.349203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.349766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.350141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.350687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.351507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.353847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.363243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ee0c4-a3e1-442a-9c87-2ec3ce923767 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.377253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.378512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.378898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.379428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.380521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.382882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.394800 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 650/1291] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/projects => generated 397 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.396035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.432756 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 642/1292] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.433649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.464701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:25.484644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aac447-1ddf-466a-80f5-e9f4b0826abf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.504800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:25.526880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cf69-1e21-42dd-babc-eeff00358436 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.533201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.534077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.534450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.534840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] PATH_INFO: `/v3/projects/688d12b0098c4c7abb86c2deed084e6e/users/2323686003f44c3ab2ac43df77af2a27/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.537062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688d12b0098c4c7abb86c2deed084e6e, user_id=2323686003f44c3ab2ac43df77af2a27, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.539972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.569098 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 643/1293] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:25 2022] PUT /identity/v3/projects/688d12b0098c4c7abb86c2deed084e6e/users/2323686003f44c3ab2ac43df77af2a27/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:25.569098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.575109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.576293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.577210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.577737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.578601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.582009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.621837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 651/1294] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/projects => generated 371 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.627516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.655964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6e01a-6b55-4daf-bf7c-3b066614c9b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.743583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.744211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.744488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.744760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.745860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.748168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.752826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27629971-9f56-45f0-8c11-4cfa9d554053 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.759986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.761296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.761759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.762379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.763080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.765836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.782787 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 644/1295] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.783807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.799442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa981356-7726-481a-967d-a4561926f88b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.805341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.805611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 652/1296] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.806002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.806340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.806660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.807275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.807418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.809640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.838297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 645/1297] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.839149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:25.900169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97c04d-47a1-4bb5-819f-0994e3827ce2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.905241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:25.911479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:25.923913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70850a-bc1d-4add-bfa3-502850ce5872 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:25.930010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb2169-be8d-4f56-afc9-aa780a18bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.930655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb2169-be8d-4f56-afc9-aa780a18bbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.930943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb2169-be8d-4f56-afc9-aa780a18bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.931214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb2169-be8d-4f56-afc9-aa780a18bbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.932383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb2169-be8d-4f56-afc9-aa780a18bbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.934644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb2169-be8d-4f56-afc9-aa780a18bbd4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:25.964415 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 646/1298] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:25.965962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.966255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.966532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.970647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:25.971505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:25.971872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:25.972363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:25.973483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:25.977448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.001112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] MFA Rules not processed for user `2323686003f44c3ab2ac43df77af2a27`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:26.003051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:26.005711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 653/1299] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/users => generated 305 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:26.006702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.031281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569085b-0b8b-4425-a01e-05bec9be1e8e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.054800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.055103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.055408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.055685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.056453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.058600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.087043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 654/1300] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:26 2022] POST /identity/v3/users => generated 292 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:26.087899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.105754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790348b0-1257-404f-9f98-0c63fa5401f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.114191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.114746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.117220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.117220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.117220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.117557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.144302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 655/1301] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.145844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.151496 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 647/1302] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:26.154018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.158120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef622c-de67-4a9d-b4ed-d83db4fed6c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.164767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.165738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.166090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.166365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.167128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.168128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd42a0-f94b-46c9-84cb-c3b2bda802a1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.169784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.174173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.175097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.175570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.176050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.176962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.179805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.213932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 648/1303] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:26 2022] POST /identity/v3/users => generated 300 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:26.215021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.218778 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 656/1304] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:26 2022] POST /identity/v3/users => generated 300 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:26.219682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.227946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8d23a-b133-4f68-9d31-82772df66866 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.232144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619b9b6-e5c8-4be6-b5c0-229d6fde73b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.232831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.233467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.233723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.234152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.234795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.236404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.237229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.237932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.238217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.238493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.239132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.240726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.248677 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 649/1305] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.249550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.256400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 657/1306] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.258163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.260894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76415be3-38b2-424f-bb83-3fa78156c310 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.270817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9495bc-f776-4aa5-af57-b36aff0f967a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.271137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fd121-4de4-4271-a02b-f994bae37b41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.271578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9495bc-f776-4aa5-af57-b36aff0f967a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.271974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9495bc-f776-4aa5-af57-b36aff0f967a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.272254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9495bc-f776-4aa5-af57-b36aff0f967a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.273063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9495bc-f776-4aa5-af57-b36aff0f967a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.275001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9495bc-f776-4aa5-af57-b36aff0f967a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.278187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.278897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.279466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.279466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] PATH_INFO: `/v3/projects/f3840f5c35db47659944b73ab0df3be5/users/a4405e8819df40f9adae5640f7d48794/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.289211 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 650/1307] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.289211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59d9b-d042-4899-b799-b05c191472ce None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.289211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59d9b-d042-4899-b799-b05c191472ce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.289211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf59d9b-d042-4899-b799-b05c191472ce None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.293714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 651/1308] 10.222.0.16 () {54 vars in 961 bytes} [Sat Oct 29 02:45:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:26.294550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59d9b-d042-4899-b799-b05c191472ce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.301881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3840f5c35db47659944b73ab0df3be5, user_id=a4405e8819df40f9adae5640f7d48794, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.306532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.307719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf59d9b-d042-4899-b799-b05c191472ce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.312502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.313236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.313566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.313874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.314557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.316141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.325439 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 658/1309] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:26 2022] PUT /identity/v3/projects/f3840f5c35db47659944b73ab0df3be5/users/a4405e8819df40f9adae5640f7d48794/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:26.326243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.327057 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 652/1310] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.327787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.337907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141916cb-5bb9-4e8f-a638-dcfe0c355876 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.404174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.404987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.405258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.405647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] PATH_INFO: `/v3/projects/a9a37d116d8645b5a717c81eb0c83ed8/users/c2ed5c17f03d431db7b1a8ad7b5d4182/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.409709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1c5fc-fc0c-40c2-bd93-acba7537d48d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.415229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.415912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.416186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.416461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.417122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.419132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.422583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a37d116d8645b5a717c81eb0c83ed8, user_id=c2ed5c17f03d431db7b1a8ad7b5d4182, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.425452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.430953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 659/1311] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.432088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.439089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.444238 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 653/1312] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:26 2022] PUT /identity/v3/projects/a9a37d116d8645b5a717c81eb0c83ed8/users/c2ed5c17f03d431db7b1a8ad7b5d4182/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:26.446706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb793db5-1afb-43bf-aa29-ab7b8df2f10b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.448167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.463793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.512832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e21670-b097-4f68-83f5-7d5a994aa13d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.517783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92e279-375a-480a-b7c9-c92887f6552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.519356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.519616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e279-375a-480a-b7c9-c92887f6552b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.519790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e279-375a-480a-b7c9-c92887f6552b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.520068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92e279-375a-480a-b7c9-c92887f6552b admin admin] PATH_INFO: `/v3/projects/ec82daa0ef9c41df81d98670782d9139/users/5af56299c80c417fa918fd6093e92904/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.523139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.523432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.523709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] PATH_INFO: `/v3/projects/b7a4b3b6cab248409e63a216709fc3ff/users/77e6e3697dce4888930c0f1977f2bbb5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.539802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e279-375a-480a-b7c9-c92887f6552b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec82daa0ef9c41df81d98670782d9139, user_id=5af56299c80c417fa918fd6093e92904, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.541444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a4b3b6cab248409e63a216709fc3ff, user_id=77e6e3697dce4888930c0f1977f2bbb5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.545491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92e279-375a-480a-b7c9-c92887f6552b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.549056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.567840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 654/1313] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:26 2022] PUT /identity/v3/projects/ec82daa0ef9c41df81d98670782d9139/users/5af56299c80c417fa918fd6093e92904/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:26.568039 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 660/1314] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:26 2022] PUT /identity/v3/projects/b7a4b3b6cab248409e63a216709fc3ff/users/77e6e3697dce4888930c0f1977f2bbb5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:26.568039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.569219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.569508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.569965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.623238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:26.624519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:26.667790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db485d0-51c8-4d1f-823b-eb858ce462fb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.678351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.679739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.679739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.679739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.680187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.684218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.699033 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 661/1315] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:26.699946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.712150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e5375-0db5-4438-ab6a-707915bececf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.721427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.725847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.726143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.727763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] PATH_INFO: `/v3/projects/0545cc0648954292b57634b5b13ad4fc/users/a382a4da7e5d4e6ba6b0c2e56254d367/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.733687 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 655/1316] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:26.734807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.763913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7364b8-4db1-4809-908a-e4888c980b94 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.770121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0545cc0648954292b57634b5b13ad4fc, user_id=a382a4da7e5d4e6ba6b0c2e56254d367, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.772189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:26.775640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:26.776091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:26.776511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] PATH_INFO: `/v3/projects/5d2710b6387f427692528d4cc01560c5/users/e2a6b005e71249f6885e3a7816bdf5f9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:26.783301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.822725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2710b6387f427692528d4cc01560c5, user_id=e2a6b005e71249f6885e3a7816bdf5f9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:26.829948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:26.837931 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 662/1317] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:26 2022] PUT /identity/v3/projects/0545cc0648954292b57634b5b13ad4fc/users/a382a4da7e5d4e6ba6b0c2e56254d367/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:26.839033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.856285 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 656/1318] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:26 2022] PUT /identity/v3/projects/5d2710b6387f427692528d4cc01560c5/users/e2a6b005e71249f6885e3a7816bdf5f9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:26.857443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:26.958140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425bd8b-e7e5-4c97-8be2-e823913321ee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:26.958692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.991987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:26.997996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea453a-cf7c-4bc6-b073-9d876b0cacbb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.019328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.019955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.020234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.020502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.021148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.023311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.042490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 657/1319] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:27.042490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.053116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf051c1-f2ee-4459-a57a-33bb2fff3d97 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.058079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.058680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.058981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.059259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.059899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.061869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.078480 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 658/1320] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:27.078480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.085409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.086197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.086568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.086934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.087676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.089075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee129c-e7d0-4e00-8d0a-c6f4b7b7f84c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.092033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.096524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.097560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.097862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.098853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] PATH_INFO: `/v3/projects/f3840f5c35db47659944b73ab0df3be5/users/a4405e8819df40f9adae5640f7d48794/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.102034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3840f5c35db47659944b73ab0df3be5, user_id=a4405e8819df40f9adae5640f7d48794, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.105782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.115689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 663/1321] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:27.115689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.133472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 659/1322] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:27 2022] PUT /identity/v3/projects/f3840f5c35db47659944b73ab0df3be5/users/a4405e8819df40f9adae5640f7d48794/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:27.133472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.201074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7d975-307f-499f-a76a-589f94f1bb04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.207323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.208188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.208466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.208735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.211597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.215058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.242081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 660/1323] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:27.243124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.268528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61cb54-1c02-416d-81ed-631172e4377c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.279822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.282012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.282293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.282688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702b2d-da61-4d81-b72d-6dc0c7384587 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.283669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.284339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.289023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.319999 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 661/1324] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:27.320796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.342681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e53bc-9b54-4bc5-afb4-169d09ae8fa6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.365126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.366079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.366374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.366673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] PATH_INFO: `/v3/projects/ec82daa0ef9c41df81d98670782d9139/users/5af56299c80c417fa918fd6093e92904/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.374305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec82daa0ef9c41df81d98670782d9139, user_id=5af56299c80c417fa918fd6093e92904, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.381225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.415824 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 662/1325] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:27 2022] PUT /identity/v3/projects/ec82daa0ef9c41df81d98670782d9139/users/5af56299c80c417fa918fd6093e92904/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:27.417355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.447677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ee02f-7113-4733-bccf-8c2080a7392b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.454880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ee02f-7113-4733-bccf-8c2080a7392b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.455352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ee02f-7113-4733-bccf-8c2080a7392b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.455721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ee02f-7113-4733-bccf-8c2080a7392b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.515574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76019ef-f6cb-4736-ac77-99f4628cea6f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.520601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.521287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.521579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.521864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] PATH_INFO: `/v3/projects/b7a4b3b6cab248409e63a216709fc3ff/users/77e6e3697dce4888930c0f1977f2bbb5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.523848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7a4b3b6cab248409e63a216709fc3ff, user_id=77e6e3697dce4888930c0f1977f2bbb5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.526542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.540152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.562982 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 663/1326] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:27 2022] PUT /identity/v3/projects/b7a4b3b6cab248409e63a216709fc3ff/users/77e6e3697dce4888930c0f1977f2bbb5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:27.562982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.577908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ee02f-7113-4733-bccf-8c2080a7392b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.579931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ee02f-7113-4733-bccf-8c2080a7392b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.587465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:27.604532 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 664/1327] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:27.605744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37bdc5-bcfe-4d9c-8104-08550b02c9e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.606055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37bdc5-bcfe-4d9c-8104-08550b02c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.606328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37bdc5-bcfe-4d9c-8104-08550b02c9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.655475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6f37bdc5-bcfe-4d9c-8104-08550b02c9e1 None None] MFA Rules not processed for user `a4405e8819df40f9adae5640f7d48794`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:27.656915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092895ce-19c4-47bc-a69e-7e18bce47547 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.657686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f37bdc5-bcfe-4d9c-8104-08550b02c9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:27.661926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.663001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.663102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.663290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] PATH_INFO: `/v3/projects/a9a37d116d8645b5a717c81eb0c83ed8/users/c2ed5c17f03d431db7b1a8ad7b5d4182/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.665681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a37d116d8645b5a717c81eb0c83ed8, user_id=c2ed5c17f03d431db7b1a8ad7b5d4182, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.668426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.682385 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 664/1328] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:27 2022] PUT /identity/v3/projects/a9a37d116d8645b5a717c81eb0c83ed8/users/c2ed5c17f03d431db7b1a8ad7b5d4182/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:27.683460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.771841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8561e2f-339a-4b6f-9ce8-1121dcc9433d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.777107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.778146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.778498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.779058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] PATH_INFO: `/v3/projects/0545cc0648954292b57634b5b13ad4fc/users/a382a4da7e5d4e6ba6b0c2e56254d367/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.781389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0545cc0648954292b57634b5b13ad4fc, user_id=a382a4da7e5d4e6ba6b0c2e56254d367, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.785438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.802552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 665/1329] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:27 2022] PUT /identity/v3/projects/0545cc0648954292b57634b5b13ad4fc/users/a382a4da7e5d4e6ba6b0c2e56254d367/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:27.805374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:27.815727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 665/1330] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:27.816960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62f207-5aa9-4f1d-afae-c97f30276cbf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.817248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62f207-5aa9-4f1d-afae-c97f30276cbf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.817603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62f207-5aa9-4f1d-afae-c97f30276cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.881056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a62f207-5aa9-4f1d-afae-c97f30276cbf None None] MFA Rules not processed for user `5af56299c80c417fa918fd6093e92904`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:27.882455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a62f207-5aa9-4f1d-afae-c97f30276cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:27.902808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a57dc2-f236-446b-ba75-80d6d7e4c45b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:27.908791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3643a-83da-41e2-8ff5-b81a9b88d216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:27.909130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3643a-83da-41e2-8ff5-b81a9b88d216 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.909744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3643a-83da-41e2-8ff5-b81a9b88d216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.910143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3643a-83da-41e2-8ff5-b81a9b88d216 admin admin] PATH_INFO: `/v3/projects/5d2710b6387f427692528d4cc01560c5/users/e2a6b005e71249f6885e3a7816bdf5f9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.913149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3643a-83da-41e2-8ff5-b81a9b88d216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d2710b6387f427692528d4cc01560c5, user_id=e2a6b005e71249f6885e3a7816bdf5f9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:27.915983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3643a-83da-41e2-8ff5-b81a9b88d216 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:27.932871 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 666/1331] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:27 2022] PUT /identity/v3/projects/5d2710b6387f427692528d4cc01560c5/users/e2a6b005e71249f6885e3a7816bdf5f9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:27.935039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8654-ff8f-41f4-ad94-5f29f5a9f6ec None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:27.935477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8654-ff8f-41f4-ad94-5f29f5a9f6ec None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:27.935814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8654-ff8f-41f4-ad94-5f29f5a9f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:27.976514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-83cd8654-ff8f-41f4-ad94-5f29f5a9f6ec None None] MFA Rules not processed for user `77e6e3697dce4888930c0f1977f2bbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:27.978154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83cd8654-ff8f-41f4-ad94-5f29f5a9f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:28.013756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:28.046755 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 666/1332] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:28.049142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc762cd-0669-4d8a-a675-26bdc84ea4f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.050059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc762cd-0669-4d8a-a675-26bdc84ea4f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.087940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc762cd-0669-4d8a-a675-26bdc84ea4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.093400 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 667/1333] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:27 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:28.094892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69f63f-94da-47db-b1e5-0e22a7e99d2f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.095401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69f63f-94da-47db-b1e5-0e22a7e99d2f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.095683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69f63f-94da-47db-b1e5-0e22a7e99d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.114552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5dc762cd-0669-4d8a-a675-26bdc84ea4f9 None None] MFA Rules not processed for user `c2ed5c17f03d431db7b1a8ad7b5d4182`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:28.116148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5dc762cd-0669-4d8a-a675-26bdc84ea4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:28.136473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0f69f63f-94da-47db-b1e5-0e22a7e99d2f None None] MFA Rules not processed for user `a382a4da7e5d4e6ba6b0c2e56254d367`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:28.137901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f69f63f-94da-47db-b1e5-0e22a7e99d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:28.176008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:28.215958 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 668/1335] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:28.216499 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 667/1335] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:28.217330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b109990-501d-4820-826b-7173f6d4f239 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.217453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dde1e7-f9db-429e-805e-f7bb250726e5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.217605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b109990-501d-4820-826b-7173f6d4f239 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.217686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dde1e7-f9db-429e-805e-f7bb250726e5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.217903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b109990-501d-4820-826b-7173f6d4f239 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.218080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dde1e7-f9db-429e-805e-f7bb250726e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.219861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 669/1336] 10.222.0.16 () {54 vars in 961 bytes} [Sat Oct 29 02:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:28.221246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b109990-501d-4820-826b-7173f6d4f239 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:28.265890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-10dde1e7-f9db-429e-805e-f7bb250726e5 None None] MFA Rules not processed for user `e2a6b005e71249f6885e3a7816bdf5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:28.267212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10dde1e7-f9db-429e-805e-f7bb250726e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:28.324820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b109990-501d-4820-826b-7173f6d4f239 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:28.335122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:28.335779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.336195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.336925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.353409 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 668/1337] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:28.355114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.355496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.355973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.380356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:28.382329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:28.398031 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 669/1338] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 02:45:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:28.400344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:28.406859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:28.421192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:28.423773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b8087-d132-4f7b-ab76-5b4a87919e6f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:28.424382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:28.429911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:28.430920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.431408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.431760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.440123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 670/1339] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:28.509668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:28.511573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:28.531550 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 670/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:45:28.669481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:28.688444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c416147-e0de-4a76-8d0a-4c637e756a0e service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:28.694420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:28.695045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.695345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.695615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.710122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:28.713397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:28.735833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 671/1341] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:28 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:28.862610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:28.882319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dab655-6f05-4bcd-8430-fe546dfeaa93 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:28.888672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:28.889865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:28.890340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:28.890798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:28.900345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:28.902251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:28.917905 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 671/1342] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:28.979806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:28.997843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3145c81-23ea-451f-b575-76faec1aedf7 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:29.000457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:29.001073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.001348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.001620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.012793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:29.014698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:29.027242 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 672/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:29.034931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:29.048487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7414b16-cda0-45fc-8115-5660ea4d7298 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:29.054951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:29.055597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.056509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.056841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.073433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:29.075496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:29.087629 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 672/1344] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:29.210682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:29.348439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f877bfd-83be-49b4-ba22-0574f83f58af service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:29.356365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:29.358933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:29.359746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.360027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.360307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] PATH_INFO: `/v3/users/140b06bbda1e43c2a2ca742b67a30429` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.364626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140b06bbda1e43c2a2ca742b67a30429)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:29.368360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:29.376078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a3090-0b47-4feb-a17f-91e35fdd9faa service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:29.384062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:29.384771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.385116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.386078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.435069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:29.460649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140b06bbda1e43c2a2ca742b67a30429'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:29.473724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140b06bbda1e43c2a2ca742b67a30429'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:29.475964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140b06bbda1e43c2a2ca742b67a30429'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:29.497948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:29.498543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140b06bbda1e43c2a2ca742b67a30429'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:29.499380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b56d5c0-b2ea-4b60-bf1f-a02e053c87b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140b06bbda1e43c2a2ca742b67a30429'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:29.499580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:29.522851 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 673/1345] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:45:29.523744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:29.529583 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 673/1346] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:29 2022] DELETE /identity/v3/users/140b06bbda1e43c2a2ca742b67a30429 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:29.533964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.534251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.534522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.553530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f99c3c-752d-49e6-be43-17521763f2dd service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:29.584197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:29.585428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:29.640503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:29.719326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:29.720596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.721157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.721545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.725128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:29.737061 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 674/1347] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:29.749024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:29.751002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:29.863372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef73e46-1239-4f78-aa9a-f69a9d216c2d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:29.871491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af5add-5566-45b4-9467-77b7d3a81189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:29.872613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5add-5566-45b4-9467-77b7d3a81189 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.872888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5add-5566-45b4-9467-77b7d3a81189 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.873154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5add-5566-45b4-9467-77b7d3a81189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.895013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:29.897420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b684f7-6058-4570-9a5f-556a2dc4a885 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:29.904072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af5add-5566-45b4-9467-77b7d3a81189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:29.905745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af5add-5566-45b4-9467-77b7d3a81189 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:29.920889 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 675/1348] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:29.922346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216bba-49bf-4b8a-bd09-aa102a08623e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.922631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216bba-49bf-4b8a-bd09-aa102a08623e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.922901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216bba-49bf-4b8a-bd09-aa102a08623e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.924891 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 674/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:29.930156 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 676/1350] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:45:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:29.932463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7be99-3b20-4399-9d4d-b2ab3a160106 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:29.932750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7be99-3b20-4399-9d4d-b2ab3a160106 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:29.933027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7be99-3b20-4399-9d4d-b2ab3a160106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:29.957768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ffe7be99-3b20-4399-9d4d-b2ab3a160106 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:29.960572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffe7be99-3b20-4399-9d4d-b2ab3a160106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.047607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:30.078218 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 675/1351] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:30.112199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216bba-49bf-4b8a-bd09-aa102a08623e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.114255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b216bba-49bf-4b8a-bd09-aa102a08623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.149606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.150985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.151369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.153394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216bba-49bf-4b8a-bd09-aa102a08623e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.163139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.163774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.164056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.164702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.185211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] MFA Rules not processed for user `1e835f57621f46719369731607bebb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:30.190432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.190551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.190551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.215047 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 677/1352] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:30.308345 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 676/1353] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:30.309027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.311280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.340228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd834820-366c-4cf4-a850-7a0abd81142d service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.352867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.353724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.355002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.355400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.356802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.358901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.416819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.419054 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 678/1354] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:30 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:30.422267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.424512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.440618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa616c7-9a50-45c4-8326-632531c8060d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.518852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.519504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.519824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.520098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] PATH_INFO: `/v3/projects/0e5b07bd1bf54af9b3883a471080c513` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.521207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5b07bd1bf54af9b3883a471080c513)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.523860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.535179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410d2fb-469c-4bd1-a7fe-3833d6b354d3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.540871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51739b99-c66e-40be-bf53-4ec3aa14a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.547206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51739b99-c66e-40be-bf53-4ec3aa14a057 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.547206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51739b99-c66e-40be-bf53-4ec3aa14a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.547206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51739b99-c66e-40be-bf53-4ec3aa14a057 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.547206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51739b99-c66e-40be-bf53-4ec3aa14a057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.548029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51739b99-c66e-40be-bf53-4ec3aa14a057 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.582129 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 679/1355] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:30 2022] POST /identity/v3/users => generated 308 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:30.583788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da31960-a181-41d9-9d59-1a5f44184ee3 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.584077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da31960-a181-41d9-9d59-1a5f44184ee3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.584403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da31960-a181-41d9-9d59-1a5f44184ee3 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.586041 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 680/1356] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:30.586896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da31960-a181-41d9-9d59-1a5f44184ee3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.601756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5b07bd1bf54af9b3883a471080c513', 'request_id': 'req-eb92e1f9-38e9-4b76-bf42-602933690c4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.608432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5b07bd1bf54af9b3883a471080c513', 'request_id': 'req-eb92e1f9-38e9-4b76-bf42-602933690c4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.614869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5b07bd1bf54af9b3883a471080c513', 'request_id': 'req-eb92e1f9-38e9-4b76-bf42-602933690c4c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.633936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] The token cache is being invalidate because project 0e5b07bd1bf54af9b3883a471080c513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:30.634184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.634845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb92e1f9-38e9-4b76-bf42-602933690c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.636513 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 677/1357] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:30 2022] DELETE /identity/v3/projects/0e5b07bd1bf54af9b3883a471080c513 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:30.639385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:30.640452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.640956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.641080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.667680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:30.669290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.687177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da31960-a181-41d9-9d59-1a5f44184ee3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.691923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.692544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.694521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.694521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.694521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.696846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.700471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:30.711732 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 681/1358] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:30.711732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.711732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.725006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ab900-4db3-4d87-8c2d-901fc1594367 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.730465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.731272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.731556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.731835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] PATH_INFO: `/v3/users/5af56299c80c417fa918fd6093e92904` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.733073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af56299c80c417fa918fd6093e92904)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.735155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.765343 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 678/1359] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:30.767076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.768861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.791229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ee641-fc38-4a50-9f67-19a3580ced89 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.797395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.798298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.798443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af56299c80c417fa918fd6093e92904'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.799309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.799660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] PATH_INFO: `/v3/users/0c3b35074ab0449d89c7a27bd87658fb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.801136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3b35074ab0449d89c7a27bd87658fb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.802323 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:45:30.802323 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:45:30.802323 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:45:30.804103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.810075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af56299c80c417fa918fd6093e92904'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.811573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af56299c80c417fa918fd6093e92904'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.825774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af56299c80c417fa918fd6093e92904'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.826609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af56299c80c417fa918fd6093e92904'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.861420 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 682/1360] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:30 2022] DELETE /identity/v3/users/5af56299c80c417fa918fd6093e92904 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:30.865830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.867406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:30.889937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3b35074ab0449d89c7a27bd87658fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.913225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3b35074ab0449d89c7a27bd87658fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.914099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3b35074ab0449d89c7a27bd87658fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.929760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3b35074ab0449d89c7a27bd87658fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.931415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3b35074ab0449d89c7a27bd87658fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:30.945321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e591a-7629-4e38-9140-cc77cc709aca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:30.951392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:30.952154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:30.952453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:30.952734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] PATH_INFO: `/v3/users/13ce3ca31f154e95850d3b4aacca4207` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:30.953907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13ce3ca31f154e95850d3b4aacca4207)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:30.956251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:30.956782 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 679/1361] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:30 2022] DELETE /identity/v3/users/0c3b35074ab0449d89c7a27bd87658fb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:30.957830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:30.960797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.009789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:31.018508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13ce3ca31f154e95850d3b4aacca4207'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.030335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13ce3ca31f154e95850d3b4aacca4207'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.031153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13ce3ca31f154e95850d3b4aacca4207'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.041428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13ce3ca31f154e95850d3b4aacca4207'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.042219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13ce3ca31f154e95850d3b4aacca4207'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.049036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2d79-4703-4842-959f-25100f750b8a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.054423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb727f2f-fbe9-4427-a6e8-8a2f0ac51401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.055407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb727f2f-fbe9-4427-a6e8-8a2f0ac51401 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.055686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb727f2f-fbe9-4427-a6e8-8a2f0ac51401 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.056009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb727f2f-fbe9-4427-a6e8-8a2f0ac51401 admin admin] PATH_INFO: `/v3/projects/11353d779f36430089be3e2d8162215a/users/98beec3060af4e1cb4c74f65d4d00ee6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.075202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb727f2f-fbe9-4427-a6e8-8a2f0ac51401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11353d779f36430089be3e2d8162215a, user_id=98beec3060af4e1cb4c74f65d4d00ee6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.078215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb727f2f-fbe9-4427-a6e8-8a2f0ac51401 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.080508 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 683/1362] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:30 2022] DELETE /identity/v3/users/13ce3ca31f154e95850d3b4aacca4207 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:31.081957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.084865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.097405 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 680/1363] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:30 2022] PUT /identity/v3/projects/11353d779f36430089be3e2d8162215a/users/98beec3060af4e1cb4c74f65d4d00ee6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:31.098948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1979c-2584-4b67-aa18-5d2572c99dea None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.099279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1979c-2584-4b67-aa18-5d2572c99dea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.099747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1979c-2584-4b67-aa18-5d2572c99dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.122467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-20a1979c-2584-4b67-aa18-5d2572c99dea None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:31.123909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20a1979c-2584-4b67-aa18-5d2572c99dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.133741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:31.181872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf243a-e15a-455c-8560-453da1570255 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.213256 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 681/1364] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:31.221125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.221125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.221125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.242747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:31.244124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.253296 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 682/1365] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:31.254239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.255633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.275032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915ddd2-b522-471f-97db-ccda33f5a55a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.281704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.281822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.282318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.282463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.282590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.282878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.282958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.283135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.283492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.285456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.286429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.297469 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 683/1366] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:31.298373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.298471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.300110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.300233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.311251 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 684/1367] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:31.312142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.313044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d45f0-d100-4b26-9269-794d65b8590f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.313481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.317709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.318370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.318655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.318924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] PATH_INFO: `/v3/projects/ec82daa0ef9c41df81d98670782d9139` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.320031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec82daa0ef9c41df81d98670782d9139)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.322141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.393361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90becd67-d46b-4ed7-9b08-0bec68c47165 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.394099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec82daa0ef9c41df81d98670782d9139', 'request_id': 'req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.399779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:31.406834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec82daa0ef9c41df81d98670782d9139', 'request_id': 'req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.427687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec82daa0ef9c41df81d98670782d9139', 'request_id': 'req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.447422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] The token cache is being invalidate because project ec82daa0ef9c41df81d98670782d9139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:31.447902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.448789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.451296 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 684/1368] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:31 2022] DELETE /identity/v3/projects/ec82daa0ef9c41df81d98670782d9139 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:31.452518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.454107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.468546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.469849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.470137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.470409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.472520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.535734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05e3db-b65f-48e8-a6a7-2663a4765aa0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.539823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.540514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.546177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.546584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.548557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.555421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.557081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.572053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.574543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95dbefd-896a-4606-8605-607c1b3d78bd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.580245 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 685/1369] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:31.581353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.587723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.587978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 685/1370] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:31.589483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.589913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.590230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.611075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c238bab-81cb-4780-91ec-66afa92e60b0 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.617303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:31.619865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.624219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f5c65-7733-4e2c-ab0b-154927088a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.625047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5c65-7733-4e2c-ab0b-154927088a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.625775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5c65-7733-4e2c-ab0b-154927088a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.626853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f5c65-7733-4e2c-ab0b-154927088a9c admin admin] PATH_INFO: `/v3/projects/11353d779f36430089be3e2d8162215a/users/98beec3060af4e1cb4c74f65d4d00ee6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.631221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5c65-7733-4e2c-ab0b-154927088a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11353d779f36430089be3e2d8162215a, user_id=98beec3060af4e1cb4c74f65d4d00ee6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.637640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f5c65-7733-4e2c-ab0b-154927088a9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.638947 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 686/1371] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:31.640050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.643298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.660957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 686/1372] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:31 2022] PUT /identity/v3/projects/11353d779f36430089be3e2d8162215a/users/98beec3060af4e1cb4c74f65d4d00ee6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:31.662428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.662776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.663120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.663233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948946d-1d7b-469e-90d7-a25eadc2094b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.684971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:31.686386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:31.696156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:31.812767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.813398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.813684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.813938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] PATH_INFO: `/v3/users/b7c5ded2f3e64c2da5fd7c556a275b6f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.818640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c5ded2f3e64c2da5fd7c556a275b6f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.820604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.879667 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 687/1373] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:31.884911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:31.913216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c5ded2f3e64c2da5fd7c556a275b6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.913665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb20256-8161-4323-8587-88e69be2ed9a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:31.928256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:31.928898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:31.930316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:31.930630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:31.932791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:31.933259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:31.938449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:31.947597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c5ded2f3e64c2da5fd7c556a275b6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.949173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c5ded2f3e64c2da5fd7c556a275b6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.967888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c5ded2f3e64c2da5fd7c556a275b6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.971377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33bddc02-18e9-4ff7-a6a8-4ade059af880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c5ded2f3e64c2da5fd7c556a275b6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:31.998220 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 687/1374] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:31 2022] DELETE /identity/v3/users/b7c5ded2f3e64c2da5fd7c556a275b6f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:32.002387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:32.010199 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 688/1375] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:32.012468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:32.012961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:32.014168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:32.021537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:32.074556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:32.075927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:32.078363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7290e6-0a44-4129-9273-b62d72a0bda1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:32.150707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:32.213379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:32.215196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:32.216005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:32.216366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:32.217019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:32.218987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:32.235774 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 688/1376] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:32.249385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:32.251109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:32.289034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 689/1377] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:32 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:32.293541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:32.295623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:32.326665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:32.359916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e79dc-c12c-466e-8620-13c30bbf5ccc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:32.395297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb8734-a44d-407b-adc4-2e18f7689132 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:32.403382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:32.405584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:32.406085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:32.408013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] PATH_INFO: `/v3/projects/76fbd82349a340f1aeb7081c165b949c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:32.409668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fbd82349a340f1aeb7081c165b949c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:32.410997 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:45:32.410997 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:45:32.410997 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:45:32.412889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:32.461696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:32.463224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:32.463955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:32.464443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:32.477685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:32.479704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:32.503753 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 689/1378] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:45:32.505305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fbd82349a340f1aeb7081c165b949c', 'request_id': 'req-93ea7672-c289-4fb7-8f92-637380fbfc23'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.509229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:32.530593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fcf79-d057-4411-9dcd-3ea9cfeadf02 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:32.532059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fbd82349a340f1aeb7081c165b949c', 'request_id': 'req-93ea7672-c289-4fb7-8f92-637380fbfc23'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.553875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fbd82349a340f1aeb7081c165b949c', 'request_id': 'req-93ea7672-c289-4fb7-8f92-637380fbfc23'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.591702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] The token cache is being invalidate because project 76fbd82349a340f1aeb7081c165b949c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:32.592113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.592896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.594799 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 690/1379] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:32 2022] DELETE /identity/v3/projects/76fbd82349a340f1aeb7081c165b949c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:32.602135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:32.604331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:32.694188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:32.694826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:32.695915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:32.696193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:32.696857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:32.699837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:32.702960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:32.742470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea7672-c289-4fb7-8f92-637380fbfc23 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:32.757340 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 690/1380] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:32 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:32.758688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:32.760971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:32.762734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:32.763976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:32.764220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:32.764500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] PATH_INFO: `/v3/projects/c99adc3c9ecb46309e23f220a6cedb49` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:32.767008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99adc3c9ecb46309e23f220a6cedb49)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:32.771037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:32.912317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99adc3c9ecb46309e23f220a6cedb49', 'request_id': 'req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.922307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99adc3c9ecb46309e23f220a6cedb49', 'request_id': 'req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.949439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3e30-c9aa-436d-bdb6-122c3f2ffea0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:32.953713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99adc3c9ecb46309e23f220a6cedb49', 'request_id': 'req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.985277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] The token cache is being invalidate because project c99adc3c9ecb46309e23f220a6cedb49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:32.985724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:32.992439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:33.000249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.025452 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 691/1381] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:32 2022] DELETE /identity/v3/projects/c99adc3c9ecb46309e23f220a6cedb49 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:33.029110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:33.041142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.060487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:33.062130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:33.062130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:33.062130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:33.067635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.233390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4e7e3-7b8a-43fd-8597-4a7968e1c14e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:33.234626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:33.241946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:33.243605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:33.244310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:33.244573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:33.244867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] PATH_INFO: `/v3/users/a382a4da7e5d4e6ba6b0c2e56254d367` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:33.249423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a382a4da7e5d4e6ba6b0c2e56254d367)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:33.252579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:33.255809 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 691/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:32 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:33.272373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:33.277535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.318656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363775b8-cfad-492d-8e61-5b14395d4ede service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:33.352845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39ec69-0ef2-4c07-8f08-663ad465cf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:33.353147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39ec69-0ef2-4c07-8f08-663ad465cf4b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:33.353434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39ec69-0ef2-4c07-8f08-663ad465cf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:33.354252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39ec69-0ef2-4c07-8f08-663ad465cf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:33.355263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39ec69-0ef2-4c07-8f08-663ad465cf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:33.358561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a382a4da7e5d4e6ba6b0c2e56254d367'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.364152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39ec69-0ef2-4c07-8f08-663ad465cf4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:33.378258 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 692/1383] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:33.379647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:33.379933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:33.380384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:33.384021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a382a4da7e5d4e6ba6b0c2e56254d367'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.384021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a382a4da7e5d4e6ba6b0c2e56254d367'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.402556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a382a4da7e5d4e6ba6b0c2e56254d367'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.406329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a382a4da7e5d4e6ba6b0c2e56254d367'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.421773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] MFA Rules not processed for user `255cc5a6e9584a1f94b290b617cad351`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:33.423430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.450142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:33.471558 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 692/1384] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:33 2022] DELETE /identity/v3/users/a382a4da7e5d4e6ba6b0c2e56254d367 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:33.484541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:33.498466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.647323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2d54c-6926-4b0f-aca2-eba9c7b4ada4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:33.648587 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 693/1385] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:33.649525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:33.656611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.673746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:33.676284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc54c4-5f1f-499a-b6ee-f49f8a3b261e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:33.676643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:33.676925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:33.677200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] PATH_INFO: `/v3/users/e2a6b005e71249f6885e3a7816bdf5f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:33.686970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:33.686970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:33.686970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:33.686970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] PATH_INFO: `/v3/projects/ce1981c2ab5d48e99b9b1ca83ad39a45` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:33.687408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1981c2ab5d48e99b9b1ca83ad39a45)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:33.687408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:33.691973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a6b005e71249f6885e3a7816bdf5f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:33.708521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:33.759884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:33.761851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1981c2ab5d48e99b9b1ca83ad39a45', 'request_id': 'req-1e34bb1c-ec6b-44c9-8478-62be1ef396af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.773525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1981c2ab5d48e99b9b1ca83ad39a45', 'request_id': 'req-1e34bb1c-ec6b-44c9-8478-62be1ef396af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.783115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1981c2ab5d48e99b9b1ca83ad39a45', 'request_id': 'req-1e34bb1c-ec6b-44c9-8478-62be1ef396af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.842694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] The token cache is being invalidate because project ce1981c2ab5d48e99b9b1ca83ad39a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:33.842694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.843750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a6b005e71249f6885e3a7816bdf5f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.847629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.848812 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 694/1386] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:33 2022] DELETE /identity/v3/projects/ce1981c2ab5d48e99b9b1ca83ad39a45 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:33.849551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:33.853766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:33.862999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a6b005e71249f6885e3a7816bdf5f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.863779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a6b005e71249f6885e3a7816bdf5f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.873116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a6b005e71249f6885e3a7816bdf5f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.886358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a6b005e71249f6885e3a7816bdf5f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:33.923397 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 693/1387] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:33 2022] DELETE /identity/v3/users/e2a6b005e71249f6885e3a7816bdf5f9 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:33.924354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:33.930332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.050917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e34bb1c-ec6b-44c9-8478-62be1ef396af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:34.104723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c5aab-f7d6-40e3-b1d8-9001263f15a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:34.128488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:34.130452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.130941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.131593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.135514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.173328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:34.240170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:34.240835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.242338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.242621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.245127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:34.251469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:34.271261 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 695/1388] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:34.272292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:34.274778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.298443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4833d9-a647-453f-b2a7-8bd17fe7c7d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:34.305782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:34.306567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.306854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.307175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] PATH_INFO: `/v3/users/2323686003f44c3ab2ac43df77af2a27` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.308441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2323686003f44c3ab2ac43df77af2a27)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:34.315914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:34.316953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:34.319283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:34.349797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 694/1389] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:34.352069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:34.354789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.372833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5330b98-367b-4d85-a9ca-404b96ece417 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:34.378378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082f077-c602-410a-838d-5df3f3cd0e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:34.380124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082f077-c602-410a-838d-5df3f3cd0e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.380649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082f077-c602-410a-838d-5df3f3cd0e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.381132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082f077-c602-410a-838d-5df3f3cd0e31 admin admin] PATH_INFO: `/v3/projects/7bb0081b81cc46909ff0bae0f6ac30f7/users/9c7e462d0e474a3aa94d3a146ae24d21/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.419713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082f077-c602-410a-838d-5df3f3cd0e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb0081b81cc46909ff0bae0f6ac30f7, user_id=9c7e462d0e474a3aa94d3a146ae24d21, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:34.423310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082f077-c602-410a-838d-5df3f3cd0e31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:34.427204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2323686003f44c3ab2ac43df77af2a27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:34.453481 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 695/1390] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:34 2022] PUT /identity/v3/projects/7bb0081b81cc46909ff0bae0f6ac30f7/users/9c7e462d0e474a3aa94d3a146ae24d21/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:34.464743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434665-5369-47ef-baef-856791626910 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.468191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434665-5369-47ef-baef-856791626910 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.469732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0434665-5369-47ef-baef-856791626910 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.472769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2323686003f44c3ab2ac43df77af2a27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:34.473672 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 696/1391] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:45:34 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:45:34.475641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.475876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2323686003f44c3ab2ac43df77af2a27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:34.476334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.476779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.494396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:34.500060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2323686003f44c3ab2ac43df77af2a27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:34.501268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-85bb0dd9-2e2f-427a-8685-7cb6f4ba2e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2323686003f44c3ab2ac43df77af2a27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:34.529419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] MFA Rules not processed for user `9c7e462d0e474a3aa94d3a146ae24d21`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:34.531054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.535618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 696/1392] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:34 2022] DELETE /identity/v3/users/2323686003f44c3ab2ac43df77af2a27 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:34.537051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.538453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.546098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.596805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:34.602393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.660096 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 697/1393] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:34.661268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:34.662797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.772068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 697/1394] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:34.772955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:34.776159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:34.921636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc095-69c8-4552-a191-7eea281d414e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:34.952000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:34.954216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.954967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.954967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] PATH_INFO: `/v3/projects/0545cc0648954292b57634b5b13ad4fc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:34.959984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caf697-e4bd-418b-9c55-3592e3794c68 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:34.960464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0545cc0648954292b57634b5b13ad4fc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:34.966749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:34.967269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:34.969639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:34.970156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:34.970643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.003553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.007645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:35.034339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:35.106824 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 698/1395] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:34 2022] POST /identity/v3/projects => generated 389 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:35.108155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:35.113057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.115834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0545cc0648954292b57634b5b13ad4fc', 'request_id': 'req-f42285db-094d-4138-8f99-52afc2daa9fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.125570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0545cc0648954292b57634b5b13ad4fc', 'request_id': 'req-f42285db-094d-4138-8f99-52afc2daa9fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.146775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0545cc0648954292b57634b5b13ad4fc', 'request_id': 'req-f42285db-094d-4138-8f99-52afc2daa9fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.168625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] The token cache is being invalidate because project 0545cc0648954292b57634b5b13ad4fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:35.168967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.169837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.171978 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 698/1396] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:34 2022] DELETE /identity/v3/projects/0545cc0648954292b57634b5b13ad4fc => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:35.172819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:35.174648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.293624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:35.297003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafbb03-0c16-41b0-9043-5b7ebba361c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:35.303321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:35.304195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.304475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.304748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.308550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.349770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42285db-094d-4138-8f99-52afc2daa9fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:35.471871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.473314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:35.473568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:35.474317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.474602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.474898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] PATH_INFO: `/v3/projects/5d2710b6387f427692528d4cc01560c5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.476618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d2710b6387f427692528d4cc01560c5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.479553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:35.486080 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 699/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:35.486927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:35.488457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.503361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e37dda-0958-40b8-92e8-d83b17fb9adb service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:35.511243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e50c91-ea80-45ef-82a9-9458cf73b63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:35.512171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e50c91-ea80-45ef-82a9-9458cf73b63b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.512451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e50c91-ea80-45ef-82a9-9458cf73b63b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.512724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e50c91-ea80-45ef-82a9-9458cf73b63b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.513359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e50c91-ea80-45ef-82a9-9458cf73b63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.516753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e50c91-ea80-45ef-82a9-9458cf73b63b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:35.549876 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 700/1398] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:35 2022] POST /identity/v3/users => generated 301 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:35.551353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.551556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.551830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.563605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d2710b6387f427692528d4cc01560c5', 'request_id': 'req-0564548b-b3fc-4519-a118-521b33c8a0b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.572236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d2710b6387f427692528d4cc01560c5', 'request_id': 'req-0564548b-b3fc-4519-a118-521b33c8a0b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.575312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:35.583009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:35.586094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.587976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d2710b6387f427692528d4cc01560c5', 'request_id': 'req-0564548b-b3fc-4519-a118-521b33c8a0b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.605863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] The token cache is being invalidate because project 5d2710b6387f427692528d4cc01560c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:35.606215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.607026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.608690 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 699/1399] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:35 2022] DELETE /identity/v3/projects/5d2710b6387f427692528d4cc01560c5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:35.609537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:35.611409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.675560 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 701/1400] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:35.676958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:35.678684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.693011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c946eb-e14e-431e-b766-70b1449f6efc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:35.699625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f5b28c-c27c-42e6-a53c-62b423f3ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:35.700272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b28c-c27c-42e6-a53c-62b423f3ba70 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.700554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b28c-c27c-42e6-a53c-62b423f3ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.700866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5b28c-c27c-42e6-a53c-62b423f3ba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.701605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5b28c-c27c-42e6-a53c-62b423f3ba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.703384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f5b28c-c27c-42e6-a53c-62b423f3ba70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:35.716175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 702/1401] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:35.717542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31466-bec6-433f-9b66-ba3fecf8c600 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.717752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31466-bec6-433f-9b66-ba3fecf8c600 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.718055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31466-bec6-433f-9b66-ba3fecf8c600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.739952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564548b-b3fc-4519-a118-521b33c8a0b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:35.741305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30f31466-bec6-433f-9b66-ba3fecf8c600 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:35.743039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30f31466-bec6-433f-9b66-ba3fecf8c600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.746762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:35.748137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.748613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.749776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] PATH_INFO: `/v3/projects/688d12b0098c4c7abb86c2deed084e6e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.751300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=688d12b0098c4c7abb86c2deed084e6e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.753528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:35.754876 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 703/1402] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:35.763587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.763984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.764259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.792643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:35.795139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.813846 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 704/1403] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:35.815044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:35.830925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688d12b0098c4c7abb86c2deed084e6e', 'request_id': 'req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.831118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271e329-f7b1-40f5-a761-bf1699527ba8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:35.841007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688d12b0098c4c7abb86c2deed084e6e', 'request_id': 'req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.855159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688d12b0098c4c7abb86c2deed084e6e', 'request_id': 'req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.883953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] The token cache is being invalidate because project 688d12b0098c4c7abb86c2deed084e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:35.884486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.885349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2de6a0ad-667f-4a41-9e8b-bd34b68a3984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:35.887303 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 700/1404] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:35 2022] DELETE /identity/v3/projects/688d12b0098c4c7abb86c2deed084e6e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:35.888699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416863a-b694-49fd-9751-e407e15d28fd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.889053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416863a-b694-49fd-9751-e407e15d28fd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.889410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416863a-b694-49fd-9751-e407e15d28fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.918380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:35.919912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5416863a-b694-49fd-9751-e407e15d28fd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:35.921509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5416863a-b694-49fd-9751-e407e15d28fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:35.942625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:35.943541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:35.945408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:35.946938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] PATH_INFO: `/v3/projects/b068e64c9e49494e82711c8fc927f588/users/70a29313fab846a996ac7038f076a051/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:35.974689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b068e64c9e49494e82711c8fc927f588, user_id=70a29313fab846a996ac7038f076a051, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:35.977450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.012132 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 705/1405] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:35 2022] PUT /identity/v3/projects/b068e64c9e49494e82711c8fc927f588/users/70a29313fab846a996ac7038f076a051/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:36.013153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.014928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:36.029907 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 701/1406] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:36.031040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.031427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.031860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.067296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:36.069657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:36.084991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:36.115446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bc687-527e-45ca-85ed-677f1ad19df6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.121895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.122811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.123256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.123664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.124584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:36.125312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.127601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.152094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 706/1407] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:36.152094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.153585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:36.171018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 702/1408] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:36.173890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74e6313-4540-44c5-9718-7cac58472b9b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.174042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.189917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.193061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.193426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.193780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.195887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.197906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1215728d-8c61-456d-b224-2238e4ebed5f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.198760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.211968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.212690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.213267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.213405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.214115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:36.214424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.216906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95130373-02d1-48c2-9bba-9243c2e56b2d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.229570 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 707/1409] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:36.230839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.250790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10862-2500-42d0-9ec3-2c51eeb0a1e5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.257503 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 703/1410] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:36.257503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.257503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.257503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.262805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.266640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.267125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.268358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.268358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.282983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.299213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:36.300552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:36.312760 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 704/1411] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:36.313725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.328278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8681f0-3d92-4320-ac15-c8f03f3560e7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.332753 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 708/1412] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:36 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:36.333504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.418630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b53b9-c302-41fa-b865-6e69d0631448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.419416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b53b9-c302-41fa-b865-6e69d0631448 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.420256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b53b9-c302-41fa-b865-6e69d0631448 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.420544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b53b9-c302-41fa-b865-6e69d0631448 admin admin] PATH_INFO: `/v3/projects/b068e64c9e49494e82711c8fc927f588/users/70a29313fab846a996ac7038f076a051/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.423485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b53b9-c302-41fa-b865-6e69d0631448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b068e64c9e49494e82711c8fc927f588, user_id=70a29313fab846a996ac7038f076a051, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.428831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b53b9-c302-41fa-b865-6e69d0631448 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.441829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 705/1413] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:36 2022] PUT /identity/v3/projects/b068e64c9e49494e82711c8fc927f588/users/70a29313fab846a996ac7038f076a051/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:36.449387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef6ceb-2607-4e6d-ab68-af7724f598a1 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.449702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef6ceb-2607-4e6d-ab68-af7724f598a1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.449972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ef6ceb-2607-4e6d-ab68-af7724f598a1 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.453491 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 706/1414] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:45:36 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:36.459552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef6ceb-2607-4e6d-ab68-af7724f598a1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.471398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9adaae-f109-4ea8-9f00-d6d988a7a276 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.513947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:36.550107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.551591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.552367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.552862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.554836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.557246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.590179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ef6ceb-2607-4e6d-ab68-af7724f598a1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.596660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.599307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.600569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.601102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.603847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:36.604243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.607337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.612333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 709/1415] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:36 2022] POST /identity/v3/projects => generated 383 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:36.613446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.640483 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 707/1416] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:36.645290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:36.647760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:36.716196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd10b8-3e81-4471-8d94-293de7dd0095 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:36.729932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67c162-e2fc-4a01-96a0-af47bc06d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:36.733089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67c162-e2fc-4a01-96a0-af47bc06d670 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.733707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67c162-e2fc-4a01-96a0-af47bc06d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.743650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67c162-e2fc-4a01-96a0-af47bc06d670 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.743650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67c162-e2fc-4a01-96a0-af47bc06d670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:36.759201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe67c162-e2fc-4a01-96a0-af47bc06d670 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:36.816696 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 710/1417] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:36 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:36.821339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6bd2-003b-49e6-9a1e-2e75197a7e8b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:36.821630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6bd2-003b-49e6-9a1e-2e75197a7e8b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:36.821960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea6bd2-003b-49e6-9a1e-2e75197a7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:36.903683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a3ea6bd2-003b-49e6-9a1e-2e75197a7e8b None None] MFA Rules not processed for user `70a29313fab846a996ac7038f076a051`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:36.905115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3ea6bd2-003b-49e6-9a1e-2e75197a7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:36.939511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:36.989988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37c775-2a37-47ff-ba3a-834a3fd0524a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.075915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.076892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.077265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.077631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.079252 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 711/1418] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:37.080564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f5ff-ad5f-4d5f-b36e-e8066b177b05 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.080849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f5ff-ad5f-4d5f-b36e-e8066b177b05 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.081125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9f5ff-ad5f-4d5f-b36e-e8066b177b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.089432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:37.103216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.104930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.115912 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 708/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:37.116880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.127748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeacfc5-763b-42a1-b1ad-3e0bfca483c8 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.127939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01b9f5ff-ad5f-4d5f-b36e-e8066b177b05 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:37.131330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01b9f5ff-ad5f-4d5f-b36e-e8066b177b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:37.132878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.133784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.134193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.134564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.135395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.137554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.170203 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 709/1420] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:37 2022] POST /identity/v3/users => generated 292 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:37.172910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.200911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4fbd4-4e31-4f34-8aa7-dc132cd99bd3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.208463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:37.218896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.219633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.219922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.221584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.223418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.227065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.285070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 710/1421] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:37 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:37.286803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.301986 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 712/1422] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:37.303178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.303465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.306528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.357823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] MFA Rules not processed for user `9c7e462d0e474a3aa94d3a146ae24d21`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:37.359145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:37.439629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e73f51-ae35-4175-81a5-0f25b8c2cee1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.454123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.454853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.455139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.455561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.456460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.460067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.490176 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 711/1423] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:37.493417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.501158 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 713/1424] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:37.502652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.518182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f600308-99d2-4af5-8286-9fb04e6a5df7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.524941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783f2d1-ddb6-4cb7-84d5-2cdefeeb40ba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.531016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.531187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.531531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.531812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.531977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.532247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.532344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.532518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.532940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.533315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.535507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.536192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.568344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 712/1425] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:37.569849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.571799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:37.578360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:37.589259 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 714/1426] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:37 2022] POST /identity/v3/users => generated 292 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:37.589259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.604058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f85af-56b2-4df3-ac38-98ccb1ecb1b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.609947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.611204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.611204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.611204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.612008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.613711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.626463 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 715/1427] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:37.630877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.633337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:37.722416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754b74c-163c-421c-b9fb-82d6529005d3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.726800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.727490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.728207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.728207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.877368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.879460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.894771 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 713/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:37.895804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.909638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc33f0b-cd9c-49ce-8a18-d066aa558118 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.910674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f03574-7e8e-4176-a31b-2ea0cc98136b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.915927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.916550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.917028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.917300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.918515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.920728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.922397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.923249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.923463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.923782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.930605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:37.937694 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 714/1429] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:37.939006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.955502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.956748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fa8f5-c39e-4c9d-a52a-10f029661a08 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:37.959417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.964151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:37.965191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:37.965719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:37.966254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:37.967199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:37.969287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:37.988629 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 716/1430] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:37.989712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:37.992979 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 715/1431] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:37.994403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.020181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448349a-bed2-4e69-868c-d5f99aea7c07 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.030613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849266bb-b6bb-46c7-9fb3-84f59cfed781 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.036307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.037023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.037513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.037628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] PATH_INFO: `/v3/projects/d59162acd36543e784c4b8ab093caa44/users/1d9cad68397146e18ccf0a52670be0fb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.042612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd960-ae67-4f08-ad0a-34b21dfa4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.043428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd960-ae67-4f08-ad0a-34b21dfa4eee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.043653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd960-ae67-4f08-ad0a-34b21dfa4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.043926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd960-ae67-4f08-ad0a-34b21dfa4eee admin admin] PATH_INFO: `/v3/projects/a237878563704f5d9ce25ff1c8de6866/users/29104f5da5754d63b55d39dde1dce403/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.056577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59162acd36543e784c4b8ab093caa44, user_id=1d9cad68397146e18ccf0a52670be0fb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.059504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.077608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bd960-ae67-4f08-ad0a-34b21dfa4eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=a237878563704f5d9ce25ff1c8de6866, user_id=29104f5da5754d63b55d39dde1dce403, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.088510 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 716/1432] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:37 2022] PUT /identity/v3/projects/d59162acd36543e784c4b8ab093caa44/users/1d9cad68397146e18ccf0a52670be0fb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:38.088849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bd960-ae67-4f08-ad0a-34b21dfa4eee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.088959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.110393 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 717/1433] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:37 2022] PUT /identity/v3/projects/a237878563704f5d9ce25ff1c8de6866/users/29104f5da5754d63b55d39dde1dce403/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:38.110393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e15880-8e9f-4137-9665-f199e6daf90b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.110393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e15880-8e9f-4137-9665-f199e6daf90b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.110393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e15880-8e9f-4137-9665-f199e6daf90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.123113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:38.148620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-36e15880-8e9f-4137-9665-f199e6daf90b None None] MFA Rules not processed for user `1d9cad68397146e18ccf0a52670be0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:38.150077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36e15880-8e9f-4137-9665-f199e6daf90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:38.221551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:38.233461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c47fa2-8e53-43c8-8ac3-2e7e3a1ca669 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.270147 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 718/1434] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:38.272247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.272785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.273172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.322885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] MFA Rules not processed for user `29104f5da5754d63b55d39dde1dce403`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:38.324926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:38.357942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.360662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.361221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.361684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.363703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.366086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.383482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 717/1435] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:38.384677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.398447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80351e8-b1b0-42fd-9893-880151bec259 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.414589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.416983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.419084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.419454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.421549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.426085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.440122 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 719/1436] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:38.441134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.455978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4250b3-2496-4078-a524-cf7eecf5ab4c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.464516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.465735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.466340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.466702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] PATH_INFO: `/v3/projects/6db7a038e0864d498b7fb80426229db6/users/3adcd4a96faf40539344ab022d1016e3/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.493150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 718/1437] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:38.494551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.499296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db7a038e0864d498b7fb80426229db6, user_id=3adcd4a96faf40539344ab022d1016e3, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.502081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.519628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 720/1438] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:38 2022] PUT /identity/v3/projects/6db7a038e0864d498b7fb80426229db6/users/3adcd4a96faf40539344ab022d1016e3/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:38.521744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.619465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399be1d-88a4-4337-8ac3-ef98d2d36c34 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.663649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b436b-6ec9-4eaa-866f-c4a312e5d3d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.669132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cf21ca-56af-4c07-81f0-1c8832aa601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.670118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf21ca-56af-4c07-81f0-1c8832aa601a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.670544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf21ca-56af-4c07-81f0-1c8832aa601a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.670961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cf21ca-56af-4c07-81f0-1c8832aa601a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.671768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf21ca-56af-4c07-81f0-1c8832aa601a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.674053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cf21ca-56af-4c07-81f0-1c8832aa601a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.687017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:38.710115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 721/1439] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:38.711647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.711929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.712208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.719124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.719854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.720227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.720585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.721952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.723976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.758837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] MFA Rules not processed for user `3adcd4a96faf40539344ab022d1016e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:38.760136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:38.775953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 719/1440] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/projects => generated 375 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:38.777286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.799370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:38.866757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 722/1441] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:38.868085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.883126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556e628-9b8a-4b4c-b331-71408b287728 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.887527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dde2-00e8-4429-958c-7734da57acb0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.894345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.895180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.895555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.895914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.897465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.897991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.898628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.898911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.899190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.899998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.900816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.902481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.913312 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 720/1442] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:38.917670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:38.945857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be6b2d-e4d2-4521-99d8-9c7d956108f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:38.968058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:38.974287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:38.975053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:38.975520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:38.976615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:38.979225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:38.982849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 723/1443] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:38.983767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.013196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7e6e9-da24-4515-b836-c0dc7ea39ff2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.040826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.044394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.048456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.048747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] PATH_INFO: `/v3/projects/285fc704b0334edfa4068fd19aab6823/users/50e84b7586cc465cb50bca96acdc383c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.056008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 721/1444] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:38 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:39.060804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.136099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=285fc704b0334edfa4068fd19aab6823, user_id=50e84b7586cc465cb50bca96acdc383c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.140414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.148097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a2d2a-c9c0-4597-adaf-a1d9594ecf0f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.163338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 724/1445] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:38 2022] PUT /identity/v3/projects/285fc704b0334edfa4068fd19aab6823/users/50e84b7586cc465cb50bca96acdc383c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:39.164025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.283890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ebb54-5b99-443f-be7b-98cc2044e69e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.289656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.290331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.290772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.291055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.291707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.293964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.314606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.315282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.315564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.316016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.316987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.319014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.325328 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 725/1446] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:39 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:39.326866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.335931 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 722/1447] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:39.335931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.353546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a05a60-7d0a-45af-8dc7-dbcc68ba74d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.355081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13fd439-f601-459c-958d-56ef2aee7f4a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.360124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.360442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.360752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.361028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.361334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.361435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.361791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.362175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.362277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.363308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.363954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.365076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.379171 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 726/1448] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:39.380187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.381445 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 723/1449] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:39.382601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.393901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ae04-0482-4703-a429-946559adeff3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.396614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac05f7-6852-4fbc-8983-1725bc5009d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.401738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.402592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.402892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.403314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] PATH_INFO: `/v3/projects/03a919af8dc742959f455c629120a611/users/97c80881b57047dfb36078f9bae5ba45/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.403469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.404503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.404982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.405446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] PATH_INFO: `/v3/projects/9aeb6a22806e4f448ab446afe65b9041/users/15d16213595640378512d8d9099b700d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.431797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a919af8dc742959f455c629120a611, user_id=97c80881b57047dfb36078f9bae5ba45, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.439840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeb6a22806e4f448ab446afe65b9041, user_id=15d16213595640378512d8d9099b700d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.441004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.444710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:39.447318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.462649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:39.476045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 727/1450] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:39 2022] PUT /identity/v3/projects/03a919af8dc742959f455c629120a611/users/97c80881b57047dfb36078f9bae5ba45/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:39.477347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.511873 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 724/1451] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:39 2022] PUT /identity/v3/projects/9aeb6a22806e4f448ab446afe65b9041/users/15d16213595640378512d8d9099b700d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:39.512972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.622220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963ddb-ebae-436e-9fc8-afb6b1fd37ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.645898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de388b85-4f58-4f14-96bb-6daaba466c94 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.662375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.664769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.664966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.665243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.665926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.668034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.691391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 725/1452] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:39.696150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.719908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192f6d3-ba94-4464-b6a9-3472ef37ac77 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.747020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.748449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.749036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.750821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.751625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.754567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.767087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:39.767948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:39.768368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:39.768779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] PATH_INFO: `/v3/projects/285fc704b0334edfa4068fd19aab6823/users/50e84b7586cc465cb50bca96acdc383c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:39.787469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=285fc704b0334edfa4068fd19aab6823, user_id=50e84b7586cc465cb50bca96acdc383c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:39.793383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 726/1453] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:39.794820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:39.797348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:39.829092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71988431-9ca4-4192-9b35-242e075c367a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:39.851471 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 728/1454] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:39 2022] PUT /identity/v3/projects/285fc704b0334edfa4068fd19aab6823/users/50e84b7586cc465cb50bca96acdc383c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:39.851471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:40.056773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb56666-715a-4e7b-bd4e-2f7bd222d535 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:40.065716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8c1d70-738a-4f7b-818a-7bab85345127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:40.066627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1d70-738a-4f7b-818a-7bab85345127 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.067015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1d70-738a-4f7b-818a-7bab85345127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.069836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c1d70-738a-4f7b-818a-7bab85345127 admin admin] PATH_INFO: `/v3/projects/9aeb6a22806e4f448ab446afe65b9041/users/15d16213595640378512d8d9099b700d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.070899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c1d70-738a-4f7b-818a-7bab85345127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aeb6a22806e4f448ab446afe65b9041, user_id=15d16213595640378512d8d9099b700d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:40.083601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8c1d70-738a-4f7b-818a-7bab85345127 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:40.117161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 729/1455] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:39 2022] PUT /identity/v3/projects/9aeb6a22806e4f448ab446afe65b9041/users/15d16213595640378512d8d9099b700d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:40.117161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af385e-1f8e-4100-a3c1-549e70bd7b5c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.117161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af385e-1f8e-4100-a3c1-549e70bd7b5c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.117161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af385e-1f8e-4100-a3c1-549e70bd7b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.152965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc630c7e-bfa5-4090-8f65-8bdd017d46cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:40.154001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630c7e-bfa5-4090-8f65-8bdd017d46cd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.154387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630c7e-bfa5-4090-8f65-8bdd017d46cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.154762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc630c7e-bfa5-4090-8f65-8bdd017d46cd admin admin] PATH_INFO: `/v3/projects/03a919af8dc742959f455c629120a611/users/97c80881b57047dfb36078f9bae5ba45/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.162758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc630c7e-bfa5-4090-8f65-8bdd017d46cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a919af8dc742959f455c629120a611, user_id=97c80881b57047dfb36078f9bae5ba45, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:40.168741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc630c7e-bfa5-4090-8f65-8bdd017d46cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:40.220573 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 727/1456] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:39 2022] PUT /identity/v3/projects/03a919af8dc742959f455c629120a611/users/97c80881b57047dfb36078f9bae5ba45/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:40.223920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89cc3-e781-48ec-81f6-86251072c0cf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.224699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89cc3-e781-48ec-81f6-86251072c0cf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.224792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7af385e-1f8e-4100-a3c1-549e70bd7b5c None None] MFA Rules not processed for user `50e84b7586cc465cb50bca96acdc383c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:40.225632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89cc3-e781-48ec-81f6-86251072c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.226006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7af385e-1f8e-4100-a3c1-549e70bd7b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:40.271037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:40.304013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2be89cc3-e781-48ec-81f6-86251072c0cf None None] MFA Rules not processed for user `15d16213595640378512d8d9099b700d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:40.306233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2be89cc3-e781-48ec-81f6-86251072c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:40.358183 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 730/1457] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:40.359724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e082c-1989-455a-9335-432844b0675d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.373271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e082c-1989-455a-9335-432844b0675d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.374631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e082c-1989-455a-9335-432844b0675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.426936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:40.431022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f15e082c-1989-455a-9335-432844b0675d None None] MFA Rules not processed for user `97c80881b57047dfb36078f9bae5ba45`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:40.434926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f15e082c-1989-455a-9335-432844b0675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:40.446000 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 728/1458] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:40.449601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.449949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.450654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.501201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] MFA Rules not processed for user `98beec3060af4e1cb4c74f65d4d00ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:40.502175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:40.565696 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 731/1459] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:40.569725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f472f-c479-4530-b715-1bea9c918500 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.571277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f472f-c479-4530-b715-1bea9c918500 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.571584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f472f-c479-4530-b715-1bea9c918500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.622473 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 729/1460] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:40.623809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:40.642145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-550f472f-c479-4530-b715-1bea9c918500 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:40.643411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-550f472f-c479-4530-b715-1bea9c918500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:40.736114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c0911-e0ea-4804-b940-1e496a0e7f70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:40.744139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:40.744963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.745669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.746166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.752198 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 732/1461] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:40.753254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f472f-c479-4530-b715-1bea9c918500 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:40.757225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-550f472f-c479-4530-b715-1bea9c918500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:40.792473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f472f-c479-4530-b715-1bea9c918500 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:40.793244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:40.797087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:40.809147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:40.810462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:40.810780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:40.811055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:40.836166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:40.836644 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 730/1462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:40.970962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:40.972554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:41.014528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:41.018966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:41.054610 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 733/1463] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:41.075003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:41.194162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:41.229058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813e457-e34d-4347-90bc-f41fdea647e7 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:41.232729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930af186-292e-438a-a5a6-d6323dcd9de5 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:41.242261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:41.255110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.255110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.255110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.256599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:41.257467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.257930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.258466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] PATH_INFO: `/v3/users/3adcd4a96faf40539344ab022d1016e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.260043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adcd4a96faf40539344ab022d1016e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:41.263124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:41.268894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:41.270553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:41.286984 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 731/1464] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:45:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 02:45:41.288056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:41.304730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b123f7-3ed8-4ada-a369-f25e443cf85b service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:41.317135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:41.317710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.318021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.320347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.337342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:41.339402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:41.361575 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 732/1465] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:41.363578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:41.389220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c082c5-619e-4bdb-9b5f-05009038f5c4 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:41.395898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adcd4a96faf40539344ab022d1016e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.406806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:41.407477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.407863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.408013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.412952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:41.415821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adcd4a96faf40539344ab022d1016e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.417201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adcd4a96faf40539344ab022d1016e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.435775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adcd4a96faf40539344ab022d1016e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.437463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6e8f60a-9ed4-4196-9672-977e9a2a38a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adcd4a96faf40539344ab022d1016e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.462628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 734/1466] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:41 2022] DELETE /identity/v3/users/3adcd4a96faf40539344ab022d1016e3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:41.468229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.468517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.468788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.512969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:41.516308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:41.560327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:41.561745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:41.576477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:41.584576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 733/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:41.654004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:41.669268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e578133-3c7c-4604-bf5d-e9f55744710f service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:41.685485 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 735/1468] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:41.685485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:41.689213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:41.734221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833718f5-77ee-431b-990e-6ec4a1657474 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:41.753313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:41.754136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.754398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.754731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] PATH_INFO: `/v3/users/1d9cad68397146e18ccf0a52670be0fb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.757913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9cad68397146e18ccf0a52670be0fb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:41.760142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:41.858405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9cad68397146e18ccf0a52670be0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.884347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:41.886885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:41.888339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:41.889204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:41.890063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9cad68397146e18ccf0a52670be0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.891209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9cad68397146e18ccf0a52670be0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.894224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:41.910290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9cad68397146e18ccf0a52670be0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.915435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9cad68397146e18ccf0a52670be0fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:41.946960 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 736/1469] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:41 2022] DELETE /identity/v3/users/1d9cad68397146e18ccf0a52670be0fb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:41.948158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:41.954082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.060747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43e82-297b-4692-b5aa-4de3958a1c1d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:42.066318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:42.068466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:42.069001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:42.069600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:42.072067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.119024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:42.121242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03fe96-d023-4c9f-8f7b-5add47b80747 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:42.129074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:42.145869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 734/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:42.154180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d9d3-b6cf-4369-9a97-405b56b8206b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:42.154308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d9d3-b6cf-4369-9a97-405b56b8206b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:42.154580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8d9d3-b6cf-4369-9a97-405b56b8206b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:42.255311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92a8d9d3-b6cf-4369-9a97-405b56b8206b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:42.267656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92a8d9d3-b6cf-4369-9a97-405b56b8206b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.333366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:42.382912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:42.385347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:42.403866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 737/1471] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:42.404978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:42.406585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.576736 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 735/1472] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:42.584519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:42.588845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:42.588845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:42.657934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ea982-c606-437f-80f9-b37c35cb4eec service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:42.671435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:42.672128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:42.672448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:42.672689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:42.675075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:42.679156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.682460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.927746 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 736/1473] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:42.928883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:42.935228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:42.970052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:42.971528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a34f5-ec4c-4a57-8c71-58b5587abda2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:42.974237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a6a2-48d7-4a40-8ee7-3ce0b561b56f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:43.020722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:43.022759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:43.022759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:43.022759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:43.027483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 738/1474] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:43.032886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:43.033974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:43.036028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:43.054347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:43.057230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:43.099973 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 737/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:43.101585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:43.103189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:43.206855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:43.208928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:43.223405 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 739/1476] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 29 02:45:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:43.280593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:43.282538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:43.308674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0d4b8-c8a8-4754-9a7a-c6683fbb5b2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:43.317716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:43.318835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:43.319236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:43.319524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] PATH_INFO: `/v3/users/29104f5da5754d63b55d39dde1dce403` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:43.320983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29104f5da5754d63b55d39dde1dce403)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:43.323821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:43.395837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2837e2-cb97-4659-a893-ed9d6d689996 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:43.407422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:43.407877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:43.408258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:43.408504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:43.437486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:43.439144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:43.448413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29104f5da5754d63b55d39dde1dce403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:43.467534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:43.473383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 738/1477] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:45:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:45:43.478527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:43.482857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29104f5da5754d63b55d39dde1dce403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:43.483598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29104f5da5754d63b55d39dde1dce403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:43.499736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa864c-27ad-4fb8-a9c5-a42522e7dd50 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:43.502157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29104f5da5754d63b55d39dde1dce403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:43.503125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6bd184a6-5c8d-4cfa-b9dd-5e17c09aecc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29104f5da5754d63b55d39dde1dce403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:43.513741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:43.514787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:43.515138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:43.515406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:43.523907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:43.537979 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 740/1478] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:43 2022] DELETE /identity/v3/users/29104f5da5754d63b55d39dde1dce403 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:43.540732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:43.541944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:43.543459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:43.557909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:43.566050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:43.592057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:43.593623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:43.593937 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 739/1479] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:43.770571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 741/1480] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:43.840928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:43.845585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:43.889593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7fa6-8e3f-401a-8349-34cfa12360ae service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:43.915803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:44.043261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:44.045390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:44.081218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:44.090109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4acc9e-c638-413d-8c6d-b418937484ee None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:44.091283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:44.091681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:44.094313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:44.113968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:44.116670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:44.119580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:44.119896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] PATH_INFO: `/v3/projects/6db7a038e0864d498b7fb80426229db6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:44.129453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db7a038e0864d498b7fb80426229db6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:44.131471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:44.148349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:44.153636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:44.171944 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 740/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:44.311293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db7a038e0864d498b7fb80426229db6', 'request_id': 'req-9d352d71-96b5-4641-ab4e-e957f6fec41c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.333026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db7a038e0864d498b7fb80426229db6', 'request_id': 'req-9d352d71-96b5-4641-ab4e-e957f6fec41c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.363392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db7a038e0864d498b7fb80426229db6', 'request_id': 'req-9d352d71-96b5-4641-ab4e-e957f6fec41c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.387738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] The token cache is being invalidate because project 6db7a038e0864d498b7fb80426229db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:44.388050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.388730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.397524 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 742/1482] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:44 2022] DELETE /identity/v3/projects/6db7a038e0864d498b7fb80426229db6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:44.399464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:44.417006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a151fff-5461-4267-bfd6-d2236b4c2a92 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:44.571169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:44.572123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:44.572555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:44.572994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] PATH_INFO: `/v3/users/15d16213595640378512d8d9099b700d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:44.574973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d16213595640378512d8d9099b700d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:44.577338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:44.707718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d16213595640378512d8d9099b700d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.722099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d16213595640378512d8d9099b700d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.723130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d16213595640378512d8d9099b700d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.738591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d16213595640378512d8d9099b700d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.741045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d16213595640378512d8d9099b700d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:44.798527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 741/1483] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:44 2022] DELETE /identity/v3/users/15d16213595640378512d8d9099b700d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:45.669327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:45.672544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:45.708214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d352d71-96b5-4641-ab4e-e957f6fec41c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:45.878614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:45.879510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:45.880059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:45.880837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] PATH_INFO: `/v3/projects/a237878563704f5d9ce25ff1c8de6866` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:45.883880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a237878563704f5d9ce25ff1c8de6866)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:45.886691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:45.889660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:45.978988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:45.981070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:46.007303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a237878563704f5d9ce25ff1c8de6866', 'request_id': 'req-8b895255-cbab-43c7-a775-954387091ffc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.020866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a237878563704f5d9ce25ff1c8de6866', 'request_id': 'req-8b895255-cbab-43c7-a775-954387091ffc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.023449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad6ecf-8dd5-443b-8d55-6fdb890b1527 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:46.037166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a237878563704f5d9ce25ff1c8de6866', 'request_id': 'req-8b895255-cbab-43c7-a775-954387091ffc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.062890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] The token cache is being invalidate because project a237878563704f5d9ce25ff1c8de6866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:46.063195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.063883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.068420 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 743/1484] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:45 2022] DELETE /identity/v3/projects/a237878563704f5d9ce25ff1c8de6866 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:46.069569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:46.071767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:46.119351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:46.163446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895255-cbab-43c7-a775-954387091ffc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:46.170476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:46.171345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:46.171764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:46.172193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] PATH_INFO: `/v3/users/97c80881b57047dfb36078f9bae5ba45` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:46.173747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c80881b57047dfb36078f9bae5ba45)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:46.178130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:46.190147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:46.191255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:46.193210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:46.193686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] PATH_INFO: `/v3/projects/d59162acd36543e784c4b8ab093caa44` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:46.197346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59162acd36543e784c4b8ab093caa44)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:46.201199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:46.245027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c80881b57047dfb36078f9bae5ba45'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.263645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c80881b57047dfb36078f9bae5ba45'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.264428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c80881b57047dfb36078f9bae5ba45'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.273742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c80881b57047dfb36078f9bae5ba45'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.274528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c80881b57047dfb36078f9bae5ba45'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.326577 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 744/1485] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:46 2022] DELETE /identity/v3/users/97c80881b57047dfb36078f9bae5ba45 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:46.394427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59162acd36543e784c4b8ab093caa44', 'request_id': 'req-652a3ca1-457d-4ad1-b330-b92b324f1440'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.403547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59162acd36543e784c4b8ab093caa44', 'request_id': 'req-652a3ca1-457d-4ad1-b330-b92b324f1440'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.412801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59162acd36543e784c4b8ab093caa44', 'request_id': 'req-652a3ca1-457d-4ad1-b330-b92b324f1440'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.479246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] The token cache is being invalidate because project d59162acd36543e784c4b8ab093caa44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:46.479939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.481041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-652a3ca1-457d-4ad1-b330-b92b324f1440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:46.490238 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 742/1486] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:45 2022] DELETE /identity/v3/projects/d59162acd36543e784c4b8ab093caa44 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:46.494380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:46.496999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:46.525063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:46.697056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae7986-65d7-40e5-b193-a28d7fb3b959 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:46.895793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:46.896794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:46.897473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:46.897934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] PATH_INFO: `/v3/users/50e84b7586cc465cb50bca96acdc383c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:46.899118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:46.899499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e84b7586cc465cb50bca96acdc383c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:46.899722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:46.900143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:46.902999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:46.960007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:46.967554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:47.021009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e84b7586cc465cb50bca96acdc383c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.058007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e84b7586cc465cb50bca96acdc383c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.059859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e84b7586cc465cb50bca96acdc383c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.085929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e84b7586cc465cb50bca96acdc383c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.087299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e84b7586cc465cb50bca96acdc383c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.142176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 745/1487] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:46 2022] DELETE /identity/v3/users/50e84b7586cc465cb50bca96acdc383c => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:47.155798 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 743/1488] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Oct 29 02:45:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:47.257408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:47.259394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:47.359868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:47.366693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:47.368473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:47.437590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe50077-03d6-40fa-bd6a-36623bc8c542 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:47.463987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b091670-f480-4661-be80-99f5d6249ffa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:47.478465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a559923-2e44-44c5-a21d-1058bd293bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:47.479290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a559923-2e44-44c5-a21d-1058bd293bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:47.479695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a559923-2e44-44c5-a21d-1058bd293bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:47.480058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a559923-2e44-44c5-a21d-1058bd293bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:47.498423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a559923-2e44-44c5-a21d-1058bd293bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:47.500161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a559923-2e44-44c5-a21d-1058bd293bc3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:47.534230 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 746/1489] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:47.742425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:47.746252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:47.746760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:47.747051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] PATH_INFO: `/v3/projects/03a919af8dc742959f455c629120a611` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:47.752862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a919af8dc742959f455c629120a611)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:47.759351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:47.792079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:47.890695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a919af8dc742959f455c629120a611', 'request_id': 'req-aebbfec3-e5e0-450a-b470-26873b675787'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.910157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a919af8dc742959f455c629120a611', 'request_id': 'req-aebbfec3-e5e0-450a-b470-26873b675787'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.928065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a919af8dc742959f455c629120a611', 'request_id': 'req-aebbfec3-e5e0-450a-b470-26873b675787'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.973438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] The token cache is being invalidate because project 03a919af8dc742959f455c629120a611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:47.990152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.991399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aebbfec3-e5e0-450a-b470-26873b675787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:47.999884 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 744/1490] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:47 2022] DELETE /identity/v3/projects/03a919af8dc742959f455c629120a611 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:48.005309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.005951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.005951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.073712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:48.075923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:48.265238 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 747/1491] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:48.267796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.268606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.269081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.270422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:48.272018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:48.310974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:48.315337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:48.317929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0951e-49f6-48d9-bb50-107bb6ceac5e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:48.332140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:48.332971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.333553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.334010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] PATH_INFO: `/v3/projects/9aeb6a22806e4f448ab446afe65b9041` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.336181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aeb6a22806e4f448ab446afe65b9041)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:48.342139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:48.347404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 745/1492] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:48.352248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:48.386834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187e6ed-d792-48f1-a3a7-c32284aa90b8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:48.402269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:48.404874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.405257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.405541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.406698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:48.408781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:48.413707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:48.454231 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 746/1493] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:48.458782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aeb6a22806e4f448ab446afe65b9041', 'request_id': 'req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:48.459054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:48.474110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aeb6a22806e4f448ab446afe65b9041', 'request_id': 'req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:48.487923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab655-b635-412b-a3be-ea9ea9960263 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:48.490349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aeb6a22806e4f448ab446afe65b9041', 'request_id': 'req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:48.518911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] The token cache is being invalidate because project 9aeb6a22806e4f448ab446afe65b9041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:48.519419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:48.520534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d897fa3-e7f9-4f4b-97c3-baa3b9a929c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:48.529164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 748/1494] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:48 2022] DELETE /identity/v3/projects/9aeb6a22806e4f448ab446afe65b9041 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:48.535620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638baeee-3828-405f-829a-71b04bcdf3aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.536157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638baeee-3828-405f-829a-71b04bcdf3aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.536624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638baeee-3828-405f-829a-71b04bcdf3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.607422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-638baeee-3828-405f-829a-71b04bcdf3aa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:48.616170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-638baeee-3828-405f-829a-71b04bcdf3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:48.714675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:48.715479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.715838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.716098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.716789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:48.724945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:48.828723 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 747/1495] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:48 2022] POST /identity/v3/projects => generated 387 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:48.830173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:48.832209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:48.901840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 749/1496] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:48.911816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.913519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.913937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.937882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:48.986068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2780f-d816-4ee2-80f5-b8101879d00a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:48.987150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:48.988521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:48.991473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:48.992864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:48.993144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:48.993628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:48.994323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:48.998110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.013400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 750/1497] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:49.019710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:49.021052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.046914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 748/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:48 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:49.053238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44753ded-b97e-41ff-a9bd-65f970c1e6ef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.071394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.072235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.072718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.073654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.075291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:49.075583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.078513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.083661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.113918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958b1b9-e351-417e-a9aa-413e28c4baf4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.133859 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 751/1499] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:45:49.133859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.134643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.135438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.135644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.135861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:49.135969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.136817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.144363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.165602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c49b8-778a-4b4a-b51e-80f3146d212e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.181481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.182425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.182836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.183324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] PATH_INFO: `/v3/projects/285fc704b0334edfa4068fd19aab6823` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.187226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285fc704b0334edfa4068fd19aab6823)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.192506 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 749/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:49.193730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.194446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.228141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f6676-93dc-436d-a266-d588903c6ece admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.252545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.254564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.254851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.255121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.255781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.257764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.333114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285fc704b0334edfa4068fd19aab6823', 'request_id': 'req-8b72ab8f-a9ae-4491-a469-836f6591ac21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:49.345536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285fc704b0334edfa4068fd19aab6823', 'request_id': 'req-8b72ab8f-a9ae-4491-a469-836f6591ac21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:49.366848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285fc704b0334edfa4068fd19aab6823', 'request_id': 'req-8b72ab8f-a9ae-4491-a469-836f6591ac21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:49.367072 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 750/1501] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:49 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:49.369657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.393221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] The token cache is being invalidate because project 285fc704b0334edfa4068fd19aab6823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:49.393736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:49.398327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:49.400623 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 752/1502] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:49 2022] DELETE /identity/v3/projects/285fc704b0334edfa4068fd19aab6823 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:49.401525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.405611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:49.496098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce10314-8b1b-4bc9-9b3e-9bf8de2b1762 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.507181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41002d0-1b94-4537-a3de-8ccac291e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.507181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41002d0-1b94-4537-a3de-8ccac291e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.507181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41002d0-1b94-4537-a3de-8ccac291e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.507181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41002d0-1b94-4537-a3de-8ccac291e6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.507570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41002d0-1b94-4537-a3de-8ccac291e6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.509912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41002d0-1b94-4537-a3de-8ccac291e6c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.528780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 751/1503] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:49.531560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.532230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.533611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.564356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:49.565474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72ab8f-a9ae-4491-a469-836f6591ac21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.566474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:49.577131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e6a33-e4dd-4e23-8a14-71fa14f82495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.577981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e6a33-e4dd-4e23-8a14-71fa14f82495 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.578404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e6a33-e4dd-4e23-8a14-71fa14f82495 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.578819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e6a33-e4dd-4e23-8a14-71fa14f82495 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.579670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e6a33-e4dd-4e23-8a14-71fa14f82495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.582001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e6a33-e4dd-4e23-8a14-71fa14f82495 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.585026 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 752/1504] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:49.586132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.594796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:49.622822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed54aa4-4f4e-4c66-be04-9c991cd2f663 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.627579 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 753/1505] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:49 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:49.629043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.629481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.630396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.632208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.634214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.634934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.635524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] PATH_INFO: `/v3/projects/95e80c722df94993b9231f5b17ee4c3d/users/de04aa74bc1f403ea9818dcbcaba7b63/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.700956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e80c722df94993b9231f5b17ee4c3d, user_id=de04aa74bc1f403ea9818dcbcaba7b63, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:49.705373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:49.708595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:49.713584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:49.744987 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 754/1506] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:49.751172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.771027 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 753/1507] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:49 2022] PUT /identity/v3/projects/95e80c722df94993b9231f5b17ee4c3d/users/de04aa74bc1f403ea9818dcbcaba7b63/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:49.773861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:49.818018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1194d-da33-4130-9dcd-e31cfe28731b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:49.969867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:49.993884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d02489-316e-46e3-a9d1-095c470b9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:49.994854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d02489-316e-46e3-a9d1-095c470b9d60 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:49.995589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d02489-316e-46e3-a9d1-095c470b9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:49.996099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d02489-316e-46e3-a9d1-095c470b9d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:49.996965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d02489-316e-46e3-a9d1-095c470b9d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.004364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d02489-316e-46e3-a9d1-095c470b9d60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.032680 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 755/1508] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:49 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:50.034990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.038250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.039103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.054522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a32de9-0bd1-4f77-ae28-da581007532a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:50.064369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:50.072659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.073135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.073379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.075647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:50.076078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.082747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.108513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] MFA Rules not processed for user `de04aa74bc1f403ea9818dcbcaba7b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:50.120988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:50.125387 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 754/1509] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:50.125387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:50.164567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b06de4-ebc7-44bb-8cd8-fcb3de051f74 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:50.186279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:50.187083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.193346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.193729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.194590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.206335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.248973 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 755/1510] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:50.250178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:50.284239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 756/1511] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:50.285869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:50.291816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c884f-012d-49c9-90b9-289d3cc649cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:50.301162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205ad8a-7d5c-4886-adfd-e1b726c8c31e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:50.307694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:50.308434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.308905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.309416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] PATH_INFO: `/v3/projects/b867dd7225ed42128c1c95c17dcfaf3a/users/a91d8ac818c74b54be55fa74c1fa9cfe/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.323014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bd42e-c9e2-4c68-8753-a1c5adffe698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:50.323651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd42e-c9e2-4c68-8753-a1c5adffe698 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.323933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd42e-c9e2-4c68-8753-a1c5adffe698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.326299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bd42e-c9e2-4c68-8753-a1c5adffe698 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.327831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bd42e-c9e2-4c68-8753-a1c5adffe698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.334914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bd42e-c9e2-4c68-8753-a1c5adffe698 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.337833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b867dd7225ed42128c1c95c17dcfaf3a, user_id=a91d8ac818c74b54be55fa74c1fa9cfe, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.347647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.360977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:50.395460 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 757/1512] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:50 2022] PUT /identity/v3/projects/b867dd7225ed42128c1c95c17dcfaf3a/users/a91d8ac818c74b54be55fa74c1fa9cfe/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:50.397653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:50.401714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 756/1513] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/projects => generated 397 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:50.403545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4061c-0d28-4fab-91a9-0a03d3661dc8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.406278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4061c-0d28-4fab-91a9-0a03d3661dc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.406621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4061c-0d28-4fab-91a9-0a03d3661dc8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.412486 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 757/1514] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:45:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:50.414835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4061c-0d28-4fab-91a9-0a03d3661dc8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:50.573475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4061c-0d28-4fab-91a9-0a03d3661dc8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:50.579040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03066595-8013-40cc-b987-6e535106e42f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:50.586560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638fe3-ae19-4679-a196-c7f52d471592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:50.587503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638fe3-ae19-4679-a196-c7f52d471592 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.587840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638fe3-ae19-4679-a196-c7f52d471592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.589979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638fe3-ae19-4679-a196-c7f52d471592 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.590680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638fe3-ae19-4679-a196-c7f52d471592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.592147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c118762-a01f-4064-8f50-6aa985e12fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:50.593235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c118762-a01f-4064-8f50-6aa985e12fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.594004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c118762-a01f-4064-8f50-6aa985e12fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.594473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c118762-a01f-4064-8f50-6aa985e12fd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.595214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638fe3-ae19-4679-a196-c7f52d471592 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.595608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c118762-a01f-4064-8f50-6aa985e12fd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:50.598473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c118762-a01f-4064-8f50-6aa985e12fd4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:50.644801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 758/1515] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:50.654352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.654352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.655473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.668785 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 758/1516] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:50.670634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:50.671249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:50.671728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:50.700046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:50.701751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:50.755145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] MFA Rules not processed for user `a91d8ac818c74b54be55fa74c1fa9cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:50.756974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:50.760645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:50.864091 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 759/1517] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:50.866934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:50.896065 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 759/1518] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:50.901198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.040112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1b1d6-d84e-4451-a8c2-d1393bddbb96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.052973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe99cc-a058-4ac8-92e6-11a5c886e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.054269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe99cc-a058-4ac8-92e6-11a5c886e370 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.054550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe99cc-a058-4ac8-92e6-11a5c886e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.054838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe99cc-a058-4ac8-92e6-11a5c886e370 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.055480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe99cc-a058-4ac8-92e6-11a5c886e370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.057104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe99cc-a058-4ac8-92e6-11a5c886e370 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.061698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1680-a2e3-4584-ab76-e0daf4b82fd1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.078381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.079022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.079297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.079570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.080377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.082399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.085434 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 760/1519] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:50 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:51.086967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48a90-1557-4801-b0fc-dad15fa1c121 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.087252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48a90-1557-4801-b0fc-dad15fa1c121 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.087526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc48a90-1557-4801-b0fc-dad15fa1c121 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.089225 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 761/1520] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:51.090262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48a90-1557-4801-b0fc-dad15fa1c121 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.117534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:51.126685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc48a90-1557-4801-b0fc-dad15fa1c121 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.131472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 760/1521] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:50 2022] POST /identity/v3/users => generated 300 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:51.132891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.137119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:51.139002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.139632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.139921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.140973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.141609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.147670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.175112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9940548-2b1b-4630-89df-96bd53b1c9d0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.187445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9032ea-c5de-4ac1-b087-f33b7e9866bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.188085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9032ea-c5de-4ac1-b087-f33b7e9866bd service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.188363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9032ea-c5de-4ac1-b087-f33b7e9866bd service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.188994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9032ea-c5de-4ac1-b087-f33b7e9866bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.214392 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 762/1522] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:51 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:51.215503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.218186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9032ea-c5de-4ac1-b087-f33b7e9866bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.219791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9032ea-c5de-4ac1-b087-f33b7e9866bd service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.269685 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 761/1523] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:51.271555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747671-4279-465e-9823-6983b6750a49 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.274376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747671-4279-465e-9823-6983b6750a49 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.274930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747671-4279-465e-9823-6983b6750a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.351584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf747671-4279-465e-9823-6983b6750a49 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:51.353048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf747671-4279-465e-9823-6983b6750a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:51.430702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ea4d1-e8da-4b0f-88a8-83e21a494f4a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.437214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.438171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.438281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.438542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.439269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.440915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.458084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 763/1524] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:51.460043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.473180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc820d-c9f6-4571-85cb-4998d99a01f0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.481869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305c24-6140-4319-8949-9de94c61ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.488773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305c24-6140-4319-8949-9de94c61ac85 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.490330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305c24-6140-4319-8949-9de94c61ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.491154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305c24-6140-4319-8949-9de94c61ac85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.492307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305c24-6140-4319-8949-9de94c61ac85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.494935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305c24-6140-4319-8949-9de94c61ac85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.506487 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 762/1525] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:45:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:51.508292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747671-4279-465e-9823-6983b6750a49 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.520369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747671-4279-465e-9823-6983b6750a49 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.528849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.531032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.531481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.532194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.533064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.536816 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 764/1526] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:51.537013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.538725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.539196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.539727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.575038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] MFA Rules not processed for user `1e835f57621f46719369731607bebb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:51.577009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:51.591418 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 763/1527] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:51 2022] POST /identity/v3/users => generated 302 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:51.592336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.606204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:51.618160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903b3e0-5999-4029-aece-89862e6a0214 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.626895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.627992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.628274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.628551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] PATH_INFO: `/v3/projects/0f4a4c1ee62949eca8e063748bea9e33/users/cfcf745cf2ea4c88b724b34ff179beca/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.659097 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 765/1528] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:51 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:51.660550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4a4c1ee62949eca8e063748bea9e33, user_id=cfcf745cf2ea4c88b724b34ff179beca, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.660851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.665082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.688083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 764/1529] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:51 2022] PUT /identity/v3/projects/0f4a4c1ee62949eca8e063748bea9e33/users/cfcf745cf2ea4c88b724b34ff179beca/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:51.689407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.693488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d70bca-bee5-4d57-9e17-40fa80d97281 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.806307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310196c3-1aa9-4d33-ae18-8e762566dc9b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.823121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9079e-c186-42e7-9eaa-f55770890ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.827063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9079e-c186-42e7-9eaa-f55770890ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.827682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9079e-c186-42e7-9eaa-f55770890ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.827999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9079e-c186-42e7-9eaa-f55770890ba2 admin admin] PATH_INFO: `/v3/projects/30dfe0aa5f804f7080e8d026ff0bcd92/users/c5a9c291f290489caa0a328d923c3488/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.857257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:51.859330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.859614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.859896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.872452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9079e-c186-42e7-9eaa-f55770890ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dfe0aa5f804f7080e8d026ff0bcd92, user_id=c5a9c291f290489caa0a328d923c3488, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.877266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9079e-c186-42e7-9eaa-f55770890ba2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.884919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:51.887133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:51.901859 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 766/1531] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:51.901859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:51.906045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 765/1531] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:51 2022] PUT /identity/v3/projects/30dfe0aa5f804f7080e8d026ff0bcd92/users/c5a9c291f290489caa0a328d923c3488/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:51.907477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:51.907756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:51.908021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:51.919640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492ce38-5d66-4a85-9eba-c82a0c35d4ab service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:51.961044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] MFA Rules not processed for user `cfcf745cf2ea4c88b724b34ff179beca`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:51.963270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:51.977189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:52.059262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.060105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.060745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.061194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.066450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.066450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.083176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 767/1532] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:52.084384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.100412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cafb2-d627-4e0b-9868-635ecdc7b553 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.107996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.112472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.112472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.112472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.112472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.114313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.129708 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 766/1533] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:52.130931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.131277 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 768/1534] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:52.136325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.160871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650821-6de8-4f9b-b0df-86aed9969e90 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.167665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.169142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.169681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.170197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8b574-9d5c-49eb-b89f-1b87ea00529e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.170531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.171733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.173911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.178465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.180187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.180953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.181282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] PATH_INFO: `/v3/projects/7eab14e0f37c45adba4c117a835353bc/users/56b0003b341c4fa19cf0089c08ede369/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.213427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eab14e0f37c45adba4c117a835353bc, user_id=56b0003b341c4fa19cf0089c08ede369, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.218307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.228245 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 769/1535] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:52 2022] POST /identity/v3/projects => generated 397 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:52.229532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.246791 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 767/1536] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:52 2022] PUT /identity/v3/projects/7eab14e0f37c45adba4c117a835353bc/users/56b0003b341c4fa19cf0089c08ede369/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:52.248316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.287534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:52.390207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255798-4e4d-4c82-ad52-92a48369e237 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.417078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df257a11-1264-4b43-88a1-06cf35a026f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.430464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.435105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.436275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.437522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.438298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] PATH_INFO: `/v3/projects/30dfe0aa5f804f7080e8d026ff0bcd92/users/c5a9c291f290489caa0a328d923c3488/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.441149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.441908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.442360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.443330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.445719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.449996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dfe0aa5f804f7080e8d026ff0bcd92, user_id=c5a9c291f290489caa0a328d923c3488, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.461352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.503481 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 768/1538] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:52 2022] POST /identity/v3/users => generated 305 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:52.504940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.512929 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 770/1538] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:52 2022] PUT /identity/v3/projects/30dfe0aa5f804f7080e8d026ff0bcd92/users/c5a9c291f290489caa0a328d923c3488/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:52.514032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.528913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50500bfa-0a19-468e-a5af-ef508a09fb0a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.713535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aae02e-7331-4187-8cc7-636b4ce06210 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.724674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f4002-a103-4ca6-9cfb-de32d371041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.725638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4002-a103-4ca6-9cfb-de32d371041a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.725982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4002-a103-4ca6-9cfb-de32d371041a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.726470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f4002-a103-4ca6-9cfb-de32d371041a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.727771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4002-a103-4ca6-9cfb-de32d371041a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.731659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f4002-a103-4ca6-9cfb-de32d371041a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.750556 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 771/1539] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:52.750556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.750556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.750556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.766300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.767083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.767421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.767828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.768659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.770678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.800903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 769/1540] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:52.800903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:52.826118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] MFA Rules not processed for user `c5a9c291f290489caa0a328d923c3488`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:52.830810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:52.839045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11429c-a4d9-4654-bcec-ae975949b47c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:52.844745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:52.845430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:52.846241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:52.846458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] PATH_INFO: `/v3/projects/b1549f1fa70846c58b639a628684668d/users/9cd65497589949e6a8513d7410740a15/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:52.853136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:52.907166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1549f1fa70846c58b639a628684668d, user_id=9cd65497589949e6a8513d7410740a15, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:52.916326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:52.952903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 770/1541] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:52 2022] PUT /identity/v3/projects/b1549f1fa70846c58b639a628684668d/users/9cd65497589949e6a8513d7410740a15/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:52.953955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:53.042058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 772/1542] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:53.043007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:53.071864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25a617-a0a9-4d3f-bd25-abadd5de228c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:53.143316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:53.179423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee71189-c0eb-411c-8ef0-06c7d1447a1c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:53.184523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8866553a-b52d-4bc2-8b13-e698115c7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:53.185102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866553a-b52d-4bc2-8b13-e698115c7f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.185376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866553a-b52d-4bc2-8b13-e698115c7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.185643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8866553a-b52d-4bc2-8b13-e698115c7f6f admin admin] PATH_INFO: `/v3/projects/7eab14e0f37c45adba4c117a835353bc/users/56b0003b341c4fa19cf0089c08ede369/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.187834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866553a-b52d-4bc2-8b13-e698115c7f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eab14e0f37c45adba4c117a835353bc, user_id=56b0003b341c4fa19cf0089c08ede369, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:53.188620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b8496-0629-4f4e-88c5-b52fff6fd513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:53.189299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8496-0629-4f4e-88c5-b52fff6fd513 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.189647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8496-0629-4f4e-88c5-b52fff6fd513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.190154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b8496-0629-4f4e-88c5-b52fff6fd513 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.190591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8866553a-b52d-4bc2-8b13-e698115c7f6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:53.191978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b8496-0629-4f4e-88c5-b52fff6fd513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:53.194224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b8496-0629-4f4e-88c5-b52fff6fd513 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:53.207681 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 771/1543] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:52 2022] PUT /identity/v3/projects/7eab14e0f37c45adba4c117a835353bc/users/56b0003b341c4fa19cf0089c08ede369/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:53.210179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 773/1544] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:53.222864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.223533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.224008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.227986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.228599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.229945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.281322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] MFA Rules not processed for user `56b0003b341c4fa19cf0089c08ede369`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:53.283289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:53.287543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] MFA Rules not processed for user `de04aa74bc1f403ea9818dcbcaba7b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:53.289489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:53.431979 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 772/1545] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:53.432813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:53.458059 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 774/1546] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:53.459451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:53.461982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:53.551941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ff08f-ed32-4a08-b538-03ed48a57fb7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:53.564381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2b850-2dbb-4944-bc53-97e7cfe56e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:53.565870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b850-2dbb-4944-bc53-97e7cfe56e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.566164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b850-2dbb-4944-bc53-97e7cfe56e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.566482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2b850-2dbb-4944-bc53-97e7cfe56e6b admin admin] PATH_INFO: `/v3/projects/b1549f1fa70846c58b639a628684668d/users/9cd65497589949e6a8513d7410740a15/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.570797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2b850-2dbb-4944-bc53-97e7cfe56e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1549f1fa70846c58b639a628684668d, user_id=9cd65497589949e6a8513d7410740a15, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:53.577502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2b850-2dbb-4944-bc53-97e7cfe56e6b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:53.605601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 773/1547] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:53 2022] PUT /identity/v3/projects/b1549f1fa70846c58b639a628684668d/users/9cd65497589949e6a8513d7410740a15/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:53.619214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.619574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.619914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.623078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e9a1a-48d0-4163-ba47-695e670589d1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:53.698903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] MFA Rules not processed for user `9cd65497589949e6a8513d7410740a15`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:53.699156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:53.700382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:53.716326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:53.731145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc595b78-d130-43cf-bf4a-fbdd6ea72736 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:53.731937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595b78-d130-43cf-bf4a-fbdd6ea72736 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:53.732208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595b78-d130-43cf-bf4a-fbdd6ea72736 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:53.732478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595b78-d130-43cf-bf4a-fbdd6ea72736 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:53.898316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc595b78-d130-43cf-bf4a-fbdd6ea72736 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:53.900782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc595b78-d130-43cf-bf4a-fbdd6ea72736 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:53.921719 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 774/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:53.923627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 775/1549] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:55.555760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:55.575984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d3736-b40f-473f-96e5-872ac4c404b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:55.586474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:55.587132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:55.587413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:55.589635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:55.607146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05b57-8457-4524-8326-1a0416fbb138 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:55.607717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05b57-8457-4524-8326-1a0416fbb138 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:55.607930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc05b57-8457-4524-8326-1a0416fbb138 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:55.610462 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 776/1550] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:45:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:45:55.623744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:55.623943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:55.624235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:55.665787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:55.667678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:55.755075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:55.757061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:55.812852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 775/1551] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:55.859775 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 777/1552] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:45:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:55.872224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:55.873708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:55.895666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63257ff-71b6-4b7a-a6bd-7952a71919a3 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:55.904363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:55.905001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:55.905285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:55.905773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:55.922071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:55.923605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:55.940683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 776/1553] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:56.145509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:56.166721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204d23f-2c4c-4592-8c8c-4e247df175e2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:56.174951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:56.175587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:56.175869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:56.176178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:56.278735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:56.283960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:56.305925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 778/1554] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:56 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:56.783432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:56.803206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8e53-87be-40c0-9d8b-140c769ee638 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:56.811320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:56.812208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:56.813175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:56.813536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:56.828782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:56.832691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:56.861557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 777/1555] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:56.888549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:56.960194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:56.992124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f44911-fda8-4532-b647-a05be6c43b7b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:57.005001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:57.006056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.006319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.006586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] PATH_INFO: `/v3/users/a91d8ac818c74b54be55fa74c1fa9cfe` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.008028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91d8ac818c74b54be55fa74c1fa9cfe)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:57.012111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:57.083066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91d8ac818c74b54be55fa74c1fa9cfe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.099614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91d8ac818c74b54be55fa74c1fa9cfe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.100805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91d8ac818c74b54be55fa74c1fa9cfe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.115682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91d8ac818c74b54be55fa74c1fa9cfe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.116479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4887f821-22df-4771-9637-da5252ee3f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91d8ac818c74b54be55fa74c1fa9cfe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.129257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:57.136457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 779/1556] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:56 2022] DELETE /identity/v3/users/a91d8ac818c74b54be55fa74c1fa9cfe => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:57.140351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66360b-bfdf-4bc0-9751-9068f8266412 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:57.140983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.141326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.141604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.160778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:57.162060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.204561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:57.205223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.205500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.205851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] PATH_INFO: `/v3/users/cfcf745cf2ea4c88b724b34ff179beca` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.206980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfcf745cf2ea4c88b724b34ff179beca)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:57.209171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:57.224203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:57.236441 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 780/1557] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:57.247290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:57.248836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.263947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfcf745cf2ea4c88b724b34ff179beca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.274029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfcf745cf2ea4c88b724b34ff179beca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.274706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfcf745cf2ea4c88b724b34ff179beca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.284434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfcf745cf2ea4c88b724b34ff179beca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.285628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a46734e1-4b7b-471c-bc09-4efce16ea3b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfcf745cf2ea4c88b724b34ff179beca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:57.305513 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 778/1558] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:57 2022] DELETE /identity/v3/users/cfcf745cf2ea4c88b724b34ff179beca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:57.310006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.310294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.310566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.321560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0cf8-2a16-4fb3-8dc8-a80ecb57fd68 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:57.334569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:57.338736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:57.340173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.378775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:57.379579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.379963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.380442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.382383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.430045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 779/1559] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:57.440085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:57.441754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.456123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa6409-17f1-40e9-92b9-6af5b83d5609 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:57.461137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:57.462711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:57.465835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:57.466625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.466957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.470385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.473493 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 781/1560] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:45:57.486047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:57.487624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:57.499269 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 780/1561] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:45:57.948956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:57.950616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.965783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c5a98-8eb1-4134-931a-2142dcba9f48 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:57.970689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:57.972233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:57.977875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:57.978584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.978867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.979571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] PATH_INFO: `/v3/projects/b867dd7225ed42128c1c95c17dcfaf3a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.980791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b867dd7225ed42128c1c95c17dcfaf3a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:57.982965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:57.987838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f17390-3acc-472d-ad6f-8c1f5ca2c652 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:57.993027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:57.993859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:57.994275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:57.994682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] PATH_INFO: `/v3/projects/0f4a4c1ee62949eca8e063748bea9e33` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:57.996749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4a4c1ee62949eca8e063748bea9e33)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:57.998906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:58.033192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b867dd7225ed42128c1c95c17dcfaf3a', 'request_id': 'req-9b8b8bc9-888d-4621-b948-852fb06dc7d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.040349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b867dd7225ed42128c1c95c17dcfaf3a', 'request_id': 'req-9b8b8bc9-888d-4621-b948-852fb06dc7d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.046352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b867dd7225ed42128c1c95c17dcfaf3a', 'request_id': 'req-9b8b8bc9-888d-4621-b948-852fb06dc7d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.056201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4a4c1ee62949eca8e063748bea9e33', 'request_id': 'req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.059578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] The token cache is being invalidate because project b867dd7225ed42128c1c95c17dcfaf3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:58.059870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.060512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.062295 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 782/1562] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:57 2022] DELETE /identity/v3/projects/b867dd7225ed42128c1c95c17dcfaf3a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:58.064167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4a4c1ee62949eca8e063748bea9e33', 'request_id': 'req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.065879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:58.067503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:58.070302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4a4c1ee62949eca8e063748bea9e33', 'request_id': 'req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.081318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:58.085697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] The token cache is being invalidate because project 0f4a4c1ee62949eca8e063748bea9e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:58.086035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.087056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.088693 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 781/1563] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:57 2022] DELETE /identity/v3/projects/0f4a4c1ee62949eca8e063748bea9e33 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:58.092909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:58.094520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:58.121783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:58.138669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b8bc9-888d-4621-b948-852fb06dc7d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:58.160488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092280ba-0f7e-4741-ad1c-0ab6dada8f2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:58.165089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:58.165778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.166085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.166389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] PATH_INFO: `/v3/users/9cd65497589949e6a8513d7410740a15` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.167555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cd65497589949e6a8513d7410740a15)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:58.169894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:58.195181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:58.195903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.196301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.196572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] PATH_INFO: `/v3/users/56b0003b341c4fa19cf0089c08ede369` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.197946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56b0003b341c4fa19cf0089c08ede369)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:58.200104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:58.216399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cd65497589949e6a8513d7410740a15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.225657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cd65497589949e6a8513d7410740a15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.226333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cd65497589949e6a8513d7410740a15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.234243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cd65497589949e6a8513d7410740a15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.234962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cd65497589949e6a8513d7410740a15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.246783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56b0003b341c4fa19cf0089c08ede369'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.253238 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 782/1564] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:58 2022] DELETE /identity/v3/users/9cd65497589949e6a8513d7410740a15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:58.258822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56b0003b341c4fa19cf0089c08ede369'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.259623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56b0003b341c4fa19cf0089c08ede369'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.266559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56b0003b341c4fa19cf0089c08ede369'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.267223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56b0003b341c4fa19cf0089c08ede369'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.280954 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 783/1565] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:45:58 2022] DELETE /identity/v3/users/56b0003b341c4fa19cf0089c08ede369 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:58.582023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:58.584592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:58.652998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:58.654648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:58.668909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e7812-2781-48a8-9f4e-4b111a62c1dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:58.693547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:58.729757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:58.730601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.731007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.731286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] PATH_INFO: `/v3/projects/b1549f1fa70846c58b639a628684668d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.732651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1549f1fa70846c58b639a628684668d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:58.734733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:58.734894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1404e-68a1-4da2-80ed-4fc3c50bd871 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:58.740368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:58.741171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.741518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.741892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] PATH_INFO: `/v3/projects/7eab14e0f37c45adba4c117a835353bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.743930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eab14e0f37c45adba4c117a835353bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:58.746730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:58.767109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:58.798253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1549f1fa70846c58b639a628684668d', 'request_id': 'req-2501e881-c08e-44be-8662-0aaa8a8f14c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.805521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1549f1fa70846c58b639a628684668d', 'request_id': 'req-2501e881-c08e-44be-8662-0aaa8a8f14c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.814027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eab14e0f37c45adba4c117a835353bc', 'request_id': 'req-ce3b1644-0fb0-4e58-8bc5-840a083ba415'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.815776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1549f1fa70846c58b639a628684668d', 'request_id': 'req-2501e881-c08e-44be-8662-0aaa8a8f14c0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.822551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eab14e0f37c45adba4c117a835353bc', 'request_id': 'req-ce3b1644-0fb0-4e58-8bc5-840a083ba415'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.830780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eab14e0f37c45adba4c117a835353bc', 'request_id': 'req-ce3b1644-0fb0-4e58-8bc5-840a083ba415'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.840957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] The token cache is being invalidate because project b1549f1fa70846c58b639a628684668d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:58.841393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.842361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2501e881-c08e-44be-8662-0aaa8a8f14c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.844595 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 783/1566] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:58 2022] DELETE /identity/v3/projects/b1549f1fa70846c58b639a628684668d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:58.847922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] The token cache is being invalidate because project 7eab14e0f37c45adba4c117a835353bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:45:58.848208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.849733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19ea15-bf84-4aa2-9e23-37c5d270a97e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.850140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19ea15-bf84-4aa2-9e23-37c5d270a97e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.850511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19ea15-bf84-4aa2-9e23-37c5d270a97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.854066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ce3b1644-0fb0-4e58-8bc5-840a083ba415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:45:58.857593 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 784/1567] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:45:58 2022] DELETE /identity/v3/projects/7eab14e0f37c45adba4c117a835353bc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:58.862289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9ed8-20d6-4edb-97d4-c31f1bc64dde None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.862809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9ed8-20d6-4edb-97d4-c31f1bc64dde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.863463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf9ed8-20d6-4edb-97d4-c31f1bc64dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.876541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8a19ea15-bf84-4aa2-9e23-37c5d270a97e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:58.877826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a19ea15-bf84-4aa2-9e23-37c5d270a97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:58.893061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a3cf9ed8-20d6-4edb-97d4-c31f1bc64dde None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:58.896844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3cf9ed8-20d6-4edb-97d4-c31f1bc64dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:58.964665 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 784/1568] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:58.972410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:58.973036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:58.973036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:58.997170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:58.998881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:59.001768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 785/1569] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:59.009683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.010016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.012542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.027539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 785/1570] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:59.032131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.033950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:59.035383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:59.044509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1450c1a-4dd6-4d94-9aad-6e9f974e4f44 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.049203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.050882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.050882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.050882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.051128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:59.051360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.051715 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 786/1571] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:45:59.052964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.065077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.066269 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 786/1572] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:45:59.070118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.075626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3e011-a76b-4c75-a56e-21fba648dd8c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.080479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.081094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.081369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.081636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.082334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:45:59.082635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.084227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.092002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abfbce-a123-4ebd-84f3-4840d7928aa6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.097825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.098191 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 787/1573] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:45:59.101762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.102029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.102128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.102340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.102977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.104923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.111776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2b63a-513a-4eb1-b94f-e1922e1f5766 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.116259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.116840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.117116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.117379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.118048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.119901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.134698 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 787/1574] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/projects => generated 357 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:59.138873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.149610 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 788/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:59.154061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.156821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:59.204425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f7563c-6aec-4a9a-bf3e-2ffa9b8d20ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.219851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cbacd-287e-46c6-9ab4-410ff374fbd8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.225488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.226277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.226620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.226877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.227520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.229465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.240285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:59.261722 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 789/1576] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:59.266705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.277533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.278190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.278461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.278723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.278875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29157ef8-743c-4822-b8e1-0ddbcd60479c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.279374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.281320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.284692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.285439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.285859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.286247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.287195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.289207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.305560 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 790/1577] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:59.308320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 788/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/users => generated 279 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:59.309581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.311937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.319975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba342bd3-b142-4635-947b-30831ef480c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.321507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8056c-9d96-444e-bfe9-21a56a36a844 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.325220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.325854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.326102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.326211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.326529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.326689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.326964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.327170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.327260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.327843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.328778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.329475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.339931 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 791/1579] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:45:59.341766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 789/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:45:59.344448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.345682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.354166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6de28-1542-4bcb-afcc-bf555f219eab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.355842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e61b01-d5a3-4494-a178-ff180b3c453c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.358881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47703dc4-963c-4998-bae3-9b4c3476d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.359515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47703dc4-963c-4998-bae3-9b4c3476d550 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.359792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47703dc4-963c-4998-bae3-9b4c3476d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.360063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47703dc4-963c-4998-bae3-9b4c3476d550 admin admin] PATH_INFO: `/v3/projects/fcd63371ae724d4b881aee530f10906b/users/74051ce335ab48a5bced7e7352c112f8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.361297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.361916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.362225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.362492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.363234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.364908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.374929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47703dc4-963c-4998-bae3-9b4c3476d550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd63371ae724d4b881aee530f10906b, user_id=74051ce335ab48a5bced7e7352c112f8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.376383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 790/1581] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:45:59.377961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47703dc4-963c-4998-bae3-9b4c3476d550 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.380614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.390570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19806b87-22b6-4ffb-9c3b-3ded2d0130e1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.392240 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 792/1582] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:59 2022] PUT /identity/v3/projects/fcd63371ae724d4b881aee530f10906b/users/74051ce335ab48a5bced7e7352c112f8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:45:59.402680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.402959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.403234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.432532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] MFA Rules not processed for user `74051ce335ab48a5bced7e7352c112f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:59.433794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:59.446839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d21c-4626-4da1-9841-c7eaa575113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.447507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d21c-4626-4da1-9841-c7eaa575113c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.447787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d21c-4626-4da1-9841-c7eaa575113c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.448053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d21c-4626-4da1-9841-c7eaa575113c admin admin] PATH_INFO: `/v3/projects/dafa429985064c318f4278f43c43c3d5/users/62cca0a22a3a4397a0bae85b653cffec/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.463472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d21c-4626-4da1-9841-c7eaa575113c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dafa429985064c318f4278f43c43c3d5, user_id=62cca0a22a3a4397a0bae85b653cffec, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.466309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d21c-4626-4da1-9841-c7eaa575113c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.479610 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 791/1583] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:59 2022] PUT /identity/v3/projects/dafa429985064c318f4278f43c43c3d5/users/62cca0a22a3a4397a0bae85b653cffec/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:45:59.491345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.491773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.492047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.507221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 793/1584] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:59.512582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.517265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:59.520545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] MFA Rules not processed for user `62cca0a22a3a4397a0bae85b653cffec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:45:59.522711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:45:59.524597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3705949d-a707-49ba-b180-5b54a82d5152 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.620086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.622243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.623301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.623667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.624583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.628106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.671654 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 792/1585] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:45:59.672730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 794/1586] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:59.676520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.680504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.693644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3724788-7efc-4d62-b1b9-cb8a036d5824 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.718175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:45:59.777342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f551-d604-4dd9-b923-3595454a4ae5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.783706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.785374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.785719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.786161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.786978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.789246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.805662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.806482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.806959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.807234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.808222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.810879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.816728 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 795/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/users => generated 301 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:59.823150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.836758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83533e04-aaba-409a-81b2-0a6ad90f18c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.842811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.843856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.844260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.844621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.846187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.848331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.860455 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 793/1588] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:45:59.866790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.881430 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 796/1589] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:45:59.886214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.897578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0ca6d-d5ac-4710-bf29-549ed3e6fccc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.944250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcae53-960f-4f0c-8a42-c738f1a0c6d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:45:59.949078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.949697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.949997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.950265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.950892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.952799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.960326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:45:59.960994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:45:59.961268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:45:59.961535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] PATH_INFO: `/v3/projects/0c5bdd5144a14cb08fd5aacb6796337e/users/6b29253868444a06b2795ec1f444277c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:45:59.980291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5bdd5144a14cb08fd5aacb6796337e, user_id=6b29253868444a06b2795ec1f444277c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:45:59.983448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:45:59.984713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 794/1590] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:45:59 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:45:59.988888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:45:59.999414 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 797/1591] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:45:59 2022] PUT /identity/v3/projects/0c5bdd5144a14cb08fd5aacb6796337e/users/6b29253868444a06b2795ec1f444277c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:00.000413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01de06-e0e4-479f-a2d6-a9ee00e9579a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.003093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.015187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:00.080209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.080941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.081308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.081707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.082780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.084805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.091194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf759db-e9f4-4389-ac38-bc29d6132721 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.097707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.098552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 795/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:00.103326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.103326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.103326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.103326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.103326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.117996 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 798/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:00.118149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.119036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.139195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0bdea0-59df-4b03-b433-b823012b6b41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.142006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cbd7a-cf72-4a11-9ded-9cc743ad905a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.151808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25f7e1-7b8a-48a8-aae3-d7afff0688be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.152542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f7e1-7b8a-48a8-aae3-d7afff0688be admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.152819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f7e1-7b8a-48a8-aae3-d7afff0688be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.153089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f7e1-7b8a-48a8-aae3-d7afff0688be admin admin] PATH_INFO: `/v3/projects/0c5bdd5144a14cb08fd5aacb6796337e/users/6b29253868444a06b2795ec1f444277c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.154508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.155176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.155449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.155715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] PATH_INFO: `/v3/projects/ff62c66089224894af441875e4adb5a4/users/00164a26d99a4d3a9ac5eec4e56e7eb0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.163909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25f7e1-7b8a-48a8-aae3-d7afff0688be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5bdd5144a14cb08fd5aacb6796337e, user_id=6b29253868444a06b2795ec1f444277c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.167216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25f7e1-7b8a-48a8-aae3-d7afff0688be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.181930 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 799/1594] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:00 2022] PUT /identity/v3/projects/0c5bdd5144a14cb08fd5aacb6796337e/users/6b29253868444a06b2795ec1f444277c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:00.194085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.194085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.194319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.204953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff62c66089224894af441875e4adb5a4, user_id=00164a26d99a4d3a9ac5eec4e56e7eb0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.208662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.219382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:00.239311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 796/1595] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:00 2022] PUT /identity/v3/projects/ff62c66089224894af441875e4adb5a4/users/00164a26d99a4d3a9ac5eec4e56e7eb0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:00.244262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.259416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] MFA Rules not processed for user `6b29253868444a06b2795ec1f444277c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:00.265855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:00.399021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332da9f8-a2c0-426f-86c1-e592e59bfc03 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.414335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.415370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.415753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.416144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.429833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.429833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.452919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 800/1596] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:00.463229 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 797/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:00.465459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.468134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.470068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:00.484497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3805c77-7f34-482c-8ca9-4d6a1cfd9e7c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.490983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fec98-3f68-4dd6-bb65-fd2323735be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.492691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fec98-3f68-4dd6-bb65-fd2323735be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.494049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fec98-3f68-4dd6-bb65-fd2323735be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.495767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fec98-3f68-4dd6-bb65-fd2323735be4 admin admin] PATH_INFO: `/v3/projects/ff62c66089224894af441875e4adb5a4/users/00164a26d99a4d3a9ac5eec4e56e7eb0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.500466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fec98-3f68-4dd6-bb65-fd2323735be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff62c66089224894af441875e4adb5a4, user_id=00164a26d99a4d3a9ac5eec4e56e7eb0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.503316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fec98-3f68-4dd6-bb65-fd2323735be4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.522034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 801/1598] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:00 2022] PUT /identity/v3/projects/ff62c66089224894af441875e4adb5a4/users/00164a26d99a4d3a9ac5eec4e56e7eb0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:00.534022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.535059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.536784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.587944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] MFA Rules not processed for user `00164a26d99a4d3a9ac5eec4e56e7eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:00.591385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:00.596735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a94c3-a93d-47ea-b90f-235fef0df834 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.621564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:00.682848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.683319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.683609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.684130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.719472 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 802/1599] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:00.745027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:00.746783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:00.767277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f91fd2-149a-457c-ad67-11ab0098a3a6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:00.778608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.780929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.784637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce2372-edf2-4eb1-9ebb-8dec30761c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:00.785276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce2372-edf2-4eb1-9ebb-8dec30761c3f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:00.785551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce2372-edf2-4eb1-9ebb-8dec30761c3f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:00.785840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce2372-edf2-4eb1-9ebb-8dec30761c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:00.798962 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 798/1600] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:00.806643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce2372-edf2-4eb1-9ebb-8dec30761c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:00.809173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce2372-edf2-4eb1-9ebb-8dec30761c3f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:00.826045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 803/1601] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:01.852861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:01.957141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dd7a9-cc77-46f0-9de5-b30b7eca6cb4 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:01.964591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:01.967559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:01.968197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:01.968738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] PATH_INFO: `/v3/users/74051ce335ab48a5bced7e7352c112f8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:01.970539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74051ce335ab48a5bced7e7352c112f8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:01.973011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:02.078342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74051ce335ab48a5bced7e7352c112f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.106757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74051ce335ab48a5bced7e7352c112f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.108215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74051ce335ab48a5bced7e7352c112f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.117546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:02.124219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74051ce335ab48a5bced7e7352c112f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.130314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74051ce335ab48a5bced7e7352c112f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.174897 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 799/1602] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:01 2022] DELETE /identity/v3/users/74051ce335ab48a5bced7e7352c112f8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:02.176320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c715-b02d-4c25-ad26-8334470e0068 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.176786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c715-b02d-4c25-ad26-8334470e0068 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.176879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8c715-b02d-4c25-ad26-8334470e0068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.202203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9ae8c715-b02d-4c25-ad26-8334470e0068 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:02.203447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ae8c715-b02d-4c25-ad26-8334470e0068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.210971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:02.213673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.264230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:02.304748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 804/1603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:02.306282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060fda9-fa01-42f2-aab8-78b3ee35dd22 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.310556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060fda9-fa01-42f2-aab8-78b3ee35dd22 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.311037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060fda9-fa01-42f2-aab8-78b3ee35dd22 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.313006 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 805/1604] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:46:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:02.324116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.324913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.325363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.400105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:02.402756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e125c0-210c-4e1e-a564-975f3724747f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:02.404693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.418080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:02.419864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.420152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.420621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] PATH_INFO: `/v3/users/62cca0a22a3a4397a0bae85b653cffec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.422967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62cca0a22a3a4397a0bae85b653cffec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:02.426576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:02.519149 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 806/1605] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:02.520138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:02.521402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.555110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62cca0a22a3a4397a0bae85b653cffec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.568592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62cca0a22a3a4397a0bae85b653cffec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.570034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62cca0a22a3a4397a0bae85b653cffec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.586559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62cca0a22a3a4397a0bae85b653cffec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.587277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf8f2b16-4528-43a3-8c05-f8195b051ff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62cca0a22a3a4397a0bae85b653cffec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:02.609776 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 800/1606] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:02 2022] DELETE /identity/v3/users/62cca0a22a3a4397a0bae85b653cffec => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:02.614163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.614762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.615353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.651881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e6c49d-bf40-4bf9-a2e6-f66f39cd5a78 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:02.657326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:02.658681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.715032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:02.715859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.716232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.716711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.719674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.727438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:02.751580 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 801/1607] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:02.753109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:02.755581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.816301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:02.846899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:02.852317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:02.878893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 807/1608] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:02.879865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:02.882906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.901162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b7ca1-dac2-479f-b19b-8736c3769ec3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:02.908676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a16276-acd4-4d0c-9ba3-589d0c682977 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:02.909901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:02.910710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.910989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.911347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.913391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:02.919394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:02.920181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:02.920547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:02.920943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:02.931386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:02.933268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:02.947143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:02.948982 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 802/1609] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:02.959579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:02.988590 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 808/1610] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:03.409722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:03.411454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:03.434756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fcc80-ec70-4fae-b0e1-96853560e346 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:03.440295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:03.441015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:03.441354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:03.441685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] PATH_INFO: `/v3/projects/fcd63371ae724d4b881aee530f10906b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:03.443398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd63371ae724d4b881aee530f10906b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:03.445405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:03.500690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd63371ae724d4b881aee530f10906b', 'request_id': 'req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.508992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd63371ae724d4b881aee530f10906b', 'request_id': 'req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.520391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd63371ae724d4b881aee530f10906b', 'request_id': 'req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.536274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] The token cache is being invalidate because project fcd63371ae724d4b881aee530f10906b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:03.536561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.537773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.539787 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 803/1611] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:03 2022] DELETE /identity/v3/projects/fcd63371ae724d4b881aee530f10906b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:03.543567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:03.558435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d831b75-eb87-453b-a541-9ba33bdd4c07 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:03.628339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:03.629034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:03.629322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:03.629598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] PATH_INFO: `/v3/users/6b29253868444a06b2795ec1f444277c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:03.630776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b29253868444a06b2795ec1f444277c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:03.632752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:03.655993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:03.657499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:03.672793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd902ef-b88d-4e71-bbd7-586d4c5a5251 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:03.684618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:03.687373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:03.688468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:03.689683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] PATH_INFO: `/v3/projects/dafa429985064c318f4278f43c43c3d5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:03.692402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dafa429985064c318f4278f43c43c3d5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:03.694888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:03.697500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b29253868444a06b2795ec1f444277c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.711318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b29253868444a06b2795ec1f444277c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.712526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b29253868444a06b2795ec1f444277c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.720596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b29253868444a06b2795ec1f444277c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.721380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b29253868444a06b2795ec1f444277c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.740688 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 809/1612] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:03 2022] DELETE /identity/v3/users/6b29253868444a06b2795ec1f444277c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:03.756211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dafa429985064c318f4278f43c43c3d5', 'request_id': 'req-13f46f25-2f51-49ff-9f11-99d64e6c1f91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.763836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dafa429985064c318f4278f43c43c3d5', 'request_id': 'req-13f46f25-2f51-49ff-9f11-99d64e6c1f91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.768116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:03.771055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dafa429985064c318f4278f43c43c3d5', 'request_id': 'req-13f46f25-2f51-49ff-9f11-99d64e6c1f91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.787357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] The token cache is being invalidate because project dafa429985064c318f4278f43c43c3d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:03.787661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.788331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.793408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 804/1613] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:03 2022] DELETE /identity/v3/projects/dafa429985064c318f4278f43c43c3d5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:03.795047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:03.797398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:03.874915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:03.880395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe5a50-d9e1-4325-a280-b27b1713a5bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:03.892367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:03.893367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:03.894603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:03.894848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] PATH_INFO: `/v3/users/00164a26d99a4d3a9ac5eec4e56e7eb0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:03.896884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00164a26d99a4d3a9ac5eec4e56e7eb0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:03.900080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:03.956489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00164a26d99a4d3a9ac5eec4e56e7eb0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.974016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00164a26d99a4d3a9ac5eec4e56e7eb0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.974844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00164a26d99a4d3a9ac5eec4e56e7eb0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.985213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00164a26d99a4d3a9ac5eec4e56e7eb0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:03.986094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2befab2-f648-4809-afe9-f453b1f24ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00164a26d99a4d3a9ac5eec4e56e7eb0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.001905 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 810/1614] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:03 2022] DELETE /identity/v3/users/00164a26d99a4d3a9ac5eec4e56e7eb0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:04.065275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.066806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.138794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f46f25-2f51-49ff-9f11-99d64e6c1f91 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.201378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.202085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.202380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.202635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] PATH_INFO: `/v3/projects/0c5bdd5144a14cb08fd5aacb6796337e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.203800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5bdd5144a14cb08fd5aacb6796337e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.206232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.256450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5bdd5144a14cb08fd5aacb6796337e', 'request_id': 'req-caed0091-5853-4814-aa7e-01bca504da8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.263626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5bdd5144a14cb08fd5aacb6796337e', 'request_id': 'req-caed0091-5853-4814-aa7e-01bca504da8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.269659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5bdd5144a14cb08fd5aacb6796337e', 'request_id': 'req-caed0091-5853-4814-aa7e-01bca504da8d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.287184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] The token cache is being invalidate because project 0c5bdd5144a14cb08fd5aacb6796337e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:04.288058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.289044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.291537 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 805/1615] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:04 2022] DELETE /identity/v3/projects/0c5bdd5144a14cb08fd5aacb6796337e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:04.296604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a2bd1-b496-4631-91ba-67004372d724 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.296916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a2bd1-b496-4631-91ba-67004372d724 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.297177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a2bd1-b496-4631-91ba-67004372d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.318023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a8a2bd1-b496-4631-91ba-67004372d724 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:04.319334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a8a2bd1-b496-4631-91ba-67004372d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.353524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.355478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.413388 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 811/1616] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:04.421377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.422062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.422482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.432536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:04.463925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:04.465543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.475123 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 812/1617] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:04.479127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.500845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed0091-5853-4814-aa7e-01bca504da8d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.501480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca33666-5416-49b4-ab89-174f9314a80c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.506157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.507817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.508114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.508387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.509049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:04.509351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.509874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.510841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.511375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.511759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.512048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] PATH_INFO: `/v3/projects/ff62c66089224894af441875e4adb5a4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.513531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff62c66089224894af441875e4adb5a4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.515989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.536386 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 813/1618] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:04.540416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.562101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47032-a144-47bf-9cf3-4ea405c6d251 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.576183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.576821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.577096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.578619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.579271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.584209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.599523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff62c66089224894af441875e4adb5a4', 'request_id': 'req-2bd322c5-c215-4422-9470-443bca3a8c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.607548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff62c66089224894af441875e4adb5a4', 'request_id': 'req-2bd322c5-c215-4422-9470-443bca3a8c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.615881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff62c66089224894af441875e4adb5a4', 'request_id': 'req-2bd322c5-c215-4422-9470-443bca3a8c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.636549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] The token cache is being invalidate because project ff62c66089224894af441875e4adb5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:04.636903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.637894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2bd322c5-c215-4422-9470-443bca3a8c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:04.639984 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 806/1619] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:04 2022] DELETE /identity/v3/projects/ff62c66089224894af441875e4adb5a4 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:04.646083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1538-43f8-4e74-b37b-b14b7edb3054 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.646083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1538-43f8-4e74-b37b-b14b7edb3054 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.646083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd1538-43f8-4e74-b37b-b14b7edb3054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.646691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 814/1620] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:04.647928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.662431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.675219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-50bd1538-43f8-4e74-b37b-b14b7edb3054 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:04.676728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50bd1538-43f8-4e74-b37b-b14b7edb3054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.698181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:04.757357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0856f-e151-4924-b366-76a2e25c6941 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.761480 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 807/1621] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:04.770469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.770806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.771713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.771713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.772021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.772180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.772770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.773034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.775168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.796197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:04.797447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:04.803308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 815/1622] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:04.806427 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 808/1623] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:04.810607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.810744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.821338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b738c-5a0e-412e-b42b-2625ee77b4e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.821511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c936e-39ba-4929-83d4-e09b7aa97571 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.826553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.827481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.827764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.828037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.828682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.830331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.835944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.836712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.836993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.837264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.837954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:04.838259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.840237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.845010 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 816/1624] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:04.845944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.857674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7d0593-e597-4718-bffe-52c0b09387f9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.861929 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 809/1625] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:04.862948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.867340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.868225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.868509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.868783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.869509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.871636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.877446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218d5ad-3206-4aa4-a7fc-22a694588375 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.884891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.885680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.886044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.886468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.887198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.889172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.892920 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 817/1626] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:04.894334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.908014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf8dd9-31de-4500-9917-5d7e30242406 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:04.918014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b2fa3-a21e-40ef-9144-9e6347fa9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:04.919262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2fa3-a21e-40ef-9144-9e6347fa9862 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.919655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2fa3-a21e-40ef-9144-9e6347fa9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.920070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b2fa3-a21e-40ef-9144-9e6347fa9862 admin admin] PATH_INFO: `/v3/projects/6972fcf9d354490d9cb20c76fdcea364/users/6cf7af92906e4ca083df688e6bee31e3/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:04.935757 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 810/1627] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:04.939878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:04.943851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2fa3-a21e-40ef-9144-9e6347fa9862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6972fcf9d354490d9cb20c76fdcea364, user_id=6cf7af92906e4ca083df688e6bee31e3, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:04.946578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b2fa3-a21e-40ef-9144-9e6347fa9862 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:04.956357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:04.971317 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 818/1628] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:04 2022] PUT /identity/v3/projects/6972fcf9d354490d9cb20c76fdcea364/users/6cf7af92906e4ca083df688e6bee31e3/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:04.973755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:04.974073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:04.974346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.005344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] MFA Rules not processed for user `6cf7af92906e4ca083df688e6bee31e3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:05.006702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:05.015570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bb987-0efc-4d53-9423-bf13f1b8f486 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.084673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.085423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.085588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.085978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.087082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.090150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.096356 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 819/1629] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:05.103272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.120013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0478843b-bfdf-417f-8e59-2cfb4b46301d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.123885 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 811/1630] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:04 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:05.127069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.127746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.128032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.128307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.128788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.128986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.130991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.141753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79db362-de23-42b3-af39-f81852a9f397 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.146408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.147023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.147300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.147569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.148263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.149915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.173584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 812/1631] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:05.177428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.183136 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 820/1632] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:05.187766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.194791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215245da-a98b-4925-a4ec-249715091122 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.248296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.261633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.262276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.262549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.262817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.263447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.265056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.268754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab4d5c-f1d2-4211-9060-50a7bfdd3b8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.273417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.274194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.274479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.274751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.275386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.277572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.278628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 813/1633] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:05.286051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.303425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a11642-1a86-4396-b2a6-8f23beabc361 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.308098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 821/1634] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:05.308384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc537-7a70-48ab-8446-3fd000e14238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.309050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc537-7a70-48ab-8446-3fd000e14238 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.309163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.309331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc537-7a70-48ab-8446-3fd000e14238 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.309602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc537-7a70-48ab-8446-3fd000e14238 admin admin] PATH_INFO: `/v3/projects/fa0ee86db58d4231a356e54307ccf6f2/users/5a3d655324ed4f23909beda9ceff0123/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.318826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecf6ad-7913-4691-8040-6dbb38fb43d4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.323648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.324253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.324526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.324794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.325172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc537-7a70-48ab-8446-3fd000e14238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa0ee86db58d4231a356e54307ccf6f2, user_id=5a3d655324ed4f23909beda9ceff0123, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.325425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.327101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.327887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc537-7a70-48ab-8446-3fd000e14238 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.337967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 822/1635] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:05.342051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.344139 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 814/1636] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:05 2022] PUT /identity/v3/projects/fa0ee86db58d4231a356e54307ccf6f2/users/5a3d655324ed4f23909beda9ceff0123/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:05.351604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61724281-3890-4c33-a39a-f66ea95b60f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.355219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.355497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.355846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.376257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.384711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] MFA Rules not processed for user `5a3d655324ed4f23909beda9ceff0123`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:05.386599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:05.411722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.412444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.412768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.413153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] PATH_INFO: `/v3/projects/9ccfc2304f3046a2b2fb0046dae68fbd/users/f408e17ecd0f4dab834b2560f64d7864/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.431179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccfc2304f3046a2b2fb0046dae68fbd, user_id=f408e17ecd0f4dab834b2560f64d7864, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.434920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.449698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 823/1637] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:05 2022] PUT /identity/v3/projects/9ccfc2304f3046a2b2fb0046dae68fbd/users/f408e17ecd0f4dab834b2560f64d7864/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:05.453618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.458350 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 815/1638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:05.462541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.473436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4119805a-b2b9-4bf0-94ec-b503978cba52 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.520816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a47a9-bbd2-473b-9709-9ca3f151c653 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.525853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.526465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.526785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.527056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.527695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.529298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.530781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.531399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.531680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.531952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.533265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.534598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.542526 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 824/1639] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:05.547069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.555743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcfc1f5-027a-41c7-9db7-4ab540f3d66a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.565650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 816/1640] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:05.566171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa562efb-c91f-44a7-8fd8-3d94b169813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.566879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562efb-c91f-44a7-8fd8-3d94b169813c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.567159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562efb-c91f-44a7-8fd8-3d94b169813c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.567432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562efb-c91f-44a7-8fd8-3d94b169813c admin admin] PATH_INFO: `/v3/projects/9ccfc2304f3046a2b2fb0046dae68fbd/users/f408e17ecd0f4dab834b2560f64d7864/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.569335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.570086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa562efb-c91f-44a7-8fd8-3d94b169813c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ccfc2304f3046a2b2fb0046dae68fbd, user_id=f408e17ecd0f4dab834b2560f64d7864, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.572735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa562efb-c91f-44a7-8fd8-3d94b169813c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.587264 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 825/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:05 2022] PUT /identity/v3/projects/9ccfc2304f3046a2b2fb0046dae68fbd/users/f408e17ecd0f4dab834b2560f64d7864/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:05.598697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.598980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.599255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.627124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] MFA Rules not processed for user `f408e17ecd0f4dab834b2560f64d7864`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:05.628348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:05.633001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fd9ff-c245-4399-a60a-29bbcbdaa234 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.644924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.668448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:05.707220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.707903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.708184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.708454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.709094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.712172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.716898 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 826/1642] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:05.725178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.737349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2a173d-e815-4bb3-a391-8312580cae81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.742302 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 817/1643] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:05.744365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.745074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.745899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.746125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.746229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.746775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:05.747083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.748688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.761738 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 827/1644] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:05.765967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf331e5-df78-4f7a-81fe-a0cc0b11e0a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.766711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.773067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.773657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.773970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.774242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.774886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.776497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.787968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2d34a-4008-4df6-ad73-198b1a37daf8 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.792779 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 818/1645] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:05.794259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.806460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.807181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9f251-f30d-484f-abff-ae86fd26dc94 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.807348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.807654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.807956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.808701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.812161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.816123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.817021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.817465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.817753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] PATH_INFO: `/v3/projects/0a35b71ce902468f8489db054f38a60e/users/d45ccfbbd19c4f6fbe16a30c16edfef9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.834406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a35b71ce902468f8489db054f38a60e, user_id=d45ccfbbd19c4f6fbe16a30c16edfef9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.840246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:05.849362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 828/1646] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:05 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:05.862415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.865388 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 819/1647] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:05 2022] PUT /identity/v3/projects/0a35b71ce902468f8489db054f38a60e/users/d45ccfbbd19c4f6fbe16a30c16edfef9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:05.869478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:05.943350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49724d9-7634-4a6c-a0ee-e76cade8c7f6 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.976969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d5efd-a492-4c8b-90f6-3ed4443f1af9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:05.991109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:05.991747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:05.992026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:05.992300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:05.992953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:05.994699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.010193 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 820/1648] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:06.013457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:06.024500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcab83-3a3d-4d4a-b060-3080310c8221 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:06.029724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd92536-f745-4a80-b59f-624c89463a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.030460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd92536-f745-4a80-b59f-624c89463a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.030739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd92536-f745-4a80-b59f-624c89463a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.031010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd92536-f745-4a80-b59f-624c89463a2f admin admin] PATH_INFO: `/v3/projects/0a35b71ce902468f8489db054f38a60e/users/d45ccfbbd19c4f6fbe16a30c16edfef9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.033169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd92536-f745-4a80-b59f-624c89463a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a35b71ce902468f8489db054f38a60e, user_id=d45ccfbbd19c4f6fbe16a30c16edfef9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.035868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd92536-f745-4a80-b59f-624c89463a2f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.038592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.039720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.040406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.040931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.041937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:06.042539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.044653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.048897 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 821/1649] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:06 2022] PUT /identity/v3/projects/0a35b71ce902468f8489db054f38a60e/users/d45ccfbbd19c4f6fbe16a30c16edfef9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:06.060414 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 829/1650] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:06.062392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890349ab-7ea1-47e3-97ca-a8ecb94cafdc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.062750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890349ab-7ea1-47e3-97ca-a8ecb94cafdc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.063091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890349ab-7ea1-47e3-97ca-a8ecb94cafdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.070849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:06.072871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:06.095349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-890349ab-7ea1-47e3-97ca-a8ecb94cafdc None None] MFA Rules not processed for user `d45ccfbbd19c4f6fbe16a30c16edfef9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:06.097235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-890349ab-7ea1-47e3-97ca-a8ecb94cafdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:06.097700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:06.175835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4886-76d3-4a33-b14f-7eaa2c12fbf9 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:06.183714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:06.211993 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 822/1651] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:06.226496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92986740-e883-47b4-8bcf-756df0cd2fa8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.228364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92986740-e883-47b4-8bcf-756df0cd2fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.228364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92986740-e883-47b4-8bcf-756df0cd2fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.259080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92986740-e883-47b4-8bcf-756df0cd2fa8 None None] MFA Rules not processed for user `5a3d655324ed4f23909beda9ceff0123`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:06.260329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92986740-e883-47b4-8bcf-756df0cd2fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:06.305408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.306328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.306923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.307328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.328880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 823/1652] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:06.385086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.386926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.399506 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 830/1653] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:06.415743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325d31-b7a5-47cb-85fc-6eae294ec56f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.416224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325d31-b7a5-47cb-85fc-6eae294ec56f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.416502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34325d31-b7a5-47cb-85fc-6eae294ec56f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.418132 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 824/1654] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:06.423130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:06.434935 n-d-862964-4 devstack@keystone.service[82079]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 29 02:46:06.435180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:06.443618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019dad-3576-4bf9-9092-6f50ba67b251 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:06.448236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.449195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.449534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.449836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/04e32cf324f34b2f83a492bc113da37f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.450981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=04e32cf324f34b2f83a492bc113da37f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.453031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.454875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 831/1655] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:06 2022] GET /identity/v3/projects/04e32cf324f34b2f83a492bc113da37f => generated 371 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:06.476995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325d31-b7a5-47cb-85fc-6eae294ec56f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:06.491952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34325d31-b7a5-47cb-85fc-6eae294ec56f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:06.498175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c65e48-8fa2-4131-b6e3-9ab41a970f6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.498780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c65e48-8fa2-4131-b6e3-9ab41a970f6d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.499055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c65e48-8fa2-4131-b6e3-9ab41a970f6d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.499322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c65e48-8fa2-4131-b6e3-9ab41a970f6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.507959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c65e48-8fa2-4131-b6e3-9ab41a970f6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.509562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c65e48-8fa2-4131-b6e3-9ab41a970f6d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.519683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 825/1656] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:06.550560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:06.552390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:06.571076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef6e2-5c16-4632-b2c4-8acddad4ef63 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:06.578144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.578776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.579053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.579456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.581647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:06.632833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:06.657191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.658828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.669561 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 832/1657] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:06.716266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0f9d-fa3b-4048-9c0d-57c3b7915749 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.716546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0f9d-fa3b-4048-9c0d-57c3b7915749 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.716835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0f9d-fa3b-4048-9c0d-57c3b7915749 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.718224 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 826/1658] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:06.723315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:06.740465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:06.757820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf200af7-69fb-43fb-8caa-47ae88a951c7 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:06.764936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:06.766406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:06.766756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:06.767535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/04e32cf324f34b2f83a492bc113da37f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:06.769959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=04e32cf324f34b2f83a492bc113da37f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:06.772952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:06.775195 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 833/1659] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:06 2022] GET /identity/v3/projects/04e32cf324f34b2f83a492bc113da37f => generated 371 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:07.365240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036a08-4a3b-4263-9891-895d083635a4 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.365767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036a08-4a3b-4263-9891-895d083635a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.365899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d036a08-4a3b-4263-9891-895d083635a4 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.367515 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 827/1660] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:07.374849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:07.398144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:07.407709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4f666-912e-4fb0-b8fe-70cb69a264eb tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:07.413003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae85d76-6529-4962-befc-7583341d804a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:07.413645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85d76-6529-4962-befc-7583341d804a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.413963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85d76-6529-4962-befc-7583341d804a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.414368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae85d76-6529-4962-befc-7583341d804a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/04e32cf324f34b2f83a492bc113da37f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.416067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae85d76-6529-4962-befc-7583341d804a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=04e32cf324f34b2f83a492bc113da37f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:07.418357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae85d76-6529-4962-befc-7583341d804a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:07.420448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 834/1661] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:07 2022] GET /identity/v3/projects/04e32cf324f34b2f83a492bc113da37f => generated 371 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:07.445061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d036a08-4a3b-4263-9891-895d083635a4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:07.458380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d036a08-4a3b-4263-9891-895d083635a4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:07.465073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:07.465651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.466030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.466370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/04e32cf324f34b2f83a492bc113da37f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.467592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04e32cf324f34b2f83a492bc113da37f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:07.469836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:07.520019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e32cf324f34b2f83a492bc113da37f', 'request_id': 'req-f051a7f4-e1cd-46a7-a51a-80cf8975f540'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:07.526308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e32cf324f34b2f83a492bc113da37f', 'request_id': 'req-f051a7f4-e1cd-46a7-a51a-80cf8975f540'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:07.531929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e32cf324f34b2f83a492bc113da37f', 'request_id': 'req-f051a7f4-e1cd-46a7-a51a-80cf8975f540'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:07.545499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] The token cache is being invalidate because project 04e32cf324f34b2f83a492bc113da37f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:07.545796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:07.546511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:07.548257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 828/1662] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:07 2022] DELETE /identity/v3/projects/04e32cf324f34b2f83a492bc113da37f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:07.567093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1fcab-1398-48ea-ab21-54e139bdcf24 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.567376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1fcab-1398-48ea-ab21-54e139bdcf24 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.567649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1fcab-1398-48ea-ab21-54e139bdcf24 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.569158 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 835/1663] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:07.574220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:07.575780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:07.653029 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 29 02:46:07.653334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:07.654696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:07.660211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:07.730727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051a7f4-e1cd-46a7-a51a-80cf8975f540 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:07.735687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:07.736337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.736613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.736883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/6972fcf9d354490d9cb20c76fdcea364` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.738033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=6972fcf9d354490d9cb20c76fdcea364)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:07.740121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:07.741861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 829/1664] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:07 2022] GET /identity/v3/projects/6972fcf9d354490d9cb20c76fdcea364 => generated 375 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:07.760354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1fcab-1398-48ea-ab21-54e139bdcf24 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:07.774264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1fcab-1398-48ea-ab21-54e139bdcf24 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:07.779898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:07.780505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.780788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.781062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.781700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:07.782041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:07.783639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:07.798880 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 836/1665] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:07.805434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:07.816966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a252e-5c04-433a-b0ee-f6a1b19745b2 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:07.821992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63089252-2db2-4b29-b07b-439e61638c67 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:07.822593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089252-2db2-4b29-b07b-439e61638c67 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.822872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089252-2db2-4b29-b07b-439e61638c67 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.823141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63089252-2db2-4b29-b07b-439e61638c67 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.823837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63089252-2db2-4b29-b07b-439e61638c67 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:07.825794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63089252-2db2-4b29-b07b-439e61638c67 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:07.860670 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 830/1666] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:07 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:07.866927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:07.881613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e6284-c167-495c-881e-9593bb025aee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:07.939697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:07.940307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.940585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.940865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.941500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:07.941837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:07.943459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:07.955946 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 837/1667] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:07.977035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f848db0-9281-448c-84d0-f798bbbfa72b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:07.977306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f848db0-9281-448c-84d0-f798bbbfa72b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:07.977578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f848db0-9281-448c-84d0-f798bbbfa72b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:07.979051 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 831/1668] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:07.983918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:07.985819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:08.068169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.076687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5aa9b-f38b-4d29-a83f-a5c11922bdac tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.081526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.082182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.082458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.082722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/bd9490652a874247866b4298f9f090a6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.083852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd9490652a874247866b4298f9f090a6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.085917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.087558 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 838/1669] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:07 2022] GET /identity/v3/projects/bd9490652a874247866b4298f9f090a6 => generated 369 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:08.181464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581401c4-d059-46c2-a5c4-f8efc69c43d8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.181748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581401c4-d059-46c2-a5c4-f8efc69c43d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.182131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581401c4-d059-46c2-a5c4-f8efc69c43d8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.183741 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 832/1670] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:08.188589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:08.202565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.212400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79979a7b-566d-427a-8e9c-e90f52cabfbf tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.218522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.219118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.219399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.219665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/bd9490652a874247866b4298f9f090a6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.220962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd9490652a874247866b4298f9f090a6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.223083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.224735 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 839/1671] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:08 2022] GET /identity/v3/projects/bd9490652a874247866b4298f9f090a6 => generated 369 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:08.271141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581401c4-d059-46c2-a5c4-f8efc69c43d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.286946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581401c4-d059-46c2-a5c4-f8efc69c43d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.292544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.293310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.293676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.294080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.294758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:08.295069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.296675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.311969 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 833/1672] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:08.313139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.324146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b86fd-9943-4658-a685-c42238c2b9ee tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.329947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9ce80-4f71-4517-873c-11d395a3b493 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.331013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9ce80-4f71-4517-873c-11d395a3b493 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.331436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9ce80-4f71-4517-873c-11d395a3b493 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.331816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9ce80-4f71-4517-873c-11d395a3b493 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.332649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9ce80-4f71-4517-873c-11d395a3b493 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.334601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9ce80-4f71-4517-873c-11d395a3b493 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.363059 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 840/1673] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:08 2022] POST /identity/v3/users => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:08.368091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.383338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c85002-00bd-4690-b454-4248a9975d51 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.390432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.391442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.392036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.392377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.393557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:08.394115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.403278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.418684 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 834/1674] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:08.539809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844863e-8eed-42b3-8e09-a66a184f557f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.546052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844863e-8eed-42b3-8e09-a66a184f557f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.546642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844863e-8eed-42b3-8e09-a66a184f557f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.550967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 841/1675] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:08.553141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:08.572595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.582057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61110053-fb74-46dd-a426-e6422e0c21df tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.586885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.587527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.587806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.588070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/bd9490652a874247866b4298f9f090a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.589369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd9490652a874247866b4298f9f090a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.591483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.593347 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 835/1676] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:08 2022] GET /identity/v3/projects/bd9490652a874247866b4298f9f090a6 => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:08.873761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0819c8-793d-4c0d-ad99-4200b2bfb112 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.877131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0819c8-793d-4c0d-ad99-4200b2bfb112 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.877424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0819c8-793d-4c0d-ad99-4200b2bfb112 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.879407 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 842/1677] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:08.884482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:08.900585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.912565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17772694-2b4f-4685-83e0-742c7a7da623 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:08.918308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:08.919091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:08.919609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:08.919887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/bd9490652a874247866b4298f9f090a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:08.921036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=bd9490652a874247866b4298f9f090a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:08.923150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:08.929896 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 836/1678] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:08 2022] GET /identity/v3/projects/bd9490652a874247866b4298f9f090a6 => generated 369 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:08.964478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0819c8-793d-4c0d-ad99-4200b2bfb112 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:08.975374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:08.989910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0819c8-793d-4c0d-ad99-4200b2bfb112 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:09.007980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:09.011527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:09.012486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:09.012839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/users/39beef93f4184945aefbfc0b489719e6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:09.036431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:delete_user(user_id=39beef93f4184945aefbfc0b489719e6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:09.038820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:09.098593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39beef93f4184945aefbfc0b489719e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.114988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39beef93f4184945aefbfc0b489719e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.116066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39beef93f4184945aefbfc0b489719e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.128245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39beef93f4184945aefbfc0b489719e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.129624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3f8b917-dd29-492d-8890-ad279f045de3 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39beef93f4184945aefbfc0b489719e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.153320 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:08 2022] DELETE /identity/v3/users/39beef93f4184945aefbfc0b489719e6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:09.157443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:09.159340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:09.185859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765872-dffc-4872-824a-32346748e700 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:09.354334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:09.356592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:09.357026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:09.357470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/bd9490652a874247866b4298f9f090a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:09.359141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd9490652a874247866b4298f9f090a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:09.361931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:09.430243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:09.440120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9490652a874247866b4298f9f090a6', 'request_id': 'req-7da20772-4fce-469a-ba18-c3a7b616a87a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.450662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9490652a874247866b4298f9f090a6', 'request_id': 'req-7da20772-4fce-469a-ba18-c3a7b616a87a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.456906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9490652a874247866b4298f9f090a6', 'request_id': 'req-7da20772-4fce-469a-ba18-c3a7b616a87a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.474464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] The token cache is being invalidate because project bd9490652a874247866b4298f9f090a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:09.474782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.476429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:09.478905 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 837/1680] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:09 2022] DELETE /identity/v3/projects/bd9490652a874247866b4298f9f090a6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:09.697865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df539-2a20-4871-b50d-bfeae73e67af None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:09.698164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df539-2a20-4871-b50d-bfeae73e67af None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:09.698564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35df539-2a20-4871-b50d-bfeae73e67af None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:09.700959 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 844/1681] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:09.706644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:09.708547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:09.790526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:09.791776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:09.855743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da20772-4fce-469a-ba18-c3a7b616a87a tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:09.860945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:09.861724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:09.862029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:09.862297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/6972fcf9d354490d9cb20c76fdcea364` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:09.863454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=6972fcf9d354490d9cb20c76fdcea364)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:09.865595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:09.867490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 838/1682] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:09 2022] GET /identity/v3/projects/6972fcf9d354490d9cb20c76fdcea364 => generated 375 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:10.037018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c020-79c3-45e5-be7e-9f1f2093a03a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:10.037505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c020-79c3-45e5-be7e-9f1f2093a03a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:10.037592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c020-79c3-45e5-be7e-9f1f2093a03a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:10.039078 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 845/1683] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:10.044439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:10.046329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:10.063055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:10.072107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243ea14-7fb6-4b2c-8625-d8e025624428 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:10.077413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:10.078080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:10.078358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:10.078657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/6972fcf9d354490d9cb20c76fdcea364` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:10.079882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=6972fcf9d354490d9cb20c76fdcea364)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:10.081958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:10.083626 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 839/1684] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:10 2022] GET /identity/v3/projects/6972fcf9d354490d9cb20c76fdcea364 => generated 375 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:10.318881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa192b5-7abc-4319-8bda-1c70a2a7dbf3 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:10.319340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa192b5-7abc-4319-8bda-1c70a2a7dbf3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:10.322656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa192b5-7abc-4319-8bda-1c70a2a7dbf3 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:10.322656 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 846/1685] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:10.326533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:10.342120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:10.351446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb594835-731f-453e-b85c-d1fed05f9fe0 tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:10.357177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450db5bc-60bd-483b-9ab6-f892f3f1536f tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f408e17ecd0f4dab834b2560f64d7864', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ccfc2304f3046a2b2fb0046dae68fbd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:10.358067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db5bc-60bd-483b-9ab6-f892f3f1536f tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:10.358352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db5bc-60bd-483b-9ab6-f892f3f1536f tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:10.359137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450db5bc-60bd-483b-9ab6-f892f3f1536f tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] PATH_INFO: `/v3/projects/6972fcf9d354490d9cb20c76fdcea364` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:10.360589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450db5bc-60bd-483b-9ab6-f892f3f1536f tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorizing `identity:get_project(project_id=6972fcf9d354490d9cb20c76fdcea364)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:10.363165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450db5bc-60bd-483b-9ab6-f892f3f1536f tempest-QuotasAdminTestJSON-219431579 tempest-QuotasAdminTestJSON-219431579-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:10.364855 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 840/1686] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:10 2022] GET /identity/v3/projects/6972fcf9d354490d9cb20c76fdcea364 => generated 375 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:10.688295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa192b5-7abc-4319-8bda-1c70a2a7dbf3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:10.690458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fa192b5-7abc-4319-8bda-1c70a2a7dbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:10.761598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa192b5-7abc-4319-8bda-1c70a2a7dbf3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:10.766804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:10.767463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:10.767740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:10.768031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] PATH_INFO: `/v3/users/6cf7af92906e4ca083df688e6bee31e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:10.769178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf7af92906e4ca083df688e6bee31e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:10.771142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:10.825787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf7af92906e4ca083df688e6bee31e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:10.846071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf7af92906e4ca083df688e6bee31e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:10.846904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf7af92906e4ca083df688e6bee31e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:10.848464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:10.859932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf7af92906e4ca083df688e6bee31e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:10.860735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf7af92906e4ca083df688e6bee31e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:10.876141 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 847/1687] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:10 2022] DELETE /identity/v3/users/6cf7af92906e4ca083df688e6bee31e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:10.880429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:10.880927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:10.881071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:10.904747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:10.906672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:10.977279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:10.999462 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 841/1688] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:11.007963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:11.009639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:11.077843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47873b8-88c2-4507-9593-f005a3d187ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:11.082293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:11.083656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:11.083982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:11.084272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:11.094093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:11.095538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:11.105694 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 848/1689] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:11.474411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:11.476106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:11.489944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d932bb3-e097-40b8-aa3b-c7e708c96f2e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:11.495864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:11.496702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:11.496979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:11.497254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] PATH_INFO: `/v3/projects/6972fcf9d354490d9cb20c76fdcea364` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:11.498700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6972fcf9d354490d9cb20c76fdcea364)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:11.500420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:11.567136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6972fcf9d354490d9cb20c76fdcea364', 'request_id': 'req-cd7492a5-a845-460e-9c2b-1686058f711d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.574136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6972fcf9d354490d9cb20c76fdcea364', 'request_id': 'req-cd7492a5-a845-460e-9c2b-1686058f711d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.580617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6972fcf9d354490d9cb20c76fdcea364', 'request_id': 'req-cd7492a5-a845-460e-9c2b-1686058f711d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.594572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] The token cache is being invalidate because project 6972fcf9d354490d9cb20c76fdcea364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:11.594855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.595555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.597074 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 842/1690] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:11 2022] DELETE /identity/v3/projects/6972fcf9d354490d9cb20c76fdcea364 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:11.601219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:11.611839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5e1d6-0331-4bd7-9b34-2ec9e12a1db3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:11.670532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:11.671168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:11.671510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:11.671817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] PATH_INFO: `/v3/users/f408e17ecd0f4dab834b2560f64d7864` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:11.672968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f408e17ecd0f4dab834b2560f64d7864)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:11.674898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:11.727038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f408e17ecd0f4dab834b2560f64d7864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.739586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f408e17ecd0f4dab834b2560f64d7864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.740264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f408e17ecd0f4dab834b2560f64d7864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.747720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f408e17ecd0f4dab834b2560f64d7864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.748351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab45438b-6eff-4519-8449-6e1d53b836f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f408e17ecd0f4dab834b2560f64d7864'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:11.762620 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 849/1691] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:11 2022] DELETE /identity/v3/users/f408e17ecd0f4dab834b2560f64d7864 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:12.142197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.144055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:12.158468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7492a5-a845-460e-9c2b-1686058f711d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.227617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d0d0b-5059-4ebb-b045-98880ebcce0e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.228121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d0d0b-5059-4ebb-b045-98880ebcce0e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.228210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d0d0b-5059-4ebb-b045-98880ebcce0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.236797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:12.250627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.250926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-450d0d0b-5059-4ebb-b045-98880ebcce0e None None] MFA Rules not processed for user `9c7e462d0e474a3aa94d3a146ae24d21`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:12.251434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.251781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.252145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] PATH_INFO: `/v3/projects/9ccfc2304f3046a2b2fb0046dae68fbd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.252287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-450d0d0b-5059-4ebb-b045-98880ebcce0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:12.253399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ccfc2304f3046a2b2fb0046dae68fbd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.255496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:12.315374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ccfc2304f3046a2b2fb0046dae68fbd', 'request_id': 'req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:12.323626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ccfc2304f3046a2b2fb0046dae68fbd', 'request_id': 'req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:12.331122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ccfc2304f3046a2b2fb0046dae68fbd', 'request_id': 'req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:12.347833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] The token cache is being invalidate because project 9ccfc2304f3046a2b2fb0046dae68fbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:12.348128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:12.349474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-784e6a62-95ad-4bf6-a07b-64b8ff8f489b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:12.351738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 843/1692] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:12 2022] DELETE /identity/v3/projects/9ccfc2304f3046a2b2fb0046dae68fbd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:12.358222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.358542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.359240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.371821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:12.390957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 850/1693] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:12.395685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:12.397970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:12.502017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 844/1694] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:12.506991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.507419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.507781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.529892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:12.531412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:12.545176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 851/1695] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:12.546471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.558064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424102-06e0-4b77-8bcf-d52124532a8a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.567479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.568126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.568544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.568826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.570488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:12.570799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.572422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:12.596028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 845/1696] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:12.597016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.609980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d3a59-d02b-4791-9111-afbeef918949 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.615025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.626180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.626180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.626180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.626180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.626180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:12.675953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.682901 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 852/1697] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:12 2022] POST /identity/v3/projects => generated 403 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:12.702189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c30a5-b999-4266-9e6a-65af821db3af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.795764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.795764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.795764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.795764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.796337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.798335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:12.842445 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 846/1698] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:12 2022] POST /identity/v3/users => generated 302 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:12.846502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.864689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836b735-6bd0-49f6-9147-e6976c851f81 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.875549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.876218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.876497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.876767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.877481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.879122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:12.892758 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 853/1699] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:12.894046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.906038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e6619c-01d1-4a5e-9c92-7da26de2dc83 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.913199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5098d1c2-bfed-4879-a883-af66e4fdfe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.914666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d1c2-bfed-4879-a883-af66e4fdfe6d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.914954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d1c2-bfed-4879-a883-af66e4fdfe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.915222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5098d1c2-bfed-4879-a883-af66e4fdfe6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.916006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098d1c2-bfed-4879-a883-af66e4fdfe6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.917594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5098d1c2-bfed-4879-a883-af66e4fdfe6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:12.932275 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 847/1700] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:12.934043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:12.951181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd82f2f-c1e8-414d-8a31-79bf34d32b84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:12.957024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:12.957730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:12.958057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:12.958329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] PATH_INFO: `/v3/projects/a163557c7c794c75bffb275e370b8c03/users/379b9151d1c04a008a54b5cd20d27c92/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:12.977254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a163557c7c794c75bffb275e370b8c03, user_id=379b9151d1c04a008a54b5cd20d27c92, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:12.980243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.000949 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 854/1701] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:12 2022] PUT /identity/v3/projects/a163557c7c794c75bffb275e370b8c03/users/379b9151d1c04a008a54b5cd20d27c92/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:13.014845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.014845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.015079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.056313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] MFA Rules not processed for user `379b9151d1c04a008a54b5cd20d27c92`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:13.057983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:13.188574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:13.198548 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 848/1702] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:13 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:13.198800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:13.359020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b0962-f1c0-401e-be44-614baa62f6e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:13.373583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:13.374398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.374681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.375614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.376424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:13.378463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.460841 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 855/1703] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:13 2022] POST /identity/v3/projects => generated 403 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:13.464681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:13.479359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f087c8-8557-4fc5-92a0-57ca774f9c6c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:13.585494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:13.586176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.586457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.586744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.587399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:13.589526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.619699 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 849/1704] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:13 2022] POST /identity/v3/users => generated 308 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:13.624261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:13.635265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c82760-d68a-4409-843a-f3b0073a541b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:13.640855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:13.641199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.641346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.641620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.642316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:13.644240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.666833 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 856/1705] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:13.670868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:13.685356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2e80e-2240-4fa1-baef-a9474180d19d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:13.691669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:13.692764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.692876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.693085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] PATH_INFO: `/v3/projects/997fdb4006314146b75d01581def6b3f/users/954b6011ae8643229b6fd3c72a4fa892/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.719613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] RBAC: Authorizing `identity:create_grant(project_id=997fdb4006314146b75d01581def6b3f, user_id=954b6011ae8643229b6fd3c72a4fa892, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:13.722686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.739983 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 850/1706] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:13 2022] PUT /identity/v3/projects/997fdb4006314146b75d01581def6b3f/users/954b6011ae8643229b6fd3c72a4fa892/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:13.743754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:13.754312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853098-024c-4a58-b1d1-21611d043482 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:13.773356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:13.831416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce350fe-c353-40e7-be62-37e953412358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:13.832150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce350fe-c353-40e7-be62-37e953412358 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.832495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce350fe-c353-40e7-be62-37e953412358 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.832933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce350fe-c353-40e7-be62-37e953412358 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.833639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce350fe-c353-40e7-be62-37e953412358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:13.835532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce350fe-c353-40e7-be62-37e953412358 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.849352 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 857/1707] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:13.853309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:13.864266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1274e-f127-442d-8b3c-afd5666913da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:13.870977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:13.871658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.871928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.872232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] PATH_INFO: `/v3/projects/997fdb4006314146b75d01581def6b3f/users/954b6011ae8643229b6fd3c72a4fa892/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.874235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997fdb4006314146b75d01581def6b3f, user_id=954b6011ae8643229b6fd3c72a4fa892, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:13.876882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:13.893467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 851/1708] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:13 2022] PUT /identity/v3/projects/997fdb4006314146b75d01581def6b3f/users/954b6011ae8643229b6fd3c72a4fa892/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:13.907896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:13.908372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:13.909008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:13.947185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] MFA Rules not processed for user `954b6011ae8643229b6fd3c72a4fa892`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:13.948706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:14.030702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 858/1709] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:14.045690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:14.048135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:14.186166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9eae21-af64-4e2e-9146-9fd7f13682c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:14.191892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54de287-1472-42f1-a0a8-000be9c9841d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:14.192506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54de287-1472-42f1-a0a8-000be9c9841d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:14.192800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54de287-1472-42f1-a0a8-000be9c9841d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:14.193019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54de287-1472-42f1-a0a8-000be9c9841d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:14.202831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54de287-1472-42f1-a0a8-000be9c9841d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:14.204828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54de287-1472-42f1-a0a8-000be9c9841d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:14.216318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 852/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:14 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:14.507755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:14.511465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:14.533900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f281dfd-eb7e-447a-ad1c-2e568be18ed8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:14.541076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:14.556142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:14.556142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:14.556142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:14.571187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:14.691256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:14.696343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:14.718398 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 859/1711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:14.855429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:14.855710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:14.855976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:14.881617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:14.882863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:14.922991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:14.943321 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 853/1712] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:46:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:14.962366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:14.963999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:14.978914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49159c38-caff-4585-a4f2-806ba6a91c96 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:14.983121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:14.983972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:14.984249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:14.984515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:14.992954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:14.995614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:15.007672 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 860/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:15.067559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:15.088218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703773ba-7ca9-468d-8285-b695799c64e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:15.117236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d989-f107-471a-9e9a-b19fb4f2c025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:15.117906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d989-f107-471a-9e9a-b19fb4f2c025 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:15.119439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d989-f107-471a-9e9a-b19fb4f2c025 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:15.119721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d989-f107-471a-9e9a-b19fb4f2c025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:15.271627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5d989-f107-471a-9e9a-b19fb4f2c025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:15.274173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5d989-f107-471a-9e9a-b19fb4f2c025 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:15.289968 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 854/1714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:15 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:15.312103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:15.341257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:15.387264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e66511-4241-4815-9f7c-dc707c5694cf service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:15.396402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:15.397361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:15.397841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:15.398286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] PATH_INFO: `/v3/users/379b9151d1c04a008a54b5cd20d27c92` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:15.399614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379b9151d1c04a008a54b5cd20d27c92)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:15.401933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:15.418905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:15.419345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:15.419620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:15.468241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] MFA Rules not processed for user `de04aa74bc1f403ea9818dcbcaba7b63`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:15.469610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:15.494651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379b9151d1c04a008a54b5cd20d27c92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:15.524650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379b9151d1c04a008a54b5cd20d27c92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:15.525360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379b9151d1c04a008a54b5cd20d27c92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:15.533675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379b9151d1c04a008a54b5cd20d27c92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:15.534421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e179df50-e942-41db-8eb9-7936e88851f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379b9151d1c04a008a54b5cd20d27c92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:15.588940 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 861/1715] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:15 2022] DELETE /identity/v3/users/379b9151d1c04a008a54b5cd20d27c92 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:15.590605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:15.590894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:15.591179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:15.609935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 855/1716] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:15.619339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:15.622069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:15.738297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 862/1717] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:15.781219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:15.783684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:15.809872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59942b69-5d8f-4086-8c22-9c138c9f4236 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:15.946311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:15.960168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:15.960577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:15.960864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:15.982579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:15.983967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:16.026561 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 856/1718] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:17.105121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:17.107422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:17.124584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8898d4a-2778-4d76-b42f-c1d38dec418b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:17.140766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:17.141752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:17.142315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:17.143019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] PATH_INFO: `/v3/users/a66a1a17d4654203a88f77f485dc865e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:17.146080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66a1a17d4654203a88f77f485dc865e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:17.148156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:17.172960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:17.176598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:17.234306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc67253-978c-4bf8-845c-63323da23eba service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:17.247282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:17.248674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:17.249170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:17.249629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] PATH_INFO: `/v3/projects/a163557c7c794c75bffb275e370b8c03` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:17.252537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a163557c7c794c75bffb275e370b8c03)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:17.254936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:17.263050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:17.302133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66a1a17d4654203a88f77f485dc865e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.325109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66a1a17d4654203a88f77f485dc865e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.326304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66a1a17d4654203a88f77f485dc865e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.337472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66a1a17d4654203a88f77f485dc865e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.339173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c163aa21-88ed-4ff7-8885-caeaf612b546 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66a1a17d4654203a88f77f485dc865e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.366203 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 863/1719] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:17 2022] DELETE /identity/v3/users/a66a1a17d4654203a88f77f485dc865e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:17.371419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:17.371705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:17.371983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:17.396137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:17.397980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:17.398104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:17.439737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a163557c7c794c75bffb275e370b8c03', 'request_id': 'req-a01e16cc-2a1f-4838-b929-9229e8f2fc26'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.457527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a163557c7c794c75bffb275e370b8c03', 'request_id': 'req-a01e16cc-2a1f-4838-b929-9229e8f2fc26'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.466251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a163557c7c794c75bffb275e370b8c03', 'request_id': 'req-a01e16cc-2a1f-4838-b929-9229e8f2fc26'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.489708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] The token cache is being invalidate because project a163557c7c794c75bffb275e370b8c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:17.490084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.491699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.497627 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 857/1720] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:17 2022] DELETE /identity/v3/projects/a163557c7c794c75bffb275e370b8c03 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:17.499148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:17.502187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:17.587903 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 864/1721] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:17.596614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:17.598916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:17.662533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e16cc-2a1f-4838-b929-9229e8f2fc26 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:17.667746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:17.668542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:17.668826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:17.669099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] PATH_INFO: `/v3/users/954b6011ae8643229b6fd3c72a4fa892` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:17.670501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=954b6011ae8643229b6fd3c72a4fa892)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:17.672614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:17.760129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954b6011ae8643229b6fd3c72a4fa892'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.793931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954b6011ae8643229b6fd3c72a4fa892'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.795646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954b6011ae8643229b6fd3c72a4fa892'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.797577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6662d-0feb-4e09-b1f1-d64b838a241a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:17.818173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954b6011ae8643229b6fd3c72a4fa892'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.826351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954b6011ae8643229b6fd3c72a4fa892'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:17.858196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 858/1722] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:17 2022] DELETE /identity/v3/users/954b6011ae8643229b6fd3c72a4fa892 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:17.925519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:17.926194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:17.926458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:17.926814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:17.939431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:17.960763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:17.962423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426f73f-4387-41cc-a996-614784a1b7d5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:17.990815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 865/1723] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:18.000990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:18.005038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:18.133233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:18.198307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163723f9-0116-449e-bdcd-0e397e401cfb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:18.209260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:18.209968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:18.210254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:18.210528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] PATH_INFO: `/v3/users/52e91da7b94f490faf595d5de7818ac1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:18.211691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e91da7b94f490faf595d5de7818ac1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:18.214445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:18.321105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e91da7b94f490faf595d5de7818ac1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.348521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e91da7b94f490faf595d5de7818ac1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.349365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e91da7b94f490faf595d5de7818ac1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.361787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e91da7b94f490faf595d5de7818ac1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.362877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e91da7b94f490faf595d5de7818ac1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.390672 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 859/1724] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:17 2022] DELETE /identity/v3/users/52e91da7b94f490faf595d5de7818ac1 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:18.395743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:18.396645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:18.396926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:18.418792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:18.420119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:18.430235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:18.558571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 866/1725] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:18.567889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:18.582055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:18.714767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7bcd4-d69e-49ac-8a7a-ad3ffefd7245 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:18.719981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:18.721416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:18.721942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:18.722409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:18.740448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:18.741950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:18.744930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:18.747186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:18.760721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c115d80-be66-4728-aebf-614a398fb6d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:18.769676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:18.773527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 860/1726] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:18.782697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:18.782988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:18.783266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] PATH_INFO: `/v3/projects/2504c8ae592e45c4a9650b492d6ed747` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:18.789111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2504c8ae592e45c4a9650b492d6ed747)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:18.791358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:18.901538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2504c8ae592e45c4a9650b492d6ed747', 'request_id': 'req-1f66e82c-cdfb-47ad-8046-6a3809c600e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.912495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2504c8ae592e45c4a9650b492d6ed747', 'request_id': 'req-1f66e82c-cdfb-47ad-8046-6a3809c600e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.921563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2504c8ae592e45c4a9650b492d6ed747', 'request_id': 'req-1f66e82c-cdfb-47ad-8046-6a3809c600e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.938356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] The token cache is being invalidate because project 2504c8ae592e45c4a9650b492d6ed747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:18.939129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.940275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:18.942863 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 867/1727] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:18 2022] DELETE /identity/v3/projects/2504c8ae592e45c4a9650b492d6ed747 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:18.946626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:18.958081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e7a66-9b70-42bc-b6ff-54b05c514b7f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:19.016430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:19.018092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:19.103185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:19.120519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:19.121281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.121625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.121989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] PATH_INFO: `/v3/users/c2ed5c17f03d431db7b1a8ad7b5d4182` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.124126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2ed5c17f03d431db7b1a8ad7b5d4182)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:19.129102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:19.191596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66e82c-cdfb-47ad-8046-6a3809c600e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:19.199765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:19.200428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.200721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.201035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] PATH_INFO: `/v3/projects/997fdb4006314146b75d01581def6b3f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.204177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997fdb4006314146b75d01581def6b3f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:19.210286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:19.238812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2ed5c17f03d431db7b1a8ad7b5d4182'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.251411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2ed5c17f03d431db7b1a8ad7b5d4182'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.254181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2ed5c17f03d431db7b1a8ad7b5d4182'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.267303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2ed5c17f03d431db7b1a8ad7b5d4182'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.268752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2ed5c17f03d431db7b1a8ad7b5d4182'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.338782 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 861/1728] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:18 2022] DELETE /identity/v3/users/c2ed5c17f03d431db7b1a8ad7b5d4182 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:19.339042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:19.352649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:19.354186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:19.364013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997fdb4006314146b75d01581def6b3f', 'request_id': 'req-f01410a3-26db-4be7-98f9-b6a8a60a45f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.373145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997fdb4006314146b75d01581def6b3f', 'request_id': 'req-f01410a3-26db-4be7-98f9-b6a8a60a45f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.380674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997fdb4006314146b75d01581def6b3f', 'request_id': 'req-f01410a3-26db-4be7-98f9-b6a8a60a45f7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.397110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] The token cache is being invalidate because project 997fdb4006314146b75d01581def6b3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:19.397707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.398263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f01410a3-26db-4be7-98f9-b6a8a60a45f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.399821 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 868/1729] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:19 2022] DELETE /identity/v3/projects/997fdb4006314146b75d01581def6b3f => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:19.405107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bb3d-5207-4ad4-af5d-9e19ecd07088 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.405495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bb3d-5207-4ad4-af5d-9e19ecd07088 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.406122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606bb3d-5207-4ad4-af5d-9e19ecd07088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.435169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6606bb3d-5207-4ad4-af5d-9e19ecd07088 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:19.437111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6606bb3d-5207-4ad4-af5d-9e19ecd07088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:19.471678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126f705-4936-4cad-a8f3-c54f8d14d45b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:19.480134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:19.480943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.481336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.481790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] PATH_INFO: `/v3/projects/24a3d738a21746bd996db6a866ff6e7b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.483424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=24a3d738a21746bd996db6a866ff6e7b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:19.485445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:19.579255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24a3d738a21746bd996db6a866ff6e7b', 'request_id': 'req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.581103 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 869/1730] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:19.587342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24a3d738a21746bd996db6a866ff6e7b', 'request_id': 'req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.588962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.589209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.589434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.602069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24a3d738a21746bd996db6a866ff6e7b', 'request_id': 'req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.624427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] The token cache is being invalidate because project 24a3d738a21746bd996db6a866ff6e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:19.624795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.625534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.629201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:19.632652 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 862/1731] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:19 2022] DELETE /identity/v3/projects/24a3d738a21746bd996db6a866ff6e7b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:19.633686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:19.634276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:19.635198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:19.650777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:19.783910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 870/1732] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:19.787825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:19.793262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ebc108-e7d8-4c15-89f1-bc036c6dddcd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:19.801092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f5e28-e92b-48f1-8452-2120a2e0cd71 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:19.804531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:19.804694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.805022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.805128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] PATH_INFO: `/v3/users/77e6e3697dce4888930c0f1977f2bbb5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.806578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e6e3697dce4888930c0f1977f2bbb5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:19.808673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:19.819847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:19.820486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.820759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.821037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.821676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:19.822014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:19.825648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:19.860088 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 871/1733] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:19.864944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:19.893303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3952a0-6ce1-4389-afa5-039dd6ae65ce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:19.902752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:19.903561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:19.904103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:19.908246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:19.909461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:19.914297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:19.936484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e6e3697dce4888930c0f1977f2bbb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.948396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e6e3697dce4888930c0f1977f2bbb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.950093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e6e3697dce4888930c0f1977f2bbb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.981704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e6e3697dce4888930c0f1977f2bbb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.983981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e6e3697dce4888930c0f1977f2bbb5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:19.991897 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 872/1734] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:19 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:19.996286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.024511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:20.036749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 863/1735] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:19 2022] DELETE /identity/v3/users/77e6e3697dce4888930c0f1977f2bbb5 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:20.121593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:20.196244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748e026-72dc-4f47-9063-56dccb6e204b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:20.288378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.290750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:20.362931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:20.363831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.364118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.364394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.365042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:20.372348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:20.424656 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 873/1736] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:19 2022] POST /identity/v3/users => generated 293 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:20.426945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.440881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf2030-78ed-44d0-b247-33d6eaf29b19 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:20.447020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:20.448240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.448928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.449456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.450397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:20.452312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:20.474553 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 874/1737] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:20.478892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.497266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebb587-090b-4f5a-9a64-a0993b93a27b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:20.503167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989be10-2286-4531-b23b-9286fc9d93f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:20.508685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:20.509534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.509791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.510174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] PATH_INFO: `/v3/projects/a9a37d116d8645b5a717c81eb0c83ed8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.514088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a37d116d8645b5a717c81eb0c83ed8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:20.514513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:20.515187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.515526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.515712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.516042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:20.516407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:20.533924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:20.589964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 875/1738] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:20.591038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.599288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:20.605290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2a721-24bd-4cd9-a655-ffe10fa88582 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:20.641281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a37d116d8645b5a717c81eb0c83ed8', 'request_id': 'req-a35550b9-cc43-4cc8-ba05-2f65986e39a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:20.654819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a37d116d8645b5a717c81eb0c83ed8', 'request_id': 'req-a35550b9-cc43-4cc8-ba05-2f65986e39a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:20.661924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a37d116d8645b5a717c81eb0c83ed8', 'request_id': 'req-a35550b9-cc43-4cc8-ba05-2f65986e39a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:20.687731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] The token cache is being invalidate because project a9a37d116d8645b5a717c81eb0c83ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:20.688172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:20.688859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a35550b9-cc43-4cc8-ba05-2f65986e39a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:20.691127 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 864/1739] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:20 2022] DELETE /identity/v3/projects/a9a37d116d8645b5a717c81eb0c83ed8 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:20.696080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789f84b-9526-4830-b55c-d5bdd40fd0b1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.699535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789f84b-9526-4830-b55c-d5bdd40fd0b1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.699853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789f84b-9526-4830-b55c-d5bdd40fd0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.741865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871138f-e957-4746-bd2c-b40fc4bfaad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:20.742554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871138f-e957-4746-bd2c-b40fc4bfaad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.742839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871138f-e957-4746-bd2c-b40fc4bfaad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.743113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871138f-e957-4746-bd2c-b40fc4bfaad4 admin admin] PATH_INFO: `/v3/projects/f76e01279e6d47c0aa4fb03206db8050/users/1486b01e2a39475dab72aa7f36816c1a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.743224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d789f84b-9526-4830-b55c-d5bdd40fd0b1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:20.745541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d789f84b-9526-4830-b55c-d5bdd40fd0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:20.768199 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 865/1740] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:20.770090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871138f-e957-4746-bd2c-b40fc4bfaad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f76e01279e6d47c0aa4fb03206db8050, user_id=1486b01e2a39475dab72aa7f36816c1a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:20.772913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871138f-e957-4746-bd2c-b40fc4bfaad4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:20.786082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.786406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.786624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.816461 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 876/1741] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:20 2022] PUT /identity/v3/projects/f76e01279e6d47c0aa4fb03206db8050/users/1486b01e2a39475dab72aa7f36816c1a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:20.824700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:20.826131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:20.826131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:20.826379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:20.826483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:20.872784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:20.872784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:20.915700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:20.972621 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 866/1742] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:20.974244 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 877/1743] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:20.980527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.984464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:20.986509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:20.991944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203b8c-c0b8-4b6e-aaaf-7225aff10028 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:20.998760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:20.999832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.000260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.000717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.002228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:21.002862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.005924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.007368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44e8503-83f3-4165-8ec9-db0820d8714b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.019121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.021371 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 878/1744] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:21.022310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.022536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.023042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.024209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.024629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] PATH_INFO: `/v3/users/255cc5a6e9584a1f94b290b617cad351` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.027072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] RBAC: Authorizing `identity:delete_user(user_id=255cc5a6e9584a1f94b290b617cad351)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.029274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.105882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c925092-3bf8-455e-9a78-49bc210bca3f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.106092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '255cc5a6e9584a1f94b290b617cad351'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.115479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.118382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.118382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.118382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.124607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '255cc5a6e9584a1f94b290b617cad351'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.126928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '255cc5a6e9584a1f94b290b617cad351'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.129345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.130952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.146044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 879/1745] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:21.146044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.148539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '255cc5a6e9584a1f94b290b617cad351'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.154791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9863df-b91c-463a-9179-ccc3279a16bf service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.159105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '255cc5a6e9584a1f94b290b617cad351'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.159847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5ce0-afb8-4210-b74e-e48981920c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.160662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5ce0-afb8-4210-b74e-e48981920c57 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.160943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5ce0-afb8-4210-b74e-e48981920c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.161215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5ce0-afb8-4210-b74e-e48981920c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.161892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5ce0-afb8-4210-b74e-e48981920c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.163809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5ce0-afb8-4210-b74e-e48981920c57 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.180976 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 867/1746] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:20 2022] DELETE /identity/v3/users/255cc5a6e9584a1f94b290b617cad351 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:21.181622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.183254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.204039 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 880/1747] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:21 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:21.205362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.205688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.206046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.222246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:21.249399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:21.251574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.275395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359eb8a7-67e4-4193-95b9-f4b48032d52a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.360311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.361717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.362053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.362383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] PATH_INFO: `/v3/projects/b7a4b3b6cab248409e63a216709fc3ff` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.363758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7a4b3b6cab248409e63a216709fc3ff)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.365951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.375387 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 881/1748] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:21.380861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.383402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.405898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42445-bb81-4627-b10a-c45cca6cbe17 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.415526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.416488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.416981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.417941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.418902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.422114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.437931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7a4b3b6cab248409e63a216709fc3ff', 'request_id': 'req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.447878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7a4b3b6cab248409e63a216709fc3ff', 'request_id': 'req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.457502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7a4b3b6cab248409e63a216709fc3ff', 'request_id': 'req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.475871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] The token cache is being invalidate because project b7a4b3b6cab248409e63a216709fc3ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:21.476166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.477046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:21.479347 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 868/1749] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:21 2022] DELETE /identity/v3/projects/b7a4b3b6cab248409e63a216709fc3ff => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:21.481128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.482687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.483099 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 882/1750] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:21 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:21.488532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.491101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.528176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0221b1-e56b-48b5-b4a8-712effd916e0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.576666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd1c2e-4a76-4c0a-bd3e-7e6f9a2b0a67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.581408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.582070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.582354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.582628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.588786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.593002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:21.614892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:21.680369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766116ad-5c54-414b-a3a9-715dd1a8dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.681254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766116ad-5c54-414b-a3a9-715dd1a8dc4b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.681713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766116ad-5c54-414b-a3a9-715dd1a8dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.682232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766116ad-5c54-414b-a3a9-715dd1a8dc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.683273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766116ad-5c54-414b-a3a9-715dd1a8dc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.686218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766116ad-5c54-414b-a3a9-715dd1a8dc4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.697115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.700013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.705313 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 883/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:21.707278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398965e4-dc2d-4224-83fa-939b9cda8fee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.707794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398965e4-dc2d-4224-83fa-939b9cda8fee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.708275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398965e4-dc2d-4224-83fa-939b9cda8fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.724558 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 869/1752] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:21.727196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.741585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-398965e4-dc2d-4224-83fa-939b9cda8fee None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:21.743473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-398965e4-dc2d-4224-83fa-939b9cda8fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.748081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f9fe-3e88-4e07-9005-b1855f52b69d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.753211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.753873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.754182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.754443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.754822 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 884/1753] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:21.755091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.757412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.763439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.764132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.764632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.777196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 870/1754] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:21.779919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.794700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e571d1a-040c-4917-8d4f-adf0d4240132 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.795906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:21.798526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.799576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cfce2-efe4-4863-bd21-f2d1c50f34a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.800331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cfce2-efe4-4863-bd21-f2d1c50f34a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.800617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cfce2-efe4-4863-bd21-f2d1c50f34a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.801420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cfce2-efe4-4863-bd21-f2d1c50f34a0 admin admin] PATH_INFO: `/v3/projects/bb5aec15c4e844b2872c9eab52f69482/users/efecedc77d3048c4a0ec0fe6701f9ccc/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.811698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 885/1755] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:21.818954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:21.833505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cfce2-efe4-4863-bd21-f2d1c50f34a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5aec15c4e844b2872c9eab52f69482, user_id=efecedc77d3048c4a0ec0fe6701f9ccc, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:21.836995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cfce2-efe4-4863-bd21-f2d1c50f34a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:21.847322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743c3da-49c1-444e-897b-d1f671c0dacf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:21.866462 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 871/1756] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:21 2022] PUT /identity/v3/projects/bb5aec15c4e844b2872c9eab52f69482/users/efecedc77d3048c4a0ec0fe6701f9ccc/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:21.872729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.873055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:21.873383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:21.909715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] MFA Rules not processed for user `efecedc77d3048c4a0ec0fe6701f9ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:21.910984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:21.996970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:21.997764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:21.998326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.000293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.001078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:22.003334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.009736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.048860 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 872/1757] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:22.054140 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 886/1758] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:22.055268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.055607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.070936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67e79e-58ab-4f28-98b6-193906e33af4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.077607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d022bab-da43-431c-8854-ef0f9b07f564 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.080419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.081322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.082256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.083132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.084149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.087541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.090392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.093000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.093366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.094145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.096348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.101148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.164963 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 887/1759] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:22 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:22.177930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.201352 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 873/1760] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:22 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:22.205517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.321389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518c058-6cfb-48fa-94df-311f39ee4e6b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.355483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:22.364752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:22.402519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d7dd5-5af7-467d-84aa-b3af3cb5b216 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.416548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.417285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.417979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.417979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.421329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.425673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.452027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.452847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.453132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.453530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.454511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.458120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.473602 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 874/1761] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:22 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:22.474689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.481013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:22.488828 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 888/1762] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:22 2022] POST /identity/v3/users => generated 289 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:22.488828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.498130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd35a-81f9-4320-b4dd-4dccdf56f84a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.503142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.503764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.504047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.504326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.505562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.507464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.508749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dc8ae-d60d-40bc-8e27-94b0b8513202 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.524245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.525271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.525907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.526095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 889/1763] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:22.527046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] PATH_INFO: `/v3/projects/67ea773130ed4742915da0d5abf84f3a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.528926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ea773130ed4742915da0d5abf84f3a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.531588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.538362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.564929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fc1a-7a08-4b42-aaa8-abd937f29457 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.580191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.581395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.581395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.581706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.582548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.584818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.625902 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 890/1764] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:22.626897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.646361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f044dd2-ba43-4373-a0b4-07354abd1e74 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.646936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ea773130ed4742915da0d5abf84f3a', 'request_id': 'req-af9ddb05-c615-44bb-885f-0a2eead6d4e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:22.655624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ea773130ed4742915da0d5abf84f3a', 'request_id': 'req-af9ddb05-c615-44bb-885f-0a2eead6d4e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:22.662496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ea773130ed4742915da0d5abf84f3a', 'request_id': 'req-af9ddb05-c615-44bb-885f-0a2eead6d4e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:22.682922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] The token cache is being invalidate because project 67ea773130ed4742915da0d5abf84f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:22.683566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:22.685758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:22.708204 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 875/1765] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:22 2022] DELETE /identity/v3/projects/67ea773130ed4742915da0d5abf84f3a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:22.709297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.710855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:22.737539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.739157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.740107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.740107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] PATH_INFO: `/v3/projects/07f22d73ce564906bfcb14f79df2912e/users/13849b751a7141e9900d3999a3693b38/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.761182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f22d73ce564906bfcb14f79df2912e, user_id=13849b751a7141e9900d3999a3693b38, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.765865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.787499 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 891/1766] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:22 2022] PUT /identity/v3/projects/07f22d73ce564906bfcb14f79df2912e/users/13849b751a7141e9900d3999a3693b38/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:22.788467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:22.791389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:22.879231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ddb05-c615-44bb-885f-0a2eead6d4e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.969050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c0b59-d5fe-4908-8c1e-46b90f42a720 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:22.976854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.979140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.979140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.979140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.980346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:22.983027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:22.983566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:22.986481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:22.987743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:22.988751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:22.989241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] PATH_INFO: `/v3/users/a4405e8819df40f9adae5640f7d48794` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:22.995628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4405e8819df40f9adae5640f7d48794)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.001439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.003504 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 876/1767] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:23.007772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.014790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.027545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:23.035053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7e3f6-9962-4372-b221-738a90595a44 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:23.041826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:23.043000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.043297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.043572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.044258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.046507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.060332 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 877/1768] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:23.064650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.076896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31394bc3-6583-46b3-8285-0a0233834025 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:23.082058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:23.082825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.083017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.083296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] PATH_INFO: `/v3/projects/72426021319b4d52b8d526d27e8339e8/users/e747d48a8db4494b87003e907d81ee28/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.088937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4405e8819df40f9adae5640f7d48794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.100215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=72426021319b4d52b8d526d27e8339e8, user_id=e747d48a8db4494b87003e907d81ee28, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.103379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.114803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4405e8819df40f9adae5640f7d48794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.116555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4405e8819df40f9adae5640f7d48794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.125833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 878/1769] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:23 2022] PUT /identity/v3/projects/72426021319b4d52b8d526d27e8339e8/users/e747d48a8db4494b87003e907d81ee28/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:23.125833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.132051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.136474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4405e8819df40f9adae5640f7d48794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.139243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbc97aac-d911-4e5e-8500-3498fda6d2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4405e8819df40f9adae5640f7d48794'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.162883 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 892/1770] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:22 2022] DELETE /identity/v3/users/a4405e8819df40f9adae5640f7d48794 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:23.180348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.180639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.180918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.217615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7089cc-1598-4e57-9d28-5b383dbcdfbf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:23.266039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] MFA Rules not processed for user `e747d48a8db4494b87003e907d81ee28`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:23.267309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.319147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c86e27-7a2e-47f9-8e98-c89bb093c636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:23.322851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86e27-7a2e-47f9-8e98-c89bb093c636 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.323765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86e27-7a2e-47f9-8e98-c89bb093c636 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.324460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86e27-7a2e-47f9-8e98-c89bb093c636 admin admin] PATH_INFO: `/v3/projects/07f22d73ce564906bfcb14f79df2912e/users/13849b751a7141e9900d3999a3693b38/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.330230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86e27-7a2e-47f9-8e98-c89bb093c636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f22d73ce564906bfcb14f79df2912e, user_id=13849b751a7141e9900d3999a3693b38, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.339333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86e27-7a2e-47f9-8e98-c89bb093c636 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.375137 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 879/1771] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:23 2022] PUT /identity/v3/projects/07f22d73ce564906bfcb14f79df2912e/users/13849b751a7141e9900d3999a3693b38/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:23.387832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.388657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.389413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.441064 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 893/1772] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:23.446577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.448330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.457779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] MFA Rules not processed for user `13849b751a7141e9900d3999a3693b38`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:23.459971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.480990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c5891-2135-45e1-94bd-ca7d347ca539 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:23.580550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:23.615859 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 880/1773] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:23.616947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8712e2-f1bf-4e2e-b340-af101ac9f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:23.617635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8712e2-f1bf-4e2e-b340-af101ac9f83b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.618233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8712e2-f1bf-4e2e-b340-af101ac9f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.618444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8712e2-f1bf-4e2e-b340-af101ac9f83b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.619089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8712e2-f1bf-4e2e-b340-af101ac9f83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.622882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8712e2-f1bf-4e2e-b340-af101ac9f83b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.624868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.626735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.651672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5427969c-99fd-4a95-afea-3cec3268a55b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:23.657618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 894/1774] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/projects => generated 379 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:23.659302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c3db2-9467-48e8-9711-81d646a2e978 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.660379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c3db2-9467-48e8-9711-81d646a2e978 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.660876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c3db2-9467-48e8-9711-81d646a2e978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.665045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:23.665713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.666023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.666295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] PATH_INFO: `/v3/projects/f3840f5c35db47659944b73ab0df3be5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.667956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3840f5c35db47659944b73ab0df3be5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.669915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.685728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-823c3db2-9467-48e8-9711-81d646a2e978 None None] MFA Rules not processed for user `efecedc77d3048c4a0ec0fe6701f9ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:23.687708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-823c3db2-9467-48e8-9711-81d646a2e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.692352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:23.751537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3840f5c35db47659944b73ab0df3be5', 'request_id': 'req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.761985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3840f5c35db47659944b73ab0df3be5', 'request_id': 'req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.778634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3840f5c35db47659944b73ab0df3be5', 'request_id': 'req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.799738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] The token cache is being invalidate because project f3840f5c35db47659944b73ab0df3be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:23.809033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.810130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:23.812256 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 881/1775] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:23 2022] DELETE /identity/v3/projects/f3840f5c35db47659944b73ab0df3be5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:23.813325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.813509 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 895/1776] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:23.816162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.816531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.816816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.817163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.845753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:23.846546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.905157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12cb4-c07d-4d47-a5e6-0f8c4c08dd2e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:23.909980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c338f2-8e8b-4661-b884-e10fc474b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:23.910605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c338f2-8e8b-4661-b884-e10fc474b454 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.910888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c338f2-8e8b-4661-b884-e10fc474b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.911266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c338f2-8e8b-4661-b884-e10fc474b454 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.912131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c338f2-8e8b-4661-b884-e10fc474b454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:23.914289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c338f2-8e8b-4661-b884-e10fc474b454 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:23.935719 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 896/1777] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:23.938339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:23.940144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.948542 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 882/1778] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:23.951699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:23.952287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:23.952740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:23.979239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:23.981774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:23.992639 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 883/1779] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:23.993566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.007485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8bc0a-fd67-43ab-9c80-f7f694ced36b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.013752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.014407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.014806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.015081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.015733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.020743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.047300 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 884/1780] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:24.048321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.062928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d159ceb-ed7e-4fc9-a4ff-89d2a75b1631 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.071274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.072146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.072648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.074466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.074466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:24.075799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.076873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.097545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 885/1781] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:24.098651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.117139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848651a-c5ae-4bf2-b9eb-1bebdf1ced23 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.129200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.132438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.132438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.132438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] PATH_INFO: `/v3/projects/855717e78fa1492eb3639b70d90a7420/users/72cd57013e69429e901c403f94e033c1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.146387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a44e77-f03d-4fa4-955f-e8658ed76673 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.156005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=855717e78fa1492eb3639b70d90a7420, user_id=72cd57013e69429e901c403f94e033c1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.160472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.160899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.162791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.163521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.164253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.168521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:24.185971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 886/1782] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:24 2022] PUT /identity/v3/projects/855717e78fa1492eb3639b70d90a7420/users/72cd57013e69429e901c403f94e033c1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:24.187212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.201632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:24.266607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:24.279986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.284327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.290244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193064c-0cb4-4423-975c-808458450d2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.296727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.297690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.298069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.298408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.299377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.301686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.308221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 897/1783] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:24.309092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.320691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773d6ef-98a1-4a72-ae46-0a38bad25337 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.328836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.329179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.329459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.329726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.330509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.337124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.355978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 898/1784] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:24.357095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.363753 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 887/1785] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:24 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:24.365983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.371291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abbb2b-7687-492f-8696-0e00c856b107 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.473234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cdd952-1adf-4ef4-bf20-138487b295a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.474412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd952-1adf-4ef4-bf20-138487b295a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.474695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd952-1adf-4ef4-bf20-138487b295a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.475153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cdd952-1adf-4ef4-bf20-138487b295a2 admin admin] PATH_INFO: `/v3/projects/855717e78fa1492eb3639b70d90a7420/users/72cd57013e69429e901c403f94e033c1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.477916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd952-1adf-4ef4-bf20-138487b295a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=855717e78fa1492eb3639b70d90a7420, user_id=72cd57013e69429e901c403f94e033c1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.481178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cdd952-1adf-4ef4-bf20-138487b295a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.504022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbac868-9b3e-42da-bb83-62be56825f83 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.514984 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 899/1786] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:24 2022] PUT /identity/v3/projects/855717e78fa1492eb3639b70d90a7420/users/72cd57013e69429e901c403f94e033c1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:24.518455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.518748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.519020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.605201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] MFA Rules not processed for user `72cd57013e69429e901c403f94e033c1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:24.606533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:24.609334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.610285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.610558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.611518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.612173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.614843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.650111 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 888/1787] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:24 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:24.651544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.663754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f06ee-0331-4107-a5c2-41545a8d1bc3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.669184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.669836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.670117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.670387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.671193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.672811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.689056 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 889/1788] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:24.693633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.715915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01407c8-b0ba-4d0e-a8c5-148bafe1ae9f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.721881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce9801-ea7f-4b99-83d2-0b083f144824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.722909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9801-ea7f-4b99-83d2-0b083f144824 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.723558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9801-ea7f-4b99-83d2-0b083f144824 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.724025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce9801-ea7f-4b99-83d2-0b083f144824 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.724869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9801-ea7f-4b99-83d2-0b083f144824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.726749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce9801-ea7f-4b99-83d2-0b083f144824 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.745987 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 900/1789] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:24.747871 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 890/1790] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:24.752076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:24.764761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740050c-0513-46ae-b195-b02a4fa07e2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:24.774853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:24.776381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.776778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.777118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] PATH_INFO: `/v3/projects/6ae8565ad69743a097aab544d04bf08f/users/113cbdea2dcf43cc9bac355d927b6fa7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.798058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae8565ad69743a097aab544d04bf08f, user_id=113cbdea2dcf43cc9bac355d927b6fa7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:24.802017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:24.825901 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 901/1791] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:24 2022] PUT /identity/v3/projects/6ae8565ad69743a097aab544d04bf08f/users/113cbdea2dcf43cc9bac355d927b6fa7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:24.835232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:24.835232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:24.835232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:24.871967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:24.946449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] MFA Rules not processed for user `113cbdea2dcf43cc9bac355d927b6fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:24.951639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:25.004052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:25.006772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:25.104004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:25.147660 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 891/1792] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:25.171985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da549b-2af8-464f-905f-265276c2631e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:25.183879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece635e-7244-4cf8-8352-2e366429bdb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:25.184525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece635e-7244-4cf8-8352-2e366429bdb8 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:25.184804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece635e-7244-4cf8-8352-2e366429bdb8 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:25.185065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece635e-7244-4cf8-8352-2e366429bdb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:25.265639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:25.267551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:25.350663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece635e-7244-4cf8-8352-2e366429bdb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:25.352514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece635e-7244-4cf8-8352-2e366429bdb8 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:25.378668 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 902/1793] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:25.413419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae6cc2-7cfe-4c39-b384-349f70dd8f85 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:25.428929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:25.429635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:25.430230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:25.430490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:25.448197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:25.449790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:25.458969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb51a0-ccca-4290-9894-29f173082cd8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:25.459420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb51a0-ccca-4290-9894-29f173082cd8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:25.459864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb51a0-ccca-4290-9894-29f173082cd8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:25.461888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 903/1794] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:25.466524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb51a0-ccca-4290-9894-29f173082cd8 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:25.486395 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 892/1795] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:25.498381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb51a0-ccca-4290-9894-29f173082cd8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:25.510186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb51a0-ccca-4290-9894-29f173082cd8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:25.515539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab328d-96bb-4785-a6b2-18434ed6a1eb tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72cd57013e69429e901c403f94e033c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '855717e78fa1492eb3639b70d90a7420', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:25.516388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab328d-96bb-4785-a6b2-18434ed6a1eb tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:25.516745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab328d-96bb-4785-a6b2-18434ed6a1eb tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:25.517208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab328d-96bb-4785-a6b2-18434ed6a1eb tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] PATH_INFO: `/v3/projects/72426021319b4d52b8d526d27e8339e8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:25.519687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab328d-96bb-4785-a6b2-18434ed6a1eb tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] RBAC: Authorizing `identity:get_project(project_id=72426021319b4d52b8d526d27e8339e8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:25.522640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab328d-96bb-4785-a6b2-18434ed6a1eb tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:25.525225 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 904/1796] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:25 2022] GET /identity/v3/projects/72426021319b4d52b8d526d27e8339e8 => generated 377 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:25.600209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:25.617024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424c89a-7c97-4b72-af37-33bf582cc94b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:25.633020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:25.633641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:25.633946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:25.634216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:25.652859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:25.839804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:25.846844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:25.889250 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 893/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:25.987303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d89d0-3463-4287-bcab-48820bfd5baf None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:25.987808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d89d0-3463-4287-bcab-48820bfd5baf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:25.987808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d89d0-3463-4287-bcab-48820bfd5baf None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:25.990106 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 905/1798] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:26.004093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:26.036444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:26.065659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba642d63-17fc-4b55-91cf-bdb1521856f3 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:26.074296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e520125-7324-4f73-ad4e-11e235bd1dcf tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72cd57013e69429e901c403f94e033c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '855717e78fa1492eb3639b70d90a7420', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:26.075373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e520125-7324-4f73-ad4e-11e235bd1dcf tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:26.075836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e520125-7324-4f73-ad4e-11e235bd1dcf tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:26.076385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e520125-7324-4f73-ad4e-11e235bd1dcf tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] PATH_INFO: `/v3/projects/72426021319b4d52b8d526d27e8339e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:26.077838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e520125-7324-4f73-ad4e-11e235bd1dcf tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] RBAC: Authorizing `identity:get_project(project_id=72426021319b4d52b8d526d27e8339e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:26.080465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e520125-7324-4f73-ad4e-11e235bd1dcf tempest-FlavorsAccessTestJSON-1079292724 tempest-FlavorsAccessTestJSON-1079292724-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:26.083017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 894/1799] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:26 2022] GET /identity/v3/projects/72426021319b4d52b8d526d27e8339e8 => generated 377 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:26.227779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d89d0-3463-4287-bcab-48820bfd5baf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:26.459193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d89d0-3463-4287-bcab-48820bfd5baf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:26.464088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:26.464746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:26.465027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:26.465301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] PATH_INFO: `/v3/users/113cbdea2dcf43cc9bac355d927b6fa7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:26.466496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113cbdea2dcf43cc9bac355d927b6fa7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:26.469194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:26.550637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113cbdea2dcf43cc9bac355d927b6fa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:26.553779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:26.556835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113cbdea2dcf43cc9bac355d927b6fa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:26.560413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113cbdea2dcf43cc9bac355d927b6fa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:26.577165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113cbdea2dcf43cc9bac355d927b6fa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:26.577999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113cbdea2dcf43cc9bac355d927b6fa7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:26.596098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 906/1800] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:26 2022] DELETE /identity/v3/users/113cbdea2dcf43cc9bac355d927b6fa7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:26.600721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:26.601221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:26.601221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:26.651940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:26.653179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:26.710405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:26.777504 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 895/1801] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:26.797035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:26.798881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:26.813617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd184ea-b9b9-4138-bc61-712ada4f1cd1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:26.819237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:26.820599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:26.821142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:26.821701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] PATH_INFO: `/v3/users/e747d48a8db4494b87003e907d81ee28` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:26.823269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e747d48a8db4494b87003e907d81ee28)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:26.825542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:26.859920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:26.862076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:26.968839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e747d48a8db4494b87003e907d81ee28'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:27.001919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e747d48a8db4494b87003e907d81ee28'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:27.004397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e747d48a8db4494b87003e907d81ee28'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:27.021511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e747d48a8db4494b87003e907d81ee28'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:27.024184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a52fb236-3075-408b-86ca-073cc1a8fb80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e747d48a8db4494b87003e907d81ee28'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:27.030170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411ea70-2c17-430d-8d30-defeefcb8500 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:27.045111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:27.047177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:27.050343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:27.050687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:27.054153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:27.057399 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 907/1802] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:26 2022] DELETE /identity/v3/users/e747d48a8db4494b87003e907d81ee28 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:27.062458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:27.063023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:27.063493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:27.095657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:27.097125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:27.103726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:27.105983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:27.136902 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 896/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:27.262174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 908/1804] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:27.277292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:27.279674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:27.299873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314d18e-5fb9-48e7-948d-5bb474a625a9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:27.424025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a4d97-1a6e-44e9-ba4b-8a4ba55db0a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:27.425053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4d97-1a6e-44e9-ba4b-8a4ba55db0a8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:27.425564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4d97-1a6e-44e9-ba4b-8a4ba55db0a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:27.426066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a4d97-1a6e-44e9-ba4b-8a4ba55db0a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:27.448259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4d97-1a6e-44e9-ba4b-8a4ba55db0a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:27.450397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a4d97-1a6e-44e9-ba4b-8a4ba55db0a8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:27.462944 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 897/1805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:28.077028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:28.078601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:28.095398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8deb7-0443-4c24-b3ae-a4c4280bbfbc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:28.114200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:28.115015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.115316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.115624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] PATH_INFO: `/v3/projects/6ae8565ad69743a097aab544d04bf08f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.118613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae8565ad69743a097aab544d04bf08f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:28.121547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:28.192162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:28.204862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae8565ad69743a097aab544d04bf08f', 'request_id': 'req-06636ab7-df11-48d6-b8be-95191e55189f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.230568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae8565ad69743a097aab544d04bf08f', 'request_id': 'req-06636ab7-df11-48d6-b8be-95191e55189f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.242034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae8565ad69743a097aab544d04bf08f', 'request_id': 'req-06636ab7-df11-48d6-b8be-95191e55189f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.297899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] The token cache is being invalidate because project 6ae8565ad69743a097aab544d04bf08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:28.298462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.299396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06636ab7-df11-48d6-b8be-95191e55189f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.301420 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 909/1806] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:28 2022] DELETE /identity/v3/projects/6ae8565ad69743a097aab544d04bf08f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:28.308366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.309302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.310426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.335583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:28.337285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:28.410474 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 898/1807] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:28.419236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.419569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.419792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.449238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:28.451271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:28.464370 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 910/1808] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:28.468821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:28.478816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b0360-ec72-4f56-80e4-39b9dab0b497 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:28.486132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:28.486132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.486132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.486132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.486530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:28.486530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:28.488000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:28.507756 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 899/1809] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:28.514034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:28.527223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192ebb9-8fa9-4839-bd23-590bd2b46570 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:28.528485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:28.531636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:28.534616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:28.535258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.535592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.535861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.536562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:28.538653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:28.550426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1001c5-fa5e-47ee-aea4-99097a43220a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:28.551612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:28.565141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:28.566003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.566266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.568105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] PATH_INFO: `/v3/projects/72426021319b4d52b8d526d27e8339e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.570523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72426021319b4d52b8d526d27e8339e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:28.572741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:28.631133 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 911/1810] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:28 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:28.639868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:28.673723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72426021319b4d52b8d526d27e8339e8', 'request_id': 'req-93e9a7d8-415e-4716-89ac-1bbb75ebe287'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.689208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72426021319b4d52b8d526d27e8339e8', 'request_id': 'req-93e9a7d8-415e-4716-89ac-1bbb75ebe287'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.702902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72426021319b4d52b8d526d27e8339e8', 'request_id': 'req-93e9a7d8-415e-4716-89ac-1bbb75ebe287'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.724825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] The token cache is being invalidate because project 72426021319b4d52b8d526d27e8339e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:28.725148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.725916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:28.727839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 900/1811] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:28 2022] DELETE /identity/v3/projects/72426021319b4d52b8d526d27e8339e8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:28.732772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:28.734398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:28.812100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790e05a-52ff-4fd9-9beb-2502f5a31fc9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:28.923091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9a7d8-415e-4716-89ac-1bbb75ebe287 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:28.943632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:28.944270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.944549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.944821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.945462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:28.948471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:28.961412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:28.965870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:28.965870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:28.965870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] PATH_INFO: `/v3/users/72cd57013e69429e901c403f94e033c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:28.969434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cd57013e69429e901c403f94e033c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:28.971681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.012543 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 912/1812] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:28 2022] POST /identity/v3/users => generated 290 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:29.014309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.016454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:29.040285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1bece-8401-4ca6-b61f-9c0563927d1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.051748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.053854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.056039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.056430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.057234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.068810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.095452 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 913/1813] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:29.099091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.100104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cd57013e69429e901c403f94e033c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:29.116460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5836-12aa-467b-b2bb-89e872de0720 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.120808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cd57013e69429e901c403f94e033c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:29.122081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cd57013e69429e901c403f94e033c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:29.127560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.128249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.128707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.129165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.130862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.132885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.137855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cd57013e69429e901c403f94e033c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:29.138722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b45d54a5-da62-470d-a2f3-dc81eb7bb295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cd57013e69429e901c403f94e033c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:29.148418 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 914/1814] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:29.155229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.157378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:29.172420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18746e-8ff9-4161-a4f7-c96a7890d248 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.184305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.185305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.185735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.186432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] PATH_INFO: `/v3/projects/06401486eff840eda743bfd9b42d9bdc/users/6380150ca420412bbc86e6ce794d1f86/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.188484 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 901/1815] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:28 2022] DELETE /identity/v3/users/72cd57013e69429e901c403f94e033c1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:29.226418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] RBAC: Authorizing `identity:create_grant(project_id=06401486eff840eda743bfd9b42d9bdc, user_id=6380150ca420412bbc86e6ce794d1f86, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.230157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.236467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=4,keystone:SELECT=90,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:29.254678 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 915/1816] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:29 2022] PUT /identity/v3/projects/06401486eff840eda743bfd9b42d9bdc/users/6380150ca420412bbc86e6ce794d1f86/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:29.267403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.267655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.267931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.291397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:29.345986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] MFA Rules not processed for user `6380150ca420412bbc86e6ce794d1f86`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:29.347350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:29.487565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.488523 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 902/1817] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:29.643752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc718f-b2dd-40fc-bd4d-f65da683786e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.656943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.657759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.658293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.658686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.659469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.665526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.711451 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 916/1818] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:29 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:29.712654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.730947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd52dd7-8416-4afd-a857-e61e1ea4397f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.820219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.821012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.821300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.821569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.822298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.824845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.856583 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 903/1819] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:29 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:29.860905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.878697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc9b6-c3f9-4035-8c52-aa0666174785 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.892400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.893621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.894506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.894506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.894848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.896473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.913919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 917/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:29.914826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.926127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7ffcb-e617-45e0-9367-bbb47651215d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:29.931811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:29.932573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:29.932865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:29.933763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] PATH_INFO: `/v3/projects/92e41696db45462a94a5d79e421cc9f4/users/ac221826b5244b70b4f7956e22213adb/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:29.952950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e41696db45462a94a5d79e421cc9f4, user_id=ac221826b5244b70b4f7956e22213adb, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:29.955130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:29.969988 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 904/1821] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:29 2022] PUT /identity/v3/projects/92e41696db45462a94a5d79e421cc9f4/users/ac221826b5244b70b4f7956e22213adb/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:29.974119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:29.985422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2cd2e-8917-4e33-92d7-c81ee3cd628e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:30.053549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba0fea-9147-4927-9957-6820c61b9084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:30.054195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba0fea-9147-4927-9957-6820c61b9084 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.054465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba0fea-9147-4927-9957-6820c61b9084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.054738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba0fea-9147-4927-9957-6820c61b9084 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.055570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba0fea-9147-4927-9957-6820c61b9084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:30.057201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba0fea-9147-4927-9957-6820c61b9084 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:30.068308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 918/1822] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:30.072583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:30.086759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218f567-5117-4e4e-a627-397762a9a7ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:30.091867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:30.092783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.093129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.093465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] PATH_INFO: `/v3/projects/92e41696db45462a94a5d79e421cc9f4/users/ac221826b5244b70b4f7956e22213adb/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.095631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e41696db45462a94a5d79e421cc9f4, user_id=ac221826b5244b70b4f7956e22213adb, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:30.098376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:30.113850 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 905/1823] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:30 2022] PUT /identity/v3/projects/92e41696db45462a94a5d79e421cc9f4/users/ac221826b5244b70b4f7956e22213adb/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:30.121321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.121912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.121912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.153706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] MFA Rules not processed for user `ac221826b5244b70b4f7956e22213adb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:30.155781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:30.237047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:30.276531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:30.278545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:30.283265 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 919/1824] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:30.410639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:30.412633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:30.415012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:30.468141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ae736-b4d2-47f6-af53-fd883f361fb9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:30.475036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1636c001-c383-4f8f-99ab-2dc150aa0c52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:30.475779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636c001-c383-4f8f-99ab-2dc150aa0c52 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.476144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636c001-c383-4f8f-99ab-2dc150aa0c52 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.476501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1636c001-c383-4f8f-99ab-2dc150aa0c52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.486646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636c001-c383-4f8f-99ab-2dc150aa0c52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:30.488376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1636c001-c383-4f8f-99ab-2dc150aa0c52 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:30.506010 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 906/1825] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:30.536937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f7fd4-f6d3-4938-a5a4-6eaf83ee27c5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:30.542237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:30.542899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.543177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.543448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] PATH_INFO: `/v3/projects/855717e78fa1492eb3639b70d90a7420` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.544768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=855717e78fa1492eb3639b70d90a7420)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:30.546906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:30.662676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '855717e78fa1492eb3639b70d90a7420', 'request_id': 'req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:30.675786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '855717e78fa1492eb3639b70d90a7420', 'request_id': 'req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:30.687232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '855717e78fa1492eb3639b70d90a7420', 'request_id': 'req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:30.704701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] The token cache is being invalidate because project 855717e78fa1492eb3639b70d90a7420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:30.705692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:30.706912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d7477a84-c8ac-473b-93aa-fdc5bc812ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:30.718889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0387-ffc6-48f9-b695-a585d496d9b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.719617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0387-ffc6-48f9-b695-a585d496d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.720101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b0387-ffc6-48f9-b695-a585d496d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.725073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 920/1826] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:30 2022] DELETE /identity/v3/projects/855717e78fa1492eb3639b70d90a7420 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:30.763026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3d3b0387-ffc6-48f9-b695-a585d496d9b6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:30.770275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d3b0387-ffc6-48f9-b695-a585d496d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:30.848741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.849128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.849408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.916029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] MFA Rules not processed for user `1486b01e2a39475dab72aa7f36816c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:30.923369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:30.939132 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 907/1827] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:30.941101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:30.941673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:30.941673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:30.983062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:30.990038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:31.008549 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 908/1828] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:31.012983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.046610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f658-decb-47bd-935f-8894d7d30328 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.061120 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 921/1829] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:31.068472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.069135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.069665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.071743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.073608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.074525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:31.076810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.077724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:31.079354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.110243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f353-e882-4ba1-9d28-58d5de5d7756 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.119601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 909/1830] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:31.121497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.125287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.126071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.126444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.126812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.127993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.132334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.145913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141efa4-6ce3-4780-b5dd-df3ee1825376 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.159651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:31.162544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.163180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.163462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.163731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.164986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.166317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.201927 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 922/1831] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:31 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:31.203210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.209945 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 910/1832] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:31 2022] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:31.212611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.376166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73f16e-ad25-49a8-bac2-7a666cf3b660 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.376594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1fdc8-695e-4abe-b03f-27a9221e1e00 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.382603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.383450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.383873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.384314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.385164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.387353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.393651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.394507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.394789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.395057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.395694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.397838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.420294 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 911/1833] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:31 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:31.424513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.451095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03948ec-a510-498a-8178-9ff597f2b2e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.460352 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 923/1834] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:31 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:31.461391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.466238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:31.470141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.471002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.471326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.471598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.472463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.474374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.498123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 912/1835] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:31.499511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.502454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623334f-cc82-48be-9a85-521cc234d15a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.518364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.519030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.519314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.519601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] PATH_INFO: `/v3/users/6380150ca420412bbc86e6ce794d1f86` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.523288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6380150ca420412bbc86e6ce794d1f86)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.525347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.529169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a520c-c4e4-41a5-8f9d-a154caa156d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.556353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.556921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.557402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.557558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.558259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.560561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.569310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:31.602807 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 913/1836] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:31.605224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.619768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca657bc-85a2-4a8a-b4ce-d1934758c4ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.628370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.629273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.629664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.630064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.630836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.632721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.647818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6380150ca420412bbc86e6ce794d1f86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:31.651412 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 914/1837] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:31.652423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.671788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc40e06-cc70-43b2-97ec-daf41a3b89cc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.684202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301ff42-af8f-45f2-a57b-a8dc3a642c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:31.685614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ff42-af8f-45f2-a57b-a8dc3a642c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.685924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ff42-af8f-45f2-a57b-a8dc3a642c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.686194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ff42-af8f-45f2-a57b-a8dc3a642c0f admin admin] PATH_INFO: `/v3/projects/89bff91261ea40b6855ac96a9db6c878/users/3c866ee9d2744a73b55d1be2b3d69dc5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.688455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6380150ca420412bbc86e6ce794d1f86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:31.698319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6380150ca420412bbc86e6ce794d1f86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:31.719094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6380150ca420412bbc86e6ce794d1f86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:31.719871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6380150ca420412bbc86e6ce794d1f86'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:31.733748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ff42-af8f-45f2-a57b-a8dc3a642c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bff91261ea40b6855ac96a9db6c878, user_id=3c866ee9d2744a73b55d1be2b3d69dc5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:31.737668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ff42-af8f-45f2-a57b-a8dc3a642c0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:31.752325 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 924/1838] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:31 2022] DELETE /identity/v3/users/6380150ca420412bbc86e6ce794d1f86 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:31.754774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:31.761234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:31.769287 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 915/1839] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:31 2022] PUT /identity/v3/projects/89bff91261ea40b6855ac96a9db6c878/users/3c866ee9d2744a73b55d1be2b3d69dc5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:31.771128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:31.771624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:31.772086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:31.829023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:31.847753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aca574-8e63-4f7c-a1c1-3dde0d95312d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:31.849132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:31.851688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:32.012786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.017150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.017584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.020587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086/users/eb138b2c90fd4c9ea2fdce09df43ecb3/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.033788 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 916/1840] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:32.037322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.044814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:32.053341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c448ad9eb5d439eb7cd762216e53086, user_id=eb138b2c90fd4c9ea2fdce09df43ecb3, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.062430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.071580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfd4a5-6ed9-4517-93c8-57baa522a12d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.079830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1433a-9b2e-4361-86c5-eb945ce2e771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.080596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1433a-9b2e-4361-86c5-eb945ce2e771 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.080925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1433a-9b2e-4361-86c5-eb945ce2e771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.081603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1433a-9b2e-4361-86c5-eb945ce2e771 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.082350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1433a-9b2e-4361-86c5-eb945ce2e771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.084510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1433a-9b2e-4361-86c5-eb945ce2e771 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.085975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 925/1841] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:31 2022] PUT /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086/users/eb138b2c90fd4c9ea2fdce09df43ecb3/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:32.097182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.099667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:32.116485 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 917/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:32.122609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.126430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.126726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.186968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] MFA Rules not processed for user `eb138b2c90fd4c9ea2fdce09df43ecb3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:32.189246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:32.228113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a5eaf4-3a7f-464d-a963-21f31a2cd9f0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.239980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.241418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.242888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.243172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.338923 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 918/1843] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:32.339930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.379601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.381259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.392921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 926/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:32.406507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.414016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:32.422712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50556c59-37f7-4b72-886d-b970282f83e9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.428240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.429154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.429437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.429729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.430380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.432686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.467454 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 927/1845] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:32 2022] POST /identity/v3/projects => generated 395 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:32.472570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec00cde-999c-4492-968e-47c3eb83fb74 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.473772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.494380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:32.585036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b303813-a920-495a-8327-387819d80a78 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.592931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.594122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.594515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.594847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.595569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.597592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.618537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.619300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.619576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.619923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] PATH_INFO: `/v3/projects/89bff91261ea40b6855ac96a9db6c878/users/3c866ee9d2744a73b55d1be2b3d69dc5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.627334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bff91261ea40b6855ac96a9db6c878, user_id=3c866ee9d2744a73b55d1be2b3d69dc5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.630466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.644524 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 928/1846] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:32 2022] POST /identity/v3/users => generated 304 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:32.648223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.656268 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 919/1847] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:32 2022] PUT /identity/v3/projects/89bff91261ea40b6855ac96a9db6c878/users/3c866ee9d2744a73b55d1be2b3d69dc5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:32.670036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a85f00-b340-4039-b9a1-17806859f91e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.841469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.842944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.843827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.844968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.846067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.851953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.882999 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 929/1848] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:32.884325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.899748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679a099-7388-4555-9137-aff0edbed93a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:32.910945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:32.912120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:32.912692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:32.913247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] PATH_INFO: `/v3/projects/5faacb88ba934a498d3b7724d75d11aa/users/8cd96c1a751642c2b60625e72d2551d6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:32.951743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faacb88ba934a498d3b7724d75d11aa, user_id=8cd96c1a751642c2b60625e72d2551d6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:32.955026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:32.982710 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 920/1849] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:32 2022] PUT /identity/v3/projects/5faacb88ba934a498d3b7724d75d11aa/users/8cd96c1a751642c2b60625e72d2551d6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:32.984063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:32.995807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51762a-112e-45de-9aae-252b78b1df43 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.087584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efb479-99d0-4a15-9819-3f0562a004ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.088961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efb479-99d0-4a15-9819-3f0562a004ae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.089668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efb479-99d0-4a15-9819-3f0562a004ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.090074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efb479-99d0-4a15-9819-3f0562a004ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.090995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efb479-99d0-4a15-9819-3f0562a004ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.093220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efb479-99d0-4a15-9819-3f0562a004ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.122003 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 930/1850] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:33.127092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.142400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67260f0-b9c3-4e94-ac48-073fae9c8990 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.152851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.153554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.153858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.154137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] PATH_INFO: `/v3/projects/5faacb88ba934a498d3b7724d75d11aa/users/8cd96c1a751642c2b60625e72d2551d6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.156822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faacb88ba934a498d3b7724d75d11aa, user_id=8cd96c1a751642c2b60625e72d2551d6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.160305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.173358 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 921/1851] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:33 2022] PUT /identity/v3/projects/5faacb88ba934a498d3b7724d75d11aa/users/8cd96c1a751642c2b60625e72d2551d6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:33.186364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.186997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.187447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.250966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] MFA Rules not processed for user `8cd96c1a751642c2b60625e72d2551d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:33.252241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:33.279513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.282390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:33.313406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:33.446480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0538ca-50e3-4a21-a1a4-487362da4cfc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.453474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.456509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.457289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.458546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] PATH_INFO: `/v3/projects/06401486eff840eda743bfd9b42d9bdc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.468797 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 931/1852] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:33.472889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.479647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06401486eff840eda743bfd9b42d9bdc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.483414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.491410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50283f9-4d87-4c99-b220-fc64dd2c1e90 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.505323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.506400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.507063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.507471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.508286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.511285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.597491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06401486eff840eda743bfd9b42d9bdc', 'request_id': 'req-c6b87e4e-310b-4e80-b403-acf417bee622'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.599288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:33.619228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 932/1853] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:33 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:33.620987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.623489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06401486eff840eda743bfd9b42d9bdc', 'request_id': 'req-c6b87e4e-310b-4e80-b403-acf417bee622'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.634368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06401486eff840eda743bfd9b42d9bdc', 'request_id': 'req-c6b87e4e-310b-4e80-b403-acf417bee622'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.657470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] The token cache is being invalidate because project 06401486eff840eda743bfd9b42d9bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:33.657710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.658293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.665882 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 922/1854] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:33 2022] DELETE /identity/v3/projects/06401486eff840eda743bfd9b42d9bdc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:33.667245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.676213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:33.747026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089cb5d-d4e6-4d56-a638-9d377ca1276a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.753747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.754506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.754813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.755086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.755728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.757679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.790991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b87e4e-310b-4e80-b403-acf417bee622 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.795606 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 933/1855] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:33 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:33.796545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.802718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:33.804363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.805030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.805306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.805579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] PATH_INFO: `/v3/users/ac221826b5244b70b4f7956e22213adb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.808355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac221826b5244b70b4f7956e22213adb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.812690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.825715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98d5f4-80c9-4a54-8481-29aad29101c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:33.831548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:33.832537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.832910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.833301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] PATH_INFO: `/v3/users/9c7e462d0e474a3aa94d3a146ae24d21` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:33.835108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7e462d0e474a3aa94d3a146ae24d21)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:33.837275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:33.888447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac221826b5244b70b4f7956e22213adb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.897551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac221826b5244b70b4f7956e22213adb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.900504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac221826b5244b70b4f7956e22213adb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.911673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac221826b5244b70b4f7956e22213adb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.912410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac221826b5244b70b4f7956e22213adb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.920350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7e462d0e474a3aa94d3a146ae24d21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.933551 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 923/1856] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:33 2022] DELETE /identity/v3/users/ac221826b5244b70b4f7956e22213adb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:33.934624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:33.939954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:33.941026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7e462d0e474a3aa94d3a146ae24d21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.941956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7e462d0e474a3aa94d3a146ae24d21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.955488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7e462d0e474a3aa94d3a146ae24d21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.956333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7607dfbd-0485-4351-8452-e7a982ecb70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7e462d0e474a3aa94d3a146ae24d21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:33.962477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:33.978639 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 934/1857] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:33 2022] DELETE /identity/v3/users/9c7e462d0e474a3aa94d3a146ae24d21 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:33.983020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:33.983353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:33.983630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.010926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:34.012409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:34.048313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:34.055845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880543e6-5c53-4cec-bffe-fece9f802e94 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:34.093028 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 935/1858] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:34.103035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:34.104810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:34.147404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:34.148452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:34.148856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:34.149225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.150920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:34.170891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:34.200482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 924/1859] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:34.201926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:34.206141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:34.231148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185931-1f0c-44b6-9629-549caedd0fd7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:34.238311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:34.240115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:34.240550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:34.240962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.242440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:34.246460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:34.278418 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 925/1860] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:34.279533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:34.287980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad344621-d210-4aad-8878-a452363f2da1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:34.295799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdfdcf-f660-48c0-ac6e-d6f1e060c904 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:34.300451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a9215-12ed-4d2d-9f5c-6914f40979ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:34.301258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9215-12ed-4d2d-9f5c-6914f40979ed service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:34.301533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9215-12ed-4d2d-9f5c-6914f40979ed service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:34.301819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a9215-12ed-4d2d-9f5c-6914f40979ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.310092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:34.313280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:34.313735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:34.314056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] PATH_INFO: `/v3/projects/afd7266de3634dc7930933a51f0ccd0b/users/3477d63d6e12467ea4922396eeda2e46/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.327657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9215-12ed-4d2d-9f5c-6914f40979ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:34.333683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a9215-12ed-4d2d-9f5c-6914f40979ed service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:34.339303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd7266de3634dc7930933a51f0ccd0b, user_id=3477d63d6e12467ea4922396eeda2e46, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:34.343107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:34.360906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 936/1861] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:34.365565 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 926/1862] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:34 2022] PUT /identity/v3/projects/afd7266de3634dc7930933a51f0ccd0b/users/3477d63d6e12467ea4922396eeda2e46/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:34.376728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:34.377665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:34.378052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.422881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] MFA Rules not processed for user `3477d63d6e12467ea4922396eeda2e46`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:34.424819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:34.530859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:34.532870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:34.579399 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 937/1863] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:34.701069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac864-ecf8-4630-b91b-3f53ab2a2212 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:34.727437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:34.728192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:34.728727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:34.729407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] PATH_INFO: `/v3/projects/92e41696db45462a94a5d79e421cc9f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:34.730880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e41696db45462a94a5d79e421cc9f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:34.734431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:34.736090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:34.737616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:34.811753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:34.850616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e41696db45462a94a5d79e421cc9f4', 'request_id': 'req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:34.884364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e41696db45462a94a5d79e421cc9f4', 'request_id': 'req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:34.904941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577a4c4-3938-4d1c-a601-55f4bff5dc7f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:34.930793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e41696db45462a94a5d79e421cc9f4', 'request_id': 'req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:34.944421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:35.001644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] The token cache is being invalidate because project 92e41696db45462a94a5d79e421cc9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:35.001972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.003147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c78bc7d-fe4f-4768-ab40-eeb75ab27af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.014527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 927/1864] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:34 2022] DELETE /identity/v3/projects/92e41696db45462a94a5d79e421cc9f4 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:35.020017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe32a4-5002-46a0-a55a-f10a1477b43b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.020475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe32a4-5002-46a0-a55a-f10a1477b43b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.021201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe32a4-5002-46a0-a55a-f10a1477b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.048947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:35.049906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.050563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.051011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.063002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.098979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bebe32a4-5002-46a0-a55a-f10a1477b43b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:35.099633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bebe32a4-5002-46a0-a55a-f10a1477b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.202245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:35.204233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:35.218317 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 938/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:35.219809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.221342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.222385 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 928/1866] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:35.230991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62565c-e20c-4af4-9f86-6d9bd4c4a6e4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.231430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62565c-e20c-4af4-9f86-6d9bd4c4a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.231715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e62565c-e20c-4af4-9f86-6d9bd4c4a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.238800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626d324-c5f9-472c-8ce3-0d382c9c396d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:35.249025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:35.249863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.250392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.250672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] PATH_INFO: `/v3/projects/7bb0081b81cc46909ff0bae0f6ac30f7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.255042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb0081b81cc46909ff0bae0f6ac30f7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:35.257161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:35.276287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e62565c-e20c-4af4-9f86-6d9bd4c4a6e4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:35.278156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e62565c-e20c-4af4-9f86-6d9bd4c4a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.294482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 929/1867] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:35.297518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55a4f-ce11-41d4-905e-eac2107a87fb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.298774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55a4f-ce11-41d4-905e-eac2107a87fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.298964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55a4f-ce11-41d4-905e-eac2107a87fb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.300542 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 930/1868] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:35.301134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f55a4f-ce11-41d4-905e-eac2107a87fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.326011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f55a4f-ce11-41d4-905e-eac2107a87fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:35.334485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb0081b81cc46909ff0bae0f6ac30f7', 'request_id': 'req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.345942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb0081b81cc46909ff0bae0f6ac30f7', 'request_id': 'req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.349237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:35.366376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb0081b81cc46909ff0bae0f6ac30f7', 'request_id': 'req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.388851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] The token cache is being invalidate because project 7bb0081b81cc46909ff0bae0f6ac30f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:35.389418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.391596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.396186 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 939/1869] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:35 2022] DELETE /identity/v3/projects/7bb0081b81cc46909ff0bae0f6ac30f7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:35.397215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:35.399365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.422803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:35.423509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.423893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.424268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.425028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:35.425440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:35.427566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:35.445110 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 931/1870] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:35.446464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.450936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.470399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b9e01-7bbb-4a29-b8ea-a3345e0e5dae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:35.476713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:35.477556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.477969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.478367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] PATH_INFO: `/v3/users/70a29313fab846a996ac7038f076a051` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.480407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a29313fab846a996ac7038f076a051)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:35.483036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:35.495021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.497564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.590296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a29313fab846a996ac7038f076a051'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.606539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00420ab-4a25-4fba-b4f6-e1bebbe32dd2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:35.611690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a29313fab846a996ac7038f076a051'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.612425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a29313fab846a996ac7038f076a051'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.614192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd96c1a751642c2b60625e72d2551d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5faacb88ba934a498d3b7724d75d11aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:35.614930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.615359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.615894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.617307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c448ad9eb5d439eb7cd762216e53086)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:35.620857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:35.623914 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 940/1871] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:35 2022] GET /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086 => generated 393 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:35.624946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.627671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.636792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a29313fab846a996ac7038f076a051'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.637885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b33d1c07-cb75-411e-b988-add1785684ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a29313fab846a996ac7038f076a051'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:35.652346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:35.665136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6d924-0f90-4a85-b8e4-bc807594b8b5 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:35.667182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 932/1872] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:35 2022] DELETE /identity/v3/users/70a29313fab846a996ac7038f076a051 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:35.690168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.690704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.691049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.693308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 933/1873] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:46:35.698645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:35.705366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:35.793396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:35.794071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:35.794354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:35.794627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:35.795280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:35.797731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:35.873467 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 941/1874] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:35 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:35.877988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.895062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:35.927085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:35.927085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.005987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5eeb28-ad0a-45fa-971d-d69d539d4f2a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.013293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.014942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.015411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.016858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.017717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.020550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.043923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506d326-a928-4420-a556-02cfe8913c3f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.071700 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 942/1875] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:35 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:36.074023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.089765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029df702-2197-4056-83b7-94564484a2e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.106531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.107164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.107439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.107706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.108349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.109980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.149406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 943/1876] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:36.150183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.168807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd96c1a751642c2b60625e72d2551d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5faacb88ba934a498d3b7724d75d11aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.169722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.170384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.170825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.171780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1857f4-cb34-4375-9e31-e5b8e052f703 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.180984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c448ad9eb5d439eb7cd762216e53086)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.184225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.184853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.185135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.185467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.185790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.186154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.187788 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 934/1877] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:35 2022] GET /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086 => generated 393 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:36.187902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.205301 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 944/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:36.206077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.206266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.207925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.243363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd107a5d-9b97-45fb-8a5b-9bd66a49491c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.250069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62177422-db56-4a54-9e41-d54fa2c212e2 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.259885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504cc5b-bd3e-42cd-bc85-9c9d25e464cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.260617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.260751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504cc5b-bd3e-42cd-bc85-9c9d25e464cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.261015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504cc5b-bd3e-42cd-bc85-9c9d25e464cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.261323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504cc5b-bd3e-42cd-bc85-9c9d25e464cb admin admin] PATH_INFO: `/v3/projects/723cab031afe4d02bd9b2bc47906b067/users/765f6959ffc24c1590605961f1725e15/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.262731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.265394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.265795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] PATH_INFO: `/v3/projects/b068e64c9e49494e82711c8fc927f588` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.267393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b068e64c9e49494e82711c8fc927f588)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.270211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.294129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504cc5b-bd3e-42cd-bc85-9c9d25e464cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=723cab031afe4d02bd9b2bc47906b067, user_id=765f6959ffc24c1590605961f1725e15, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.294129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504cc5b-bd3e-42cd-bc85-9c9d25e464cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.318179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 945/1879] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:36 2022] PUT /identity/v3/projects/723cab031afe4d02bd9b2bc47906b067/users/765f6959ffc24c1590605961f1725e15/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:36.330756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c7994-4737-44d9-917b-f600b1200361 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.331033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c7994-4737-44d9-917b-f600b1200361 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.331507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c7994-4737-44d9-917b-f600b1200361 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.333251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 946/1880] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:36 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:36.334849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686304b-041c-41a6-99bd-db395a5f9ddc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.335758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686304b-041c-41a6-99bd-db395a5f9ddc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.336144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686304b-041c-41a6-99bd-db395a5f9ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.347699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:36.362492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b068e64c9e49494e82711c8fc927f588', 'request_id': 'req-3ba64aa8-f9e3-45b0-94a9-259201b67adc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:36.378153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b068e64c9e49494e82711c8fc927f588', 'request_id': 'req-3ba64aa8-f9e3-45b0-94a9-259201b67adc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:36.385101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b068e64c9e49494e82711c8fc927f588', 'request_id': 'req-3ba64aa8-f9e3-45b0-94a9-259201b67adc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:36.396445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8686304b-041c-41a6-99bd-db395a5f9ddc None None] MFA Rules not processed for user `765f6959ffc24c1590605961f1725e15`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:36.398259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8686304b-041c-41a6-99bd-db395a5f9ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.404901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] The token cache is being invalidate because project b068e64c9e49494e82711c8fc927f588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:36.405199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:36.406089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:36.407684 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 935/1881] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:36 2022] DELETE /identity/v3/projects/b068e64c9e49494e82711c8fc927f588 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:36.408584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:36.412376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.508247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 947/1882] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:36.510678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea463f4b-25b3-45ad-819c-8417ae7c7417 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.511137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea463f4b-25b3-45ad-819c-8417ae7c7417 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.511551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea463f4b-25b3-45ad-819c-8417ae7c7417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.512693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.514091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.541092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea463f4b-25b3-45ad-819c-8417ae7c7417 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:36.548913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea463f4b-25b3-45ad-819c-8417ae7c7417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.607588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:36.623731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba64aa8-f9e3-45b0-94a9-259201b67adc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.629369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd96c1a751642c2b60625e72d2551d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5faacb88ba934a498d3b7724d75d11aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.630936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.631426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.632844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.635058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c448ad9eb5d439eb7cd762216e53086)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.639064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.644284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 936/1883] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:36 2022] GET /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086 => generated 393 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:36.646669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.655472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.664741 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 948/1884] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:36.675499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.675499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.675499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.693417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ef52c-6a2c-47ea-aca8-b933c4b53314 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.699373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:36.701342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:36.705969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.707907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.712052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.712052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.714116 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 949/1885] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:36.714238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.716422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.718330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.748560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9324b-d84b-4549-ac70-9362492cf28a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.773423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.774115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.774402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.774658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.775313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:36.776276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.780738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.793889 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 937/1886] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:36 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:36.797224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.814611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 950/1887] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:36.815536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:36.838100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a663f-c1c4-48b9-a621-2a267b23a479 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.864372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:36.920113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977f858-0e65-424e-b462-fb081bfbac03 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:36.932949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.933596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.933997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.934276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.934929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.939600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:36.972819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:36.974008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:36.974427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:36.974858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:36.975638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:36.977698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.008430 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 938/1888] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:36 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:37.010668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.047550 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 951/1889] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:36 2022] POST /identity/v3/projects => generated 401 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:37.051843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.054492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8746ed-be43-4f94-b209-bc3a1aeddbdc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.167919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.168845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.169367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.169997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.170884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.175379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.190750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b000bb-5196-4ea4-86bd-e2c147ded9df admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.213743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.214124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.214408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.214686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.215385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.215589 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 939/1890] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:37.216636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.217251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.236833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111587-b35c-484c-92df-99148644bd67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.242689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.243146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.243610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.243959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] PATH_INFO: `/v3/projects/f9e525fd77e04a8fa0cd29b3a9f4ee5c/users/12591057a6124e7fb5e776e05469f5bc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.266633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e525fd77e04a8fa0cd29b3a9f4ee5c, user_id=12591057a6124e7fb5e776e05469f5bc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.270992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.288759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 952/1891] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:37 2022] POST /identity/v3/users => generated 301 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:37.289774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.302740 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 940/1892] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:37 2022] PUT /identity/v3/projects/f9e525fd77e04a8fa0cd29b3a9f4ee5c/users/12591057a6124e7fb5e776e05469f5bc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:37.302740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.381075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:37.451009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bade388-05a0-4a94-bfdd-94210c3a7fe4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.456621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce809c-4588-43b2-b18a-9764936ccc55 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.457795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.458944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.459233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.459505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.460152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.462525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.476490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 941/1893] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:37.477146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.491252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d2a0e-98ae-420d-ab29-6d0ff6eaa0d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.505571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.506242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.506516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.506789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.507432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.509264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.521974 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 942/1894] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:37.522853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.535576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba78356-4ba6-4980-969e-0723b70a40ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.574870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.575683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.576019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.576296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.576954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.585581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.618684 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 943/1895] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:37.619517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.646697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b862f-249e-4b71-81a7-69d3ad5f6c55 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.649979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.651572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.652413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.652745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.656610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.657291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.657564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.657856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] PATH_INFO: `/v3/projects/f9e525fd77e04a8fa0cd29b3a9f4ee5c/users/12591057a6124e7fb5e776e05469f5bc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.659252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:37.663628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e525fd77e04a8fa0cd29b3a9f4ee5c, user_id=12591057a6124e7fb5e776e05469f5bc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.670818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.686621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:37.716526 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 944/1896] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:37 2022] PUT /identity/v3/projects/f9e525fd77e04a8fa0cd29b3a9f4ee5c/users/12591057a6124e7fb5e776e05469f5bc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:37.717375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:37.814951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.818430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5377ade-4691-4f69-b9cb-524db674e577 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.842567 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 953/1897] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:37.843937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a93c-2a3e-4368-87e6-b89f19111416 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.844227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a93c-2a3e-4368-87e6-b89f19111416 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.844500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482a93c-2a3e-4368-87e6-b89f19111416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.869142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a949a1-429c-48f1-8217-8b9e01096e9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:37.884414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186a367-73af-42da-9391-41cde08ff1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:37.885542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a367-73af-42da-9391-41cde08ff1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.886062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a367-73af-42da-9391-41cde08ff1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.886569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186a367-73af-42da-9391-41cde08ff1e9 admin admin] PATH_INFO: `/v3/projects/c7b37add6b344f4ea758f3b64d6d0d33/users/c43a781399fc4e7798a7acb16cc980e6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:37.906886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a482a93c-2a3e-4368-87e6-b89f19111416 None None] MFA Rules not processed for user `12591057a6124e7fb5e776e05469f5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:37.913748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a482a93c-2a3e-4368-87e6-b89f19111416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:37.920403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186a367-73af-42da-9391-41cde08ff1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b37add6b344f4ea758f3b64d6d0d33, user_id=c43a781399fc4e7798a7acb16cc980e6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:37.928351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186a367-73af-42da-9391-41cde08ff1e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:37.966817 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 945/1898] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:37 2022] PUT /identity/v3/projects/c7b37add6b344f4ea758f3b64d6d0d33/users/c43a781399fc4e7798a7acb16cc980e6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:37.968540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:37.968867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:37.977306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.035081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] MFA Rules not processed for user `c43a781399fc4e7798a7acb16cc980e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:38.039911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:38.099363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:38.127598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 954/1899] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:38.130586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5dd4-cfbd-4d62-8343-d9d16000df7b None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.130929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5dd4-cfbd-4d62-8343-d9d16000df7b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.131197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c5dd4-cfbd-4d62-8343-d9d16000df7b None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.132766 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 955/1900] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:38.138848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5dd4-cfbd-4d62-8343-d9d16000df7b None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:38.231074 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 946/1901] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:38.232505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.298661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5dd4-cfbd-4d62-8343-d9d16000df7b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.350445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e61e0e-6c5c-4e35-ad5e-44cd176df8f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.360541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.363369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.363753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.364126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.365170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.368715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.404843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:38.424466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c5dd4-cfbd-4d62-8343-d9d16000df7b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.430577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 947/1902] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:38 2022] POST /identity/v3/projects => generated 403 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:38.435129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.439559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd96c1a751642c2b60625e72d2551d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5faacb88ba934a498d3b7724d75d11aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.440244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.440532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.440812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.442543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c448ad9eb5d439eb7cd762216e53086)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.449108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.465982 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 956/1903] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:38 2022] GET /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086 => generated 393 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:46:38.496771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.517003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85562579-72c5-46ad-be59-ec39790bb720 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.585358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d457d-5224-49fb-9e8f-affd1acbc2f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.597682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.598500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.598872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.599298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.600141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.602359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.635218 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 948/1904] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:38 2022] POST /identity/v3/users => generated 308 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:38.639884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.654955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.655590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.655880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.656142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.660757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb3780-6b72-4741-a043-724d5e413b0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.674214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.674846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.675126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.675398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.676050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.677681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.703263 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 949/1905] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:38.710164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.714934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:38.731438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e39444-b7ae-440a-99b2-ea6488e17a96 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.747290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.747985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.748265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.748538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] PATH_INFO: `/v3/projects/227454c954934f0eb16185f740510957/users/1285be221cc84102b3de2bc25c6d1f3b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.783230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=227454c954934f0eb16185f740510957, user_id=1285be221cc84102b3de2bc25c6d1f3b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.785933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.789006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.790982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.822782 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 957/1906] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:38.826161 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 950/1907] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:38 2022] PUT /identity/v3/projects/227454c954934f0eb16185f740510957/users/1285be221cc84102b3de2bc25c6d1f3b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:38.830097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:38.849373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d08d0c-af4b-4f6c-88e6-a5118865eac7 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:38.946185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15986503-0101-4c5a-9c02-b988ad31f76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:38.946994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15986503-0101-4c5a-9c02-b988ad31f76e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:38.947383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15986503-0101-4c5a-9c02-b988ad31f76e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:38.947858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15986503-0101-4c5a-9c02-b988ad31f76e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:38.949454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15986503-0101-4c5a-9c02-b988ad31f76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:38.952074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15986503-0101-4c5a-9c02-b988ad31f76e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:38.967599 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 958/1908] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:46:38.977028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:39.002629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326d7c-7eca-420f-9cf2-0e4cdc354d2f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:39.002629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326d7c-7eca-420f-9cf2-0e4cdc354d2f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:39.002887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe949e6-ee21-4375-945f-cc6439830c4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:39.002989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19326d7c-7eca-420f-9cf2-0e4cdc354d2f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:39.002989 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 959/1909] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:46:39.003116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bb598-4b82-4de5-8c2d-14bebf661945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:39.003201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb598-4b82-4de5-8c2d-14bebf661945 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:39.003487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb598-4b82-4de5-8c2d-14bebf661945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:39.003767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bb598-4b82-4de5-8c2d-14bebf661945 admin admin] PATH_INFO: `/v3/projects/227454c954934f0eb16185f740510957/users/1285be221cc84102b3de2bc25c6d1f3b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:39.003930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19326d7c-7eca-420f-9cf2-0e4cdc354d2f None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:39.005773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb598-4b82-4de5-8c2d-14bebf661945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227454c954934f0eb16185f740510957, user_id=1285be221cc84102b3de2bc25c6d1f3b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:39.008946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bb598-4b82-4de5-8c2d-14bebf661945 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:39.041935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 951/1910] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:38 2022] PUT /identity/v3/projects/227454c954934f0eb16185f740510957/users/1285be221cc84102b3de2bc25c6d1f3b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:39.045136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:39.045642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:39.045958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:39.095954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] MFA Rules not processed for user `1285be221cc84102b3de2bc25c6d1f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:39.097294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:39.164325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19326d7c-7eca-420f-9cf2-0e4cdc354d2f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:39.210061 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 952/1911] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:39 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:39.253985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:39.267571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19326d7c-7eca-420f-9cf2-0e4cdc354d2f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:39.373913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:39.375345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:39.376812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd96c1a751642c2b60625e72d2551d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5faacb88ba934a498d3b7724d75d11aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:39.377867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:39.378400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:39.378734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:39.380011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorizing `identity:get_project(project_id=9c448ad9eb5d439eb7cd762216e53086)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:39.382370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:39.384980 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 960/1912] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:39 2022] GET /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086 => generated 393 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:39.423439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:39.505203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40fa5-42fb-4324-8a96-e58681f8909e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:39.541366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015ce41-3020-454d-b92a-a0aedba0c639 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:39.542146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015ce41-3020-454d-b92a-a0aedba0c639 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:39.545986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015ce41-3020-454d-b92a-a0aedba0c639 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:39.546362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015ce41-3020-454d-b92a-a0aedba0c639 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:39.582378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015ce41-3020-454d-b92a-a0aedba0c639 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:39.584022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015ce41-3020-454d-b92a-a0aedba0c639 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:39.610710 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 953/1913] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:39 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:39.855174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:39.874632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c93131-f473-48f3-a0e0-0eed11e7822f tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:39.881225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:39.881885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:39.882169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:39.882438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:40.038041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:40.039851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:40.070999 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 961/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:39 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:40.145217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eb673-ab78-4a51-a3d3-8ae51c7e8883 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:40.145785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eb673-ab78-4a51-a3d3-8ae51c7e8883 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:40.145785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eb673-ab78-4a51-a3d3-8ae51c7e8883 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:40.147403 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 954/1915] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:40.160947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:46:40.175738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:40.194453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81da774-a24c-4add-a561-f72f1f26059b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:40.199939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8cd96c1a751642c2b60625e72d2551d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5faacb88ba934a498d3b7724d75d11aa', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:40.200771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:40.201060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:40.201336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] PATH_INFO: `/v3/projects/afd7266de3634dc7930933a51f0ccd0b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:40.202529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorizing `identity:get_project(project_id=afd7266de3634dc7930933a51f0ccd0b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:40.204603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:40.211855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 962/1916] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:46:40 2022] GET /identity/v3/projects/afd7266de3634dc7930933a51f0ccd0b => generated 393 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:40.468772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eb673-ab78-4a51-a3d3-8ae51c7e8883 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:40.472135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb3eb673-ab78-4a51-a3d3-8ae51c7e8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:40.654671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eb673-ab78-4a51-a3d3-8ae51c7e8883 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:40.660383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:40.661617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:40.661617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:40.662068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] PATH_INFO: `/v3/users/eb138b2c90fd4c9ea2fdce09df43ecb3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:40.663330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb138b2c90fd4c9ea2fdce09df43ecb3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:40.665546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:40.726665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:40.745769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635359f8-f81c-4c26-9824-69930abdbcf3 tempest-FlavorsAccessNegativeTestJSON-1189508126 tempest-FlavorsAccessNegativeTestJSON-1189508126-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:40.758663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:40.760711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:40.761054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:40.762449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] PATH_INFO: `/v3/users/765f6959ffc24c1590605961f1725e15` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:40.764778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765f6959ffc24c1590605961f1725e15)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:40.768123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:40.783352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb138b2c90fd4c9ea2fdce09df43ecb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.803858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb138b2c90fd4c9ea2fdce09df43ecb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.804672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb138b2c90fd4c9ea2fdce09df43ecb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.839142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb138b2c90fd4c9ea2fdce09df43ecb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.840258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d0fac9c-73f9-4e3a-8ffd-7394f5ba47f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb138b2c90fd4c9ea2fdce09df43ecb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.874174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 955/1917] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:40 2022] DELETE /identity/v3/users/eb138b2c90fd4c9ea2fdce09df43ecb3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:40.886084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc929d-c182-402e-a588-d3670ed81dde None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:40.887131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc929d-c182-402e-a588-d3670ed81dde None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:40.887559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc929d-c182-402e-a588-d3670ed81dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:40.891536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765f6959ffc24c1590605961f1725e15'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.921614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765f6959ffc24c1590605961f1725e15'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.923581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765f6959ffc24c1590605961f1725e15'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.932531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765f6959ffc24c1590605961f1725e15'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.933305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05accddb-745f-4621-9956-38fa2fdf3061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765f6959ffc24c1590605961f1725e15'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:40.958412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3ffc929d-c182-402e-a588-d3670ed81dde None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:40.969069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ffc929d-c182-402e-a588-d3670ed81dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:40.982779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 963/1918] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:40 2022] DELETE /identity/v3/users/765f6959ffc24c1590605961f1725e15 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:40.984257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:40.984446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:40.984720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.002611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:41.040857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] MFA Rules not processed for user `3c866ee9d2744a73b55d1be2b3d69dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:41.045833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.046027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:41.164467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 956/1919] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:41.171085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:41.171345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:41.171624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.174855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 964/1920] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:40 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:41.175888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:41.177747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.205574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488fb05-93e1-4f19-9d00-ebf0f8ab9baf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:41.224345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:41.225019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:41.225299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:41.226043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] PATH_INFO: `/v3/users/c43a781399fc4e7798a7acb16cc980e6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.227305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43a781399fc4e7798a7acb16cc980e6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:41.229304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:41.259291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:41.260658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.279019 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 957/1921] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:41.279977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:41.282122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.359940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43a781399fc4e7798a7acb16cc980e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:41.378091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43a781399fc4e7798a7acb16cc980e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:41.379003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43a781399fc4e7798a7acb16cc980e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:41.389131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43a781399fc4e7798a7acb16cc980e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:41.390110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43a781399fc4e7798a7acb16cc980e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:41.415660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 965/1922] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:41 2022] DELETE /identity/v3/users/c43a781399fc4e7798a7acb16cc980e6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:41.416749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:41.420314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.458648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234eb17-fdb5-42c5-94b5-4a737fc2857c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:41.560230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:41.561332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:41.561759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:41.562198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.567632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.579701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1023117-6931-47b5-b6a1-7db06cf84c66 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:41.606370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:41.608045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:41.609017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:41.610161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.612819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.655841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:41.702104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:41.703793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:41.730812 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 958/1923] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:41.731811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:41.735871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.777116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:41.778918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98917550-f193-44a1-b812-5e4f3a5bbfd7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:41.796276 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 966/1924] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:41.798005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:41.798367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:41.798734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.823913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:41.826447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.851796 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 967/1925] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:41.853296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:41.937627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:41.939592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:41.957504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa12b35-2eb6-46a9-bbb5-78060dda281b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:41.969854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:41.972226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:41.973687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:41.974158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:41.993510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e9912-2f90-4187-8c3c-b559fbdba7db service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:42.002870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:42.004331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:42.012371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:42.015417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:42.016602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:42.016940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:42.022650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:42.028551 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 968/1926] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:42.203230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:42.205772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:42.239425 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 959/1927] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:42.686799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:42.688313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:42.715227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a98c1b-af67-4d73-9970-550914016c4c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:42.739708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:42.740424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:42.740424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:42.740865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] PATH_INFO: `/v3/projects/c7b37add6b344f4ea758f3b64d6d0d33` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:42.745833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b37add6b344f4ea758f3b64d6d0d33)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:42.751948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:42.870957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b37add6b344f4ea758f3b64d6d0d33', 'request_id': 'req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:42.895419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b37add6b344f4ea758f3b64d6d0d33', 'request_id': 'req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:42.907508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b37add6b344f4ea758f3b64d6d0d33', 'request_id': 'req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:42.908863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:42.912902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:42.923247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] The token cache is being invalidate because project c7b37add6b344f4ea758f3b64d6d0d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:42.924104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:42.924653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:42.929624 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 969/1928] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:42 2022] DELETE /identity/v3/projects/c7b37add6b344f4ea758f3b64d6d0d33 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:42.930678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:42.932657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:42.983634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22972e97-f303-4363-84a6-e011f43500fb service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:43.019996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9c7cf-5b23-4f98-8d3d-a2cdb383dc1b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:43.027108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:43.027961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:43.028238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:43.028672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] PATH_INFO: `/v3/users/1285be221cc84102b3de2bc25c6d1f3b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:43.029858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1285be221cc84102b3de2bc25c6d1f3b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:43.031841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:43.051575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:43.094164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1285be221cc84102b3de2bc25c6d1f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.116008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1285be221cc84102b3de2bc25c6d1f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.116008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1285be221cc84102b3de2bc25c6d1f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.123258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1285be221cc84102b3de2bc25c6d1f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.124089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1285be221cc84102b3de2bc25c6d1f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.146168 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 970/1929] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:42 2022] DELETE /identity/v3/users/1285be221cc84102b3de2bc25c6d1f3b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:43.146168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:43.161019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:43.181705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:43.184999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:43.185325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:43.185603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] PATH_INFO: `/v3/projects/723cab031afe4d02bd9b2bc47906b067` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:43.191378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=723cab031afe4d02bd9b2bc47906b067)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:43.201649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:43.310914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da44c40b-5c9d-45e6-8232-e990833e98ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:43.315943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723cab031afe4d02bd9b2bc47906b067', 'request_id': 'req-11e081b5-8c9e-4d47-864e-1beb5ec40825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.329344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723cab031afe4d02bd9b2bc47906b067', 'request_id': 'req-11e081b5-8c9e-4d47-864e-1beb5ec40825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.348313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723cab031afe4d02bd9b2bc47906b067', 'request_id': 'req-11e081b5-8c9e-4d47-864e-1beb5ec40825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.355397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:43.376258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] The token cache is being invalidate because project 723cab031afe4d02bd9b2bc47906b067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:43.376560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.378249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.382960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 960/1930] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:42 2022] DELETE /identity/v3/projects/723cab031afe4d02bd9b2bc47906b067 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:43.382960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:43.383167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:43.449484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:43.450569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:43.451053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:43.451541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:43.453756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:43.486200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e081b5-8c9e-4d47-864e-1beb5ec40825 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:43.493222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:43.493908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:43.494188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:43.494524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] PATH_INFO: `/v3/projects/9c448ad9eb5d439eb7cd762216e53086` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:43.496009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c448ad9eb5d439eb7cd762216e53086)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:43.499789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:43.508321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:43.565837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:43.567455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:43.579471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c448ad9eb5d439eb7cd762216e53086', 'request_id': 'req-60f0eb8b-0d4b-4251-8089-ed0ff555a952'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.585784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 971/1931] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:43.586881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:43.588773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:43.595070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c448ad9eb5d439eb7cd762216e53086', 'request_id': 'req-60f0eb8b-0d4b-4251-8089-ed0ff555a952'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.603021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c448ad9eb5d439eb7cd762216e53086', 'request_id': 'req-60f0eb8b-0d4b-4251-8089-ed0ff555a952'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.608339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9d87-d71b-46be-bb24-3b82ef3febd4 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:43.629105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] The token cache is being invalidate because project 9c448ad9eb5d439eb7cd762216e53086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:43.629428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.638285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.640220 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 961/1932] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:43 2022] DELETE /identity/v3/projects/9c448ad9eb5d439eb7cd762216e53086 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:43.644049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:43.646525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:43.696795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:43.698189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:43.698962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:43.699989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] PATH_INFO: `/v3/users/12591057a6124e7fb5e776e05469f5bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:43.701298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12591057a6124e7fb5e776e05469f5bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:43.705438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:43.800544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12591057a6124e7fb5e776e05469f5bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.830934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12591057a6124e7fb5e776e05469f5bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.832839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12591057a6124e7fb5e776e05469f5bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.842884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12591057a6124e7fb5e776e05469f5bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.843525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12591057a6124e7fb5e776e05469f5bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:43.853749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0eb8b-0d4b-4251-8089-ed0ff555a952 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:43.867541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:43.868573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:43.872925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:43.873229 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 972/1933] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:43 2022] DELETE /identity/v3/users/12591057a6124e7fb5e776e05469f5bc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:43.875035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] PATH_INFO: `/v3/users/8cd96c1a751642c2b60625e72d2551d6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:43.877257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd96c1a751642c2b60625e72d2551d6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:43.883642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:43.926975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:43.929217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:43.940419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:44.002410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd96c1a751642c2b60625e72d2551d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.023214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd96c1a751642c2b60625e72d2551d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.027129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd96c1a751642c2b60625e72d2551d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.059051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd96c1a751642c2b60625e72d2551d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.060180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd96c1a751642c2b60625e72d2551d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.068927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:44.121150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c987-ef27-49e3-8df9-e5575772b01c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:44.125001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 962/1934] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:43 2022] DELETE /identity/v3/users/8cd96c1a751642c2b60625e72d2551d6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:44.235859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:44.237320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:44.237616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:44.237926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:44.240235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:44.312370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:44.314245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:44.418883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:44.418883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea30239-7406-40ec-a1cd-5c536d363eb4 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:44.451886 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 973/1935] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:44.545773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5380830-2d46-4bdb-a55d-923e6eff00c0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:44.563301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:44.564089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:44.564690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:44.565068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] PATH_INFO: `/v3/projects/227454c954934f0eb16185f740510957` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:44.567029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=227454c954934f0eb16185f740510957)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:44.569990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:44.645361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227454c954934f0eb16185f740510957', 'request_id': 'req-6fc4625d-01e1-4394-aa6f-d7c64e432d92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.655274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227454c954934f0eb16185f740510957', 'request_id': 'req-6fc4625d-01e1-4394-aa6f-d7c64e432d92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.664609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227454c954934f0eb16185f740510957', 'request_id': 'req-6fc4625d-01e1-4394-aa6f-d7c64e432d92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.688127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] The token cache is being invalidate because project 227454c954934f0eb16185f740510957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:44.688610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.690378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:44.692465 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 963/1936] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:44 2022] DELETE /identity/v3/projects/227454c954934f0eb16185f740510957 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:44.697415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770114-c311-4390-a728-31c5882ee916 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:44.697736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770114-c311-4390-a728-31c5882ee916 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:44.698059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19770114-c311-4390-a728-31c5882ee916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:44.740867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-19770114-c311-4390-a728-31c5882ee916 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:44.742681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-19770114-c311-4390-a728-31c5882ee916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:44.773141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:44.776101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:44.885016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:44.894565 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 974/1937] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:44.914999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:44.915294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:44.915573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:44.934978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4625d-01e1-4394-aa6f-d7c64e432d92 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:44.941762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:44.943830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:44.944334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:44.946241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] PATH_INFO: `/v3/projects/5faacb88ba934a498d3b7724d75d11aa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:44.949190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faacb88ba934a498d3b7724d75d11aa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:44.961836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:44.962662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:44.962662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:44.985266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 975/1938] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:44.989485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:45.014201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044c1df-4f78-441f-8c1e-67a82ead470b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:45.020372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:45.021641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.022102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.022653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.026282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:45.028109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:45.031058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:45.039576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:45.059406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 976/1939] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:45.069283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faacb88ba934a498d3b7724d75d11aa', 'request_id': 'req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.076024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:45.089383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faacb88ba934a498d3b7724d75d11aa', 'request_id': 'req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.097609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faacb88ba934a498d3b7724d75d11aa', 'request_id': 'req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.099893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88981616-89d5-455a-88f3-3698001e251d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:45.117790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] The token cache is being invalidate because project 5faacb88ba934a498d3b7724d75d11aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:45.118352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.120503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.124695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 964/1940] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:44 2022] DELETE /identity/v3/projects/5faacb88ba934a498d3b7724d75d11aa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:45.125667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:45.139146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.243487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:45.244294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.245072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.245502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.246521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:45.248804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:45.306077 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 977/1941] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:45 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:45.306077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:45.310920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.331369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23d2f5-4215-4d01-ab4c-f9a4852018c2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:45.440983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca47ec-6bbf-4294-90f9-bf50d19b24ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:45.462120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:45.462937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.463918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.464324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] PATH_INFO: `/v3/projects/f9e525fd77e04a8fa0cd29b3a9f4ee5c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.465738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e525fd77e04a8fa0cd29b3a9f4ee5c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:45.468300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:45.516794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:45.517592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.517935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.518433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] PATH_INFO: `/v3/users/3477d63d6e12467ea4922396eeda2e46` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.524615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=3477d63d6e12467ea4922396eeda2e46)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:45.529157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:45.558884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e525fd77e04a8fa0cd29b3a9f4ee5c', 'request_id': 'req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.570703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:45.572602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e525fd77e04a8fa0cd29b3a9f4ee5c', 'request_id': 'req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.592859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e525fd77e04a8fa0cd29b3a9f4ee5c', 'request_id': 'req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.615975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] The token cache is being invalidate because project f9e525fd77e04a8fa0cd29b3a9f4ee5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:45.616267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.617028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.619049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 978/1942] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:45 2022] DELETE /identity/v3/projects/f9e525fd77e04a8fa0cd29b3a9f4ee5c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:45.620627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:45.626776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.642640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3477d63d6e12467ea4922396eeda2e46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.644013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:45.661754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3477d63d6e12467ea4922396eeda2e46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.662779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3477d63d6e12467ea4922396eeda2e46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.673630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3477d63d6e12467ea4922396eeda2e46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.674404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b43325e-f0a2-49bd-a74e-b7432902aaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3477d63d6e12467ea4922396eeda2e46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:45.700828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 965/1943] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:45 2022] DELETE /identity/v3/users/3477d63d6e12467ea4922396eeda2e46 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:45.703115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7205b8-e1ea-4a6c-9aa8-0b0cdfe8b7c1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.703510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7205b8-e1ea-4a6c-9aa8-0b0cdfe8b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.703894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7205b8-e1ea-4a6c-9aa8-0b0cdfe8b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.726152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958e01e-0c3b-43ed-8c3b-ee5ed909a7fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:45.746817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0f7205b8-e1ea-4a6c-9aa8-0b0cdfe8b7c1 None None] MFA Rules not processed for user `1486b01e2a39475dab72aa7f36816c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:45.748319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f7205b8-e1ea-4a6c-9aa8-0b0cdfe8b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.846718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:45.849634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.850152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.850555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.856053 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 966/1944] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:45.856216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:45.857911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536feb-1f97-407a-b219-8ce0c3cbbfef None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.858273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536feb-1f97-407a-b219-8ce0c3cbbfef None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.858514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:45.858678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34536feb-1f97-407a-b219-8ce0c3cbbfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.908986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-34536feb-1f97-407a-b219-8ce0c3cbbfef None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:45.910581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-34536feb-1f97-407a-b219-8ce0c3cbbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.913373 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 979/1945] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:45 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:45.921285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:45.923499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.924957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 967/1946] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:45.933654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6e39-7bde-434b-b8b9-891ff9c6c675 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.934004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6e39-7bde-434b-b8b9-891ff9c6c675 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.934283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b6e39-7bde-434b-b8b9-891ff9c6c675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.950807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd66d-77c4-48d3-9e87-4193ce796730 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:45.968275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09017aec-3baf-4c72-b01d-213ec0cb4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:45.969486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017aec-3baf-4c72-b01d-213ec0cb4c34 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.970108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017aec-3baf-4c72-b01d-213ec0cb4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.971606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09017aec-3baf-4c72-b01d-213ec0cb4c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.972439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09017aec-3baf-4c72-b01d-213ec0cb4c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:45.974013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae7b6e39-7bde-434b-b8b9-891ff9c6c675 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:45.974445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09017aec-3baf-4c72-b01d-213ec0cb4c34 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:45.975445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae7b6e39-7bde-434b-b8b9-891ff9c6c675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:45.990768 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 968/1947] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:45.992364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333d516-12dc-4a9e-9516-956d19e6daf9 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:45.992657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333d516-12dc-4a9e-9516-956d19e6daf9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:45.992960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333d516-12dc-4a9e-9516-956d19e6daf9 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:45.995483 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 969/1948] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:45.996435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333d516-12dc-4a9e-9516-956d19e6daf9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.008941 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 980/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:46.011080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.011936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.012369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.016919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333d516-12dc-4a9e-9516-956d19e6daf9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.022032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.022857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.023140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.023413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.024245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:46.024555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.026517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.048026 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 970/1950] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:46.049407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.053492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:46.054759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.071101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54bbeb-2f72-43a6-8296-6069962842f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.080176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.081345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.083073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.084648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.085666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.087538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.103512 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 971/1951] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:46.105199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.123948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4425d8-f785-4176-ac95-cc9ca72525dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.131997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.132679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.132961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.133233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.134315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.137423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.153377 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 981/1952] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:46.162040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.187337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 972/1953] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:46 2022] POST /identity/v3/projects => generated 409 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:46.187337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.187909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.194479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeb70a4-ae19-4242-b7b3-4ac180bf601f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.264970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:46.290960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:46.295493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfd0f4-78b6-4ab8-a96c-6ef61f89b955 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.304006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.304949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.305233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.305506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.325938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.327054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.328217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.328680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] PATH_INFO: `/v3/projects/1e68a44cc9d74ecb9259ac82b777939e/users/581f79694cc5431cbdcddbf57705f8b6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.336057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.338070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.348489 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 973/1954] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:46.349396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.364099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508649-f6ac-47af-99bd-8a6a01a371a4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.377218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c172e-534f-4f7d-a7bd-5d1fb0bb0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.378023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c172e-534f-4f7d-a7bd-5d1fb0bb0006 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.378371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c172e-534f-4f7d-a7bd-5d1fb0bb0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.378853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c172e-534f-4f7d-a7bd-5d1fb0bb0006 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.379721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c172e-534f-4f7d-a7bd-5d1fb0bb0006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.382096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c172e-534f-4f7d-a7bd-5d1fb0bb0006 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.394669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e68a44cc9d74ecb9259ac82b777939e, user_id=581f79694cc5431cbdcddbf57705f8b6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.397883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.429512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 982/1955] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:46 2022] PUT /identity/v3/projects/1e68a44cc9d74ecb9259ac82b777939e/users/581f79694cc5431cbdcddbf57705f8b6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:46.429954 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 974/1956] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:46 2022] POST /identity/v3/users => generated 305 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:46.430795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.432605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.472837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.473969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.474425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.549044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] MFA Rules not processed for user `581f79694cc5431cbdcddbf57705f8b6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:46.550312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.643446 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 975/1957] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:46.645694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.663314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f898e-e700-4802-984c-ea6395546d78 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.669067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.669975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.670658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.671038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f58d6-3134-4647-ae21-7f576f6048a4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.671180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] PATH_INFO: `/v3/projects/afd7266de3634dc7930933a51f0ccd0b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.672406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd7266de3634dc7930933a51f0ccd0b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.674519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.677194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.678027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.678706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.679129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.679993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.682204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.714704 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 976/1958] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:46.716090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.718715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.758347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd7266de3634dc7930933a51f0ccd0b', 'request_id': 'req-787a984f-75aa-4ea7-886d-d8f422986f7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:46.765474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd7266de3634dc7930933a51f0ccd0b', 'request_id': 'req-787a984f-75aa-4ea7-886d-d8f422986f7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:46.772884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd7266de3634dc7930933a51f0ccd0b', 'request_id': 'req-787a984f-75aa-4ea7-886d-d8f422986f7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:46.788453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] The token cache is being invalidate because project afd7266de3634dc7930933a51f0ccd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:46.788707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:46.789364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:46.791493 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 983/1959] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:46 2022] DELETE /identity/v3/projects/afd7266de3634dc7930933a51f0ccd0b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:46.792425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.797310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.838988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c56a3-d365-43bf-ba46-116901a60c1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.891592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:46.911051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a984f-75aa-4ea7-886d-d8f422986f7b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:46.917709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.917879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab96a73-eae2-4744-9c1b-4270a03cb0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:46.918460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96a73-eae2-4744-9c1b-4270a03cb0fc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.918735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96a73-eae2-4744-9c1b-4270a03cb0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.919010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab96a73-eae2-4744-9c1b-4270a03cb0fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.919494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.919651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab96a73-eae2-4744-9c1b-4270a03cb0fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.920060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.920468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.923626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.937568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab96a73-eae2-4744-9c1b-4270a03cb0fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.941837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:46.944266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:46.947128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:46.963315 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 977/1960] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:46.965174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:46.967524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:46.988570 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 984/1961] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:46 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:46.990250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:46.990682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:46.991120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:46.992143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf51a0-1eaf-4e46-a1ba-4fc7b71d3a96 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.043648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:47.047093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:47.111324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.114611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.114892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.115163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.117340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.122112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.146733 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 978/1962] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:47.148870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.173785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23128b2a-068c-4e9e-99c7-46d4fcaabad2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.193041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b52496-4b24-4577-9fcf-b4521511debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.193041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52496-4b24-4577-9fcf-b4521511debf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.193041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52496-4b24-4577-9fcf-b4521511debf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.193041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b52496-4b24-4577-9fcf-b4521511debf admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.193476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52496-4b24-4577-9fcf-b4521511debf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.193476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b52496-4b24-4577-9fcf-b4521511debf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.193640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 985/1963] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:47.195123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.212818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc3143-c625-4ecc-ad6f-dcc1df168fcc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.222888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.223872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.224122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.224580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] PATH_INFO: `/v3/projects/cf185db7458546f8af11d535235c6fb9/users/8e6478c845e84f2dbf66826f632372e9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.241622 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 979/1964] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:47.244789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24983d4-0285-46cd-b28d-94e0ec514ea0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.245033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24983d4-0285-46cd-b28d-94e0ec514ea0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.247258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24983d4-0285-46cd-b28d-94e0ec514ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.263818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf185db7458546f8af11d535235c6fb9, user_id=8e6478c845e84f2dbf66826f632372e9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.271129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.291460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d24983d4-0285-46cd-b28d-94e0ec514ea0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:47.294828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d24983d4-0285-46cd-b28d-94e0ec514ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:47.298771 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 986/1965] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:47 2022] PUT /identity/v3/projects/cf185db7458546f8af11d535235c6fb9/users/8e6478c845e84f2dbf66826f632372e9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:47.299599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.369869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 980/1966] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:47.371535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65bf9-85b4-4dc5-9e2c-9300f0176453 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.371821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65bf9-85b4-4dc5-9e2c-9300f0176453 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.372115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65bf9-85b4-4dc5-9e2c-9300f0176453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.402967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8bb65bf9-85b4-4dc5-9e2c-9300f0176453 None None] MFA Rules not processed for user `8e6478c845e84f2dbf66826f632372e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:47.404336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8bb65bf9-85b4-4dc5-9e2c-9300f0176453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:47.405108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d352e-219a-415d-b1d2-bac68f9a3d48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.415083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b431256-f7e0-4a37-a988-e0feea3960b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.416390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431256-f7e0-4a37-a988-e0feea3960b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.416721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431256-f7e0-4a37-a988-e0feea3960b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.417370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b431256-f7e0-4a37-a988-e0feea3960b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.418357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431256-f7e0-4a37-a988-e0feea3960b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.420364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b431256-f7e0-4a37-a988-e0feea3960b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.442897 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 987/1967] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:47.442897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605fbc-2a22-4d40-ab1f-5dfada8dc291 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.442897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605fbc-2a22-4d40-ab1f-5dfada8dc291 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.443246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c605fbc-2a22-4d40-ab1f-5dfada8dc291 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.445247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 988/1968] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:46:47.446082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605fbc-2a22-4d40-ab1f-5dfada8dc291 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.461146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c605fbc-2a22-4d40-ab1f-5dfada8dc291 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.467549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.469129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.469497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.469684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.470445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:47.470739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.472424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.496136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:47.530754 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 989/1969] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:47.530754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.531770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863fb9b-b40f-4d0d-96cc-754d20d0b531 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.537076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.537754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.538435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.538715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] PATH_INFO: `/v3/projects/8b4f96e5760942f4921f38d354158d93/users/1f01c876de0248c586122b78214b6f1b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.565591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 981/1970] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:47.572319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.572319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.572319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.589456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4f96e5760942f4921f38d354158d93, user_id=1f01c876de0248c586122b78214b6f1b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.594440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.624678 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 990/1971] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:47 2022] PUT /identity/v3/projects/8b4f96e5760942f4921f38d354158d93/users/1f01c876de0248c586122b78214b6f1b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:47.629039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.637049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:47.651193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:47.665444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:47.713889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610542a-d287-4a1d-8b35-410021f1d37f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.719542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.720303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.720854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.721209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.721999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.724135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.757415 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 991/1972] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/projects => generated 395 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:47.758500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.775397 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 982/1973] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:47.777208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.803991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa054b38-ce63-4fd1-82cc-c1439bf6e85a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.850725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86919af-11d0-44b0-8506-c9cf9a4bf241 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:47.870976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.871674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.871953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.872227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.872871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.875100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.907818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:47.909333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:47.910409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:47.911637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:47.912413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:47.918280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:47.936902 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 983/1974] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:47.937712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.942996 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 992/1975] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/projects => generated 411 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:47.943966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:47.946034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:47.949108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2bf6c-b73c-4d27-8b82-18227042e690 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.045269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f1f2a-2ecd-4070-8b7f-f2261a593978 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.051178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.054341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.055014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.055609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.079809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.080518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.080940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.081316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.081992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.088430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.118239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:48.136457 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 984/1976] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:47 2022] POST /identity/v3/users => generated 298 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:48.137562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.157094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:48.158263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7a27a-a068-4d1d-8015-cf7315c7ff17 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.164697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.165658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.166233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.167043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] PATH_INFO: `/v3/projects/8b4f96e5760942f4921f38d354158d93/users/1f01c876de0248c586122b78214b6f1b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.169488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4f96e5760942f4921f38d354158d93, user_id=1f01c876de0248c586122b78214b6f1b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.172690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.185665 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 985/1977] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:48 2022] PUT /identity/v3/projects/8b4f96e5760942f4921f38d354158d93/users/1f01c876de0248c586122b78214b6f1b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:48.186876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.193858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.195312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.220147 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 993/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:48.221119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.233866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcc0e8-c726-4ef4-bbe3-251d1ef41142 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.270573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81697325-0f74-4ddc-a150-8e55e86580fa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.278727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70e030-9271-4c3a-b00e-edde8c523934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.280728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70e030-9271-4c3a-b00e-edde8c523934 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.280998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70e030-9271-4c3a-b00e-edde8c523934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.281314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70e030-9271-4c3a-b00e-edde8c523934 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.281970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70e030-9271-4c3a-b00e-edde8c523934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.284120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70e030-9271-4c3a-b00e-edde8c523934 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.318464 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 986/1979] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:48 2022] POST /identity/v3/users => generated 312 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:48.318464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.318464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.318464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.347057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.348234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.348234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.348429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.349144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.350903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] MFA Rules not processed for user `1f01c876de0248c586122b78214b6f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:48.351245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.352279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:48.363972 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 994/1980] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:48.364898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.378945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7abf95-646c-4223-9eaa-8058b8863008 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.384785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.385156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.385512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.385783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.386542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.388144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.402056 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 995/1981] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:48.402056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.410211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566796b-d629-4825-9793-01b7dbbeeb3c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.415495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.416105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.416428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.416682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.417491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.419114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.430762 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 996/1982] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:48.431594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.441348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc0f8a-cc40-4b83-aee5-5aadb73b8637 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.446242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.446895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.447170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.447632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] PATH_INFO: `/v3/projects/2cd290d9e267437b922234fab5b1278e/users/28eccb43c1414ad8809c9d384b3d76a2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.447737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 987/1983] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:48.448854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.466669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd290d9e267437b922234fab5b1278e, user_id=28eccb43c1414ad8809c9d384b3d76a2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.466874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f6d65-2a7a-454e-89ec-c6df640feda6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.469410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.471543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.472214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.472492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.472763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] PATH_INFO: `/v3/projects/393c30f287484ec68631da999171a853/users/8a1bd0cb84574a90885ce189bb6e3b81/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.484600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 997/1984] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:48 2022] PUT /identity/v3/projects/2cd290d9e267437b922234fab5b1278e/users/28eccb43c1414ad8809c9d384b3d76a2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:48.485675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.487608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:48.496060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] RBAC: Authorizing `identity:create_grant(project_id=393c30f287484ec68631da999171a853, user_id=8a1bd0cb84574a90885ce189bb6e3b81, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.500172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.514969 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 988/1985] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:48 2022] PUT /identity/v3/projects/393c30f287484ec68631da999171a853/users/8a1bd0cb84574a90885ce189bb6e3b81/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:48.523754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.624857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:48.634843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d3c35-4b17-43d3-a8e0-89a812ad7fd2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.660902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:48.674759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3288b1c-cb1e-45c4-8380-0c59b50de34c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.681954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a931c-4b7d-4ab4-9c27-8614a6978e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.683022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a931c-4b7d-4ab4-9c27-8614a6978e77 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.683435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a931c-4b7d-4ab4-9c27-8614a6978e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.683709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a931c-4b7d-4ab4-9c27-8614a6978e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.684713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a931c-4b7d-4ab4-9c27-8614a6978e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.686760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a931c-4b7d-4ab4-9c27-8614a6978e77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.702871 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 989/1986] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:48.702871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.703481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.703872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.759869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] MFA Rules not processed for user `8a1bd0cb84574a90885ce189bb6e3b81`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:48.761850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:48.796968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.797594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.802528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.802878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.899916 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 990/1987] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:48.900911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.926181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9876fac-587d-4741-80b7-5a8dbd6938c2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:48.933844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:48.934540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:48.934821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:48.935107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] PATH_INFO: `/v3/projects/2cd290d9e267437b922234fab5b1278e/users/28eccb43c1414ad8809c9d384b3d76a2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:48.936070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.937663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.953449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd290d9e267437b922234fab5b1278e, user_id=28eccb43c1414ad8809c9d384b3d76a2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:48.956428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:48.962203 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 998/1988] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:48.963072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:48.979203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022716e-4e33-4423-9509-44a847b1a460 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.004123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 991/1989] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:48 2022] PUT /identity/v3/projects/2cd290d9e267437b922234fab5b1278e/users/28eccb43c1414ad8809c9d384b3d76a2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:49.005118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.014979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.062598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534c62b-ead1-4e91-a0ec-2e895e08cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.063232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c62b-ead1-4e91-a0ec-2e895e08cabb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.063576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c62b-ead1-4e91-a0ec-2e895e08cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.063859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534c62b-ead1-4e91-a0ec-2e895e08cabb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.064934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534c62b-ead1-4e91-a0ec-2e895e08cabb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.067123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534c62b-ead1-4e91-a0ec-2e895e08cabb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.106937 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 999/1990] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:48 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:49.108502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.108790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.109064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.116701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa3ebd-9a3d-4d8a-b187-6758d005d0b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.138101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] MFA Rules not processed for user `28eccb43c1414ad8809c9d384b3d76a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:49.139331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.166448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:49.166971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:49.176242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.176903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.177422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.177700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] PATH_INFO: `/v3/users/de04aa74bc1f403ea9818dcbcaba7b63` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.179648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de04aa74bc1f403ea9818dcbcaba7b63)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.182163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.230726 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1000/1991] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:49.231436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.232797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.242633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de04aa74bc1f403ea9818dcbcaba7b63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:49.252994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de04aa74bc1f403ea9818dcbcaba7b63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:49.255384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de04aa74bc1f403ea9818dcbcaba7b63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:49.265664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de04aa74bc1f403ea9818dcbcaba7b63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:49.267422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de04aa74bc1f403ea9818dcbcaba7b63'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:49.293563 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 992/1992] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:49 2022] DELETE /identity/v3/users/de04aa74bc1f403ea9818dcbcaba7b63 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:49.295645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.298068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.374193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96b8bd-4877-4c05-b288-e62881548322 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.394101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef79ee-a51c-4ae3-abbf-69ed2627cc27 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.400626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de3483-092c-48c7-a787-ac39a5e5bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.401502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de3483-092c-48c7-a787-ac39a5e5bd0c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.401690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de3483-092c-48c7-a787-ac39a5e5bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.402146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de3483-092c-48c7-a787-ac39a5e5bd0c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.402753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de3483-092c-48c7-a787-ac39a5e5bd0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.405343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6de3483-092c-48c7-a787-ac39a5e5bd0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.433450 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 993/1993] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:49 2022] POST /identity/v3/users => generated 303 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:49.435117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.435327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.435596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.463143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:49.464994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.473606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.474666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.475148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.475502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 994/1994] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:49.475971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.476572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.480266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.484395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.502229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587d3b2-22ea-4aab-9143-38b9266cf2fc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.510490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.511123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.511410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.512222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.513836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.545273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.547124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.552392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:49.566919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1001/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:49.567923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.585246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:49.586843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db34ec-ffe0-4c67-ad34-e66d38a52a27 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.592477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.594308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.594645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.594925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.595655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.597317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.599966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.603016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.613101 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1002/1996] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:49.613101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.614634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.619138 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 995/1997] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:49 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:49.630999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.662088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668f9cd-a9aa-4d19-8575-388eb1758b4c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.670916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.671908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.672332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.672755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] PATH_INFO: `/v3/projects/9cc408f13fea47a1bb205f4aece9e78c/users/8f407849721640989cb13cb1f3009f15/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.709854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c6e9e-1ab8-4e3d-aa4c-9ce485d6a4f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.713323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc408f13fea47a1bb205f4aece9e78c, user_id=8f407849721640989cb13cb1f3009f15, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.716781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.725582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.726250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.726531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.726935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.749005 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 996/1998] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:49 2022] PUT /identity/v3/projects/9cc408f13fea47a1bb205f4aece9e78c/users/8f407849721640989cb13cb1f3009f15/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:49.750281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.751509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.752970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.764891 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1003/1999] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:49.766007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.794720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e578c90-32d3-4653-9359-84c7d7828e7f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.883761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.884398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.884677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.885169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.886051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.888105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.897864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f8cee-c125-4f1d-bc4b-f78c3489317b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.903606 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1004/2000] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:49.905335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.906281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.906563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.906884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.910394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:49.913045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:49.931322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88b67e-15d9-4e71-ac33-47c60b6967b6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:49.938168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88a7d-8ec2-4446-9b9f-4389d63325fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:49.940855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88a7d-8ec2-4446-9b9f-4389d63325fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.941351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88a7d-8ec2-4446-9b9f-4389d63325fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.941840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88a7d-8ec2-4446-9b9f-4389d63325fe admin admin] PATH_INFO: `/v3/projects/9cc408f13fea47a1bb205f4aece9e78c/users/8f407849721640989cb13cb1f3009f15/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:49.945956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88a7d-8ec2-4446-9b9f-4389d63325fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc408f13fea47a1bb205f4aece9e78c, user_id=8f407849721640989cb13cb1f3009f15, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:49.950444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88a7d-8ec2-4446-9b9f-4389d63325fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:49.968007 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1005/2001] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:49 2022] PUT /identity/v3/projects/9cc408f13fea47a1bb205f4aece9e78c/users/8f407849721640989cb13cb1f3009f15/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:49.983075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:49.983570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:49.983933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.018659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.020389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.033646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 997/2002] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:50.043931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] MFA Rules not processed for user `8f407849721640989cb13cb1f3009f15`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:50.046067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.150640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:50.163909 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1006/2003] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:50.215041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.216461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.238768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55c51f-c885-429a-a71f-c08f9962f2d7 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:50.253867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.256115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.330319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:50.331070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.332169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.332512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] PATH_INFO: `/v3/users/8e6478c845e84f2dbf66826f632372e9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.333762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6478c845e84f2dbf66826f632372e9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.335888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.346958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:50.375722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17792e7-388f-421b-afe3-41798d6b8f69 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:50.384804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:50.385865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.386532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.387189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.399034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.401253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.412744 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1007/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:50.413747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.415201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.432351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6478c845e84f2dbf66826f632372e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.434660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461cfd3-06db-4566-b934-57e6fb7bbbd0 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:50.441544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:50.442443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.442895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.443372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] PATH_INFO: `/v3/users/581f79694cc5431cbdcddbf57705f8b6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.445739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] RBAC: Authorizing `identity:delete_user(user_id=581f79694cc5431cbdcddbf57705f8b6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.446074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6478c845e84f2dbf66826f632372e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.446876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6478c845e84f2dbf66826f632372e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.449248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.457726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6478c845e84f2dbf66826f632372e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.459057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6478c845e84f2dbf66826f632372e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.486908 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 998/2005] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:50 2022] DELETE /identity/v3/users/8e6478c845e84f2dbf66826f632372e9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:50.488372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.489606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.575078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581f79694cc5431cbdcddbf57705f8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.589668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581f79694cc5431cbdcddbf57705f8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.590461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581f79694cc5431cbdcddbf57705f8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.600840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec54c30-6685-41c5-a208-358d0482ca49 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:50.601691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581f79694cc5431cbdcddbf57705f8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.602478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0362375b-2f7c-46a9-8a30-5d10276683df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581f79694cc5431cbdcddbf57705f8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.607126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:50.607961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.608338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.608732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] PATH_INFO: `/v3/projects/95e80c722df94993b9231f5b17ee4c3d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.610615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e80c722df94993b9231f5b17ee4c3d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.613013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.626159 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1008/2006] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:50 2022] DELETE /identity/v3/users/581f79694cc5431cbdcddbf57705f8b6 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:50.627930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bcfd3-5725-45f2-85cd-15b92e21cfde None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.628398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bcfd3-5725-45f2-85cd-15b92e21cfde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.628818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bcfd3-5725-45f2-85cd-15b92e21cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.656467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5b1bcfd3-5725-45f2-85cd-15b92e21cfde None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:50.658162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b1bcfd3-5725-45f2-85cd-15b92e21cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.677152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e80c722df94993b9231f5b17ee4c3d', 'request_id': 'req-56ddccde-c8bf-48da-a45d-1a419a8bcb22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.688703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e80c722df94993b9231f5b17ee4c3d', 'request_id': 'req-56ddccde-c8bf-48da-a45d-1a419a8bcb22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.699065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e80c722df94993b9231f5b17ee4c3d', 'request_id': 'req-56ddccde-c8bf-48da-a45d-1a419a8bcb22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.728312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] The token cache is being invalidate because project 95e80c722df94993b9231f5b17ee4c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:50.729420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.730954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.735899 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 999/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:50 2022] DELETE /identity/v3/projects/95e80c722df94993b9231f5b17ee4c3d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:50.737862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.739123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.740316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:50.756926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:50.767152 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1009/2008] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:50.769197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.769672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.770122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.804706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:50.806023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.818179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1010/2009] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:50.819326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.821331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.823284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddccde-c8bf-48da-a45d-1a419a8bcb22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:50.829897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:50.830818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.832209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.832671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] PATH_INFO: `/v3/users/8a1bd0cb84574a90885ce189bb6e3b81` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.836987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1bd0cb84574a90885ce189bb6e3b81)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.837521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0a568-15d5-49d7-8a44-d57ab8d89d18 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:50.841112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.855053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:50.855928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:50.856189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:50.862645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] PATH_INFO: `/v3/users/c5a9c291f290489caa0a328d923c3488` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:50.863464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a9c291f290489caa0a328d923c3488)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:50.865413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:50.910878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1bd0cb84574a90885ce189bb6e3b81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.927385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1bd0cb84574a90885ce189bb6e3b81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.929115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1bd0cb84574a90885ce189bb6e3b81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.939874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1bd0cb84574a90885ce189bb6e3b81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.940694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1bd0cb84574a90885ce189bb6e3b81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.948944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a9c291f290489caa0a328d923c3488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.963941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a9c291f290489caa0a328d923c3488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.964728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a9c291f290489caa0a328d923c3488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.966524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1000/2010] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:50 2022] DELETE /identity/v3/users/8a1bd0cb84574a90885ce189bb6e3b81 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:50.967449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.968850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:50.974263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a9c291f290489caa0a328d923c3488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.975143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a9c291f290489caa0a328d923c3488'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:50.991155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1011/2011] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:50 2022] DELETE /identity/v3/users/c5a9c291f290489caa0a328d923c3488 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:50.991750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:50.993118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.044042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8be54-8070-4109-96fe-e8231ecccb82 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.083371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b0bb9-fa94-431d-94c0-adc099df8897 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.087320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.087954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.088354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.088629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.090650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.109355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:51.116466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.117150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.117605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.118054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.121958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.179347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.180914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4883e9a-4780-436e-8b99-67bfc0ff4936 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.192333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1012/2012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:51.193462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.193830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.194166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.218239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:51.219630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.223585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.226012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.229730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1013/2013] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:51.237667 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1001/2014] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:51.253379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:51.255194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.270130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:51.277238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be9221-f7aa-4bf0-b136-97e1a90e87d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.282774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa09d6-8b52-4d8b-82df-872eb236c011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.284114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa09d6-8b52-4d8b-82df-872eb236c011 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.285580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa09d6-8b52-4d8b-82df-872eb236c011 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.286562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa09d6-8b52-4d8b-82df-872eb236c011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.301079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa09d6-8b52-4d8b-82df-872eb236c011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.303330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa09d6-8b52-4d8b-82df-872eb236c011 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.315763 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1014/2015] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:51.396178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:51.398946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.412311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4627d-400a-44db-a456-c311c5488182 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.418270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.419506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.419506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.419718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] PATH_INFO: `/v3/projects/30dfe0aa5f804f7080e8d026ff0bcd92` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.421288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dfe0aa5f804f7080e8d026ff0bcd92)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.423099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.490116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dfe0aa5f804f7080e8d026ff0bcd92', 'request_id': 'req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.502863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dfe0aa5f804f7080e8d026ff0bcd92', 'request_id': 'req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.527751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dfe0aa5f804f7080e8d026ff0bcd92', 'request_id': 'req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.570223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] The token cache is being invalidate because project 30dfe0aa5f804f7080e8d026ff0bcd92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:51.570909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.572403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a47317cb-c5b3-4d49-a73f-52b290ab3bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.579414 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1002/2016] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:51 2022] DELETE /identity/v3/projects/30dfe0aa5f804f7080e8d026ff0bcd92 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:51.581057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.581775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.581775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.616845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:51.618118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.714418 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1015/2017] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:51.716206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.716694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.716982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.755555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:51.756798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.779440 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1003/2018] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:51.783911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:51.794819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee76f1c-fb37-485f-bc74-02380af8cc8c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.800054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.800918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.801394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.801903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.802766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:51.803291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.805110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.831815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1016/2019] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:51.833393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:51.844647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738c815-908f-4e05-95f4-199a6102d75e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.851499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:51.852784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.853273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.853553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.853839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:51.853941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.855161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.857235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.867448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f679a-2938-47da-86ed-b524d938ae45 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:51.884358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:51.885179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:51.885545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:51.886065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] PATH_INFO: `/v3/projects/1e68a44cc9d74ecb9259ac82b777939e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:51.888008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e68a44cc9d74ecb9259ac82b777939e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:51.890113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:51.914737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1004/2020] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:51 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:51.919224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:51.975012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e68a44cc9d74ecb9259ac82b777939e', 'request_id': 'req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.985026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e68a44cc9d74ecb9259ac82b777939e', 'request_id': 'req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:51.991677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e68a44cc9d74ecb9259ac82b777939e', 'request_id': 'req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.001997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:52.009254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] The token cache is being invalidate because project 1e68a44cc9d74ecb9259ac82b777939e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:52.009550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.010709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.012223 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1017/2021] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:51 2022] DELETE /identity/v3/projects/1e68a44cc9d74ecb9259ac82b777939e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:46:52.013009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.017591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.022717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8516-e8ee-4f45-945d-a0f5f1e5de13 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.104124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.104751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.105032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.105302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.106116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.108244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.112172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae91e32-d035-4cf4-8f88-e5e8b7c4d2ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.117372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.118168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.118515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.118969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] PATH_INFO: `/v3/projects/393c30f287484ec68631da999171a853` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.120623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393c30f287484ec68631da999171a853)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.122655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.125191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:52.144021 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1005/2022] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:51 2022] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:46:52.144021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.145265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.157354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10157690-5f76-4410-a1cb-58e3db485c6c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.162010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.162643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.162921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.163200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] PATH_INFO: `/v3/projects/cf185db7458546f8af11d535235c6fb9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.164373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf185db7458546f8af11d535235c6fb9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.166348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.172538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393c30f287484ec68631da999171a853', 'request_id': 'req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.179143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393c30f287484ec68631da999171a853', 'request_id': 'req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.185033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393c30f287484ec68631da999171a853', 'request_id': 'req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.197281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] The token cache is being invalidate because project 393c30f287484ec68631da999171a853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:52.197594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.198319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.199938 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1018/2023] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:52 2022] DELETE /identity/v3/projects/393c30f287484ec68631da999171a853 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:52.200874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.202293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.219001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf185db7458546f8af11d535235c6fb9', 'request_id': 'req-fe4b1950-e21f-4a14-a38b-4471938e7093'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.227792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf185db7458546f8af11d535235c6fb9', 'request_id': 'req-fe4b1950-e21f-4a14-a38b-4471938e7093'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.233553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf185db7458546f8af11d535235c6fb9', 'request_id': 'req-fe4b1950-e21f-4a14-a38b-4471938e7093'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.248904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] The token cache is being invalidate because project cf185db7458546f8af11d535235c6fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:52.249197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.249905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.251446 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1006/2024] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:52 2022] DELETE /identity/v3/projects/cf185db7458546f8af11d535235c6fb9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:52.252281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.253598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.272100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7cd7-b62f-4082-87a1-a6deea3b0e89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.320739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b1950-e21f-4a14-a38b-4471938e7093 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.326034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.326657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.326934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.327236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.327878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.329645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.332205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.332849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.333122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.333393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] PATH_INFO: `/v3/users/1f01c876de0248c586122b78214b6f1b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.334695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f01c876de0248c586122b78214b6f1b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.336599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.340121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1007/2025] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:52.340949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.343391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.355814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3cc4-3dc6-4a1c-a0c5-4c9db3b3526a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.360456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.361089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.361369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.361646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] PATH_INFO: `/v3/users/8f407849721640989cb13cb1f3009f15` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.362833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f407849721640989cb13cb1f3009f15)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.364811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.367381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:52.382726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:52.389232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f01c876de0248c586122b78214b6f1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.404194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f01c876de0248c586122b78214b6f1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.405183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f01c876de0248c586122b78214b6f1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.412185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f01c876de0248c586122b78214b6f1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.412807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f01c876de0248c586122b78214b6f1b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.414586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f407849721640989cb13cb1f3009f15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.424558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f407849721640989cb13cb1f3009f15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.425187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f407849721640989cb13cb1f3009f15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.428118 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1019/2026] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:52 2022] DELETE /identity/v3/users/1f01c876de0248c586122b78214b6f1b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:52.429003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.430505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.436395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f407849721640989cb13cb1f3009f15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.437150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f407849721640989cb13cb1f3009f15'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.460322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1008/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:52 2022] DELETE /identity/v3/users/8f407849721640989cb13cb1f3009f15 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:52.460322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.460322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.508007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292554e-f39c-4069-be93-98574dc1095c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.540425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c541d-9060-4b88-a1ca-8bb54a2d9e50 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.550422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.552290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.552786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.553545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.555025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.558437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.573617 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1009/2028] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:52.578032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.581688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.582422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.582706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.582980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] PATH_INFO: `/v3/users/28eccb43c1414ad8809c9d384b3d76a2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.584470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eccb43c1414ad8809c9d384b3d76a2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.587386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.589988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13821e6f-ad29-4688-b020-fc6d3e188c63 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.595054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b916-94fb-402a-9a6d-01a74f0daaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.596687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b916-94fb-402a-9a6d-01a74f0daaff admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.596988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b916-94fb-402a-9a6d-01a74f0daaff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.597247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b916-94fb-402a-9a6d-01a74f0daaff admin admin] PATH_INFO: `/v3/projects/1031cc111cc747098bbc8a428c1cfad6/users/fa30f68a081646d6b452d1cdf6e0181c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.626268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788b916-94fb-402a-9a6d-01a74f0daaff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1031cc111cc747098bbc8a428c1cfad6, user_id=fa30f68a081646d6b452d1cdf6e0181c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.629403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788b916-94fb-402a-9a6d-01a74f0daaff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.654573 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1010/2029] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:52 2022] PUT /identity/v3/projects/1031cc111cc747098bbc8a428c1cfad6/users/fa30f68a081646d6b452d1cdf6e0181c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:52.665208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.665498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.666307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.669561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eccb43c1414ad8809c9d384b3d76a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.684674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eccb43c1414ad8809c9d384b3d76a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.685408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eccb43c1414ad8809c9d384b3d76a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.687560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:52.694190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eccb43c1414ad8809c9d384b3d76a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.695601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eccb43c1414ad8809c9d384b3d76a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:52.711717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:52.713310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.745546 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1020/2030] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:52 2022] DELETE /identity/v3/users/28eccb43c1414ad8809c9d384b3d76a2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:52.800008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:52.834529 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1011/2031] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:46:52.839805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:52.843677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:52.934629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad266b85-8fab-406c-ba8e-8d395b57e3f1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:52.940077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:52.940704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:52.941031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:52.941531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:52.942063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:52.944203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:52.990915 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1021/2032] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:52 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:52.996196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.069055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123b094-c1ff-4f0c-b0d4-a8f0ec461365 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.136498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.137143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.137422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.137693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.138377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.140669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.188682 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1012/2033] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:52 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:53.190011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.201273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a77e21-ac5f-4c69-8a3b-20d320b8d79c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.213590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.214301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.214584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.214856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.215514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.217135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.237256 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1022/2034] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:53.238570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.249612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816a54a-49a9-483e-9b21-d85df1f6a327 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.261772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.262895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.263259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.264690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.265344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] PATH_INFO: `/v3/projects/1d3d948782ee4768af668635788e508c/users/f3334cb715fb407c987585460261e625/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.266446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.283806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3d948782ee4768af668635788e508c, user_id=f3334cb715fb407c987585460261e625, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.287810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.288599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd41ca8-c353-4136-aa97-4c43999258d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.316359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.317668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.317668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.317668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] PATH_INFO: `/v3/projects/8b4f96e5760942f4921f38d354158d93` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.319237 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1013/2035] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:53 2022] PUT /identity/v3/projects/1d3d948782ee4768af668635788e508c/users/f3334cb715fb407c987585460261e625/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:53.320179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.321930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.324022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4f96e5760942f4921f38d354158d93)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.330842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.454190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:53.461913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4f96e5760942f4921f38d354158d93', 'request_id': 'req-fe4893ee-bbed-40f3-b009-72e851b22729'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.462146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210585ad-3167-403e-a1e1-b7f804e0fc52 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.471707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4f96e5760942f4921f38d354158d93', 'request_id': 'req-fe4893ee-bbed-40f3-b009-72e851b22729'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.479921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4f96e5760942f4921f38d354158d93', 'request_id': 'req-fe4893ee-bbed-40f3-b009-72e851b22729'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.500893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] The token cache is being invalidate because project 8b4f96e5760942f4921f38d354158d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:53.501195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.502088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.503938 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1023/2036] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:53 2022] DELETE /identity/v3/projects/8b4f96e5760942f4921f38d354158d93 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:53.504719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.506157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.543725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.544790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.545271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.546050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] PATH_INFO: `/v3/projects/9cc408f13fea47a1bb205f4aece9e78c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.547405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc408f13fea47a1bb205f4aece9e78c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.549639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.554326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:53.576651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4893ee-bbed-40f3-b009-72e851b22729 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.581778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.582719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.582998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.583272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.584130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.585699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.595981 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1024/2037] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:53.596727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.598414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.600154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc408f13fea47a1bb205f4aece9e78c', 'request_id': 'req-92286074-4628-4d7c-9a70-b7bc01eb983b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.606849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc408f13fea47a1bb205f4aece9e78c', 'request_id': 'req-92286074-4628-4d7c-9a70-b7bc01eb983b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.610905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9059b-06f7-43e0-a667-f37fe9ed0696 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.612679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc408f13fea47a1bb205f4aece9e78c', 'request_id': 'req-92286074-4628-4d7c-9a70-b7bc01eb983b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.629260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] The token cache is being invalidate because project 9cc408f13fea47a1bb205f4aece9e78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:53.629540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.630261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92286074-4628-4d7c-9a70-b7bc01eb983b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.632517 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1014/2038] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:53 2022] DELETE /identity/v3/projects/9cc408f13fea47a1bb205f4aece9e78c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:53.633911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.634198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.634516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.655225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:53.656456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.670694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.671364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.671643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.671919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] PATH_INFO: `/v3/projects/2cd290d9e267437b922234fab5b1278e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.673057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd290d9e267437b922234fab5b1278e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.674988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.718047 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1015/2039] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:53.719433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.721147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.721267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd290d9e267437b922234fab5b1278e', 'request_id': 'req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.727873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd290d9e267437b922234fab5b1278e', 'request_id': 'req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.734090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd290d9e267437b922234fab5b1278e', 'request_id': 'req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.735451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c43771-5a4d-4ddf-a5cf-05d567a2da19 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.748979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] The token cache is being invalidate because project 2cd290d9e267437b922234fab5b1278e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:53.749270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.750081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1ea4d7bf-295e-49fb-ba90-312c75c36bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:53.751687 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1025/2040] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:53 2022] DELETE /identity/v3/projects/2cd290d9e267437b922234fab5b1278e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:53.753079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b541dd-d31b-4d9c-8256-3a4e6199d7e7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.753425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b541dd-d31b-4d9c-8256-3a4e6199d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.753776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b541dd-d31b-4d9c-8256-3a4e6199d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.769329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:53.773366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e2b541dd-d31b-4d9c-8256-3a4e6199d7e7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:53.774679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e2b541dd-d31b-4d9c-8256-3a4e6199d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.799530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cd907-36ff-4239-b500-04c72328a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.800490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cd907-36ff-4239-b500-04c72328a655 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.800490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cd907-36ff-4239-b500-04c72328a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.801124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cd907-36ff-4239-b500-04c72328a655 admin admin] PATH_INFO: `/v3/projects/1d3d948782ee4768af668635788e508c/users/f3334cb715fb407c987585460261e625/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.802818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cd907-36ff-4239-b500-04c72328a655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3d948782ee4768af668635788e508c, user_id=f3334cb715fb407c987585460261e625, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.805473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cd907-36ff-4239-b500-04c72328a655 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:53.815790 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1016/2041] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:53 2022] PUT /identity/v3/projects/1d3d948782ee4768af668635788e508c/users/f3334cb715fb407c987585460261e625/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:53.816994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c3443-5b31-4d0e-9330-a1b104597984 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.817273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c3443-5b31-4d0e-9330-a1b104597984 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.817548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c3443-5b31-4d0e-9330-a1b104597984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.837277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a3c3443-5b31-4d0e-9330-a1b104597984 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:53.838617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a3c3443-5b31-4d0e-9330-a1b104597984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.849232 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1026/2042] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:53.849232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542c0f-d3fb-466f-a76c-7e060a72ec7b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.849232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542c0f-d3fb-466f-a76c-7e060a72ec7b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.849232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae542c0f-d3fb-466f-a76c-7e060a72ec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.868072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ae542c0f-d3fb-466f-a76c-7e060a72ec7b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:53.869302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae542c0f-d3fb-466f-a76c-7e060a72ec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.874247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:53.903380 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1017/2043] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:53.904739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.905006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.905280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.933098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] MFA Rules not processed for user `f3334cb715fb407c987585460261e625`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:53.934374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.936912 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1027/2044] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:53.938304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.938587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.938852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.958041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:53.959251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:53.967106 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1028/2045] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:53.967947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:53.979517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f9b92-80ac-4623-81fd-b841b9c43ea5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:53.984122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:53.984823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:53.984994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:53.985263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:53.985933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:53.986232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:53.987824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad523f-a7fd-42d3-adf5-661cbf11d3b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.004663 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1029/2046] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:54.004663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.004663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.004663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.011829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1018/2047] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:54.018748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.025268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:54.026888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:54.032594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86541b9-6a6c-4e41-9198-9fdfa9c97ef9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.035569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1030/2048] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:54.036430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.042896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.043529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.043804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.044070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.044720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:54.045027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.046637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896b3d1-4197-42b1-afb9-e7eb5059d525 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.048133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886a534-3d6a-4059-b667-4812ecd80fc3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.062776 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1019/2049] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:54.062776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.062776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.062776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.068350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.069399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.070731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.071222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.072051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.074703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.081648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:54.082894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:54.119087 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1031/2050] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/projects => generated 391 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:54.121050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.123251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:54.160270 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1020/2051] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:54.161408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.178336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ce66a-dbf8-4b11-8257-ed8f0c235988 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.217842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dff8d4-ee12-452d-8edb-6c60b5b62c02 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.225458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.226113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.226391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.226657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.227830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:46:54.228136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.234611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.254124 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1032/2052] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:46:54.254124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.261192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe5ab8-7672-48ad-bd88-39da7fef1154 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.264053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.264916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.265048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.265255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.265924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.266043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.266523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.266799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.267065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.267686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.267914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.269572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.298712 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1033/2053] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:54.298712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.299399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:54.305373 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1021/2054] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:54.305373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.344338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:54.373904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959991b5-c57a-42bb-9de8-e45cbc186efb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.378570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.379187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.379464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.379733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.380366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.382341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.386113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638671cf-1d29-4c1d-a45d-6253d9a5bb3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.413219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1022/2055] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/projects => generated 397 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:54.414373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.468059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.468952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.469240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.470123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.472991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:54.479512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:54.484748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7c653-84b1-430f-8ed5-4563c5fb5555 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.491928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.493148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.493441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.494010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.495079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.497075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.509765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1023/2056] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:54.511004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.522186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9e8da-042d-481e-bddc-38b884bb96f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.528799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.529638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.530289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.530674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.531852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.533835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.546210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.548079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.561826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1034/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:54.563007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.566663 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1024/2058] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/users => generated 303 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:54.570823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.577006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1167c559-cb1e-4808-a925-ea28cd5b94a5 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.582385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.583154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.583437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.583708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.584394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.585990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd246d3-9908-44c9-8b87-93c9bcc93459 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.587076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.592710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.593553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.593858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.594144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.600083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.603967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.623419 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1035/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/users => generated 299 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:54.624370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.631940 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1025/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:54.633658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.637458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86bcd8-9dba-4766-aee6-b31d3a280770 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.642442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.643042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.643320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.643588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.644233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.646086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.648425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951ca43-d47c-44e8-a706-5b9fc025f029 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.654253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.654768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.655045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.655446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.656085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.657705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.658108 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1036/2061] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:54.658921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.669123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c986-d2a3-4cb1-bb67-00fa6b419fe4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.673256 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1026/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:54.674233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.681293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.682228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.682708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.682996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] PATH_INFO: `/v3/projects/67424d4d21764b87b04ff73a7978c1f7/users/03a8810637804c77a761d976c086d4c6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.687239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6df1a9-3066-4fcb-bf78-fd637b77ba06 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.692804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.693765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.694237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.694988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.695935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.697899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.708167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67424d4d21764b87b04ff73a7978c1f7, user_id=03a8810637804c77a761d976c086d4c6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.710835 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1027/2063] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:54.711077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.712147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.725510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1803e381-5ac7-4f31-b210-c2c8eb3588b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.728428 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1037/2064] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:54 2022] PUT /identity/v3/projects/67424d4d21764b87b04ff73a7978c1f7/users/03a8810637804c77a761d976c086d4c6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:54.729588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.758881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:54.818945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c02f61-770e-41c3-8ba1-665425a9f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.819567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02f61-770e-41c3-8ba1-665425a9f2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.819842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02f61-770e-41c3-8ba1-665425a9f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.820110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c02f61-770e-41c3-8ba1-665425a9f2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.820751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02f61-770e-41c3-8ba1-665425a9f2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.821336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717bd9e-c473-4c51-89a4-f0023edac76d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.822646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c02f61-770e-41c3-8ba1-665425a9f2a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.827377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.828275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.828958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.829392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] PATH_INFO: `/v3/projects/5fc751bd4c20472cb4414f1a58318cea/users/1f71dd00738c414d8ae6265b6e9049be/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.834545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1028/2065] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:54.835823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f958-8ea0-400f-b74b-f99eac2fe515 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.836105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f958-8ea0-400f-b74b-f99eac2fe515 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.836370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1f958-8ea0-400f-b74b-f99eac2fe515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.847714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc751bd4c20472cb4414f1a58318cea, user_id=1f71dd00738c414d8ae6265b6e9049be, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.850913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.868225 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1038/2066] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:54 2022] PUT /identity/v3/projects/5fc751bd4c20472cb4414f1a58318cea/users/1f71dd00738c414d8ae6265b6e9049be/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:54.868441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-37f1f958-8ea0-400f-b74b-f99eac2fe515 None None] MFA Rules not processed for user `03a8810637804c77a761d976c086d4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:54.869332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37f1f958-8ea0-400f-b74b-f99eac2fe515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:54.871171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:54.944715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5b4dd-06fe-42ed-9408-47ce2b6c0935 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:54.950107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:54.950776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.951052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.951452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] PATH_INFO: `/v3/projects/60896479fb0c4357ad5fb03016470283/users/f0ea28d9bb3544bca1a3c90d983fe8e4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.957932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1029/2067] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:54.957932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:54.957932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:54.957932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:54.969068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60896479fb0c4357ad5fb03016470283, user_id=f0ea28d9bb3544bca1a3c90d983fe8e4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:54.972129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:54.979003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:54.980179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:54.988349 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1030/2068] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:54.989162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.002748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1039/2069] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:54 2022] PUT /identity/v3/projects/60896479fb0c4357ad5fb03016470283/users/f0ea28d9bb3544bca1a3c90d983fe8e4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:55.003684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.005677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:55.007498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932a507-a049-430e-b544-b8b37521d9f8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.027404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:55.082051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43158b-8e6b-4f35-8be6-32d063881cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.082689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43158b-8e6b-4f35-8be6-32d063881cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.084500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43158b-8e6b-4f35-8be6-32d063881cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.084774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43158b-8e6b-4f35-8be6-32d063881cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.085441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43158b-8e6b-4f35-8be6-32d063881cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.087425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a43158b-8e6b-4f35-8be6-32d063881cc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.103491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c245-147b-4ca9-92ee-c6e8b1a3ca1b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.108191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.110494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.110789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.111050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.122930 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1031/2070] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:46:54 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:55.122930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.122930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.123235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.123326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.123977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.134312 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1040/2071] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:55.135908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.144841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34cec-f552-47e0-9881-23c7306be14b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.150520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:55.158784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:55.179177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:55.218524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.219149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.219422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.219688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.220438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.223136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.255874 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1041/2072] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:46:55 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:46:55.256004 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1032/2073] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:55.258640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.272591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515070d0-79d0-4102-8222-34e00c930f7d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.278852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.280644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:55.297641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.299516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.300065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.300065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.302481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.309440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.340519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1042/2074] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:55.342274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.363402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00521160-dcb4-4a0a-8ed3-731fb1127cce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.371622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.372225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa8c3d-2729-4cb0-97b7-c91f18769936 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.372398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.372675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.373543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] PATH_INFO: `/v3/projects/cbf65c4ec24e425190c586180503fc59/users/148d883f1eac4111a3d4078a01f51041/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.377386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.378202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.378491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.378761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.392850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.394539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.398271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf65c4ec24e425190c586180503fc59, user_id=148d883f1eac4111a3d4078a01f51041, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.403419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.406113 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1033/2075] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:46:55.420269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1043/2076] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:55 2022] PUT /identity/v3/projects/cbf65c4ec24e425190c586180503fc59/users/148d883f1eac4111a3d4078a01f51041/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:55.424235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.435522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3110-d1f5-43ef-b075-2331ed50388d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.522855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:55.554553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6cd73b-e7e0-4358-a7e0-fa9d58f28b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.555194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd73b-e7e0-4358-a7e0-fa9d58f28b19 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.555637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd73b-e7e0-4358-a7e0-fa9d58f28b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.556526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6cd73b-e7e0-4358-a7e0-fa9d58f28b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.557584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cd73b-e7e0-4358-a7e0-fa9d58f28b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.559389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6cd73b-e7e0-4358-a7e0-fa9d58f28b19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.578105 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1034/2077] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:46:55.579123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.596983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c30d5f4-8f50-4f10-88b1-9712e6c23f08 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.604144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.605012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.605294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.605566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] PATH_INFO: `/v3/projects/cbf65c4ec24e425190c586180503fc59/users/148d883f1eac4111a3d4078a01f51041/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.607810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf65c4ec24e425190c586180503fc59, user_id=148d883f1eac4111a3d4078a01f51041, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.611862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:55.651257 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1044/2078] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:46:55 2022] PUT /identity/v3/projects/cbf65c4ec24e425190c586180503fc59/users/148d883f1eac4111a3d4078a01f51041/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:55.653147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56fda-b0df-4a32-bbb9-327565577d88 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.653491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56fda-b0df-4a32-bbb9-327565577d88 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.653738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56fda-b0df-4a32-bbb9-327565577d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.742413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2b56fda-b0df-4a32-bbb9-327565577d88 None None] MFA Rules not processed for user `148d883f1eac4111a3d4078a01f51041`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:55.743912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2b56fda-b0df-4a32-bbb9-327565577d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:55.853712 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1035/2079] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:55.870420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:55.970637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507664b-d61f-49f8-a5e1-f66cf66f8ef3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:55.977959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:55.978895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:55.979527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:55.980050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] PATH_INFO: `/v3/users/03a8810637804c77a761d976c086d4c6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:55.982063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] RBAC: Authorizing `identity:delete_user(user_id=03a8810637804c77a761d976c086d4c6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:55.984987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:56.048602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03a8810637804c77a761d976c086d4c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:56.081427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03a8810637804c77a761d976c086d4c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:56.083270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03a8810637804c77a761d976c086d4c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:56.093366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:56.097624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03a8810637804c77a761d976c086d4c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:56.098874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03a8810637804c77a761d976c086d4c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:56.121172 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1045/2080] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:55 2022] DELETE /identity/v3/users/03a8810637804c77a761d976c086d4c6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:56.125444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:56.125729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:56.126042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:56.163060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:46:56.164326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:56.301145 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1036/2081] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:46:56.314005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:56.315597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:56.470221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4619b4ff-4c17-41c1-b920-7103f08e102c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:56.485046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:56.486451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:56.487101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:56.487823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:56.503449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:56.506605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:56.524759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1046/2082] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:46:57.684490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:57.686816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:57.700152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011f423-d390-4ae8-ac2b-ea1158e90008 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:57.707132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:57.708680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:57.709181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:57.709659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] PATH_INFO: `/v3/projects/67424d4d21764b87b04ff73a7978c1f7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:57.711257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67424d4d21764b87b04ff73a7978c1f7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:57.713909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:57.850222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67424d4d21764b87b04ff73a7978c1f7', 'request_id': 'req-315a95b3-8295-43a2-944c-34ac702ab72e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:57.892605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67424d4d21764b87b04ff73a7978c1f7', 'request_id': 'req-315a95b3-8295-43a2-944c-34ac702ab72e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:57.915592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67424d4d21764b87b04ff73a7978c1f7', 'request_id': 'req-315a95b3-8295-43a2-944c-34ac702ab72e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:57.921391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:46:57.943737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] The token cache is being invalidate because project 67424d4d21764b87b04ff73a7978c1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:46:57.943970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:57.945468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:57.948857 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1037/2083] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:57 2022] DELETE /identity/v3/projects/67424d4d21764b87b04ff73a7978c1f7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:57.953279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:57.968020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23573d-bbd0-4135-a9f3-0dffccd5b717 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:46:58.085315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:46:58.086150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:46:58.086433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:46:58.086708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] PATH_INFO: `/v3/users/148d883f1eac4111a3d4078a01f51041` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:46:58.093521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148d883f1eac4111a3d4078a01f51041)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:46:58.097195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:46:58.162566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148d883f1eac4111a3d4078a01f51041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:58.177376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148d883f1eac4111a3d4078a01f51041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:58.178206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148d883f1eac4111a3d4078a01f51041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:58.200118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148d883f1eac4111a3d4078a01f51041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:58.200854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-463aa9b4-3fa4-4733-a94c-7691dc1e7cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148d883f1eac4111a3d4078a01f51041'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:46:58.227344 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1047/2084] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:46:57 2022] DELETE /identity/v3/users/148d883f1eac4111a3d4078a01f51041 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:46:59.856645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:46:59.858329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:46:59.881635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a95b3-8295-43a2-944c-34ac702ab72e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:00.011831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:00.012770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.013207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.013746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] PATH_INFO: `/v3/projects/cbf65c4ec24e425190c586180503fc59` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.016530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf65c4ec24e425190c586180503fc59)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:00.019754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:00.159831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf65c4ec24e425190c586180503fc59', 'request_id': 'req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:00.172888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf65c4ec24e425190c586180503fc59', 'request_id': 'req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:00.184120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf65c4ec24e425190c586180503fc59', 'request_id': 'req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:00.204708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] The token cache is being invalidate because project cbf65c4ec24e425190c586180503fc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:00.205310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:00.205972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f6bf4fe8-452e-4a50-a2bc-66532d65e1b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:00.208356 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1038/2085] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:46:59 2022] DELETE /identity/v3/projects/cbf65c4ec24e425190c586180503fc59 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:00.214210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.214787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.215326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.247353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:00.248626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:00.268411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:00.366143 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1048/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:00.375070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.375349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.375627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.436725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:00.442166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:00.467254 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1039/2087] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:00.472011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:00.487166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d99e2-9d01-4845-9725-965f0c277b50 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:00.503264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:00.504443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.504988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.505274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.505970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:00.506344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:00.508850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:00.545485 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1049/2088] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:00.549660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:00.562724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab6f75-4201-485a-8461-cab7f7f05ffd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:00.572789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:00.573428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.580579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.580952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.587946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:00.590365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:00.643307 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1040/2089] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:00 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:00.646162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:00.670499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7937e9-812e-40e7-9224-1cff10a2f83a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:00.802114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:00.803403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.809243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.810061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.811395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:00.814770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:00.859149 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1050/2090] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:00 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:00.863089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:00.882050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ac466-8dc5-4887-9dbe-f5f034d96354 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:00.893895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:00.894790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.895276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.895748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.896650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:00.906854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:00.929846 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1041/2091] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:00.933185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:00.965487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201794c1-d3ca-453c-ba3f-afda39f54e38 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:00.971427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a67c5-d908-4cfb-a8b6-35e685ca048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:00.972113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a67c5-d908-4cfb-a8b6-35e685ca048c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:00.972397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a67c5-d908-4cfb-a8b6-35e685ca048c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:00.972714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a67c5-d908-4cfb-a8b6-35e685ca048c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:00.973367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a67c5-d908-4cfb-a8b6-35e685ca048c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:00.975305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a67c5-d908-4cfb-a8b6-35e685ca048c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:01.002001 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1051/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:01.002208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:01.038587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0c5ab-2e11-4ec3-a920-f11a0932118f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:01.058126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:01.059116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:01.059369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:01.059632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] PATH_INFO: `/v3/projects/8fc1ed1601c34602b558a5c820a58efd/users/678818d3f09148c48c835baa8f4ff918/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:01.094327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fc1ed1601c34602b558a5c820a58efd, user_id=678818d3f09148c48c835baa8f4ff918, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:01.097397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:01.136128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:01.136268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:01.136636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:01.137339 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1042/2093] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:01 2022] PUT /identity/v3/projects/8fc1ed1601c34602b558a5c820a58efd/users/678818d3f09148c48c835baa8f4ff918/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:01.228397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] MFA Rules not processed for user `678818d3f09148c48c835baa8f4ff918`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:01.229723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:01.376124 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1052/2094] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:01.382475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:01.429138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:01.530519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff873f0d-b079-42b4-a70e-73a782340939 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:01.541906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:01.542685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:01.542972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:01.543249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:01.549442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:01.549442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:01.618485 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1043/2095] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:01 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:01.622703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:01.640368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e52efc-1b12-421e-ab35-245530b62cb8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:01.650384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:01.769499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:01.770195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:01.770515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:01.770796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:01.771498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:01.774043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:01.818666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:01.818877 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1053/2096] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:01 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:01.834816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425af2-5357-4bd3-9f39-c48b37dc6187 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:01.841316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:01.841921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:01.842155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:01.842420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:01.843076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:01.844708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:01.862401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1044/2097] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:47:01.863700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:01.874600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782f968-b920-4c20-aa09-d99900283691 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:01.879560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:01.880321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:01.880663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:01.880982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] PATH_INFO: `/v3/projects/5b0161b448734affb39490e5343595d4/users/6b5147ae175942b5a653bb84a1d9bcf0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:01.902928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0161b448734affb39490e5343595d4, user_id=6b5147ae175942b5a653bb84a1d9bcf0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:01.905460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:01.927689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1054/2098] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:01 2022] PUT /identity/v3/projects/5b0161b448734affb39490e5343595d4/users/6b5147ae175942b5a653bb84a1d9bcf0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:01.929199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:01.956166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d10b-9306-4866-b39c-637e3c08796e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:02.107104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b06b01-0843-47ef-a6ab-e0ac2138e215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:02.108432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06b01-0843-47ef-a6ab-e0ac2138e215 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:02.109067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06b01-0843-47ef-a6ab-e0ac2138e215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:02.109421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b06b01-0843-47ef-a6ab-e0ac2138e215 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:02.110148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06b01-0843-47ef-a6ab-e0ac2138e215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:02.111792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b06b01-0843-47ef-a6ab-e0ac2138e215 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:02.127201 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1045/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:02.131892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:02.145112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d0a2e-6ae9-4e15-b948-6d95291b5e72 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:02.151486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:02.152171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:02.152453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:02.152728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] PATH_INFO: `/v3/projects/5b0161b448734affb39490e5343595d4/users/6b5147ae175942b5a653bb84a1d9bcf0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:02.156548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0161b448734affb39490e5343595d4, user_id=6b5147ae175942b5a653bb84a1d9bcf0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:02.164544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:02.192101 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1055/2100] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:02 2022] PUT /identity/v3/projects/5b0161b448734affb39490e5343595d4/users/6b5147ae175942b5a653bb84a1d9bcf0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:02.204514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181190ce-397b-41dc-8013-6c9e3a215eb4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:02.204829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181190ce-397b-41dc-8013-6c9e3a215eb4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:02.205070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181190ce-397b-41dc-8013-6c9e3a215eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:02.252229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-181190ce-397b-41dc-8013-6c9e3a215eb4 None None] MFA Rules not processed for user `6b5147ae175942b5a653bb84a1d9bcf0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:02.253473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-181190ce-397b-41dc-8013-6c9e3a215eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:02.385106 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1046/2101] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:02.403074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:02.405915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:02.518949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6256c6-a1f6-4221-a3dd-e54ebb1510d9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:02.525389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:02.526175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:02.526527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:02.526868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:02.537736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:02.539706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:02.551858 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1056/2102] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:02.659944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:02.660229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:02.661264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:02.703665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] MFA Rules not processed for user `1f71dd00738c414d8ae6265b6e9049be`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:02.705690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:02.711967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:02.811914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1047/2103] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:02.817860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:02.819339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:02.901597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:02.933779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1e979-3b6c-4553-b661-cf645b2bba13 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:02.940126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:02.940873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:02.941251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:02.941981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:02.942785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:02.944996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:02.986273 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1057/2104] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:02 2022] POST /identity/v3/projects => generated 403 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:02.992661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.002898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.017134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03adda85-33e0-4195-91df-66c619cb5b64 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.116132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.116767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.117178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.117412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.118221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:03.120973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:03.144887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa5127b-fe9f-4da6-ae10-bcb180214545 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.154269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.155036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.155235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.155494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] PATH_INFO: `/v3/users/678818d3f09148c48c835baa8f4ff918` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.166267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678818d3f09148c48c835baa8f4ff918)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:03.168856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:03.185859 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1048/2105] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:02 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:47:03.190536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.204229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef72a970-8996-406d-b2d1-50307c58ec41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.210338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.210976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.211369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.211655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.212386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:03.234692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:03.268129 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1049/2106] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:47:03.270275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.273278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678818d3f09148c48c835baa8f4ff918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:03.283738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2dde8-51e6-411f-a0d2-14f21537f942 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.293662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.294638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.294975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.295258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] PATH_INFO: `/v3/projects/7e227a55557045b48a5582260565354f/users/8b2d13dde9a64107b0a2546a8dade0f2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.298691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678818d3f09148c48c835baa8f4ff918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:03.299492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678818d3f09148c48c835baa8f4ff918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:03.308823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678818d3f09148c48c835baa8f4ff918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:03.309816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-119566a0-9528-493c-b931-ca5da549ecd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678818d3f09148c48c835baa8f4ff918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:03.318396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e227a55557045b48a5582260565354f, user_id=8b2d13dde9a64107b0a2546a8dade0f2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:03.321694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:03.334072 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1058/2107] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:03 2022] DELETE /identity/v3/users/678818d3f09148c48c835baa8f4ff918 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:47:03.338664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.339309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.340245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.342444 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1050/2108] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:03 2022] PUT /identity/v3/projects/7e227a55557045b48a5582260565354f/users/8b2d13dde9a64107b0a2546a8dade0f2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:03.346926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.349462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:03.369588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:03.371187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:03.436706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c4982-f0f4-4b1d-aef9-b9fc4216254e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.442132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:03.497709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:03.555570 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1059/2109] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:03.589202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.591409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:03.602154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.605158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.606147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.607028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.609708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:03.615846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:03.646975 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1051/2110] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:03.653574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:03.685722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49cde-a08b-42e2-b92d-f919da08b304 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.698783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca9aec-335e-4cf3-93c1-686b71c56d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.700318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9aec-335e-4cf3-93c1-686b71c56d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.701663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9aec-335e-4cf3-93c1-686b71c56d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.702505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca9aec-335e-4cf3-93c1-686b71c56d72 admin admin] PATH_INFO: `/v3/projects/7e227a55557045b48a5582260565354f/users/8b2d13dde9a64107b0a2546a8dade0f2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.707995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9aec-335e-4cf3-93c1-686b71c56d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e227a55557045b48a5582260565354f, user_id=8b2d13dde9a64107b0a2546a8dade0f2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:03.717057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ca9aec-335e-4cf3-93c1-686b71c56d72 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:03.736811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472f870-f284-44f0-9b25-6b4fcb515351 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:03.749242 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1052/2111] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:03 2022] PUT /identity/v3/projects/7e227a55557045b48a5582260565354f/users/8b2d13dde9a64107b0a2546a8dade0f2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:03.750832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.751189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.752424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:03.834844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] MFA Rules not processed for user `1e835f57621f46719369731607bebb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:03.839150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:03.875304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:03.878140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:03.878431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:03.878707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:04.000056 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1053/2112] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:04.047016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:04.054426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:04.076502 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1060/2113] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:05.973031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:05.975753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:06.009422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61aa26-6b5d-4594-b4c0-2be43e95b78d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:06.025862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:06.026590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:06.027673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:06.027969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] PATH_INFO: `/v3/projects/8fc1ed1601c34602b558a5c820a58efd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:06.030410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fc1ed1601c34602b558a5c820a58efd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:06.035626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:06.171566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fc1ed1601c34602b558a5c820a58efd', 'request_id': 'req-8d25fbc1-41db-48dc-8210-748b97e90ebe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.190871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fc1ed1601c34602b558a5c820a58efd', 'request_id': 'req-8d25fbc1-41db-48dc-8210-748b97e90ebe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.219084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fc1ed1601c34602b558a5c820a58efd', 'request_id': 'req-8d25fbc1-41db-48dc-8210-748b97e90ebe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.263403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] The token cache is being invalidate because project 8fc1ed1601c34602b558a5c820a58efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:06.263696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.269222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.280348 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1054/2114] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:05 2022] DELETE /identity/v3/projects/8fc1ed1601c34602b558a5c820a58efd => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:06.285090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:06.306586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624a84-bad9-476f-ad6c-ce3186a6f4f7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:06.465335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:06.485226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:06.485914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:06.486192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:06.486463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] PATH_INFO: `/v3/users/6b5147ae175942b5a653bb84a1d9bcf0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:06.487829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5147ae175942b5a653bb84a1d9bcf0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:06.491792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:06.623684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5147ae175942b5a653bb84a1d9bcf0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.675172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5147ae175942b5a653bb84a1d9bcf0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.676749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5147ae175942b5a653bb84a1d9bcf0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.701761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5147ae175942b5a653bb84a1d9bcf0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.703020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f69e045-5165-4d19-a19b-0d40e86f3318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5147ae175942b5a653bb84a1d9bcf0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:06.757562 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1061/2115] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:06 2022] DELETE /identity/v3/users/6b5147ae175942b5a653bb84a1d9bcf0 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:08.829213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:08.831402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:08.861768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25fbc1-41db-48dc-8210-748b97e90ebe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:08.915952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:09.025513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:09.026330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:09.026580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:09.026859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] PATH_INFO: `/v3/projects/5b0161b448734affb39490e5343595d4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:09.034241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0161b448734affb39490e5343595d4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:09.038088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:09.171258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0161b448734affb39490e5343595d4', 'request_id': 'req-eb111810-38df-482d-a9ea-a9be71dd8bcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:09.189979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0161b448734affb39490e5343595d4', 'request_id': 'req-eb111810-38df-482d-a9ea-a9be71dd8bcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:09.210416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0161b448734affb39490e5343595d4', 'request_id': 'req-eb111810-38df-482d-a9ea-a9be71dd8bcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:09.248775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] The token cache is being invalidate because project 5b0161b448734affb39490e5343595d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:09.249299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:09.250528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eb111810-38df-482d-a9ea-a9be71dd8bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:09.253852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1055/2116] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:08 2022] DELETE /identity/v3/projects/5b0161b448734affb39490e5343595d4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:09.258939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:09.259591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:09.259591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:09.300158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:09.301422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:09.495779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1062/2117] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:09.507768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:09.508053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:09.508326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:09.548267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:09.549508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:09.574673 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1056/2118] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:09.575375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:09.598993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a946b7-1c72-4863-865a-c143914a8ac1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:09.620457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:09.621335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:09.622357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:09.622704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:09.623452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:09.626055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:09.636294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:09.671822 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1063/2119] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:47:09.675915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:09.692212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e23c2-1aa7-4796-8f82-e7a43ebeb697 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:09.711388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:09.712319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:09.712859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:09.713283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:09.714769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:09.716852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:09.779961 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1057/2120] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:09 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:09.780889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:09.793347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034422-d394-4bc1-a2c4-0ffa43510532 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:09.995655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:09.996384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:09.996740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:09.997485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:09.998875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:10.001046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:10.024582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:10.061424 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1064/2121] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:09 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:47:10.065175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:10.091043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dbff7-2dbd-4a01-9401-866bf55eda13 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:10.101234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a6f7c-33cd-4af9-8c70-fcc932cb5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:10.101905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6f7c-33cd-4af9-8c70-fcc932cb5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:10.102188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6f7c-33cd-4af9-8c70-fcc932cb5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:10.102458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a6f7c-33cd-4af9-8c70-fcc932cb5db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:10.103866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6f7c-33cd-4af9-8c70-fcc932cb5db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:10.108241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a6f7c-33cd-4af9-8c70-fcc932cb5db3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:10.131752 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1058/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:10.136767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:10.152556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b5766-e9aa-4aa0-872e-29e179b66119 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:10.163619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:10.164256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:10.164533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:10.164802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:10.167414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:10.171132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:10.198763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:10.199043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:10.199314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:10.201885 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1065/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:10.204892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:10.219709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e99f7-e927-46aa-96e1-fa9cec47ab1e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:10.236882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd7a77-7890-4186-a055-c43a87dfd905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:10.237742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7a77-7890-4186-a055-c43a87dfd905 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:10.238460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7a77-7890-4186-a055-c43a87dfd905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:10.238878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd7a77-7890-4186-a055-c43a87dfd905 admin admin] PATH_INFO: `/v3/projects/a1287e36822b48f9a9020375bd0da2ab/users/6c2aa25bffe3421e8a75d88388dd5441/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:10.267881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] MFA Rules not processed for user `f0ea28d9bb3544bca1a3c90d983fe8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:10.269157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:10.303593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7a77-7890-4186-a055-c43a87dfd905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1287e36822b48f9a9020375bd0da2ab, user_id=6c2aa25bffe3421e8a75d88388dd5441, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:10.310510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd7a77-7890-4186-a055-c43a87dfd905 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:10.372576 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1066/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:10 2022] PUT /identity/v3/projects/a1287e36822b48f9a9020375bd0da2ab/users/6c2aa25bffe3421e8a75d88388dd5441/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:47:10.377902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:10.378845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:10.388234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:10.442649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:10.473570 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1059/2125] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:10.474996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:10.477685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:10.488819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:10.493777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:10.529697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd7fe-0e22-4dab-a3d7-79182ff345e6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:10.696155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1067/2126] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:10.707654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:10.710731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:10.723056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:10.723424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:10.723848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:10.725506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:10.726367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:10.731899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:10.791911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1060/2127] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:10 2022] POST /identity/v3/projects => generated 395 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:10.796628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:10.864493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c61c4-6df4-4314-aaed-44aad8997d42 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:11.001994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c433ccf-81d2-4501-a2ee-a83ac666c060 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:11.027799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:11.028409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:11.028682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:11.028949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:11.029890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:11.031822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:11.054719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:11.055365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:11.055642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:11.055913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:11.082809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:11.088270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:11.105634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1061/2128] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:10 2022] POST /identity/v3/users => generated 304 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:11.113401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:11.138743 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1068/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:11.149921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e9e42-8ba9-4f86-a03b-1088ff406444 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:11.162114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:11.163132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:11.163559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:11.164003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:11.164804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:11.166867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:11.207249 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1062/2130] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:11.208858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:11.224520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da173d-6c02-43f0-9ddf-1e309d9e5a50 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:11.237204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:11.238459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:11.238950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:11.239425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] PATH_INFO: `/v3/projects/42308a54f9f341b9b8c232c0879961af/users/8174a907c0c5453eb52b6ca846a7f819/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:11.271729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:11.279708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42308a54f9f341b9b8c232c0879961af, user_id=8174a907c0c5453eb52b6ca846a7f819, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:11.282761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:11.311888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1069/2131] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:11 2022] PUT /identity/v3/projects/42308a54f9f341b9b8c232c0879961af/users/8174a907c0c5453eb52b6ca846a7f819/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:11.315973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:11.332203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e68feb-47fb-4a4a-bf78-f509efa7ef9c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:11.493696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:11.494948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:11.495586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:11.495862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:11.496541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:11.498474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:11.507254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:11.526699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:11.527466 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1063/2132] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:11.542899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0901c07c-97d9-4382-882a-334c1dc22141 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:11.561278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7afc7-bee7-47f1-b1a1-480465ea391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:11.562437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7afc7-bee7-47f1-b1a1-480465ea391d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:11.563782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7afc7-bee7-47f1-b1a1-480465ea391d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:11.565089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7afc7-bee7-47f1-b1a1-480465ea391d admin admin] PATH_INFO: `/v3/projects/42308a54f9f341b9b8c232c0879961af/users/8174a907c0c5453eb52b6ca846a7f819/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:11.568720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7afc7-bee7-47f1-b1a1-480465ea391d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42308a54f9f341b9b8c232c0879961af, user_id=8174a907c0c5453eb52b6ca846a7f819, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:11.578180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7afc7-bee7-47f1-b1a1-480465ea391d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:11.637593 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1070/2133] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:11 2022] PUT /identity/v3/projects/42308a54f9f341b9b8c232c0879961af/users/8174a907c0c5453eb52b6ca846a7f819/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:18.303970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:18.316587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:18.427992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ea835-6145-4123-b3ab-ab0290845727 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:18.518161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:18.518951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:18.519157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:18.519425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:18.526473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:18.674573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:18.678719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de0fe3-5ea0-4d74-89c8-d95bfeb42916 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:18.705457 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1064/2134] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:19.794948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:19.795504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:19.795504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:19.851055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:19.852613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:20.039123 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1071/2135] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:20.386077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:20.386724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:20.386724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:20.432124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] MFA Rules not processed for user `6c2aa25bffe3421e8a75d88388dd5441`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:20.433887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:20.524030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:20.678243 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1065/2136] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:20.682921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:20.863066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853af49f-2ed6-4212-bbe5-f3e123078b53 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:20.897972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:20.898627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:20.898905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:20.902373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:20.905295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:20.914748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:20.975355 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1072/2137] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:20 2022] POST /identity/v3/projects => generated 369 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:20.979543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:20.999435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603e291-308f-4ea4-b31d-143be48db6c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:21.119640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:21.121931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:21.121931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:21.121931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:21.122426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:21.125892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:21.187224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:21.188257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1066/2138] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:20 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:47:21.204959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1facf5e0-1506-4580-bdab-1599feaf95f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:21.211973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:21.213108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:21.214367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:21.214726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:21.215715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:21.218258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:21.240393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:21.253027 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1073/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:21.255860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda80719-9159-43e0-aa7a-715cdb8a4333 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:21.265564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:21.266910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:21.267529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:21.268119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] PATH_INFO: `/v3/projects/eeceedb4ed084d7a876c03f27463bcf6/users/1605b259e8e54f4491e692b7073b3dc4/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:21.289037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeceedb4ed084d7a876c03f27463bcf6, user_id=1605b259e8e54f4491e692b7073b3dc4, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:21.292818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:21.327272 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1067/2140] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:21 2022] PUT /identity/v3/projects/eeceedb4ed084d7a876c03f27463bcf6/users/1605b259e8e54f4491e692b7073b3dc4/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:21.329297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:21.351501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f7e58-4335-4a0e-82fb-efda19be2e68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:21.516697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:21.533150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:21.533838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:21.534737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:21.534737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:21.535201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:21.537494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:21.572109 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1074/2141] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:21.576386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:21.602790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a7042-7840-436d-9246-221615a3be09 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:21.615234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc0a2-59bf-4df1-8839-1d7984012436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:21.616032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc0a2-59bf-4df1-8839-1d7984012436 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:21.616854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc0a2-59bf-4df1-8839-1d7984012436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:21.617275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc0a2-59bf-4df1-8839-1d7984012436 admin admin] PATH_INFO: `/v3/projects/eeceedb4ed084d7a876c03f27463bcf6/users/1605b259e8e54f4491e692b7073b3dc4/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:21.623749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc0a2-59bf-4df1-8839-1d7984012436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeceedb4ed084d7a876c03f27463bcf6, user_id=1605b259e8e54f4491e692b7073b3dc4, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:21.634093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc0a2-59bf-4df1-8839-1d7984012436 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:21.668615 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1068/2142] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:21 2022] PUT /identity/v3/projects/eeceedb4ed084d7a876c03f27463bcf6/users/1605b259e8e54f4491e692b7073b3dc4/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:47:21.842773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:21.845266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:21.890659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a745f0f-fdfa-4e25-a7eb-906c3a6a1798 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:22.078431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:22.079098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:22.079380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:22.079657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] PATH_INFO: `/v3/users/5a3d655324ed4f23909beda9ceff0123` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:22.085610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3d655324ed4f23909beda9ceff0123)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:22.092289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:22.230458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3d655324ed4f23909beda9ceff0123'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:22.256300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3d655324ed4f23909beda9ceff0123'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:22.257363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3d655324ed4f23909beda9ceff0123'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:22.270105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3d655324ed4f23909beda9ceff0123'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:22.271406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3d655324ed4f23909beda9ceff0123'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:22.303878 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1075/2143] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:21 2022] DELETE /identity/v3/users/5a3d655324ed4f23909beda9ceff0123 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:22.305906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715c35a-249e-4f1e-80ed-91bb8e230e39 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:22.306443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715c35a-249e-4f1e-80ed-91bb8e230e39 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:22.306805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715c35a-249e-4f1e-80ed-91bb8e230e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:22.344743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a715c35a-249e-4f1e-80ed-91bb8e230e39 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:22.361399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a715c35a-249e-4f1e-80ed-91bb8e230e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:22.580306 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1069/2144] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:22.667204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:22.668907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:22.801284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0710f6-fa9f-46f7-984c-4264f378af41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:22.805447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:22.827945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:22.830776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:22.831628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:22.867944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:22.871797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:22.920187 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1076/2145] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:47:24.272477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:24.273157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:24.273157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:24.332648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:24.356477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] MFA Rules not processed for user `8b2d13dde9a64107b0a2546a8dade0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:24.375570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:24.658524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1070/2146] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:24 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:25.886059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:25.888250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:25.916233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045132f1-8572-4d31-ac35-f0239f3c1cec service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:25.924275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:25.924966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:25.925380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:25.925655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] PATH_INFO: `/v3/projects/fa0ee86db58d4231a356e54307ccf6f2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:25.932653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa0ee86db58d4231a356e54307ccf6f2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:25.934665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:25.955054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:26.042630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa0ee86db58d4231a356e54307ccf6f2', 'request_id': 'req-a0be2626-c4d6-4db1-80a6-cae962710a42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.050036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa0ee86db58d4231a356e54307ccf6f2', 'request_id': 'req-a0be2626-c4d6-4db1-80a6-cae962710a42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.056688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa0ee86db58d4231a356e54307ccf6f2', 'request_id': 'req-a0be2626-c4d6-4db1-80a6-cae962710a42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.082426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] The token cache is being invalidate because project fa0ee86db58d4231a356e54307ccf6f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:26.082738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.090271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.092228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1077/2147] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:25 2022] DELETE /identity/v3/projects/fa0ee86db58d4231a356e54307ccf6f2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:26.096405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:26.119371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537a630-8110-4a70-80ec-ba3fa73accb5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:26.236828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:26.238617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:26.239125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:26.239814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] PATH_INFO: `/v3/users/d45ccfbbd19c4f6fbe16a30c16edfef9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:26.241242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45ccfbbd19c4f6fbe16a30c16edfef9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:26.243837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:26.339363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45ccfbbd19c4f6fbe16a30c16edfef9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.351948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45ccfbbd19c4f6fbe16a30c16edfef9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.354547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45ccfbbd19c4f6fbe16a30c16edfef9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.369473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45ccfbbd19c4f6fbe16a30c16edfef9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.372326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef5be645-9a8a-44e6-a9b1-dc41a06b27a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45ccfbbd19c4f6fbe16a30c16edfef9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:26.429975 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1071/2148] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:26 2022] DELETE /identity/v3/users/d45ccfbbd19c4f6fbe16a30c16edfef9 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:28.934391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:28.935871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:28.980655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be2626-c4d6-4db1-80a6-cae962710a42 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:29.246977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:29.247650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.247945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.248200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] PATH_INFO: `/v3/projects/0a35b71ce902468f8489db054f38a60e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.251339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a35b71ce902468f8489db054f38a60e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:29.253434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:29.321471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a35b71ce902468f8489db054f38a60e', 'request_id': 'req-5e9a31a2-5c96-415e-9d03-281dc2dfab10'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:29.329752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a35b71ce902468f8489db054f38a60e', 'request_id': 'req-5e9a31a2-5c96-415e-9d03-281dc2dfab10'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:29.343047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a35b71ce902468f8489db054f38a60e', 'request_id': 'req-5e9a31a2-5c96-415e-9d03-281dc2dfab10'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:29.382895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] The token cache is being invalidate because project 0a35b71ce902468f8489db054f38a60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:29.383279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:29.383996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5e9a31a2-5c96-415e-9d03-281dc2dfab10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:29.390443 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1078/2149] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:28 2022] DELETE /identity/v3/projects/0a35b71ce902468f8489db054f38a60e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:29.392330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.392824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.393053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.425621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:29.426992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:29.438981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:29.520740 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1072/2150] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:29.528900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.529182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.529451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.595746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:29.596907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:29.605741 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1079/2151] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:29.610285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:29.621219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934d6ce-0f62-4b6a-af6a-f533561a984c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:29.626853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:29.627478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.627754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.628025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.628676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:29.628978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:29.630657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:29.655402 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1073/2152] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:29.656665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:29.669580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22904ef-bfef-4f59-8592-fe5671fc9d75 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:29.679253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:29.679424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.679697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.680242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.681054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:29.683411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:29.730612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:29.742830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:29.751770 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1080/2153] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:29 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:47:29.755848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d159ce-a725-4784-b3bb-52e8ce265691 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:29.836536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:29.837337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.837867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.838223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.838928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:29.841835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:29.871802 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1074/2154] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:29 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:29.872861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:29.889400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f42a1-7b42-4572-8e4b-be21b5fb91be admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:29.904917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:29.905609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.906004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.906119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.906747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:29.908788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:29.929579 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1081/2155] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:29.933764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:29.951255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acbaa7-50cf-4384-a082-0b46f1d28579 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:29.967557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccdf7c-fb5e-4846-9e61-24a353d8e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:29.968474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccdf7c-fb5e-4846-9e61-24a353d8e47e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:29.968911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccdf7c-fb5e-4846-9e61-24a353d8e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:29.969347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccdf7c-fb5e-4846-9e61-24a353d8e47e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:29.975808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccdf7c-fb5e-4846-9e61-24a353d8e47e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:29.977989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccdf7c-fb5e-4846-9e61-24a353d8e47e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:30.013340 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1075/2156] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:30.017251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:30.029673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a646b-e46c-43d4-a8e7-7a5079a1e4c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:30.051267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8931b8-47d6-4bd3-beb1-d63caa3c1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:30.054393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8931b8-47d6-4bd3-beb1-d63caa3c1349 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:30.054683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8931b8-47d6-4bd3-beb1-d63caa3c1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:30.060175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8931b8-47d6-4bd3-beb1-d63caa3c1349 admin admin] PATH_INFO: `/v3/projects/4ba4b121877b458092bfd5cadec5aa3d/users/68cdeea2722e49e09ccf0b4f892906d4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:30.097198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8931b8-47d6-4bd3-beb1-d63caa3c1349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ba4b121877b458092bfd5cadec5aa3d, user_id=68cdeea2722e49e09ccf0b4f892906d4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:30.100120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8931b8-47d6-4bd3-beb1-d63caa3c1349 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:30.160854 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1082/2157] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:30 2022] PUT /identity/v3/projects/4ba4b121877b458092bfd5cadec5aa3d/users/68cdeea2722e49e09ccf0b4f892906d4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:30.171549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:30.172187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:30.172718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:30.226766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] MFA Rules not processed for user `68cdeea2722e49e09ccf0b4f892906d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:30.231820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:30.388802 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1076/2158] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:30.391679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ac643-d7b7-459d-aca5-f13c79fea687 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:30.391964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ac643-d7b7-459d-aca5-f13c79fea687 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:30.392239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ac643-d7b7-459d-aca5-f13c79fea687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:30.427625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-665ac643-d7b7-459d-aca5-f13c79fea687 None None] MFA Rules not processed for user `68cdeea2722e49e09ccf0b4f892906d4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:30.428944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-665ac643-d7b7-459d-aca5-f13c79fea687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:30.442416 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1083/2159] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:30.451571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:30.453260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:30.471294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:30.621742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f8815-59df-42cf-b86e-56f84acdce80 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:30.642763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291bae5-29e6-404c-a6a2-c85805282c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:30.644468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bae5-29e6-404c-a6a2-c85805282c0a service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:30.644468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bae5-29e6-404c-a6a2-c85805282c0a service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:30.644468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291bae5-29e6-404c-a6a2-c85805282c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:30.669573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291bae5-29e6-404c-a6a2-c85805282c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:30.676500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291bae5-29e6-404c-a6a2-c85805282c0a service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:30.707123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1077/2160] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:35.373531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:35.374152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:35.374152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:35.426787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] MFA Rules not processed for user `8174a907c0c5453eb52b6ca846a7f819`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:35.430892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:35.645759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1084/2161] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:35 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:35.664688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf279ae-8342-4f9b-aac5-d44aa2c5d311 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:35.665342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf279ae-8342-4f9b-aac5-d44aa2c5d311 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:35.665936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf279ae-8342-4f9b-aac5-d44aa2c5d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:35.725437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3cf279ae-8342-4f9b-aac5-d44aa2c5d311 None None] MFA Rules not processed for user `f0ea28d9bb3544bca1a3c90d983fe8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:35.728236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cf279ae-8342-4f9b-aac5-d44aa2c5d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:35.863205 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1078/2162] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:36.026020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:36.028065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:36.066768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c5856-4d5e-4c7f-b017-acea7f60bc6d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:36.088584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:36.090598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:36.092893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:36.093283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:36.102177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:36.128431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:36.130582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79083250-d4f2-4603-b418-a20b84c4e2ec service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:36.155309 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1085/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:39.355432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c2eb3-c561-4cb7-ac0a-42a742fb1599 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:39.356319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c2eb3-c561-4cb7-ac0a-42a742fb1599 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:39.356769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c2eb3-c561-4cb7-ac0a-42a742fb1599 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:39.358354 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1079/2164] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:47:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:47:39.390197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dba6d-a4e9-4cd9-b8bc-f4dadca6dd56 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:39.391143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dba6d-a4e9-4cd9-b8bc-f4dadca6dd56 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:39.391417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dba6d-a4e9-4cd9-b8bc-f4dadca6dd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:39.421173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e26dba6d-a4e9-4cd9-b8bc-f4dadca6dd56 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:39.423674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e26dba6d-a4e9-4cd9-b8bc-f4dadca6dd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:39.535117 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1086/2165] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:47:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:39.555096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c2eb3-c561-4cb7-ac0a-42a742fb1599 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:39.564761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de2c2eb3-c561-4cb7-ac0a-42a742fb1599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:39.611547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:39.611938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:39.612315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:39.617941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c2eb3-c561-4cb7-ac0a-42a742fb1599 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:39.631001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505d10-cc2b-44c7-beeb-f1d1787e8454 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:39.632417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505d10-cc2b-44c7-beeb-f1d1787e8454 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:39.632842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505d10-cc2b-44c7-beeb-f1d1787e8454 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:39.633272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505d10-cc2b-44c7-beeb-f1d1787e8454 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:39.645390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505d10-cc2b-44c7-beeb-f1d1787e8454 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:39.647260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505d10-cc2b-44c7-beeb-f1d1787e8454 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:39.663276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1080/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:39.688345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] MFA Rules not processed for user `1605b259e8e54f4491e692b7073b3dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:39.690940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:39.709342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:39.807615 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1087/2167] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:47:39.818361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309f43-29a4-4629-978e-030e086840ae None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:39.818897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309f43-29a4-4629-978e-030e086840ae None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:39.819335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309f43-29a4-4629-978e-030e086840ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:39.862858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-96309f43-29a4-4629-978e-030e086840ae None None] MFA Rules not processed for user `6c2aa25bffe3421e8a75d88388dd5441`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:39.864338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96309f43-29a4-4629-978e-030e086840ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:40.020601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1081/2168] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:40.359392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:40.387308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5e078-64ae-46d5-8e8a-ada340bed19a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:40.406527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:40.407261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:40.407463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:40.407692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:40.417107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:40.446219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:40.448195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:40.496818 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1088/2169] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:45.772179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:45.773057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:45.773534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:45.828017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] MFA Rules not processed for user `efecedc77d3048c4a0ec0fe6701f9ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:45.830630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:45.906069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:45.948538 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1082/2170] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:50.491168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=28 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:51.011186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:51.012968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:51.128910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c258a34-7a44-44fe-ad05-ef5062004ae5 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:51.134724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:51.135581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:51.135965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:51.136345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] PATH_INFO: `/v3/users/1f71dd00738c414d8ae6265b6e9049be` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:51.138103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f71dd00738c414d8ae6265b6e9049be)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:51.141021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:51.242554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f71dd00738c414d8ae6265b6e9049be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:51.263413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f71dd00738c414d8ae6265b6e9049be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:51.267249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f71dd00738c414d8ae6265b6e9049be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:51.284739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f71dd00738c414d8ae6265b6e9049be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:51.286243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f71dd00738c414d8ae6265b6e9049be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:51.317612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1089/2171] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:51 2022] DELETE /identity/v3/users/1f71dd00738c414d8ae6265b6e9049be => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:52.366707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:52.388315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7fe15-a643-4858-992c-ecf32b6834b1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:52.525895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:52.526497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:52.526778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:52.527052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] PATH_INFO: `/v3/projects/5fc751bd4c20472cb4414f1a58318cea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:52.528381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc751bd4c20472cb4414f1a58318cea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:52.530557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:52.612448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc751bd4c20472cb4414f1a58318cea', 'request_id': 'req-64a3e0af-debb-4039-9208-8f1266660ec3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.637066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc751bd4c20472cb4414f1a58318cea', 'request_id': 'req-64a3e0af-debb-4039-9208-8f1266660ec3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.652729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc751bd4c20472cb4414f1a58318cea', 'request_id': 'req-64a3e0af-debb-4039-9208-8f1266660ec3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.677069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] The token cache is being invalidate because project 5fc751bd4c20472cb4414f1a58318cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:52.678701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.679572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.691710 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1083/2172] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:52 2022] DELETE /identity/v3/projects/5fc751bd4c20472cb4414f1a58318cea => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:52.691919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:52.693406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:52.708626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca2b4b-fea7-46ef-8d4a-81ee8cee2839 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:52.785570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:52.787019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:52.787628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:52.788118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] PATH_INFO: `/v3/users/8b2d13dde9a64107b0a2546a8dade0f2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:52.790477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2d13dde9a64107b0a2546a8dade0f2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:52.793342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:52.827975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:52.895058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2d13dde9a64107b0a2546a8dade0f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.921410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2d13dde9a64107b0a2546a8dade0f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.922502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2d13dde9a64107b0a2546a8dade0f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.933061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2d13dde9a64107b0a2546a8dade0f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.934017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f5bfc2c-edc8-4ec7-96f5-bc434321d060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2d13dde9a64107b0a2546a8dade0f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:52.953443 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1090/2173] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:52 2022] DELETE /identity/v3/users/8b2d13dde9a64107b0a2546a8dade0f2 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:47:53.196222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.198112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:53.215480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e0af-debb-4039-9208-8f1266660ec3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.280733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.281449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.281791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.282154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] PATH_INFO: `/v3/projects/7e227a55557045b48a5582260565354f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.283366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e227a55557045b48a5582260565354f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.285332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:53.300997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:53.349992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e227a55557045b48a5582260565354f', 'request_id': 'req-ffd79864-663d-428f-9507-8d9e0a6adab0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:53.364979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e227a55557045b48a5582260565354f', 'request_id': 'req-ffd79864-663d-428f-9507-8d9e0a6adab0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:53.378754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e227a55557045b48a5582260565354f', 'request_id': 'req-ffd79864-663d-428f-9507-8d9e0a6adab0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:53.393307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] The token cache is being invalidate because project 7e227a55557045b48a5582260565354f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:53.393676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:53.394536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ffd79864-663d-428f-9507-8d9e0a6adab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:53.396081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1084/2174] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:53 2022] DELETE /identity/v3/projects/7e227a55557045b48a5582260565354f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:53.401991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.402900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.403456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.427675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:53.428893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:53.505311 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1091/2175] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:53.513481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.513755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.514052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.536637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:53.538205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:53.555919 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1085/2176] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:53.559617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.588614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f8a8c-e8ce-4dd0-8496-e8866b73d591 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.605193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.606801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.607215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.607677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.609484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:53.610161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.612115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:53.636128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1092/2177] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:53.652617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.662269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338affd-9463-4adc-8a78-d9eb391448ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.668535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a02e8-221b-4a0b-a313-dfa473f67605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.668959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a02e8-221b-4a0b-a313-dfa473f67605 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.669239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a02e8-221b-4a0b-a313-dfa473f67605 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.669515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a02e8-221b-4a0b-a313-dfa473f67605 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.670200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a02e8-221b-4a0b-a313-dfa473f67605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.672336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a02e8-221b-4a0b-a313-dfa473f67605 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:53.714948 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1086/2178] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:53 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:53.715778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.726820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09ac69-4deb-4139-aa59-e6fa8afcba4a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.782800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.783175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.783542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.808896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.809521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.809821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.810096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.810672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:53.810784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.812237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:53.812804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:53.842306 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1093/2179] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:53 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:47:53.846001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.859604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f2d58-0b9f-4d0a-9b5c-7534465388d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.865944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.866540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.866817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.867106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.868082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.869961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:53.883858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1087/2180] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:47:53.886652 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1094/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:53.891420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.907447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd73cc-f78a-4bc2-a024-37e861662a91 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.913240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a9ea47-5c6d-43f0-9af6-30483ae0bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.914018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ea47-5c6d-43f0-9af6-30483ae0bdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.914378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ea47-5c6d-43f0-9af6-30483ae0bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.914806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a9ea47-5c6d-43f0-9af6-30483ae0bdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.915589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9ea47-5c6d-43f0-9af6-30483ae0bdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.917686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a9ea47-5c6d-43f0-9af6-30483ae0bdc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:53.934391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1088/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:53.938885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:53.948035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:53.953647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d8130-1162-4018-98b2-bcc56b950dc7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:53.963453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:53.964576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:53.965941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:53.966438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] PATH_INFO: `/v3/projects/29597af8302a4f0dae4262b6f0c043f0/users/75e96418bce8480b91de3abcc2779937/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:53.995515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29597af8302a4f0dae4262b6f0c043f0, user_id=75e96418bce8480b91de3abcc2779937, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:53.998235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.015118 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1095/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:53 2022] PUT /identity/v3/projects/29597af8302a4f0dae4262b6f0c043f0/users/75e96418bce8480b91de3abcc2779937/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:54.025573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.025894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.026212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.058695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] MFA Rules not processed for user `75e96418bce8480b91de3abcc2779937`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:54.059914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:54.129981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:54.148684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:54.151628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1089/2184] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:54.229868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46989d21-04cb-48fe-a085-0de202ae051b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:54.235115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:54.235925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.236348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.236760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.237574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:54.239739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.277316 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1096/2185] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:54 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:54.281329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:54.302289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780fe28-4b92-4a30-9ca6-a9c155e85eb3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:54.403762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:54.404804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.405174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.405540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.406679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:54.409871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.438250 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1090/2186] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:54 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:54.442170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:54.469960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6bb97-80e6-4896-8768-b5a2228c9bb2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:54.475976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:54.476784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.477079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.477393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.478491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:54.480743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.499453 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1097/2187] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:47:54.504063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:54.514429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590fddb-d625-4b0d-936a-7381a36dbd60 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:54.519397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:54.520304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.520984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.521461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] PATH_INFO: `/v3/projects/8bf9ae7cbdab426cb6da81ce34b8d135/users/26ded32abf14430fab305a4a7f519806/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.543259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9ae7cbdab426cb6da81ce34b8d135, user_id=26ded32abf14430fab305a4a7f519806, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:54.546106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.567219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1091/2188] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:54 2022] PUT /identity/v3/projects/8bf9ae7cbdab426cb6da81ce34b8d135/users/26ded32abf14430fab305a4a7f519806/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:47:54.571280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:54.584996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d6469-fe7d-4aae-8037-c0536d741640 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:54.685082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138aafc-f9a9-4d4e-8515-82fdf62a06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:54.686207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138aafc-f9a9-4d4e-8515-82fdf62a06cd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.686487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138aafc-f9a9-4d4e-8515-82fdf62a06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.686914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138aafc-f9a9-4d4e-8515-82fdf62a06cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.687636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138aafc-f9a9-4d4e-8515-82fdf62a06cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:54.691692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138aafc-f9a9-4d4e-8515-82fdf62a06cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.738888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1098/2189] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:54.740472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:54.766713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a271e8f-498a-40a3-9b10-ce5a71b7c2ef admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:54.775239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:54.777326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.777758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.778327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] PATH_INFO: `/v3/projects/8bf9ae7cbdab426cb6da81ce34b8d135/users/26ded32abf14430fab305a4a7f519806/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.780479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9ae7cbdab426cb6da81ce34b8d135, user_id=26ded32abf14430fab305a4a7f519806, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:54.787457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:54.801988 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1092/2190] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:54 2022] PUT /identity/v3/projects/8bf9ae7cbdab426cb6da81ce34b8d135/users/26ded32abf14430fab305a4a7f519806/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:47:54.813857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:54.814144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:54.814415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:54.886885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] MFA Rules not processed for user `26ded32abf14430fab305a4a7f519806`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:54.890215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:54.971754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:55.033603 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1099/2191] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:55.035697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:55.052419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70cf2f-787b-4281-8953-cd4ee6ba8499 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:55.059011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:55.060914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.061353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.062703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.063770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:55.064332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:55.066801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:55.146623 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1093/2192] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:55.147039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:55.162605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6102d9-67b1-43bd-81f2-f5820be1b627 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:55.180845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:55.182020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.182439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.182817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.183617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:55.189469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:55.252284 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1100/2193] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:55 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:55.254019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:55.267341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baaf27-cc74-42e1-829e-a03149ac71e6 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:55.454787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:55.456266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.456741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.457160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.458263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:55.458760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:55.461328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50dd9c-1ff5-41fb-b91a-289db5b17051 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:55.492430 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1094/2194] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:55.577006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:55.578757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:55.707100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd91a7-757b-4225-802c-7bb1d8613543 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:55.718441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:55.719220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.719466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.719736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.734589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:55.746531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:55.763402 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1101/2195] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:55.781059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde49-6c96-4ca4-96b3-07f4c72bc9b7 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.781340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde49-6c96-4ca4-96b3-07f4c72bc9b7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.781612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde49-6c96-4ca4-96b3-07f4c72bc9b7 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.783236 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1095/2196] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:47:55.788179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:47:55.800818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:55.811133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36823c09-153c-4d33-bf54-c921d425013d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:55.816157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:55.817166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.817450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.817720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/projects/05d87be3c6704e5aba7b381da9a28914` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.818892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:get_project(project_id=05d87be3c6704e5aba7b381da9a28914)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:55.821142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:55.824115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1102/2197] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:47:55 2022] GET /identity/v3/projects/05d87be3c6704e5aba7b381da9a28914 => generated 371 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:55.936867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a2a0-2a07-4ecc-80ac-5b6ab2153152 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.937466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a2a0-2a07-4ecc-80ac-5b6ab2153152 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.937768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a2a0-2a07-4ecc-80ac-5b6ab2153152 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.939514 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1096/2198] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:47:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:47:55.962167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:47:55.976438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:55.987508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a051609-97f8-4aae-8840-07ed4a230114 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:55.992801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:55.993517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:55.993793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:55.994086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/projects/05d87be3c6704e5aba7b381da9a28914` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:55.995564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:get_project(project_id=05d87be3c6704e5aba7b381da9a28914)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:55.997599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:55.999679 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1103/2199] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:47:55 2022] GET /identity/v3/projects/05d87be3c6704e5aba7b381da9a28914 => generated 371 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:56.044656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2a2a0-2a07-4ecc-80ac-5b6ab2153152 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.057866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2a2a0-2a07-4ecc-80ac-5b6ab2153152 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.062262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.063077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.063354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.063704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.064355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:56.064654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.066894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.081679 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1097/2200] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:56.085768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.096004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c453610-8730-442b-aecb-b3c8a0d43ec8 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.100742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa5565-b3e3-4025-afc3-33542a204098 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.101342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa5565-b3e3-4025-afc3-33542a204098 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.101621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa5565-b3e3-4025-afc3-33542a204098 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.101924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa5565-b3e3-4025-afc3-33542a204098 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.102642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa5565-b3e3-4025-afc3-33542a204098 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.104549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa5565-b3e3-4025-afc3-33542a204098 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.131760 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1104/2201] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:56 2022] POST /identity/v3/users => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:56.133122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.143713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880b9b-4f7a-40ca-8e0e-25cad6583024 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.150149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.150767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.151051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.151319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.151970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:56.152275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.153908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.164731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:56.173891 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1098/2202] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:56.188954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c514ee-6a43-40b2-b070-183a67df7fc1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.189236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c514ee-6a43-40b2-b070-183a67df7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.189501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c514ee-6a43-40b2-b070-183a67df7fc1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.190876 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1105/2203] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:47:56.197453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:47:56.199210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:56.215589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.224986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff19e14-6ca1-4760-8f25-41e39fd4f660 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.229984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.230634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.230916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.231172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/projects/05d87be3c6704e5aba7b381da9a28914` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.232347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:get_project(project_id=05d87be3c6704e5aba7b381da9a28914)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.234453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.240423 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1099/2204] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:47:56 2022] GET /identity/v3/projects/05d87be3c6704e5aba7b381da9a28914 => generated 371 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:47:56.362774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4920-21d2-4f34-9cc5-ae2152adcac1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.363019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4920-21d2-4f34-9cc5-ae2152adcac1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.363288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d4920-21d2-4f34-9cc5-ae2152adcac1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.364632 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1106/2205] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:47:56.369452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:47:56.382865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.401822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323db07-3dbf-410d-8708-066814f6583b tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.406991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.407490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.407771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.408044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/projects/05d87be3c6704e5aba7b381da9a28914` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.409258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:get_project(project_id=05d87be3c6704e5aba7b381da9a28914)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.417647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.419460 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1100/2206] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:47:56 2022] GET /identity/v3/projects/05d87be3c6704e5aba7b381da9a28914 => generated 371 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:47:56.454090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4920-21d2-4f34-9cc5-ae2152adcac1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.471884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d4920-21d2-4f34-9cc5-ae2152adcac1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.480243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.481030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.481409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.482045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/users/4da50047afff4f3ea8e2ff79edd53d8e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.499607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4da50047afff4f3ea8e2ff79edd53d8e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.501649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.558268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da50047afff4f3ea8e2ff79edd53d8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.561581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:56.575552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da50047afff4f3ea8e2ff79edd53d8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.579207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da50047afff4f3ea8e2ff79edd53d8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.587605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da50047afff4f3ea8e2ff79edd53d8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.588657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da50047afff4f3ea8e2ff79edd53d8e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.625637 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1107/2207] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:56 2022] DELETE /identity/v3/users/4da50047afff4f3ea8e2ff79edd53d8e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:56.630698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.634799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:56.653501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82a9bc-0751-48d0-8d83-7615638913c3 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.722380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26ded32abf14430fab305a4a7f519806', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8bf9ae7cbdab426cb6da81ce34b8d135', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.723023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.723296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.723563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] PATH_INFO: `/v3/projects/05d87be3c6704e5aba7b381da9a28914` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.724994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorizing `identity:delete_project(project_id=05d87be3c6704e5aba7b381da9a28914)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:56.727224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:56.788986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d87be3c6704e5aba7b381da9a28914', 'request_id': 'req-f18b1071-1c21-4852-ba6c-fb4f67ed677a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.796230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d87be3c6704e5aba7b381da9a28914', 'request_id': 'req-f18b1071-1c21-4852-ba6c-fb4f67ed677a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.802582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d87be3c6704e5aba7b381da9a28914', 'request_id': 'req-f18b1071-1c21-4852-ba6c-fb4f67ed677a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.818418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] The token cache is being invalidate because project 05d87be3c6704e5aba7b381da9a28914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:56.818815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.819626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18b1071-1c21-4852-ba6c-fb4f67ed677a tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:56.821531 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1101/2208] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:56 2022] DELETE /identity/v3/projects/05d87be3c6704e5aba7b381da9a28914 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:56.826846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:56.829497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:56.909287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e184-2f88-4409-93ba-cf722c057144 tempest-QuotasAdminTestV257-93536785 tempest-QuotasAdminTestV257-93536785-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:56.996355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:56.997001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:56.997284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:56.997543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] PATH_INFO: `/v3/users/75e96418bce8480b91de3abcc2779937` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:56.998708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e96418bce8480b91de3abcc2779937)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:57.000664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:57.053595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e96418bce8480b91de3abcc2779937'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:57.067840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e96418bce8480b91de3abcc2779937'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:57.068583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e96418bce8480b91de3abcc2779937'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:57.077402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e96418bce8480b91de3abcc2779937'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:57.078103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e96418bce8480b91de3abcc2779937'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:57.079943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:57.097215 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1108/2209] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:56 2022] DELETE /identity/v3/users/75e96418bce8480b91de3abcc2779937 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:57.102024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:57.102476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:57.103532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:57.125516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:57.126945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:57.202814 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1102/2210] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:47:57.212713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:57.214240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:57.344477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556804-6e5e-4e46-966a-8c7bf8618262 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:57.349166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:57.350064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:57.350436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:57.350852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:57.367216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:57.369045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:57.382239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1109/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:47:58.047434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:58.051179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:58.085984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab385c-3cbf-4907-85ab-140344202c19 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:58.096712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:58.097390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:58.097714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:58.098173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] PATH_INFO: `/v3/projects/29597af8302a4f0dae4262b6f0c043f0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:58.099586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=29597af8302a4f0dae4262b6f0c043f0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:58.101601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:58.112873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:58.160056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29597af8302a4f0dae4262b6f0c043f0', 'request_id': 'req-80292746-5491-49d0-b022-638f8e8c39cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.167842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29597af8302a4f0dae4262b6f0c043f0', 'request_id': 'req-80292746-5491-49d0-b022-638f8e8c39cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.176212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29597af8302a4f0dae4262b6f0c043f0', 'request_id': 'req-80292746-5491-49d0-b022-638f8e8c39cf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.196595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] The token cache is being invalidate because project 29597af8302a4f0dae4262b6f0c043f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:58.197106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.197983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.199780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1103/2212] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:58 2022] DELETE /identity/v3/projects/29597af8302a4f0dae4262b6f0c043f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:58.203977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:58.216070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa5822-c274-4a0d-9932-699ae5d8f0a5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:58.297154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:58.297856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:58.298112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:58.298387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] PATH_INFO: `/v3/users/26ded32abf14430fab305a4a7f519806` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:58.299538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ded32abf14430fab305a4a7f519806)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:58.301657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:58.359745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ded32abf14430fab305a4a7f519806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.374604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ded32abf14430fab305a4a7f519806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.375428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ded32abf14430fab305a4a7f519806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.383910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ded32abf14430fab305a4a7f519806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.384827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0e262a0-4887-42e5-a01b-3a8e8f21110b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ded32abf14430fab305a4a7f519806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:58.401288 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1110/2213] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:47:58 2022] DELETE /identity/v3/users/26ded32abf14430fab305a4a7f519806 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:58.765233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:58.767197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:58.783106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80292746-5491-49d0-b022-638f8e8c39cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:58.906182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:58.907662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:58.908174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:58.908618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] PATH_INFO: `/v3/projects/8bf9ae7cbdab426cb6da81ce34b8d135` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:58.910638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf9ae7cbdab426cb6da81ce34b8d135)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:58.912946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.035016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf9ae7cbdab426cb6da81ce34b8d135', 'request_id': 'req-272b3edb-8c2d-4768-83c2-49e76b3406a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:59.055656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf9ae7cbdab426cb6da81ce34b8d135', 'request_id': 'req-272b3edb-8c2d-4768-83c2-49e76b3406a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:59.066549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf9ae7cbdab426cb6da81ce34b8d135', 'request_id': 'req-272b3edb-8c2d-4768-83c2-49e76b3406a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:59.092847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] The token cache is being invalidate because project 8bf9ae7cbdab426cb6da81ce34b8d135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:47:59.093519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:59.094874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-272b3edb-8c2d-4768-83c2-49e76b3406a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:47:59.097154 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1104/2214] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:47:58 2022] DELETE /identity/v3/projects/8bf9ae7cbdab426cb6da81ce34b8d135 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:59.103974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.104301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.104678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.128994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:59.130638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:59.144493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:59.224909 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1111/2215] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:59.233557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.234414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.235621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.264435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:59.265664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:59.279082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1105/2216] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:59.283586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.301004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893b1b7-395b-4333-934a-c676dc1051ff None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.308282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.308995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.309633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.310114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.310927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:47:59.311507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.314173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.333101 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1112/2217] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:47:59.337666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.355035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a137dc8-d39c-44f6-b09c-f86742e98a4f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.362832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.363514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.363896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.364226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.364922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.367869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.398724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:59.424600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.426635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:59.429505 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1106/2218] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/projects => generated 391 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:59.434875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.526893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc62f7-bdca-463d-83fd-573fe5a3554d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.533120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.533786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.534202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.534471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.535110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.536982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd41f1-b715-46b0-93ad-f8b65ed83169 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.537123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.565845 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1107/2219] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:47:59.569928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.580798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a82568-8d01-4316-b160-583205c20103 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.590571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.591198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.591477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.591757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.592882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.594561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.611184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1108/2220] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:47:59.615227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.618187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.618925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.619264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.619598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.622241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:59.626862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aecb56-2364-44be-a0b1-958a9a0d1d80 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.631553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.632192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.632477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.632746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.633420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.635266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.649631 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1109/2221] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:47:59.650780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.661687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a077d37-e23e-4b3e-8753-6c397cc7e4d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.663415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:47:59.668607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be752a2-3ef1-4eda-a575-2ff3364b161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.669284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be752a2-3ef1-4eda-a575-2ff3364b161f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.669559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be752a2-3ef1-4eda-a575-2ff3364b161f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.669924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be752a2-3ef1-4eda-a575-2ff3364b161f admin admin] PATH_INFO: `/v3/projects/7f9d23d263bb44b7a600166d113bf63b/users/e1dbe55d773a4e60b7ad0f0589cbc9e8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.687891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be752a2-3ef1-4eda-a575-2ff3364b161f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9d23d263bb44b7a600166d113bf63b, user_id=e1dbe55d773a4e60b7ad0f0589cbc9e8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.690519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be752a2-3ef1-4eda-a575-2ff3364b161f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.696745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.698537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.705864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1110/2222] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:47:59 2022] PUT /identity/v3/projects/7f9d23d263bb44b7a600166d113bf63b/users/e1dbe55d773a4e60b7ad0f0589cbc9e8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:47:59.711825 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1113/2223] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:47:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:47:59.719440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.719791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.720136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.753377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] MFA Rules not processed for user `e1dbe55d773a4e60b7ad0f0589cbc9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:47:59.754621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:47:59.836258 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1111/2224] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:47:59.841218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.852857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0428c-5eab-4ad5-9af6-d5e71df62838 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:47:59.936028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:47:59.936735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:47:59.937239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:47:59.937601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:47:59.938429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:47:59.940439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:47:59.981536 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1114/2225] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:47:59.985589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:47:59.997712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8780f62-2472-4695-9a36-6fcd001242af None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:00.032315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:00.065066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:00.065793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.066092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.066286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.066940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:00.068879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:00.094020 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1112/2226] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:47:59 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:48:00.096875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:00.114201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e286c-70d9-4ff2-b32c-7baca4893f83 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:00.119775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:00.120803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.121155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.121503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.122327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:00.124129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:00.137964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1115/2227] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:48:00.141642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:00.153521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b837f5-ae1d-4658-aed3-2db651425260 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:00.158940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:00.159941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.160439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.160931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] PATH_INFO: `/v3/projects/4776f6cda2924183817b663b1628dece/users/55eec2d84eca4936b2454ab64386086a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.181336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4776f6cda2924183817b663b1628dece, user_id=55eec2d84eca4936b2454ab64386086a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:00.185834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:00.202876 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1113/2228] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:48:00 2022] PUT /identity/v3/projects/4776f6cda2924183817b663b1628dece/users/55eec2d84eca4936b2454ab64386086a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:48:00.207888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:00.219666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40834a8-a4ad-4adc-8f0a-76599229a078 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:00.300722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ea0cb-0fd7-4e98-8198-9ce5142de590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:00.301362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ea0cb-0fd7-4e98-8198-9ce5142de590 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.301789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ea0cb-0fd7-4e98-8198-9ce5142de590 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.302167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ea0cb-0fd7-4e98-8198-9ce5142de590 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.302814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ea0cb-0fd7-4e98-8198-9ce5142de590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:00.304555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ea0cb-0fd7-4e98-8198-9ce5142de590 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:00.318835 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1116/2229] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:48:00.320738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:00.339203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c4525-e69d-42cf-b8f4-bbde672ea1c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:00.347437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbad922-6479-491f-a191-62935c9fed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:00.349028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbad922-6479-491f-a191-62935c9fed7d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.349619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbad922-6479-491f-a191-62935c9fed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.350127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbad922-6479-491f-a191-62935c9fed7d admin admin] PATH_INFO: `/v3/projects/4776f6cda2924183817b663b1628dece/users/55eec2d84eca4936b2454ab64386086a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.353339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbad922-6479-491f-a191-62935c9fed7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4776f6cda2924183817b663b1628dece, user_id=55eec2d84eca4936b2454ab64386086a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:00.357077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbad922-6479-491f-a191-62935c9fed7d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:00.389870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1114/2230] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:48:00 2022] PUT /identity/v3/projects/4776f6cda2924183817b663b1628dece/users/55eec2d84eca4936b2454ab64386086a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:48:00.398633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.398925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.399403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.430124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] MFA Rules not processed for user `55eec2d84eca4936b2454ab64386086a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:00.431663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:00.471824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:00.524641 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1117/2231] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:00.536142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.536499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.536840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.556739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] MFA Rules not processed for user `e1dbe55d773a4e60b7ad0f0589cbc9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:00.558263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:00.618646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1115/2232] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:00.630284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:00.706812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e2a96-0c76-49a0-bff6-2629fb5f0421 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:00.712671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044803ae-a2fd-4f83-9e7f-ca3bf8d43c8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:00.713294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044803ae-a2fd-4f83-9e7f-ca3bf8d43c8f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:00.713571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044803ae-a2fd-4f83-9e7f-ca3bf8d43c8f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:00.713875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044803ae-a2fd-4f83-9e7f-ca3bf8d43c8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:00.721988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044803ae-a2fd-4f83-9e7f-ca3bf8d43c8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:00.723681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044803ae-a2fd-4f83-9e7f-ca3bf8d43c8f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:00.733174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1118/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:02.646891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:02.661363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37993ca-bc88-447a-8ebe-82c3f70b4065 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:02.667210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:02.667834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:02.668108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:02.668376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:02.670139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:02.736787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:02.738943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:02.752015 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1116/2234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:03.962589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:03.963224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:03.963331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:04.011242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:04.012650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:04.035964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1119/2235] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:48:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:04.044615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:04.055531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:04.057225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c0120-8db9-4c27-ab35-ce1931a42020 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:04.057628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:04.063727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:04.064349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:04.064629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:04.064940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:04.067045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:04.090934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:04.140351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2a463-fc19-4b81-ab86-006722e3c027 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:04.151671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67397ee0-5c68-4693-b509-e980c2527cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:04.156892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397ee0-5c68-4693-b509-e980c2527cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:04.157305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397ee0-5c68-4693-b509-e980c2527cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:04.158454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67397ee0-5c68-4693-b509-e980c2527cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:04.180470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67397ee0-5c68-4693-b509-e980c2527cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:04.182824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67397ee0-5c68-4693-b509-e980c2527cc5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:04.187916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:04.189520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:04.208533 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1120/2237] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:48:04.210025 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1117/2236] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:04 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:04.291995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:04.292277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:04.292640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:04.317912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:04.319160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:04.377876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:04.397170 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1121/2238] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:48:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:48:04.450040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:04.452408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:04.530889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe353-eb7a-48b9-92d2-5a783171268d service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:04.536642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8de3b-c66f-4bfa-bfb1-c15807847e69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:04.536806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8de3b-c66f-4bfa-bfb1-c15807847e69 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:04.537081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8de3b-c66f-4bfa-bfb1-c15807847e69 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:04.537354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8de3b-c66f-4bfa-bfb1-c15807847e69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:04.552239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8de3b-c66f-4bfa-bfb1-c15807847e69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:04.554333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8de3b-c66f-4bfa-bfb1-c15807847e69 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:04.563958 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1118/2239] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:07.716721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:07.718440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:07.735544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2d4e-c086-4c34-9ff7-4d1f331ff51e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:07.736144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2d4e-c086-4c34-9ff7-4d1f331ff51e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:07.736144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2d4e-c086-4c34-9ff7-4d1f331ff51e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:07.737291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faaa03-fbc5-4a03-aed4-372e1ce8bc58 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:07.737418 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1119/2240] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:48:07.745067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bb527-1652-4af6-bca0-7aac3413746b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:07.745755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:07.746090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:07.746262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:07.747589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb527-1652-4af6-bca0-7aac3413746b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:07.748689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb527-1652-4af6-bca0-7aac3413746b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:07.749245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bb527-1652-4af6-bca0-7aac3413746b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:07.767060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bb527-1652-4af6-bca0-7aac3413746b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:07.771076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bb527-1652-4af6-bca0-7aac3413746b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:07.773427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:07.774695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:07.790115 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1120/2241] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:48:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:48:07.807293 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1122/2242] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:07.861580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:07.863674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:07.891564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f0b23-d16d-4a6e-931d-baf1733bc0ff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:07.904383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:07.905022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:07.905298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:07.912623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:07.931190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:07.933277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:07.962754 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1121/2243] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:08.002646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ffcb5-5206-4b8f-8510-83d39043eac7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:08.002918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ffcb5-5206-4b8f-8510-83d39043eac7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:08.003195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ffcb5-5206-4b8f-8510-83d39043eac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:08.069234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-de6ffcb5-5206-4b8f-8510-83d39043eac7 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:08.070558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de6ffcb5-5206-4b8f-8510-83d39043eac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:08.096966 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1123/2244] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:48:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:08.108235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:08.118540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ca867-f0f0-402c-b53f-762c357657da service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:08.130708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ad2504-a40f-430f-a371-c39ec5bfafe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:08.131253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad2504-a40f-430f-a371-c39ec5bfafe0 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:08.131544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad2504-a40f-430f-a371-c39ec5bfafe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:08.131800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ad2504-a40f-430f-a371-c39ec5bfafe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:08.152257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad2504-a40f-430f-a371-c39ec5bfafe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:08.153737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ad2504-a40f-430f-a371-c39ec5bfafe0 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:08.172398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1122/2245] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:12.177050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:12.177665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:12.177665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:12.218205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] MFA Rules not processed for user `1486b01e2a39475dab72aa7f36816c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:12.219872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:12.306683 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1124/2246] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:16.101486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4727-d1a5-4c39-bac8-2c0ea59ca402 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:16.102175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4727-d1a5-4c39-bac8-2c0ea59ca402 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:16.102319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4727-d1a5-4c39-bac8-2c0ea59ca402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:16.124925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-87ae4727-d1a5-4c39-bac8-2c0ea59ca402 None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:16.126537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-87ae4727-d1a5-4c39-bac8-2c0ea59ca402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:16.290322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1123/2247] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:19.748382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:19.749878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:19.907929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cf03d-bd53-49cd-abb8-b3e79dff89e3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:19.915253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:19.916148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:19.917144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:19.917144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:19.918835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:19.937870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:19.939788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:19.964551 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1125/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:23.040966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea69b-09c7-4c3b-a112-59162881874c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:23.041503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea69b-09c7-4c3b-a112-59162881874c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:23.041503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ea69b-09c7-4c3b-a112-59162881874c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:23.065758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-297ea69b-09c7-4c3b-a112-59162881874c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:23.067008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-297ea69b-09c7-4c3b-a112-59162881874c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:23.075051 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1124/2249] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:48:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:23.088220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:23.100236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b96497-9a71-45e7-8202-c935cc00e1b1 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:23.106525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cf921-8fe5-4c63-a5f6-c917ca38ff86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:23.107132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf921-8fe5-4c63-a5f6-c917ca38ff86 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:23.107404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf921-8fe5-4c63-a5f6-c917ca38ff86 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:23.107670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cf921-8fe5-4c63-a5f6-c917ca38ff86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:23.116584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf921-8fe5-4c63-a5f6-c917ca38ff86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:23.118552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cf921-8fe5-4c63-a5f6-c917ca38ff86 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:23.127342 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1126/2250] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:48:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:26.887252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:26.887802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:26.887802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:26.907578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] MFA Rules not processed for user `6c2aa25bffe3421e8a75d88388dd5441`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:26.908776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:26.914075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:26.971223 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1125/2251] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:28.028884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e25a-5e16-4874-9b2d-bd1bc3d19e0b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:28.029849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e25a-5e16-4874-9b2d-bd1bc3d19e0b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:28.030323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6e25a-5e16-4874-9b2d-bd1bc3d19e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:28.055390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c9c6e25a-5e16-4874-9b2d-bd1bc3d19e0b None None] MFA Rules not processed for user `f0ea28d9bb3544bca1a3c90d983fe8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:28.057026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9c6e25a-5e16-4874-9b2d-bd1bc3d19e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:28.130667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:28.141613 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1127/2252] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:28.800874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:28.802390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:28.825760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd8d50b-5084-47c5-9c94-ffc8fbb9902b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:28.843866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:28.845546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:28.845919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:28.846520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:28.849190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:28.866390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:28.870488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:28.884695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1126/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:33.331734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9515-f3a1-42de-892c-fdd9ce687238 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:33.332241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9515-f3a1-42de-892c-fdd9ce687238 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:33.332335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d9515-f3a1-42de-892c-fdd9ce687238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:33.354344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5b8d9515-f3a1-42de-892c-fdd9ce687238 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:33.355589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b8d9515-f3a1-42de-892c-fdd9ce687238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:33.363275 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1128/2254] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:48:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:33.376508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:33.389141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24eb7e1-c2de-4c01-937d-5bc56c6652bf service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:33.394595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:33.395208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:33.395483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:33.395750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:33.404237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:33.405792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:33.413829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1127/2255] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:48:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:48:38.963955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53ce9-b778-4968-b210-70813647432d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:38.964985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53ce9-b778-4968-b210-70813647432d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:38.965428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53ce9-b778-4968-b210-70813647432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:39.016126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98e53ce9-b778-4968-b210-70813647432d None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:39.017464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98e53ce9-b778-4968-b210-70813647432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:39.033617 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1129/2256] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:48:43.410554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=32 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:48.988121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:54.865727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:54.867442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:55.028448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ddc9a-9924-4f77-b631-e6f71ac99ef4 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:55.035901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:55.037104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:55.037708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:55.039290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] PATH_INFO: `/v3/users/1e835f57621f46719369731607bebb1f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:55.041784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e835f57621f46719369731607bebb1f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:55.045623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:55.126046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e835f57621f46719369731607bebb1f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.135563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e835f57621f46719369731607bebb1f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.136542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e835f57621f46719369731607bebb1f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.145842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e835f57621f46719369731607bebb1f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.147561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e835f57621f46719369731607bebb1f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.184625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1128/2257] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:48:54 2022] DELETE /identity/v3/users/1e835f57621f46719369731607bebb1f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:55.448598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53ce9-b778-4968-b210-70813647432d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:55.460064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53ce9-b778-4968-b210-70813647432d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:55.528569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:55.529208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:55.529483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:55.529757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] PATH_INFO: `/v3/projects/013e7f18496749fb9525e0303e688964` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:55.530896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=013e7f18496749fb9525e0303e688964)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:55.532810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:55.595479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013e7f18496749fb9525e0303e688964', 'request_id': 'req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.604831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013e7f18496749fb9525e0303e688964', 'request_id': 'req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.615047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013e7f18496749fb9525e0303e688964', 'request_id': 'req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.637691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] The token cache is being invalidate because project 013e7f18496749fb9525e0303e688964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:48:55.638212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.639608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.642344 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1130/2258] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:55 2022] DELETE /identity/v3/projects/013e7f18496749fb9525e0303e688964 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:55.646136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:55.647599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:55.668176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a507714-c997-4ebb-9283-56e49379ec21 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:55.768558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:55.769375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:55.769757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:55.770881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] PATH_INFO: `/v3/users/98beec3060af4e1cb4c74f65d4d00ee6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:55.772605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98beec3060af4e1cb4c74f65d4d00ee6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:55.786236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:55.819227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:55.856118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98beec3060af4e1cb4c74f65d4d00ee6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.878053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98beec3060af4e1cb4c74f65d4d00ee6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.878053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98beec3060af4e1cb4c74f65d4d00ee6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.891474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98beec3060af4e1cb4c74f65d4d00ee6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.892422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-384dcbf3-0b3a-4be6-8c5b-0b667bb96cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98beec3060af4e1cb4c74f65d4d00ee6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:55.916582 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1129/2259] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:48:55 2022] DELETE /identity/v3/users/98beec3060af4e1cb4c74f65d4d00ee6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:56.099799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.103124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:56.136348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953fa6c-f2f8-4f86-b506-8a30e2b7a0df admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.218946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.219608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.219873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.220128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] PATH_INFO: `/v3/projects/11353d779f36430089be3e2d8162215a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.221384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11353d779f36430089be3e2d8162215a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.223518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.275964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:56.303560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11353d779f36430089be3e2d8162215a', 'request_id': 'req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:56.310928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11353d779f36430089be3e2d8162215a', 'request_id': 'req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:56.318826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11353d779f36430089be3e2d8162215a', 'request_id': 'req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:56.333153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] The token cache is being invalidate because project 11353d779f36430089be3e2d8162215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:48:56.333440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:56.334117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bcd11d1-d74d-4bbd-a114-d6b3ac027a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:48:56.335809 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1131/2260] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:48:56 2022] DELETE /identity/v3/projects/11353d779f36430089be3e2d8162215a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:56.343213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.343543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.343766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.379495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:56.380367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:56.461539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1130/2261] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:56.463301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.464035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.464035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.485558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:56.486869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:56.495606 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1132/2262] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:56.500153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.510441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dd5ea-7784-4c2d-9aac-5e491339056b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.515095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.515734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.516014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.516284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.516935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:48:56.517239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.518861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.533831 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1131/2263] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:48:56.536457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.546565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1240c93-ff69-4edc-b10a-cfbe2a70457a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.552901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.554486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.554486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.554486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.555042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.557323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.588110 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1133/2264] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:48:56 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:48:56.592133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.602875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63b307-6b85-43fc-8e05-8cff393ecf09 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.662054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.662675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.662954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.663224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.663940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.665948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.690134 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1132/2265] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:48:56 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:48:56.694260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.705614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36e3a-9f0b-4c0b-a0a3-85663b518f78 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.710692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.711320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.711736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.712013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.712703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.714346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.725005 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1134/2266] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:48:56.730203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.740753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8de6b1-1863-41cd-a572-913344dccfb3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.746009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90edc19-84e8-4082-9997-6f6846ff59d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.746618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90edc19-84e8-4082-9997-6f6846ff59d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.746893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90edc19-84e8-4082-9997-6f6846ff59d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.747262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90edc19-84e8-4082-9997-6f6846ff59d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.747876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90edc19-84e8-4082-9997-6f6846ff59d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.749434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90edc19-84e8-4082-9997-6f6846ff59d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.760981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1133/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:48:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:48:56.764959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:56.776126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516b660-1783-495c-b700-4e5878130053 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:56.782011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:56.782730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.783018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.783251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] PATH_INFO: `/v3/projects/6e76aef622b647aebc0b203d42990b6d/users/35a63b52bc4944b68dbfc96908d1dbf8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.800493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e76aef622b647aebc0b203d42990b6d, user_id=35a63b52bc4944b68dbfc96908d1dbf8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:56.803266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:56.821848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1135/2268] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:48:56 2022] PUT /identity/v3/projects/6e76aef622b647aebc0b203d42990b6d/users/35a63b52bc4944b68dbfc96908d1dbf8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:56.833238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:56.833576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:56.833830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:56.842948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:56.865167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] MFA Rules not processed for user `35a63b52bc4944b68dbfc96908d1dbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:56.866962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:56.949793 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1134/2269] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:56.951118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:57.024253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7dd6a6-3808-4e1d-a176-60d311f30caf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:57.029311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:57.030039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.030421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.030793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.031544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:57.033589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:57.083705 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1136/2270] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:48:56 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:48:57.084804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:57.104289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afb771-2bfc-44c3-893b-33636b6fb453 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:57.208294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:57.209019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.209314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.209703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.210807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:57.212957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:57.271903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1135/2271] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:48:57 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:48:57.276127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:57.290237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff2d11-e4a2-44ae-a80a-0d8629ba98a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:57.302197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:57.303381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.303674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.303989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.305623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:57.309484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:57.329130 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1137/2272] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:48:57.331024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:57.365759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6334a9-3b19-4a53-96e6-43554e184169 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:57.377707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:57.378441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.378726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.379005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] PATH_INFO: `/v3/projects/a108f19a5fb2459e8929a2382421b756/users/8f3935fca7794c71847bcce72e6dead6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.410731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a108f19a5fb2459e8929a2382421b756, user_id=8f3935fca7794c71847bcce72e6dead6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:57.416198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:57.463891 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1136/2273] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:48:57 2022] PUT /identity/v3/projects/a108f19a5fb2459e8929a2382421b756/users/8f3935fca7794c71847bcce72e6dead6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:57.469156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:57.491481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c4d9b-486f-4cf4-abcf-71563ce6156b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:57.579590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:57.637559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b56779-df0b-41cf-af90-19829edb5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:57.637958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b56779-df0b-41cf-af90-19829edb5a9a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.638098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b56779-df0b-41cf-af90-19829edb5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.638327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b56779-df0b-41cf-af90-19829edb5a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.639058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b56779-df0b-41cf-af90-19829edb5a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:57.641425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b56779-df0b-41cf-af90-19829edb5a9a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:57.654553 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1138/2274] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:48:57.658181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:57.671551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda148e0-05ba-4705-b556-b48a0e868a7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:57.677898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:57.678284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.678674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.678998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] PATH_INFO: `/v3/projects/a108f19a5fb2459e8929a2382421b756/users/8f3935fca7794c71847bcce72e6dead6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.682838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a108f19a5fb2459e8929a2382421b756, user_id=8f3935fca7794c71847bcce72e6dead6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:57.686001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:57.699915 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1137/2275] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:48:57 2022] PUT /identity/v3/projects/a108f19a5fb2459e8929a2382421b756/users/8f3935fca7794c71847bcce72e6dead6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:48:57.712017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c192-d5a7-4e61-8fbe-b73a78ae3245 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:57.712557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c192-d5a7-4e61-8fbe-b73a78ae3245 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:57.712983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9c192-d5a7-4e61-8fbe-b73a78ae3245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:57.761182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-60d9c192-d5a7-4e61-8fbe-b73a78ae3245 None None] MFA Rules not processed for user `8f3935fca7794c71847bcce72e6dead6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:57.762633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60d9c192-d5a7-4e61-8fbe-b73a78ae3245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:57.853473 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1139/2276] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:48:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:58.443473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:58.445667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:58.517603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:48:58.552299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713c66b-8ed1-4ba2-9a62-68a676c34855 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:58.558828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:58.559469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:58.559892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:58.560215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:58.570621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:58.572255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:58.581120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48fea-81d6-4396-ace6-44c785b9d9ff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:58.581681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48fea-81d6-4396-ace6-44c785b9d9ff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:58.582152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef48fea-81d6-4396-ace6-44c785b9d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:58.586224 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1138/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:48:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:48:58.608281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fef48fea-81d6-4396-ace6-44c785b9d9ff None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:48:58.610011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fef48fea-81d6-4396-ace6-44c785b9d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:58.692495 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1140/2278] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:48:58.708337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:48:58.710115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:48:58.825109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ec500-6d24-401b-a02f-e5ab86cf2b33 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:48:58.848219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:48:58.848870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:48:58.849145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:48:58.849410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:48:58.878583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:48:58.880757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:48:58.898592 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1139/2279] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:48:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:00.435934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e062c6e-42be-4245-805a-f2ebbcdc2937 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:00.436435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e062c6e-42be-4245-805a-f2ebbcdc2937 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:00.436531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e062c6e-42be-4245-805a-f2ebbcdc2937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:00.472257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6e062c6e-42be-4245-805a-f2ebbcdc2937 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:00.473509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e062c6e-42be-4245-805a-f2ebbcdc2937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:00.483387 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1141/2280] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:49:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:00.502335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:00.514293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e168c-3ad5-4a15-9b61-a2dd6424374b service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:00.524428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:00.525095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:00.525344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:00.525616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:00.547672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:00.554284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:00.583024 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1140/2281] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:01.710662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:01.711280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:01.711674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:01.739680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] MFA Rules not processed for user `fa30f68a081646d6b452d1cdf6e0181c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:01.741221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:01.818939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:01.836040 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1142/2282] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:02.594594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:02.597206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:02.661857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e37cc8-84cf-4887-b5db-36d265482141 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:02.684844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a5b75-fbe6-4853-8a39-4a1d265d6650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:02.685563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5b75-fbe6-4853-8a39-4a1d265d6650 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:02.685927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5b75-fbe6-4853-8a39-4a1d265d6650 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:02.686264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a5b75-fbe6-4853-8a39-4a1d265d6650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:02.764941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5b75-fbe6-4853-8a39-4a1d265d6650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:02.766606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a5b75-fbe6-4853-8a39-4a1d265d6650 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:02.790290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1141/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:07.320237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:07.489158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9197e-a4fd-49b5-a7f0-d420966639f6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:07.503254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:07.504091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:07.504706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:07.505160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] PATH_INFO: `/v3/users/35a63b52bc4944b68dbfc96908d1dbf8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:07.508578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a63b52bc4944b68dbfc96908d1dbf8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:07.511257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:07.651122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a63b52bc4944b68dbfc96908d1dbf8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:07.675051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a63b52bc4944b68dbfc96908d1dbf8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:07.675822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a63b52bc4944b68dbfc96908d1dbf8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:07.685168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a63b52bc4944b68dbfc96908d1dbf8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:07.686447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a63b52bc4944b68dbfc96908d1dbf8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:07.710091 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1143/2284] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:07 2022] DELETE /identity/v3/users/35a63b52bc4944b68dbfc96908d1dbf8 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:07.712831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:07.713961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:07.714347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:07.742290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:07.744222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:07.807303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:07.833923 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1142/2285] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:07.861765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:07.864507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:08.036494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0afd89-8440-4651-a34b-39abc77aaf05 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:08.042662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a6ee1-fefe-48a2-bd53-88478065c968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:08.043352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ee1-fefe-48a2-bd53-88478065c968 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:08.043603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ee1-fefe-48a2-bd53-88478065c968 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:08.043882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a6ee1-fefe-48a2-bd53-88478065c968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:08.067014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6ee1-fefe-48a2-bd53-88478065c968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:08.068492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a6ee1-fefe-48a2-bd53-88478065c968 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:08.092114 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1144/2286] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:09.513452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:09.515128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:09.530642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93658b50-01bb-4e41-aafb-843ae35d69d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:09.587123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:09.588045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:09.588551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:09.589046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] PATH_INFO: `/v3/users/68cdeea2722e49e09ccf0b4f892906d4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:09.592258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cdeea2722e49e09ccf0b4f892906d4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:09.594712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:09.699984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cdeea2722e49e09ccf0b4f892906d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:09.711354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cdeea2722e49e09ccf0b4f892906d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:09.712461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cdeea2722e49e09ccf0b4f892906d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:09.724651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cdeea2722e49e09ccf0b4f892906d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:09.726393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cdeea2722e49e09ccf0b4f892906d4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:09.787107 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1143/2287] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:09 2022] DELETE /identity/v3/users/68cdeea2722e49e09ccf0b4f892906d4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:09.789928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:09.790420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:09.790524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:09.837071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:09.838358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:09.873226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:09.934606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:09.935919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:10.028626 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1145/2288] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:10.166830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2afa3a-0813-4996-9bdb-99ec6cfd2be2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:10.192096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:10.193596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:10.199075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:10.199075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:10.199075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:10.200153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] PATH_INFO: `/v3/projects/6e76aef622b647aebc0b203d42990b6d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:10.206852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e76aef622b647aebc0b203d42990b6d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:10.213080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:10.302932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e76aef622b647aebc0b203d42990b6d', 'request_id': 'req-7ed46401-1220-479f-99a0-75c1d0d14c78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.316177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e76aef622b647aebc0b203d42990b6d', 'request_id': 'req-7ed46401-1220-479f-99a0-75c1d0d14c78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.329426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:10.334100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e76aef622b647aebc0b203d42990b6d', 'request_id': 'req-7ed46401-1220-479f-99a0-75c1d0d14c78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.352378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3009b7-b89e-4073-a193-c03bc5b46644 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:10.363136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] The token cache is being invalidate because project 6e76aef622b647aebc0b203d42990b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:10.363500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.364146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.366591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1144/2289] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:09 2022] DELETE /identity/v3/projects/6e76aef622b647aebc0b203d42990b6d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:49:10.370567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:10.372272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:10.535997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:10.537421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:10.537421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:10.537421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:10.539791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:10.560747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed46401-1220-479f-99a0-75c1d0d14c78 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:10.572653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:10.573884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:10.574404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:10.574931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] PATH_INFO: `/v3/users/8f3935fca7794c71847bcce72e6dead6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:10.576423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3935fca7794c71847bcce72e6dead6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:10.578283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:10.580293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:10.586540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:10.600093 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1146/2290] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:10.683494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3935fca7794c71847bcce72e6dead6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.698267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3935fca7794c71847bcce72e6dead6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.699067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3935fca7794c71847bcce72e6dead6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.765748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3935fca7794c71847bcce72e6dead6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.767774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91e1bd30-9e35-47ac-aace-f113129cecd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3935fca7794c71847bcce72e6dead6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:10.828501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1145/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:10 2022] DELETE /identity/v3/users/8f3935fca7794c71847bcce72e6dead6 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:11.522262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:11.524018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:11.579767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14880083-cd31-4edb-aa17-ff8c4bfa4788 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:11.815980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:11.818350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:11.820900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:11.821294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] PATH_INFO: `/v3/projects/4ba4b121877b458092bfd5cadec5aa3d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:11.823941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ba4b121877b458092bfd5cadec5aa3d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:11.828039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:11.900219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:11.971442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ba4b121877b458092bfd5cadec5aa3d', 'request_id': 'req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:11.977612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ba4b121877b458092bfd5cadec5aa3d', 'request_id': 'req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:11.985416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ba4b121877b458092bfd5cadec5aa3d', 'request_id': 'req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:12.017503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] The token cache is being invalidate because project 4ba4b121877b458092bfd5cadec5aa3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:12.017835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:12.020408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03f0446c-cef4-4f0b-8136-6f88fa88e8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:12.028154 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1147/2292] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:11 2022] DELETE /identity/v3/projects/4ba4b121877b458092bfd5cadec5aa3d => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:12.031074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.032190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.032969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.087952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:12.091705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:12.248534 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1146/2293] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:12.256135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.256408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.256680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.295950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:12.298007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:12.321283 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1148/2294] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:12.325891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:12.338133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475264f-c41f-4779-8105-61cc7c8217c6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:12.362159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:12.370699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.371586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.373328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.375740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:49:12.376315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:12.379587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:12.389219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:12.415835 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1147/2295] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:12.419327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:12.430071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5679e-4d0d-410d-ab3e-08d2dcd43cbf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:12.443136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:12.443539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.443822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.444095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.444788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:12.454500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:12.528283 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1149/2296] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:12 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:12.533929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:12.559424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113ce5e-0a9d-4856-b377-3fd10443d579 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:12.706772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:12.707416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.707697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.707966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.708612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:12.710837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:12.758870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1148/2297] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:12 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:12.761467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:12.774852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2778af45-8b81-4853-9c33-cfd6a8277f1d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:12.780916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:12.781729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.782157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.782543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.783396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:12.785269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:12.830611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1150/2298] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:12.832839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:12.858673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9b647-4ef8-4843-a0e9-c60b71aa9e19 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:12.870920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:12.872548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.872940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.873317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:12.874148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:12.884502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:12.917397 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1149/2299] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:12.921474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:12.937681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc4b67-e43d-4aae-b623-115fee562bf8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:12.952747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3edb72a-fdbd-4b73-911b-8aeab3225364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:12.972586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb72a-fdbd-4b73-911b-8aeab3225364 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:12.972979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb72a-fdbd-4b73-911b-8aeab3225364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:12.973842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3edb72a-fdbd-4b73-911b-8aeab3225364 admin admin] PATH_INFO: `/v3/projects/1aa758093b4b4cc6a7c4c82c788fb8ee/users/0bf25302f8b84de2ac6ead21f7d23d40/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.063875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edb72a-fdbd-4b73-911b-8aeab3225364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa758093b4b4cc6a7c4c82c788fb8ee, user_id=0bf25302f8b84de2ac6ead21f7d23d40, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:13.077929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3edb72a-fdbd-4b73-911b-8aeab3225364 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:13.106080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:13.108804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:13.129896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1151/2300] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:12 2022] PUT /identity/v3/projects/1aa758093b4b4cc6a7c4c82c788fb8ee/users/0bf25302f8b84de2ac6ead21f7d23d40/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:13.132749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462ce21-8ae8-48b2-8ee0-870e3ce9f564 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.133113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462ce21-8ae8-48b2-8ee0-870e3ce9f564 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:13.133374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4462ce21-8ae8-48b2-8ee0-870e3ce9f564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.146473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8207c11c-1690-451e-9d79-7ec0bb5edd55 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:13.246000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4462ce21-8ae8-48b2-8ee0-870e3ce9f564 None None] MFA Rules not processed for user `0bf25302f8b84de2ac6ead21f7d23d40`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:13.247440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4462ce21-8ae8-48b2-8ee0-870e3ce9f564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:13.385921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:13.391782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.393122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:13.395312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] PATH_INFO: `/v3/projects/a108f19a5fb2459e8929a2382421b756` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.401023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a108f19a5fb2459e8929a2382421b756)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:13.405773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:13.465201 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1152/2301] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:13.543320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a108f19a5fb2459e8929a2382421b756', 'request_id': 'req-d05c2884-9058-4c4c-b644-51dd2de359bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:13.560109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a108f19a5fb2459e8929a2382421b756', 'request_id': 'req-d05c2884-9058-4c4c-b644-51dd2de359bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:13.586767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a108f19a5fb2459e8929a2382421b756', 'request_id': 'req-d05c2884-9058-4c4c-b644-51dd2de359bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:13.609248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] The token cache is being invalidate because project a108f19a5fb2459e8929a2382421b756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:13.611089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:13.613771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:13.622801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1150/2302] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:13 2022] DELETE /identity/v3/projects/a108f19a5fb2459e8929a2382421b756 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:13.624365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa491-cac6-49c6-8ad1-e8b4ec9d54a5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.625176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa491-cac6-49c6-8ad1-e8b4ec9d54a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:13.625604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fa491-cac6-49c6-8ad1-e8b4ec9d54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.665176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-253fa491-cac6-49c6-8ad1-e8b4ec9d54a5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:13.667935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-253fa491-cac6-49c6-8ad1-e8b4ec9d54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:13.742536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:13.765247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:13.766983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:13.775180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:13.820323 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1153/2303] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:13.836722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.837324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:13.837768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.892596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:13.894190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:13.908317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c2884-9058-4c4c-b644-51dd2de359bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:13.914724 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1154/2304] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:49:13.918650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:13.918862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:13.919640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.920045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:13.920461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.922432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:13.937779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a810222-e51c-4dc1-b765-3d7329b4fb55 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:13.950962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:13.951981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.952517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:13.952995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:13.953918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:49:13.954368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:13.956463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:13.974456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1155/2305] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:13.978561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:13.991695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7fac8-c5cd-4ba2-a9a6-343da6bb3527 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:13.998531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:13.999346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:13.999803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:14.000217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:14.001220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:14.003962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:14.010862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:14.013207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:14.030646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1151/2306] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:49:14.050922 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1156/2307] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:13 2022] POST /identity/v3/projects => generated 407 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:14.055395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:14.071789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e7fec-52b4-418b-9e6a-3e53471f5ad5 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:14.163140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:14.164002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:14.164321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:14.164599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:14.166328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:14.168639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:14.239644 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1152/2308] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:14 2022] POST /identity/v3/users => generated 304 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:14.243097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:14.260987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cca3e-b43b-41ba-9681-85ac6b5a904c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:14.274743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:14.275626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:14.276055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:14.276918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:14.277750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:14.279785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:14.307518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1157/2309] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:14.311465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:14.337897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328635b0-6bd6-4782-8e32-7e222cf917c0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:14.360921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546ea46-213c-48c6-875d-3c1440c0db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:14.364187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546ea46-213c-48c6-875d-3c1440c0db68 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:14.365267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546ea46-213c-48c6-875d-3c1440c0db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:14.366782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546ea46-213c-48c6-875d-3c1440c0db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:14.368072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546ea46-213c-48c6-875d-3c1440c0db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:14.372022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546ea46-213c-48c6-875d-3c1440c0db68 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:14.419685 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1153/2310] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:14.422622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:14.436554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9878b-cab9-42bb-8d27-47cd9f02b217 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:14.462836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:14.465115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:14.465401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:14.465678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] PATH_INFO: `/v3/projects/055a9687dc4e43f09eb779a2153b0665/users/740b5a7d816a442ba6bc1d3485d19651/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:14.538031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a9687dc4e43f09eb779a2153b0665, user_id=740b5a7d816a442ba6bc1d3485d19651, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:14.541326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:14.575669 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1158/2311] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:14 2022] PUT /identity/v3/projects/055a9687dc4e43f09eb779a2153b0665/users/740b5a7d816a442ba6bc1d3485d19651/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:14.588402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:14.588578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:14.588900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:14.664484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] MFA Rules not processed for user `740b5a7d816a442ba6bc1d3485d19651`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:14.665990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:14.681725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:14.856566 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1154/2312] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:14 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:14.856837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:15.061739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f36a-77be-471c-b4a9-8c02b6314199 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:15.073980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:15.075092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:15.075818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:15.076316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:15.077165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:15.080274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:15.158498 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1159/2313] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:14 2022] POST /identity/v3/projects => generated 409 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:15.159965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:15.185053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7e8bd-3706-4626-99b3-ef192d31747a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:15.351396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:15.352179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:15.352696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:15.353298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:15.354425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:15.377031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:15.450364 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1155/2314] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:15 2022] POST /identity/v3/users => generated 311 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:15.454480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:15.468298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:15.474758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:15.478531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f0e639-6338-472e-99e8-241542968457 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:15.494840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:15.496273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:15.496858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:15.497586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:15.498556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:15.500571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:15.507980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3cc1c-e9cb-4ae6-9d91-c8cb89355477 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:15.533675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:15.534677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:15.535865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:15.537790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] PATH_INFO: `/v3/users/0bf25302f8b84de2ac6ead21f7d23d40` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:15.541069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bf25302f8b84de2ac6ead21f7d23d40)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:15.547381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:15.547689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1160/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:15.551161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:15.588794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5dd3d-e652-41b4-affd-7e0346a09a8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:15.610402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:15.622496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:15.623092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:15.623515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] PATH_INFO: `/v3/projects/cff2e93dd71c4a1cbe60bd5230c23f39/users/11b7b38e35ea4e6ab4e50dcacc4cfd66/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:15.670991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff2e93dd71c4a1cbe60bd5230c23f39, user_id=11b7b38e35ea4e6ab4e50dcacc4cfd66, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:15.676131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:15.693979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bf25302f8b84de2ac6ead21f7d23d40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:15.717266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1161/2316] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:15 2022] PUT /identity/v3/projects/cff2e93dd71c4a1cbe60bd5230c23f39/users/11b7b38e35ea4e6ab4e50dcacc4cfd66/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:15.719324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bf25302f8b84de2ac6ead21f7d23d40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:15.721080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bf25302f8b84de2ac6ead21f7d23d40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:15.722252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:15.723974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:15.732641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bf25302f8b84de2ac6ead21f7d23d40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:15.733688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e231b291-e360-4e15-8938-d16781729b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bf25302f8b84de2ac6ead21f7d23d40'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:15.738744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:15.774902 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1156/2317] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:15 2022] DELETE /identity/v3/users/0bf25302f8b84de2ac6ead21f7d23d40 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:15.782088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:15.789132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:15.790250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:15.847864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:15.847864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:15.859758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:15.864169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38448f-d21c-4bbf-8bc3-ae220d289976 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:16.000670 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1157/2318] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:16.040489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:16.042527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:16.092766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:16.093413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:16.100720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:16.101674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:16.102421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:16.109663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:16.158780 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1162/2319] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:16.159754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:16.177300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344f721-df6f-4d2b-87e3-20d54048897e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:16.185775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bde33c-f144-4aca-8479-416a52cac17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:16.196902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220572-ac4b-4126-ac18-0d4ae82797c8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:16.205869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde33c-f144-4aca-8479-416a52cac17d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:16.206889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde33c-f144-4aca-8479-416a52cac17d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:16.206889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bde33c-f144-4aca-8479-416a52cac17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:16.219108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:16.222640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:16.223190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:16.223365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] PATH_INFO: `/v3/projects/cff2e93dd71c4a1cbe60bd5230c23f39/users/11b7b38e35ea4e6ab4e50dcacc4cfd66/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:16.232706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bde33c-f144-4aca-8479-416a52cac17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:16.235122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff2e93dd71c4a1cbe60bd5230c23f39, user_id=11b7b38e35ea4e6ab4e50dcacc4cfd66, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:16.236012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bde33c-f144-4aca-8479-416a52cac17d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:16.247788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:16.277281 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1158/2320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:16.290159 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1163/2321] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:16 2022] PUT /identity/v3/projects/cff2e93dd71c4a1cbe60bd5230c23f39/users/11b7b38e35ea4e6ab4e50dcacc4cfd66/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:16.303660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:16.303949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:16.304505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:16.354824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] MFA Rules not processed for user `11b7b38e35ea4e6ab4e50dcacc4cfd66`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:16.356928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:16.487553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1159/2322] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:16 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:16.568582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:16.580863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:16.775134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcf314-34c7-407a-9cf4-20215dabbafe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:16.786760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:16.791675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:16.791675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:16.791675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:16.827157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:16.829880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:16.853456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1164/2323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:17.010994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:17.046655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb864878-cc32-4a56-8a8b-9a53a1007787 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:17.058988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:17.061357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:17.062420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:17.063157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:17.068385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:17.145302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:17.182343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:17.184329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:17.197351 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1160/2324] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:17 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:17.467897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:17.523818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:17.614564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9b9a3-0a54-4192-9fb7-bf727e2809ed service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:17.631790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:17.632491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:17.632876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:17.633248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] PATH_INFO: `/v3/users/740b5a7d816a442ba6bc1d3485d19651` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:17.634532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:17.635572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=740b5a7d816a442ba6bc1d3485d19651)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:17.636178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:17.637515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:17.691908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6713cab2-106c-4315-86cc-70512da2c1f5 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:17.719151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:17.719901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:17.720182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:17.720458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] PATH_INFO: `/v3/projects/1aa758093b4b4cc6a7c4c82c788fb8ee` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:17.723513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa758093b4b4cc6a7c4c82c788fb8ee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:17.726312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:17.763106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740b5a7d816a442ba6bc1d3485d19651'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.799503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740b5a7d816a442ba6bc1d3485d19651'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.800874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740b5a7d816a442ba6bc1d3485d19651'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.814881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740b5a7d816a442ba6bc1d3485d19651'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.815804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39927524-0add-46b1-90e9-d7c44925d3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740b5a7d816a442ba6bc1d3485d19651'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.845954 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1165/2325] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:17 2022] DELETE /identity/v3/users/740b5a7d816a442ba6bc1d3485d19651 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:17.847690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80ae0-4281-4dc9-bc81-13a76d3ad49c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:17.847979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80ae0-4281-4dc9-bc81-13a76d3ad49c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:17.848253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d80ae0-4281-4dc9-bc81-13a76d3ad49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:17.853027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa758093b4b4cc6a7c4c82c788fb8ee', 'request_id': 'req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.868292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa758093b4b4cc6a7c4c82c788fb8ee', 'request_id': 'req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.876446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-88d80ae0-4281-4dc9-bc81-13a76d3ad49c None None] MFA Rules not processed for user `6c2aa25bffe3421e8a75d88388dd5441`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:17.877834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-88d80ae0-4281-4dc9-bc81-13a76d3ad49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:17.882385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa758093b4b4cc6a7c4c82c788fb8ee', 'request_id': 'req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.902885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] The token cache is being invalidate because project 1aa758093b4b4cc6a7c4c82c788fb8ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:17.903975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.907112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-df1c09a6-a55c-4901-a3c5-e83f70ee1f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:17.915482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1161/2326] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:17 2022] DELETE /identity/v3/projects/1aa758093b4b4cc6a7c4c82c788fb8ee => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:17.917373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:17.919659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:17.920437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:17.964361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:17.966128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:18.011356 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1166/2327] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:18.013434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d86a-addc-470d-aa50-59c88973e57c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.014157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d86a-addc-470d-aa50-59c88973e57c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.014639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517d86a-addc-470d-aa50-59c88973e57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.075574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d517d86a-addc-470d-aa50-59c88973e57c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:18.076814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d517d86a-addc-470d-aa50-59c88973e57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:18.127697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1162/2328] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:18.140149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.145965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:18.173753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:18.205932 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1167/2329] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:18.215630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.215979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.216800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.251903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:18.253212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:18.262695 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1168/2330] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:18.267394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.281727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec3bfc-d2c1-4553-a6ea-b04698c4f493 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.297756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.300425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.300974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.301246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.301936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:49:18.302238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.311369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.342874 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1169/2331] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:18.347513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.351963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2347e-b07f-4ea9-9485-1ae9328fe155 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.373302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.373981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.374258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.374529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.381188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd7c1c8-6aee-4e99-97cd-c28d54c10b1a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.387896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.388090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.389408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.389654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.389773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.390012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.390663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.392602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.417963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1163/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:18.454709 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1170/2333] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:18 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:18.458659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.466025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:18.472860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c4741-7a78-49b3-af10-71c15e9b395f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.681099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.682982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.683460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.701112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.707828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.711820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.752344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1164/2334] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:18 2022] POST /identity/v3/users => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:18.756806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.783743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4d778-35d3-40fe-a821-d57a93943b81 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.805077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.807810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.809578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.810113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.810880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.814354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.869744 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1171/2335] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:18.871312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.886943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:18.889832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:18.895493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a0b1e-3f6a-49d6-84e3-72759cccebb2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.910375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5cab-1297-4be2-968c-c3bbe24c8431 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:18.914941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bddd44-783e-41ba-a99d-5a75241ea7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.915581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bddd44-783e-41ba-a99d-5a75241ea7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.915865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bddd44-783e-41ba-a99d-5a75241ea7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.916141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bddd44-783e-41ba-a99d-5a75241ea7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.916792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bddd44-783e-41ba-a99d-5a75241ea7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.918132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:18.918624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bddd44-783e-41ba-a99d-5a75241ea7b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.919279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.919777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.920255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] PATH_INFO: `/v3/projects/055a9687dc4e43f09eb779a2153b0665` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:18.921685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=055a9687dc4e43f09eb779a2153b0665)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:18.924003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:18.941984 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1165/2336] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:18.946446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:18.946806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:18.947979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:19.068434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] MFA Rules not processed for user `efecedc77d3048c4a0ec0fe6701f9ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:19.072380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:19.079902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055a9687dc4e43f09eb779a2153b0665', 'request_id': 'req-deb743e9-1b5e-4cb4-a8a8-142c61229f56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.113856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055a9687dc4e43f09eb779a2153b0665', 'request_id': 'req-deb743e9-1b5e-4cb4-a8a8-142c61229f56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.175913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055a9687dc4e43f09eb779a2153b0665', 'request_id': 'req-deb743e9-1b5e-4cb4-a8a8-142c61229f56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.243816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] The token cache is being invalidate because project 055a9687dc4e43f09eb779a2153b0665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:19.243816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.245487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.249902 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1172/2337] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:18 2022] DELETE /identity/v3/projects/055a9687dc4e43f09eb779a2153b0665 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:19.250746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:19.263242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:19.294725 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1166/2338] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:19.294725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:19.294725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:19.429217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b2406-ac0f-40ac-9cca-3f5b68923066 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:19.439569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:19.440241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:19.440521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:19.440795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] PATH_INFO: `/v3/users/11b7b38e35ea4e6ab4e50dcacc4cfd66` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:19.446738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b7b38e35ea4e6ab4e50dcacc4cfd66)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:19.450392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:19.461790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb743e9-1b5e-4cb4-a8a8-142c61229f56 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:19.480887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa5fc4-dc84-4e6a-a1ea-11559d1dee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:19.482141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa5fc4-dc84-4e6a-a1ea-11559d1dee9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:19.482784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa5fc4-dc84-4e6a-a1ea-11559d1dee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:19.483239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa5fc4-dc84-4e6a-a1ea-11559d1dee9e admin admin] PATH_INFO: `/v3/projects/c4e6814941f64857a662c3ddc0ec9ce3/users/10d0adc7068a4f82828a344e3f18d2db/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:19.517956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa5fc4-dc84-4e6a-a1ea-11559d1dee9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e6814941f64857a662c3ddc0ec9ce3, user_id=10d0adc7068a4f82828a344e3f18d2db, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:19.521882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa5fc4-dc84-4e6a-a1ea-11559d1dee9e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:19.560962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:19.572520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:19.594477 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1173/2339] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:19 2022] PUT /identity/v3/projects/c4e6814941f64857a662c3ddc0ec9ce3/users/10d0adc7068a4f82828a344e3f18d2db/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:19.603652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e262-de7a-477e-88ae-09d196c667a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:19.603930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e262-de7a-477e-88ae-09d196c667a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:19.604205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4e262-de7a-477e-88ae-09d196c667a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:19.624931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b7b38e35ea4e6ab4e50dcacc4cfd66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.641336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-97e4e262-de7a-477e-88ae-09d196c667a9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:19.642599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97e4e262-de7a-477e-88ae-09d196c667a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:19.655278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b7b38e35ea4e6ab4e50dcacc4cfd66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.656171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b7b38e35ea4e6ab4e50dcacc4cfd66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.700407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b7b38e35ea4e6ab4e50dcacc4cfd66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.716690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b7b38e35ea4e6ab4e50dcacc4cfd66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:19.788027 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1167/2340] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:19 2022] DELETE /identity/v3/users/11b7b38e35ea4e6ab4e50dcacc4cfd66 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:19.842945 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1174/2341] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:19.881126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:19.882734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:20.005662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685fd17-c88a-455d-a758-1dd10ef2f45c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:20.010102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68df4b3-ea5c-4d94-903e-13e6d6a066be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:20.012010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df4b3-ea5c-4d94-903e-13e6d6a066be service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:20.012782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df4b3-ea5c-4d94-903e-13e6d6a066be service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:20.013300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68df4b3-ea5c-4d94-903e-13e6d6a066be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:20.187021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68df4b3-ea5c-4d94-903e-13e6d6a066be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:20.188520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68df4b3-ea5c-4d94-903e-13e6d6a066be service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:20.203734 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1168/2342] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:20.539520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edf7e-6697-4bfc-825c-3d03c81c722f None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:20.539790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edf7e-6697-4bfc-825c-3d03c81c722f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:20.540252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0edf7e-6697-4bfc-825c-3d03c81c722f None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:20.541941 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1175/2343] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 02:49:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:20.579100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:20.579580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:20.579691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:20.613352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:20.616253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:20.718461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:20.744594 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1169/2344] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 02:49:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:20.805044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edf7e-6697-4bfc-825c-3d03c81c722f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:20.807190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae0edf7e-6697-4bfc-825c-3d03c81c722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:20.846773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0edf7e-6697-4bfc-825c-3d03c81c722f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:20.862806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad8015-e149-4559-8d18-fdef69b70aac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:20.863447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad8015-e149-4559-8d18-fdef69b70aac service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:20.863732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad8015-e149-4559-8d18-fdef69b70aac service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:20.864005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad8015-e149-4559-8d18-fdef69b70aac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:20.887945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad8015-e149-4559-8d18-fdef69b70aac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:20.889932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad8015-e149-4559-8d18-fdef69b70aac service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:20.922374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1176/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:21.197332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:21.199023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:21.231682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fba9b0-95fa-4a6d-bd29-d69cdc852c04 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:21.247846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:21.248600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:21.248990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:21.249355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] PATH_INFO: `/v3/projects/cff2e93dd71c4a1cbe60bd5230c23f39` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:21.250814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff2e93dd71c4a1cbe60bd5230c23f39)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:21.252993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:21.358329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff2e93dd71c4a1cbe60bd5230c23f39', 'request_id': 'req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:21.372606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff2e93dd71c4a1cbe60bd5230c23f39', 'request_id': 'req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:21.382912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff2e93dd71c4a1cbe60bd5230c23f39', 'request_id': 'req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:21.408824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] The token cache is being invalidate because project cff2e93dd71c4a1cbe60bd5230c23f39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:21.409210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:21.410017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73dd2d4e-de88-4d77-8df8-a72c6a6be83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:21.412735 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1170/2346] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:21 2022] DELETE /identity/v3/projects/cff2e93dd71c4a1cbe60bd5230c23f39 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:21.417587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:21.418135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:21.418577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:21.450011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:21.451598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:21.578862 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1177/2347] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:21.587126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:21.588369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:21.588991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:21.627923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:21.632815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:21.661160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:21.675256 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1171/2348] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:21.679146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166a284-2b05-4a17-b07c-77da708a7838 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:21.687865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:21.688766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:21.689056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:21.689330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:21.692148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:49:21.692549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:21.697013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:21.726221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1178/2349] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:21.726505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:21.731898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff8456-f77b-442b-86fb-1b1ecbed0cf8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:21.762448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:21.763322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:21.767319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:21.767825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:21.768990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:21.773152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:21.851474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:21.852598 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1172/2350] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:21 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:21.865088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f35eaa-8aa8-40d8-918e-b3139131a296 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.037036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.040196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.040743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.041401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.043781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.052258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.116834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:22.125619 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1179/2351] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:21 2022] POST /identity/v3/users => generated 292 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:22.135807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aac543-7c38-453e-bad4-0f816973e72b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.147815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.150417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.150804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.151151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.152088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.155408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.174095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:22.182961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:22.185462 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1173/2352] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:22.189019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f2243-74ca-4d70-a3c6-d0a357fe576a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.195490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db28ed65-2eb7-4f30-bfd6-a3778621e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.196244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ed65-2eb7-4f30-bfd6-a3778621e05f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.196780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ed65-2eb7-4f30-bfd6-a3778621e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.197519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db28ed65-2eb7-4f30-bfd6-a3778621e05f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.198701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28ed65-2eb7-4f30-bfd6-a3778621e05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.200593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db28ed65-2eb7-4f30-bfd6-a3778621e05f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.220629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:22.228628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1180/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:22.237206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca974c6-d876-4209-98ed-fff8e3ba13dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.245838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.247098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.247623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.248182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686/users/26101a06e33249dab84e17021a4a1fdc/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.268942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f17887fd59d46d9b1cb91fafb9b6686, user_id=26101a06e33249dab84e17021a4a1fdc, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.275256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.312516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.312795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.313872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.323452 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1174/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:22 2022] PUT /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686/users/26101a06e33249dab84e17021a4a1fdc/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:22.364028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] MFA Rules not processed for user `26101a06e33249dab84e17021a4a1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:22.367684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:22.538788 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1181/2355] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:22.540396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:22.641934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0afa9e-b3b9-4472-a98a-fa32c436b1b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.655350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.656129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.656666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.657477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.658509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.660949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.705045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:22.724592 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1175/2356] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:22 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:22.725388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:22.745446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fd246-e910-42e4-9d5b-33a2335499b4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.882535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.883411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.883705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.884333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.885222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.887214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.917786 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1182/2357] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:22 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:49:22.921641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:22.957434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2dbed-9068-45f7-b045-7a4e05ad64ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:22.970739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:22.971654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:22.972351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:22.972828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:22.976106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:22.978221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:22.992606 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1176/2358] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:49:22.997968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:23.013386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa685a5-1ed3-4c86-936d-1cb03de53688 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:23.025380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:23.026872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:23.027485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:23.028068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] PATH_INFO: `/v3/projects/8278ac191fa8438aa336850c9c869795/users/0b3e473878d043f6896fe1c2021a3a25/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:23.050767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8278ac191fa8438aa336850c9c869795, user_id=0b3e473878d043f6896fe1c2021a3a25, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:23.056636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:23.082934 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1183/2359] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:22 2022] PUT /identity/v3/projects/8278ac191fa8438aa336850c9c869795/users/0b3e473878d043f6896fe1c2021a3a25/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:23.087005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:23.100548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b46d1-a294-4acc-a99c-d363e4353166 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:23.186800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c2d44-9c17-461e-8bdf-f9d63f40fc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:23.187706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2d44-9c17-461e-8bdf-f9d63f40fc7c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:23.187880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2d44-9c17-461e-8bdf-f9d63f40fc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:23.188159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c2d44-9c17-461e-8bdf-f9d63f40fc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:23.188809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c2d44-9c17-461e-8bdf-f9d63f40fc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:23.190471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c2d44-9c17-461e-8bdf-f9d63f40fc7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:23.232177 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1177/2360] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:49:23.233302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:23.262564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd96b1b-309a-4316-b4c6-02a0ddc8deef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:23.279620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:23.279800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:23.280187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:23.280291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] PATH_INFO: `/v3/projects/8278ac191fa8438aa336850c9c869795/users/0b3e473878d043f6896fe1c2021a3a25/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:23.287696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8278ac191fa8438aa336850c9c869795, user_id=0b3e473878d043f6896fe1c2021a3a25, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:23.291041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:23.368299 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1184/2361] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:23 2022] PUT /identity/v3/projects/8278ac191fa8438aa336850c9c869795/users/0b3e473878d043f6896fe1c2021a3a25/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:23.379663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1af04-a8cf-45a6-b47f-0d4985edb10e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:23.379881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1af04-a8cf-45a6-b47f-0d4985edb10e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:23.380361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1af04-a8cf-45a6-b47f-0d4985edb10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:23.440534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-19f1af04-a8cf-45a6-b47f-0d4985edb10e None None] MFA Rules not processed for user `0b3e473878d043f6896fe1c2021a3a25`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:23.445286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19f1af04-a8cf-45a6-b47f-0d4985edb10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:23.684373 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1178/2362] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:24.129294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:24.131237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:24.205435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:24.302546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7ab4b-17ac-4538-ac96-9082eb89c766 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:24.321846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:24.323714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:24.324328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:24.324954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:24.339369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:24.341490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:24.368283 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1185/2363] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:24.400786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505846e-6ddf-4562-9829-3fefdb4f7c86 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:24.403440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505846e-6ddf-4562-9829-3fefdb4f7c86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:24.403996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8505846e-6ddf-4562-9829-3fefdb4f7c86 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:24.406143 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1179/2364] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:24.414708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:24.430905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:24.441358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589a4cb-18c8-4cd8-bb53-f1478dfcab3b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:24.446987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:24.447955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:24.448429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:24.448894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:24.451036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:24.453410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:24.456457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1186/2365] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:24 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:49:24.684109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a3fd-2d8d-4d13-9f44-9330a580626c None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:24.684109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a3fd-2d8d-4d13-9f44-9330a580626c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:24.684109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d68a3fd-2d8d-4d13-9f44-9330a580626c None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:24.685650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1180/2366] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:24.695846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:24.698345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:24.724901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:24.737700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e88427-cf19-4e51-a321-a7966fad2903 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:24.748983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:24.750038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:24.750475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:24.750919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:24.752398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:24.754872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:24.775792 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1187/2367] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:24 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:24.886549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17523-ddc4-4b47-8b10-3d025b07d426 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:24.887564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17523-ddc4-4b47-8b10-3d025b07d426 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:24.888019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa17523-ddc4-4b47-8b10-3d025b07d426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:24.923774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5fa17523-ddc4-4b47-8b10-3d025b07d426 None None] MFA Rules not processed for user `26101a06e33249dab84e17021a4a1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:24.925665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fa17523-ddc4-4b47-8b10-3d025b07d426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:25.056982 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1181/2368] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:25.184425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:25.205835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0deec-a051-41cc-b92f-9bb2018c4ed7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:25.219813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:25.221078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:25.221416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:25.221694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:25.243419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:25.246271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:25.267209 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1188/2369] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:26.065926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3d54-d9ae-4072-80cd-551f7502759a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:26.066431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3d54-d9ae-4072-80cd-551f7502759a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:26.066431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3d54-d9ae-4072-80cd-551f7502759a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:26.068032 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1182/2370] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:26.073638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:26.093710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:26.131928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c9993-ebd3-44c5-9a7d-727479716aba service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:26.145863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:26.146686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:26.147115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:26.147514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:26.148831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:26.152132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:26.157402 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1189/2371] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:26 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:26.872501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4c3a-8bf5-47f9-a136-7266cfb75ef8 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:26.872911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4c3a-8bf5-47f9-a136-7266cfb75ef8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:26.873375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe4c3a-8bf5-47f9-a136-7266cfb75ef8 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:26.875573 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1183/2372] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:26.881176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:26.928810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:26.968162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77415664-5492-429e-9470-a5b1b766f75a tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:26.981248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:26.982295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:26.983343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:26.983854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:26.986400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:26.993022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:26.999510 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1190/2373] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:26 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:27.268625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a870a8-a4ff-467d-a391-8c38bd36433b None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:27.270402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a870a8-a4ff-467d-a391-8c38bd36433b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:27.271103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a870a8-a4ff-467d-a391-8c38bd36433b None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:27.278478 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1184/2374] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:27.287459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:27.312618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:27.334294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8ca5d-7943-49ca-9e4f-6d830e3432b7 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:27.347400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d8d3-c68c-4e72-b1b9-a1971c0e7655 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:27.348266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d8d3-c68c-4e72-b1b9-a1971c0e7655 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:27.348733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d8d3-c68c-4e72-b1b9-a1971c0e7655 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:27.349157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d8d3-c68c-4e72-b1b9-a1971c0e7655 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:27.351189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568d8d3-c68c-4e72-b1b9-a1971c0e7655 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:27.353637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568d8d3-c68c-4e72-b1b9-a1971c0e7655 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:27.361505 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1191/2375] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:27 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:27.635006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:27.635358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:27.635691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:27.685006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] MFA Rules not processed for user `26101a06e33249dab84e17021a4a1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:27.688703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:27.715447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1185/2376] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:30.165466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57d14-dd89-4f42-ae4a-1b47c4c011f4 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:30.166415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57d14-dd89-4f42-ae4a-1b47c4c011f4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:30.167085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f57d14-dd89-4f42-ae4a-1b47c4c011f4 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:30.169668 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1192/2377] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:30.176906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:30.215285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:30.238105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:30.274984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc981-0707-4720-bfde-57f95d3609f4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:30.290503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d14d-a4e1-463e-a038-9abc587ebdca tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:30.291470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d14d-a4e1-463e-a038-9abc587ebdca tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:30.291909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d14d-a4e1-463e-a038-9abc587ebdca tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:30.292361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d14d-a4e1-463e-a038-9abc587ebdca tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:30.295826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080d14d-a4e1-463e-a038-9abc587ebdca tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:30.298321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080d14d-a4e1-463e-a038-9abc587ebdca tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:30.312608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1186/2378] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:30 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:30.333550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:30.334056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:30.334422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:30.403552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] MFA Rules not processed for user `10d0adc7068a4f82828a344e3f18d2db`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:30.405060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:30.716146 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1193/2379] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:30.832542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e23a4-a87b-4875-82ec-d51dd295493e None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:30.833320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e23a4-a87b-4875-82ec-d51dd295493e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:30.833849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e23a4-a87b-4875-82ec-d51dd295493e None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:30.835453 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1187/2380] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:30.845939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:30.865050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:30.906939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b196e-25d9-4c39-b13e-5fca22aabbc3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:30.931004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccdd44-a6d5-4b37-9c29-dccaa1979152 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:30.931872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdd44-a6d5-4b37-9c29-dccaa1979152 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:30.932226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdd44-a6d5-4b37-9c29-dccaa1979152 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:30.934724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccdd44-a6d5-4b37-9c29-dccaa1979152 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:30.936678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccdd44-a6d5-4b37-9c29-dccaa1979152 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:30.941415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccdd44-a6d5-4b37-9c29-dccaa1979152 tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:30.944084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1194/2381] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:30 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:30.992320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e23a4-a87b-4875-82ec-d51dd295493e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:31.019243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e23a4-a87b-4875-82ec-d51dd295493e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:31.028721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:31.029662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:31.030211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:31.030903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:31.042122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:31.044455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:31.057417 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1188/2382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:30 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:31.318342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a287-8605-425d-8e6a-ff4ff5d72556 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:31.318872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a287-8605-425d-8e6a-ff4ff5d72556 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:31.319176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1a287-8605-425d-8e6a-ff4ff5d72556 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:31.321750 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1195/2383] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:49:31.327168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:31.341447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:31.354145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e78c63-7bb6-46aa-9d07-04e91e8a0aec service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:31.361876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:31.363064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:31.363565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:31.364010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:31.367516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:31.371778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:31.374660 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1189/2384] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:31 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:31.553634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040b089-37d3-42a6-b606-bb3168f4d7c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:31.553782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040b089-37d3-42a6-b606-bb3168f4d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:31.556232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040b089-37d3-42a6-b606-bb3168f4d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:31.602806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0040b089-37d3-42a6-b606-bb3168f4d7c7 None None] MFA Rules not processed for user `26101a06e33249dab84e17021a4a1fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:31.604045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0040b089-37d3-42a6-b606-bb3168f4d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:31.641372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1196/2385] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:32.854633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:32.856482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:33.024654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca856118-cfd3-4041-b3db-ac3ea453af5f tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:33.032244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:33.032910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:33.033200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:33.033469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] PATH_INFO: `/v3/users/1486b01e2a39475dab72aa7f36816c1a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:33.034677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1486b01e2a39475dab72aa7f36816c1a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:33.036811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:33.124994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1486b01e2a39475dab72aa7f36816c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:33.143480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1486b01e2a39475dab72aa7f36816c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:33.144383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1486b01e2a39475dab72aa7f36816c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:33.155082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1486b01e2a39475dab72aa7f36816c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:33.156851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1486b01e2a39475dab72aa7f36816c1a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:33.201017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1190/2386] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:32 2022] DELETE /identity/v3/users/1486b01e2a39475dab72aa7f36816c1a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:33.423555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1837-e30b-4a2b-bff9-c1973e7b43ab None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:33.425657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1837-e30b-4a2b-bff9-c1973e7b43ab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:33.425975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e1837-e30b-4a2b-bff9-c1973e7b43ab None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:33.427370 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1197/2387] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:49:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 02:49:33.441278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:49:33.443396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:33.449026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:33.449308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:33.449615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:33.505562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:33.513846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:33.613513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:33.623103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:33.662106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:33.670938 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1198/2388] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:49:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:33.672285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:33.678742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:33.681367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:33.780050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df44149-8776-4409-8199-e2321d0ae823 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:33.803820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b3e473878d043f6896fe1c2021a3a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8278ac191fa8438aa336850c9c869795', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:33.804504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:33.804789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:33.805780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:33.808083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorizing `identity:get_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:33.810814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:33.812785 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1191/2389] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:49:33 2022] GET /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 383 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:33.813657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:33.815593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:33.873408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968904e-0c3a-4992-b273-aed269757a20 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:33.881214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:33.882073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:33.882639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:33.883014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:33.902871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:33.904778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:33.916590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5cf6-8485-4ac8-a230-e26b4451c5be tempest-QuotasAdminNegativeTest-150358478 tempest-QuotasAdminNegativeTest-150358478-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:33.921553 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1199/2390] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 02:49:33.942699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:33.943661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:33.944166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:33.944682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] PATH_INFO: `/v3/projects/f76e01279e6d47c0aa4fb03206db8050` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:33.947143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f76e01279e6d47c0aa4fb03206db8050)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:33.951806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:34.105432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f76e01279e6d47c0aa4fb03206db8050', 'request_id': 'req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.118002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f76e01279e6d47c0aa4fb03206db8050', 'request_id': 'req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.127185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f76e01279e6d47c0aa4fb03206db8050', 'request_id': 'req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.164517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] The token cache is being invalidate because project f76e01279e6d47c0aa4fb03206db8050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:34.165652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.167199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.170036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1192/2391] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:33 2022] DELETE /identity/v3/projects/f76e01279e6d47c0aa4fb03206db8050 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:34.174440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:34.192855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a5a8e-3cd1-4528-8fae-0c8b04f315cc service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:34.335355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:34.336602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:34.337132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:34.338170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] PATH_INFO: `/v3/users/3c866ee9d2744a73b55d1be2b3d69dc5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:34.341602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c866ee9d2744a73b55d1be2b3d69dc5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:34.343871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:34.432300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c866ee9d2744a73b55d1be2b3d69dc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.458332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c866ee9d2744a73b55d1be2b3d69dc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.463983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c866ee9d2744a73b55d1be2b3d69dc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.478924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c866ee9d2744a73b55d1be2b3d69dc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.480158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0171d7fc-6a41-4b18-ad62-8cd882e09933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c866ee9d2744a73b55d1be2b3d69dc5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:34.483047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:34.523355 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1200/2392] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:34 2022] DELETE /identity/v3/users/3c866ee9d2744a73b55d1be2b3d69dc5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:35.053839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:35.055529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:35.091630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c2ff7c-ab7e-47f9-9f71-762fc346b5f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:35.158731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:35.246795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:35.247609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:35.247894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:35.248172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] PATH_INFO: `/v3/projects/89bff91261ea40b6855ac96a9db6c878` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:35.249352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bff91261ea40b6855ac96a9db6c878)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:35.252292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:35.374332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bff91261ea40b6855ac96a9db6c878', 'request_id': 'req-80a472dc-de51-495f-8c41-8753a9c16146'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:35.390025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bff91261ea40b6855ac96a9db6c878', 'request_id': 'req-80a472dc-de51-495f-8c41-8753a9c16146'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:35.405865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bff91261ea40b6855ac96a9db6c878', 'request_id': 'req-80a472dc-de51-495f-8c41-8753a9c16146'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:35.453832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] The token cache is being invalidate because project 89bff91261ea40b6855ac96a9db6c878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:35.454178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:35.455171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:35.461093 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1193/2393] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:35 2022] DELETE /identity/v3/projects/89bff91261ea40b6855ac96a9db6c878 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:35.466676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220121e-29f4-4939-92ec-8188108a0d7a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:35.467172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220121e-29f4-4939-92ec-8188108a0d7a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:35.467258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220121e-29f4-4939-92ec-8188108a0d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:35.543091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0220121e-29f4-4939-92ec-8188108a0d7a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:35.544330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0220121e-29f4-4939-92ec-8188108a0d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:35.626148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:35.628413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:35.772084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1201/2394] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:49:35.841853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a472dc-de51-495f-8c41-8753a9c16146 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:35.857062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:35.857971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:35.858252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:35.858523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] PATH_INFO: `/v3/users/26101a06e33249dab84e17021a4a1fdc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:35.860118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:35.860421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:35.860709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:35.861030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26101a06e33249dab84e17021a4a1fdc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:35.865774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:35.927884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:35.929499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:35.969135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1202/2395] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:35.970143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:35.995559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff18fe9-dd99-479a-89a0-14b978527d0c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.014811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.015870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.016611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.017250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.017502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26101a06e33249dab84e17021a4a1fdc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:36.018451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:49:36.019035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:36.022395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:36.039160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26101a06e33249dab84e17021a4a1fdc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:36.040027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26101a06e33249dab84e17021a4a1fdc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:36.041590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:36.066496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26101a06e33249dab84e17021a4a1fdc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:36.068523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c22b9a5-7dd4-4726-81de-fb45f523f89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26101a06e33249dab84e17021a4a1fdc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:36.069895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1203/2396] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:36.070890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:36.075430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:36.101486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc400f-5038-44da-a36a-c7d614b29031 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.114004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.114646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.114930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.115223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.117991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:36.123314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:36.130044 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1194/2397] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:35 2022] DELETE /identity/v3/users/26101a06e33249dab84e17021a4a1fdc => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:49:36.132626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.132920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.136041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.192368 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1204/2398] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:36 2022] POST /identity/v3/projects => generated 397 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:36.197580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:36.223618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:36.228198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:36.333493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abc321-e339-45d3-aa65-4e7dcdc4de36 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.348484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.351386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.352464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.352912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.363286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:36.373215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:36.435384 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1205/2399] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:36 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:36.436542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:36.459708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804dbd9-b451-4b37-b84d-e927e1396388 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.478981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1195/2400] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:36.479234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.479234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.479234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.479234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.479963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:36.483200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:36.505863 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1206/2401] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:49:36.511075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:36.534186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468bb22-5cc3-4058-a3ef-3e0f6b88122d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.567842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.568483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.568813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.569240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.570459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:36.572135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:36.585993 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1196/2402] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:49:36.587588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:36.590955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:36.597845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:36.633256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd4281-6ec3-4bb0-a44d-87fa1bfc28b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.648792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4160ea-6869-4d9e-a639-f8e3fb045c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.649732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4160ea-6869-4d9e-a639-f8e3fb045c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.651266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4160ea-6869-4d9e-a639-f8e3fb045c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.652001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4160ea-6869-4d9e-a639-f8e3fb045c80 admin admin] PATH_INFO: `/v3/projects/802d5fbb45b84622acf59c4046f26a8c/users/bba0b932c2af45c1a4e7fc5c185a64d1/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.675695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:36.691525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4160ea-6869-4d9e-a639-f8e3fb045c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802d5fbb45b84622acf59c4046f26a8c, user_id=bba0b932c2af45c1a4e7fc5c185a64d1, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:36.706160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4160ea-6869-4d9e-a639-f8e3fb045c80 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:36.739181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1197/2403] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:36 2022] PUT /identity/v3/projects/802d5fbb45b84622acf59c4046f26a8c/users/bba0b932c2af45c1a4e7fc5c185a64d1/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:36.746965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.750624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.751530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.760484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bdbe8-fa6c-4feb-a4dd-b26e58c329ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:36.797512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:36.799252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:36.881618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:36.886432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:36.887096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:36.887586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:36.943974 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1198/2404] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:37.034418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:37.036102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:37.056748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1207/2405] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:49:37.121353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:37.124707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:37.159373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b9d05-3d46-4e7e-b720-e150952ac482 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:37.165131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:37.165782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:37.166251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:37.171093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:37.191644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:37.198104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:37.258028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1199/2406] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:38.259507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:38.261117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:38.288301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf7cfa-de77-4396-8255-155e5b87ce4a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:38.301338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:38.302030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:38.302361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:38.302874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] PATH_INFO: `/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:38.304970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f17887fd59d46d9b1cb91fafb9b6686)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:38.311016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:38.460690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f17887fd59d46d9b1cb91fafb9b6686', 'request_id': 'req-22e7fc90-cc4a-4463-94a1-a73f10565987'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.470647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f17887fd59d46d9b1cb91fafb9b6686', 'request_id': 'req-22e7fc90-cc4a-4463-94a1-a73f10565987'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.478509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f17887fd59d46d9b1cb91fafb9b6686', 'request_id': 'req-22e7fc90-cc4a-4463-94a1-a73f10565987'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.496214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] The token cache is being invalidate because project 4f17887fd59d46d9b1cb91fafb9b6686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:38.496856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.497617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.502820 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1208/2407] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:38 2022] DELETE /identity/v3/projects/4f17887fd59d46d9b1cb91fafb9b6686 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:38.503947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:38.514994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13971b16-bf3c-4451-9729-ca32bd62e4c2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:38.568326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:38.633187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:38.634283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:38.635077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:38.635441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] PATH_INFO: `/v3/users/0b3e473878d043f6896fe1c2021a3a25` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:38.636685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b3e473878d043f6896fe1c2021a3a25)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:38.638985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:38.703524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b3e473878d043f6896fe1c2021a3a25'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.712964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b3e473878d043f6896fe1c2021a3a25'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.713777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b3e473878d043f6896fe1c2021a3a25'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.722506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b3e473878d043f6896fe1c2021a3a25'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.736036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ea4417-0bea-46cc-a8e5-cd64917bb480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b3e473878d043f6896fe1c2021a3a25'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:38.774923 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1200/2408] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:38 2022] DELETE /identity/v3/users/0b3e473878d043f6896fe1c2021a3a25 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:49:39.270132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:39.276405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:39.300024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7fc90-cc4a-4463-94a1-a73f10565987 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:39.327306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:39.409993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:39.411073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:39.411701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:39.412116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] PATH_INFO: `/v3/projects/8278ac191fa8438aa336850c9c869795` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:39.414090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8278ac191fa8438aa336850c9c869795)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:39.417607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:39.529341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8278ac191fa8438aa336850c9c869795', 'request_id': 'req-70505241-cabb-47b1-bbc0-c30f44c8e38c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:39.550219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8278ac191fa8438aa336850c9c869795', 'request_id': 'req-70505241-cabb-47b1-bbc0-c30f44c8e38c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:39.577480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8278ac191fa8438aa336850c9c869795', 'request_id': 'req-70505241-cabb-47b1-bbc0-c30f44c8e38c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:39.622324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] The token cache is being invalidate because project 8278ac191fa8438aa336850c9c869795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:39.622620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:39.625635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70505241-cabb-47b1-bbc0-c30f44c8e38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:39.639355 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1209/2409] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:39 2022] DELETE /identity/v3/projects/8278ac191fa8438aa336850c9c869795 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:39.639799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:39.641122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:39.641606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:39.685233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:39.690382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:39.906655 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1201/2410] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:49:39.907894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:39.908227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:39.908595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:39.962807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:39.964114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:40.005567 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1210/2411] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:40.010360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:40.030144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72f966-75b6-44bd-9b49-920f4e2f0253 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:40.044802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:40.045452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.045864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.046064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.047305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:49:40.047959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:40.049605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:40.076141 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1202/2412] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:49:40.076789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:40.086784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605da5f-7ddb-495b-950c-8f3bcbd2a4c9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:40.105723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:40.105723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.105723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.105723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.106652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:40.107570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:40.188418 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1211/2413] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:40 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:40.193428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:40.208295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c38c0-82f7-4818-9981-e67967a20fc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:40.268186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:40.341919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:40.343503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.344058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.344633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.345541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:40.353427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:40.423089 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1203/2414] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:40 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:40.424405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:40.437612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab5f28-5057-498e-98be-0392d8ede00e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:40.445851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:40.446732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.447191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.447619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.448444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:40.450255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:40.464515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1212/2415] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:49:40.467903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:40.482016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b908c6-627a-4ae9-b856-931b85623cd1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:40.495516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f76733-fd62-423f-b923-9abf15c7f1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:40.496870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76733-fd62-423f-b923-9abf15c7f1ff admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.498090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76733-fd62-423f-b923-9abf15c7f1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.498473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f76733-fd62-423f-b923-9abf15c7f1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.504017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f76733-fd62-423f-b923-9abf15c7f1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:40.506316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f76733-fd62-423f-b923-9abf15c7f1ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:40.531577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1204/2416] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:40.535538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:40.551505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557abdb4-b1fa-4963-8a6a-b8a8e7e5c6f0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:40.564283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:40.568178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.568742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.569171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] PATH_INFO: `/v3/projects/6b0781d2226742d7a801a8d3883db4e5/users/92c1977354d24f57ab8a2d617cab90a3/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.594338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0781d2226742d7a801a8d3883db4e5, user_id=92c1977354d24f57ab8a2d617cab90a3, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:40.597747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:40.626915 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1213/2417] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:40 2022] PUT /identity/v3/projects/6b0781d2226742d7a801a8d3883db4e5/users/92c1977354d24f57ab8a2d617cab90a3/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:40.628442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:40.628710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:40.629023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:40.716592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] MFA Rules not processed for user `92c1977354d24f57ab8a2d617cab90a3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:40.733457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:40.887007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1205/2418] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:40.891101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:41.056562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:41.107884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c854d4-a121-46f3-9950-e2a74a354e79 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:41.122626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:41.123282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:41.123926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:41.124140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:41.124802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:41.126915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:41.196191 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1214/2419] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:49:40 2022] POST /identity/v3/projects => generated 391 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:41.201498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:41.231515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408052a-2890-4eb3-bda6-5907bc9db458 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:41.431177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:41.431852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:41.432207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:41.446045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:41.446045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:41.446045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:41.517523 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1206/2420] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:49:41 2022] POST /identity/v3/users => generated 302 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:49:41.521400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:41.566560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af5c4-aea1-4091-8166-d69e453ee3fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:41.609851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:41.618329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:41.620577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:41.625028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:41.633071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:41.638541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:41.681566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:41.682133 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1215/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:41.700989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5466e-c5b9-4f0c-8c75-fcd6c2241532 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:41.729939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:41.730685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:41.731151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:41.731622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] PATH_INFO: `/v3/projects/536f3503386c4741b8ee0fb6257c25e0/users/95483e2473d543b7b0729213cf7f1638/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:41.766704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] RBAC: Authorizing `identity:create_grant(project_id=536f3503386c4741b8ee0fb6257c25e0, user_id=95483e2473d543b7b0729213cf7f1638, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:41.784774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:41.852472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1207/2422] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:41 2022] PUT /identity/v3/projects/536f3503386c4741b8ee0fb6257c25e0/users/95483e2473d543b7b0729213cf7f1638/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:41.856313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:41.879951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe45d89-41e1-4f68-9c57-6000939187ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:42.209638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7f7b8-ec04-4870-a53b-a8651a61e85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:42.210810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7f7b8-ec04-4870-a53b-a8651a61e85a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:42.214679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7f7b8-ec04-4870-a53b-a8651a61e85a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:42.218779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7f7b8-ec04-4870-a53b-a8651a61e85a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:42.223272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7f7b8-ec04-4870-a53b-a8651a61e85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:42.225099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7f7b8-ec04-4870-a53b-a8651a61e85a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:42.261726 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1216/2423] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:49:42.262620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:42.270517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:42.293307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028a2eb-d113-41c5-bb32-cf5563d321db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:42.316578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:42.320059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:42.338289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:42.338697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] PATH_INFO: `/v3/projects/536f3503386c4741b8ee0fb6257c25e0/users/95483e2473d543b7b0729213cf7f1638/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:42.353242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] RBAC: Authorizing `identity:create_grant(project_id=536f3503386c4741b8ee0fb6257c25e0, user_id=95483e2473d543b7b0729213cf7f1638, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:42.368308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:42.437434 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1208/2424] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:49:42 2022] PUT /identity/v3/projects/536f3503386c4741b8ee0fb6257c25e0/users/95483e2473d543b7b0729213cf7f1638/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:42.448431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:42.449132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:42.449670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:42.498362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] MFA Rules not processed for user `95483e2473d543b7b0729213cf7f1638`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:42.499612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:42.809748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1217/2425] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:44.009845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:44.012559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:44.172990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7716632-e479-41a5-906a-73d1f9c2810d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:44.180917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d03c-2421-4100-bbdf-baeddbdaffa1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:44.181937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d03c-2421-4100-bbdf-baeddbdaffa1 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:44.182427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d03c-2421-4100-bbdf-baeddbdaffa1 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:44.182798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d03c-2421-4100-bbdf-baeddbdaffa1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:44.296797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d03c-2421-4100-bbdf-baeddbdaffa1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:44.305845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d03c-2421-4100-bbdf-baeddbdaffa1 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:44.320717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1209/2426] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:46.263645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:46.268366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:46.313535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25eb011-2df5-402f-b75e-40a88034b9a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:46.325315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395d98a-c4e7-49a7-b8b0-be22e95f7f97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:46.327295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d98a-c4e7-49a7-b8b0-be22e95f7f97 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:46.327927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d98a-c4e7-49a7-b8b0-be22e95f7f97 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:46.328788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395d98a-c4e7-49a7-b8b0-be22e95f7f97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:46.343651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395d98a-c4e7-49a7-b8b0-be22e95f7f97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:46.346414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395d98a-c4e7-49a7-b8b0-be22e95f7f97 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:46.361942 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1218/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:46 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:49.801477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025df2-0ebf-43b2-aa93-7f3216729b74 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:49.802514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025df2-0ebf-43b2-aa93-7f3216729b74 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:49.803075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9025df2-0ebf-43b2-aa93-7f3216729b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:49.864745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c9025df2-0ebf-43b2-aa93-7f3216729b74 None None] MFA Rules not processed for user `f0ea28d9bb3544bca1a3c90d983fe8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:49.867438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9025df2-0ebf-43b2-aa93-7f3216729b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:50.017223 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1210/2428] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:49:50.201115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:50.201623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:50.201858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:50.243712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] MFA Rules not processed for user `bba0b932c2af45c1a4e7fc5c185a64d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:50.261071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:50.284785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:50.375127 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1219/2429] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:50.385055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efd658-efb4-4db9-8476-90a6608a08ed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:50.385344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efd658-efb4-4db9-8476-90a6608a08ed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:50.385632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efd658-efb4-4db9-8476-90a6608a08ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:50.408130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e3efd658-efb4-4db9-8476-90a6608a08ed None None] MFA Rules not processed for user `bba0b932c2af45c1a4e7fc5c185a64d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:50.409737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3efd658-efb4-4db9-8476-90a6608a08ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:50.419277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1211/2430] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:51.433025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:51.466185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b6ae7-e34f-4662-9837-da1a36cdbc92 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:51.480343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:51.482687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:51.483361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:51.486647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:51.505705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:51.507675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:51.536974 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1220/2431] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:51 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:55.528452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:55.529367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:55.529825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:55.582395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:55.583659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:55.650445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:55.795717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1212/2432] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:49:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:55.816485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:55.817998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:55.971631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7b1b0-6e80-4ab2-a243-3ae5af987b7e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:55.977480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50f938-707b-4f99-a89a-f9b182380464 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:55.978549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f938-707b-4f99-a89a-f9b182380464 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:55.979030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f938-707b-4f99-a89a-f9b182380464 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:55.979495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50f938-707b-4f99-a89a-f9b182380464 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:55.988970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f938-707b-4f99-a89a-f9b182380464 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:55.991232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50f938-707b-4f99-a89a-f9b182380464 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:56.016628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1221/2433] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:49:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:49:57.547257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:57.694013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e03d14-f6f0-4bb9-9934-4f6031243c10 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:57.700752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:57.701690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:57.702210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:57.702729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] PATH_INFO: `/v3/users/92c1977354d24f57ab8a2d617cab90a3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:57.704092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c1977354d24f57ab8a2d617cab90a3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:57.706446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:57.829293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c1977354d24f57ab8a2d617cab90a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:57.844966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c1977354d24f57ab8a2d617cab90a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:57.846149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c1977354d24f57ab8a2d617cab90a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:57.857165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c1977354d24f57ab8a2d617cab90a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:57.858850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c1977354d24f57ab8a2d617cab90a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:57.892980 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1213/2434] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:57 2022] DELETE /identity/v3/users/92c1977354d24f57ab8a2d617cab90a3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:57.897625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:57.898128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:57.898337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:57.924514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:49:57.926214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:58.012778 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1222/2435] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:49:58.050619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:58.051790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:58.170615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32834d1b-fdd4-427f-afc3-324f5dfc3edc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:58.184932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:58.185746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:58.187901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:58.188323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:58.199846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:58.206945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:58.208885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:58.221477 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1214/2436] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:49:59.214708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:59.216175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:49:59.228813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c521656-fa53-4e8c-922d-1f1112bc78f0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:59.242735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:59.243676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:59.244295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:59.244709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] PATH_INFO: `/v3/projects/6b0781d2226742d7a801a8d3883db4e5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:59.246897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0781d2226742d7a801a8d3883db4e5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:59.248997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:59.300263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:49:59.327117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0781d2226742d7a801a8d3883db4e5', 'request_id': 'req-93ce31d2-407b-4e81-8ebc-21d092b7da5d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.336108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0781d2226742d7a801a8d3883db4e5', 'request_id': 'req-93ce31d2-407b-4e81-8ebc-21d092b7da5d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.343436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0781d2226742d7a801a8d3883db4e5', 'request_id': 'req-93ce31d2-407b-4e81-8ebc-21d092b7da5d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.371977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] The token cache is being invalidate because project 6b0781d2226742d7a801a8d3883db4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:49:59.373337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.374997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.378102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1223/2437] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:49:59 2022] DELETE /identity/v3/projects/6b0781d2226742d7a801a8d3883db4e5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:49:59.383492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:49:59.395602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9677aa-4451-4017-a6e6-ef5902d54393 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:49:59.465407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:49:59.466410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:49:59.466836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:49:59.467344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] PATH_INFO: `/v3/users/95483e2473d543b7b0729213cf7f1638` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:49:59.468813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] RBAC: Authorizing `identity:delete_user(user_id=95483e2473d543b7b0729213cf7f1638)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:49:59.471617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:49:59.571049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95483e2473d543b7b0729213cf7f1638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.580583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95483e2473d543b7b0729213cf7f1638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.581661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95483e2473d543b7b0729213cf7f1638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.590931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95483e2473d543b7b0729213cf7f1638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.591952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dd6f8c77-9704-4533-b944-5e342105b81d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95483e2473d543b7b0729213cf7f1638'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:49:59.613588 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1215/2438] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:49:59 2022] DELETE /identity/v3/users/95483e2473d543b7b0729213cf7f1638 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:00.134615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.136171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:00.158522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce31d2-407b-4e81-8ebc-21d092b7da5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.234508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.235614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.235969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.236458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] PATH_INFO: `/v3/projects/536f3503386c4741b8ee0fb6257c25e0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.237946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536f3503386c4741b8ee0fb6257c25e0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.239968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.296798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536f3503386c4741b8ee0fb6257c25e0', 'request_id': 'req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:00.304546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536f3503386c4741b8ee0fb6257c25e0', 'request_id': 'req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:00.312468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536f3503386c4741b8ee0fb6257c25e0', 'request_id': 'req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:00.327799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] The token cache is being invalidate because project 536f3503386c4741b8ee0fb6257c25e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:00.328190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:00.329338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-464ff4ea-cbe3-4f05-adc5-fc088f5ad918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:00.331235 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1224/2439] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:00 2022] DELETE /identity/v3/projects/536f3503386c4741b8ee0fb6257c25e0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:00.336548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.336958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.337383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.360116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:00.361741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:00.455812 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1216/2440] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:00.462512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.472353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.472633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.495920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:00.497265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:00.509840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1225/2441] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:00.511491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.523525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b13b8-53d6-4d9e-9f60-bdbd4c98a176 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.529971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.530710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.531081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.531514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.532258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:50:00.532653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.534385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.546844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:00.565589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.565697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1217/2442] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:50:00.571876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dabec-6a4a-479b-9e8b-97988c06e78b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.580784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.582079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.582502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.582931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.583709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.587355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.643960 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1226/2443] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:50:00 2022] POST /identity/v3/projects => generated 373 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:00.648010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.660537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fa3be-6699-405f-8780-35a00acb3062 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.764386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.765023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.765301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.765572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.766240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.769292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.801990 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1218/2444] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:50:00 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:00.806069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.816764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abb323-b36f-49e7-8a2d-10687d2ec9ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.822088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.822878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.823183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.823502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.824534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.826410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.838239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1227/2445] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:00.843120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.854314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e18ce9-c512-4ac6-a602-d0288462832a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.860329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.861128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.861620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.862100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.863712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.866128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.880946 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1219/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:00.885410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.896716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e39380-731e-49d9-ac71-3c58ae9170e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.902557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cac93-8d3a-42e1-8579-8394f94cc5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:00.903400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cac93-8d3a-42e1-8579-8394f94cc5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.903852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cac93-8d3a-42e1-8579-8394f94cc5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.904129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cac93-8d3a-42e1-8579-8394f94cc5f8 admin admin] PATH_INFO: `/v3/projects/01d46bf526a149d7b149decc11d24f3d/users/5c78a473c70b4e29ac4d3fdd53c4b501/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.906673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:00.922806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cac93-8d3a-42e1-8579-8394f94cc5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d46bf526a149d7b149decc11d24f3d, user_id=5c78a473c70b4e29ac4d3fdd53c4b501, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:00.926054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cac93-8d3a-42e1-8579-8394f94cc5f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:00.941829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1228/2447] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:00 2022] PUT /identity/v3/projects/01d46bf526a149d7b149decc11d24f3d/users/5c78a473c70b4e29ac4d3fdd53c4b501/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:00.953620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:00.953941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:00.954275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:00.956599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:00.958389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:00.975037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bc855-3b50-4ef2-8791-b2d220f40543 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:00.988561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] MFA Rules not processed for user `5c78a473c70b4e29ac4d3fdd53c4b501`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:00.990263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:01.058390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.059056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.059863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.072411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] PATH_INFO: `/v3/users/10d0adc7068a4f82828a344e3f18d2db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.078383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d0adc7068a4f82828a344e3f18d2db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.083368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.086121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1229/2448] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:01.091585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.106877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7e8da-7a59-48ff-a4a4-e1d86f2baf21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.112299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.113143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.113566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.114139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.114947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.117725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.165962 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1230/2449] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:50:01 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:01.167306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.197370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d0adc7068a4f82828a344e3f18d2db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:01.214494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d0adc7068a4f82828a344e3f18d2db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:01.216633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d0adc7068a4f82828a344e3f18d2db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:01.231855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d0adc7068a4f82828a344e3f18d2db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:01.232922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d0adc7068a4f82828a344e3f18d2db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:01.264075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:01.278937 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1220/2450] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:00 2022] DELETE /identity/v3/users/10d0adc7068a4f82828a344e3f18d2db => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:01.292396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33a6f4-ea50-43d4-940d-5ea9e038a2a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.366149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:01.402963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.403676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.404706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.404992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.406349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.408702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.441589 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1231/2451] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:50:01 2022] POST /identity/v3/users => generated 295 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:01.446023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.448015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:01.466019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015f254-f96c-4a88-85d4-c0b4692a3ac3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.473668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.475019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.475448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.475886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.476691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.479961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.497696 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1221/2452] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:50:01.500952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.513665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad5d8c3-6491-4094-ba78-52bf1178701f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.520647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.522795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.523591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.524025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] PATH_INFO: `/v3/projects/226822caab6b4c988758d8a5e83731fd/users/18939c63fbd04a3191650d3aefb5fdfc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.547315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226822caab6b4c988758d8a5e83731fd, user_id=18939c63fbd04a3191650d3aefb5fdfc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.550380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.581047 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1232/2453] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:01 2022] PUT /identity/v3/projects/226822caab6b4c988758d8a5e83731fd/users/18939c63fbd04a3191650d3aefb5fdfc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:01.585362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.620853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e17e0-7a3a-4f81-955d-9096bbd28d1b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.735541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.736221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.736548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.737430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.738358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.740325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.753931 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1222/2454] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:01.758283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.777022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa17ccb-7edb-43c6-9f8c-92b47a2fb5e8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.783009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e216f0b-3a43-4686-82ab-7ba56e9c54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:01.783735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e216f0b-3a43-4686-82ab-7ba56e9c54ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.784167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e216f0b-3a43-4686-82ab-7ba56e9c54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.784301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e216f0b-3a43-4686-82ab-7ba56e9c54ee admin admin] PATH_INFO: `/v3/projects/226822caab6b4c988758d8a5e83731fd/users/18939c63fbd04a3191650d3aefb5fdfc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.791255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e216f0b-3a43-4686-82ab-7ba56e9c54ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=226822caab6b4c988758d8a5e83731fd, user_id=18939c63fbd04a3191650d3aefb5fdfc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:01.794655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e216f0b-3a43-4686-82ab-7ba56e9c54ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:01.827129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:01.827633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1233/2455] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:01 2022] PUT /identity/v3/projects/226822caab6b4c988758d8a5e83731fd/users/18939c63fbd04a3191650d3aefb5fdfc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:01.830241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:01.838443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bed03-4007-4002-a47e-f8415c2aa529 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:01.838949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bed03-4007-4002-a47e-f8415c2aa529 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:01.839493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bed03-4007-4002-a47e-f8415c2aa529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:01.876501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabf5a9-f6fc-4925-83b5-860e5522de9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:01.903119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8a0bed03-4007-4002-a47e-f8415c2aa529 None None] MFA Rules not processed for user `18939c63fbd04a3191650d3aefb5fdfc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:01.904490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a0bed03-4007-4002-a47e-f8415c2aa529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.031110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.031780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.033416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.033727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] PATH_INFO: `/v3/projects/c4e6814941f64857a662c3ddc0ec9ce3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.037639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e6814941f64857a662c3ddc0ec9ce3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.066858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.133742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1234/2456] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:02.180394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e6814941f64857a662c3ddc0ec9ce3', 'request_id': 'req-7f84b411-f9c1-4ffc-9768-87e532176944'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:02.188033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e6814941f64857a662c3ddc0ec9ce3', 'request_id': 'req-7f84b411-f9c1-4ffc-9768-87e532176944'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:02.195507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e6814941f64857a662c3ddc0ec9ce3', 'request_id': 'req-7f84b411-f9c1-4ffc-9768-87e532176944'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:02.212474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.212713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] The token cache is being invalidate because project c4e6814941f64857a662c3ddc0ec9ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:02.212806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.213025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:02.213143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.213855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f84b411-f9c1-4ffc-9768-87e532176944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:02.218087 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1223/2457] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:01 2022] DELETE /identity/v3/projects/c4e6814941f64857a662c3ddc0ec9ce3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:02.222626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97bbfd-5471-414b-a9d5-1ca64e217fef None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.222910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97bbfd-5471-414b-a9d5-1ca64e217fef None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.223178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97bbfd-5471-414b-a9d5-1ca64e217fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.233927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] MFA Rules not processed for user `5c78a473c70b4e29ac4d3fdd53c4b501`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:02.235796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.247884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6b97bbfd-5471-414b-a9d5-1ca64e217fef None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:02.249210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6b97bbfd-5471-414b-a9d5-1ca64e217fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.259759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:02.316416 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1235/2458] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:50:02.329000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.330587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.335206 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1224/2459] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:02.341993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.343424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.343706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.375169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:02.376674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.386258 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1225/2460] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:50:02.386723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:02.390632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.402445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90a6b-fcaa-474e-a745-561f650f3b37 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.416675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.417320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.418031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.419247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.419971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:50:02.421308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.422990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.453372 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1226/2461] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:50:02.454960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900232f9-e4fe-4f23-8d54-eca661663f8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.457759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.461616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.462402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.462781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.463245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.465507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.469912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c16fb-3707-4474-a541-de5103d19769 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.475642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.475925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.476209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.476487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.477290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.478739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.479491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.480557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.491757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1236/2462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:02.515670 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1227/2463] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:50:02 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:02.519880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.545962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94ecdb-2dde-45e4-a09f-27620f08b1b5 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.619948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.620886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.621200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.623800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.624422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.626406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.654412 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1237/2464] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:50:02 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:02.658224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.669936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39423cc7-da0b-4344-9c4d-d2b2a1116ac5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.676968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.677846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.678164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.678507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.679246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.691308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.707567 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1228/2465] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:50:02.721860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.721860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7176b0-a11d-4026-8ebd-e54b1e83f38d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.727055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3566fc3-ff19-4a0e-b12e-7083c066ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.727946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566fc3-ff19-4a0e-b12e-7083c066ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.728341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566fc3-ff19-4a0e-b12e-7083c066ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.728982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3566fc3-ff19-4a0e-b12e-7083c066ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.729630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566fc3-ff19-4a0e-b12e-7083c066ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.731636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3566fc3-ff19-4a0e-b12e-7083c066ac22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.747043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1238/2466] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:50:02.750945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.764375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78e01c-46bb-4e37-a9a8-858f4eb77640 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:02.769917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:02.770651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.770997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.771478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] PATH_INFO: `/v3/projects/45fe14a8293e416992d1e6f29ff4d5f5/users/170992795bde4f318bb47ad5d2727ca0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.795362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fe14a8293e416992d1e6f29ff4d5f5, user_id=170992795bde4f318bb47ad5d2727ca0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:02.798236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:02.817067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1229/2467] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:02 2022] PUT /identity/v3/projects/45fe14a8293e416992d1e6f29ff4d5f5/users/170992795bde4f318bb47ad5d2727ca0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:02.822388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b6f01-d25d-4b84-b204-62f3f443008d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:02.822728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b6f01-d25d-4b84-b204-62f3f443008d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:02.822938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b6f01-d25d-4b84-b204-62f3f443008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:02.850517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-573b6f01-d25d-4b84-b204-62f3f443008d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:02.851759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-573b6f01-d25d-4b84-b204-62f3f443008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:02.940633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1239/2468] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:02.961163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:02.963674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:03.062464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e37eeb-2556-483e-abf5-d59e21cf3f00 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:03.067141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69855ba0-e2bc-4e4d-93bb-987ee4c93582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:03.067838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69855ba0-e2bc-4e4d-93bb-987ee4c93582 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:03.068231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69855ba0-e2bc-4e4d-93bb-987ee4c93582 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:03.068518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69855ba0-e2bc-4e4d-93bb-987ee4c93582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:03.084685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69855ba0-e2bc-4e4d-93bb-987ee4c93582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:03.086203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69855ba0-e2bc-4e4d-93bb-987ee4c93582 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:03.105766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1230/2469] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:12.093791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:12.094301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:12.094406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:12.157223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] MFA Rules not processed for user `170992795bde4f318bb47ad5d2727ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:12.158552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:12.221621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:12.285852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1240/2470] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:12.289560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed1de0-0750-4b6a-8274-4e8018b6b4ff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:12.289560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed1de0-0750-4b6a-8274-4e8018b6b4ff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:12.290391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed1de0-0750-4b6a-8274-4e8018b6b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:12.346123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b7ed1de0-0750-4b6a-8274-4e8018b6b4ff None None] MFA Rules not processed for user `170992795bde4f318bb47ad5d2727ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:12.352584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7ed1de0-0750-4b6a-8274-4e8018b6b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:12.372816 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1231/2471] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:12.858590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:12.989610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c94789-3dd7-46a3-989f-c33a69d64e85 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:13.002714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:13.003198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:13.003480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:13.003755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:13.023625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:13.029301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:13.050531 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1241/2472] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:13.373024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c6a1-aef0-4fdb-a6b1-6269e7a5621f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:13.373976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c6a1-aef0-4fdb-a6b1-6269e7a5621f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:13.374467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b2c6a1-aef0-4fdb-a6b1-6269e7a5621f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:13.398012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9b2c6a1-aef0-4fdb-a6b1-6269e7a5621f None None] MFA Rules not processed for user `bba0b932c2af45c1a4e7fc5c185a64d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:13.400339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9b2c6a1-aef0-4fdb-a6b1-6269e7a5621f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:13.454145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:13.513977 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1232/2473] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:14.190519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:14.192945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:14.215642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7e02-04a5-4d13-bdb2-112a3534a225 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:14.222313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:14.225144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:14.225719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:14.226210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] PATH_INFO: `/v3/users/fa30f68a081646d6b452d1cdf6e0181c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:14.228166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa30f68a081646d6b452d1cdf6e0181c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:14.234916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:14.309508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa30f68a081646d6b452d1cdf6e0181c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:14.327354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa30f68a081646d6b452d1cdf6e0181c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:14.328623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa30f68a081646d6b452d1cdf6e0181c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:14.339009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa30f68a081646d6b452d1cdf6e0181c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:14.339009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa30f68a081646d6b452d1cdf6e0181c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:14.355481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1242/2474] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:14 2022] DELETE /identity/v3/users/fa30f68a081646d6b452d1cdf6e0181c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:14.360185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:14.360478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:14.360757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:14.391697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:14.393232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:14.520287 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1233/2475] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:14.536103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:14.538289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:14.616022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:14.656584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f859d05-82f5-4b27-97ad-68e995933fc3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:14.666703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:14.667428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:14.667719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:14.678351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:14.707556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:14.709900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:14.734011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1243/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:15.028098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:15.031254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:15.052682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205121af-c15d-47ee-b9aa-7a9f9f2724f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:15.062317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:15.063264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:15.064542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:15.064992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] PATH_INFO: `/v3/projects/1031cc111cc747098bbc8a428c1cfad6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:15.068016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1031cc111cc747098bbc8a428c1cfad6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:15.072518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:15.218798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1031cc111cc747098bbc8a428c1cfad6', 'request_id': 'req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.250601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1031cc111cc747098bbc8a428c1cfad6', 'request_id': 'req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.281488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1031cc111cc747098bbc8a428c1cfad6', 'request_id': 'req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.308051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] The token cache is being invalidate because project 1031cc111cc747098bbc8a428c1cfad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:15.308768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.309665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.312001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1234/2477] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:15 2022] DELETE /identity/v3/projects/1031cc111cc747098bbc8a428c1cfad6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:15.315838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:15.330236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25739e-a77d-49c0-b658-11c835b93a6a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:15.432963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:15.433626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:15.433933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:15.434212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] PATH_INFO: `/v3/users/f3334cb715fb407c987585460261e625` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:15.435375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3334cb715fb407c987585460261e625)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:15.437418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:15.488895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3334cb715fb407c987585460261e625'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.502684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3334cb715fb407c987585460261e625'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.503426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3334cb715fb407c987585460261e625'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.511027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3334cb715fb407c987585460261e625'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.511899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-15730926-44e3-46f4-9100-f55015ccc986 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3334cb715fb407c987585460261e625'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:15.529231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1244/2478] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:15 2022] DELETE /identity/v3/users/f3334cb715fb407c987585460261e625 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:15.912444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:15.915175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:15.960162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd2d4c-ce65-4fd7-a3c3-d1a23bdd9940 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.066165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.067205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.067998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.068593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] PATH_INFO: `/v3/projects/1d3d948782ee4768af668635788e508c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.070561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3d948782ee4768af668635788e508c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.073291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.078113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:16.186257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3d948782ee4768af668635788e508c', 'request_id': 'req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:16.211417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3d948782ee4768af668635788e508c', 'request_id': 'req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:16.225002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3d948782ee4768af668635788e508c', 'request_id': 'req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:16.242834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] The token cache is being invalidate because project 1d3d948782ee4768af668635788e508c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:16.243406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:16.244123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd705d2-159e-4bca-8c5f-cc79bb617f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:16.246608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1235/2479] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:15 2022] DELETE /identity/v3/projects/1d3d948782ee4768af668635788e508c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:16.251422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.251912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.252194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.292315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:16.293573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:16.385922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:16.431445 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1245/2480] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:16.432416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.432611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.432865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.479834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:16.485278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:16.504774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:16.511984 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1236/2481] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:50:16.516475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74f312-cef5-48ee-b380-ad624245b2f9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.523233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.524646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.525201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.525901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.526822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:50:16.527521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.529462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.566309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:16.575027 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1246/2482] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:50:16.581136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163c102-8405-470a-8b71-33be5ff1e19b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.587146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.587783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.588485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.588904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.589550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.592269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.634035 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1237/2483] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:50:16 2022] POST /identity/v3/projects => generated 397 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:50:16.635411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:16.646104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf88d-99e3-44bc-888e-1b9fc3384ac2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.713291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.714322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.714874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.715315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.716339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.718544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.740714 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1247/2484] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:50:16 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:16.744900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:16.758661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb38da-a616-427d-8e44-08394ffd3737 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.765547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.766348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.766625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.766890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.767532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.769154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.782963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1238/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:50:16.784157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:16.796124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baa478-6eb5-4d86-9f37-306cd77ace68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.803117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dc7e45-1ef6-4a25-85e2-1401df25463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.804125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc7e45-1ef6-4a25-85e2-1401df25463d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.804560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc7e45-1ef6-4a25-85e2-1401df25463d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.805024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dc7e45-1ef6-4a25-85e2-1401df25463d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.806043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc7e45-1ef6-4a25-85e2-1401df25463d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.808592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dc7e45-1ef6-4a25-85e2-1401df25463d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.825194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1248/2486] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:16.829239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:16.842493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87021c-09d0-46dc-ac08-e4b917723512 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:16.850977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:16.851665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.851944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.852219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] PATH_INFO: `/v3/projects/0b30ce428766445d9d0d45f350ae1024/users/837f9940834e4eaeb31c967dba6d762f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.879370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b30ce428766445d9d0d45f350ae1024, user_id=837f9940834e4eaeb31c967dba6d762f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:16.882254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:16.903329 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1239/2487] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:16 2022] PUT /identity/v3/projects/0b30ce428766445d9d0d45f350ae1024/users/837f9940834e4eaeb31c967dba6d762f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:16.908315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:16.908607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:16.909213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:16.939128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:16.940397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:17.063942 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1249/2488] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:17.079063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:17.082074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:17.177961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13995e-dd54-49c3-9d4b-9eedab29aac7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:17.181919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db026cad-dc0b-4337-b799-32e3fb532771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:17.182636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026cad-dc0b-4337-b799-32e3fb532771 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:17.182913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026cad-dc0b-4337-b799-32e3fb532771 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:17.183212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db026cad-dc0b-4337-b799-32e3fb532771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:17.193501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db026cad-dc0b-4337-b799-32e3fb532771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:17.195269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db026cad-dc0b-4337-b799-32e3fb532771 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:17.206378 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1240/2489] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:21.028337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:21.031870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:21.112982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:21.141028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1005c6-e2ca-4813-b994-53896a186485 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:21.151922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:21.152759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:21.153308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:21.153684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:21.155875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:21.296117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:21.299581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2482-4e4b-4b35-8417-970e84ec1632 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:21.315504 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1250/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:24.502210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:24.503124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:24.503575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:24.551824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] MFA Rules not processed for user `837f9940834e4eaeb31c967dba6d762f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:24.554352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:24.590843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:24.667206 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1241/2491] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:24.751596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:24.752164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:24.752164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:24.776687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] MFA Rules not processed for user `837f9940834e4eaeb31c967dba6d762f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:24.778275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:24.797371 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1251/2492] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:24 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:24.913744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:24.915377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:24.933291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f9584-0716-45e1-8016-deeab1e571dc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:24.940951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a805d910-ed3c-4d3d-823d-468c0ba2f6b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:24.942092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d910-ed3c-4d3d-823d-468c0ba2f6b8 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:24.942707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d910-ed3c-4d3d-823d-468c0ba2f6b8 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:24.944713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a805d910-ed3c-4d3d-823d-468c0ba2f6b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:24.964743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d910-ed3c-4d3d-823d-468c0ba2f6b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:24.967938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a805d910-ed3c-4d3d-823d-468c0ba2f6b8 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:24.985162 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1242/2493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:27.392289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:27.393946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:27.408518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157d7b6-95be-4155-8f30-b3ff1760420c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:27.414547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:27.415181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:27.415454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:27.415721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] PATH_INFO: `/v3/users/5c78a473c70b4e29ac4d3fdd53c4b501` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:27.416912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c78a473c70b4e29ac4d3fdd53c4b501)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:27.418896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:27.471169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c78a473c70b4e29ac4d3fdd53c4b501'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:27.485335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c78a473c70b4e29ac4d3fdd53c4b501'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:27.486270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c78a473c70b4e29ac4d3fdd53c4b501'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:27.495061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c78a473c70b4e29ac4d3fdd53c4b501'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:27.496194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c78a473c70b4e29ac4d3fdd53c4b501'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:27.511537 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1252/2494] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:27 2022] DELETE /identity/v3/users/5c78a473c70b4e29ac4d3fdd53c4b501 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:27.516279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:27.516777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:27.516897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:27.538393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:27.539616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:27.605628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1243/2495] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:50:27.616165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:27.617651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:27.680092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d0882d-6d93-4ff4-b4b2-3b5ffb705e68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:27.684316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:27.684984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:27.685266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:27.685691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:27.696761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:27.698423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:27.704533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:27.721648 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1253/2496] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:28.209968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:28.211479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:28.235354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fb97a-d539-4c0f-8276-d49cec2f2048 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:28.250569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:28.251175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:28.251454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:28.251728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] PATH_INFO: `/v3/projects/01d46bf526a149d7b149decc11d24f3d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:28.252943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d46bf526a149d7b149decc11d24f3d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:28.254965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:28.396915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d46bf526a149d7b149decc11d24f3d', 'request_id': 'req-e7543eb3-ff48-42f9-af4f-11734026592c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.415933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d46bf526a149d7b149decc11d24f3d', 'request_id': 'req-e7543eb3-ff48-42f9-af4f-11734026592c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.430897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d46bf526a149d7b149decc11d24f3d', 'request_id': 'req-e7543eb3-ff48-42f9-af4f-11734026592c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.454663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] The token cache is being invalidate because project 01d46bf526a149d7b149decc11d24f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:28.455057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.455849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.460840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1244/2497] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:28 2022] DELETE /identity/v3/projects/01d46bf526a149d7b149decc11d24f3d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:28.465394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:28.493203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd80cf-67cc-4d22-8935-9259547a2a22 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:28.595841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:28.596496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:28.596764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:28.597035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] PATH_INFO: `/v3/users/18939c63fbd04a3191650d3aefb5fdfc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:28.598202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18939c63fbd04a3191650d3aefb5fdfc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:28.600868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:28.685674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18939c63fbd04a3191650d3aefb5fdfc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.700758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18939c63fbd04a3191650d3aefb5fdfc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.701587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18939c63fbd04a3191650d3aefb5fdfc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.712434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18939c63fbd04a3191650d3aefb5fdfc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.713173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2042f696-d520-4703-a588-ef241585b927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18939c63fbd04a3191650d3aefb5fdfc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:28.735153 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1254/2498] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:28 2022] DELETE /identity/v3/users/18939c63fbd04a3191650d3aefb5fdfc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:29.079606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:29.081219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:29.103388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7543eb3-ff48-42f9-af4f-11734026592c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:29.172633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:29.228369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:29.228947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:29.229222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:29.229490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] PATH_INFO: `/v3/projects/226822caab6b4c988758d8a5e83731fd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:29.231660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] RBAC: Authorizing `identity:delete_project(project_id=226822caab6b4c988758d8a5e83731fd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:29.233595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:29.306044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226822caab6b4c988758d8a5e83731fd', 'request_id': 'req-26cd77c8-69b5-4442-b1cd-c15d147d881e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:29.313995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226822caab6b4c988758d8a5e83731fd', 'request_id': 'req-26cd77c8-69b5-4442-b1cd-c15d147d881e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:29.339917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226822caab6b4c988758d8a5e83731fd', 'request_id': 'req-26cd77c8-69b5-4442-b1cd-c15d147d881e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:29.376233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] The token cache is being invalidate because project 226822caab6b4c988758d8a5e83731fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:29.376523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:29.381524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cd77c8-69b5-4442-b1cd-c15d147d881e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:29.384248 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1245/2499] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:29 2022] DELETE /identity/v3/projects/226822caab6b4c988758d8a5e83731fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:29.393006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:29.393356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:29.393567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:29.442778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:29.443708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:29.583008 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1255/2500] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:29.583802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:29.584106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:29.584537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:29.621184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:29.622764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:29.646599 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1246/2501] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:50:29.647034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:29.673441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d153d75-4e3b-4560-8308-dec41d37bdd3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:29.688058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:29.692868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:29.693277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:29.693696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:29.696429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:50:29.696753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:29.698443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:29.726795 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1256/2502] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:50:29.734596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:29.749859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d72708-5bae-4510-ba82-a446c274ab40 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:29.762879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:29.763585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:29.763967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:29.764339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:29.765080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:29.767132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:29.839175 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1247/2503] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:50:29 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:29.840543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:29.853057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601a29ab-ca3c-4517-800e-35446c5e535a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:29.858683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:29.975238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:29.976030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:29.976433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:29.976782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:29.978319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:29.980804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:30.008805 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1257/2504] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:50:29 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:30.012724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:30.024982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae7ea-12ad-4b97-a1f5-99b210bbeaef admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:30.030973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:30.031785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:30.032165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:30.032538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:30.033298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:30.035144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:30.047103 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1248/2505] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:30.050776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:30.062098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9eada-4e3c-445d-a375-04aa9726881b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:30.069630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4238f7-02cc-47c8-a747-6f0a16aab3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:30.070238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4238f7-02cc-47c8-a747-6f0a16aab3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:30.070528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4238f7-02cc-47c8-a747-6f0a16aab3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:30.070856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4238f7-02cc-47c8-a747-6f0a16aab3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:30.081885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4238f7-02cc-47c8-a747-6f0a16aab3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:30.092351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4238f7-02cc-47c8-a747-6f0a16aab3b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:30.123495 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1258/2506] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:30.124907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:30.142599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e717c7-47b0-42ef-b47b-caf90cf89354 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:30.152976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:30.154122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:30.154642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:30.155145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] PATH_INFO: `/v3/projects/6179c6ca4a3a43f9985b4b1e4c30dc43/users/a72f924bb7cb4aa78f374ef96f6926ad/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:30.174815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6179c6ca4a3a43f9985b4b1e4c30dc43, user_id=a72f924bb7cb4aa78f374ef96f6926ad, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:30.178694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:30.207208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1249/2507] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:30 2022] PUT /identity/v3/projects/6179c6ca4a3a43f9985b4b1e4c30dc43/users/a72f924bb7cb4aa78f374ef96f6926ad/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:30.212702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:30.212993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:30.213291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:30.235809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:30.246175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:30.359065 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1259/2508] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:30.371236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:30.374737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:30.445733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526bbb6-7f50-43d6-8e9c-1621fa50bc6b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:30.455543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:30.456585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:30.457165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:30.457781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:30.469583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:30.471787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:30.478591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:30.486347 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1250/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:34.886133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:34.889715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:34.910628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a0bc1-6a5e-4671-9b3a-2dc7b4605416 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:34.920155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:34.920818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:34.921100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:34.923052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:34.932853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:35.087922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:35.091532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407956a9-d7aa-4824-ad05-54c5c0055b11 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:35.120454 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1260/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:36.319181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:36.329186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91dc34-bf37-480e-af92-cde68771b650 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:36.338846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:36.339608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:36.339801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:36.341951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:36.342079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:36.369864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:36.373692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:36.396124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1251/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:37.776535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d466a0-2659-4a55-886d-eb80f7215c93 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:37.777007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d466a0-2659-4a55-886d-eb80f7215c93 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:37.777090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d466a0-2659-4a55-886d-eb80f7215c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:37.830690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c2d466a0-2659-4a55-886d-eb80f7215c93 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:37.837288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c2d466a0-2659-4a55-886d-eb80f7215c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:37.856241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:38.038397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1261/2512] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:50:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:38.057147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:38.058898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:38.212893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c2976-fb47-4cf0-bc41-76309bf81f90 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:38.224005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:38.224913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:38.225392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:38.225916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:38.236493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:38.238490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:38.251849 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1252/2513] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:50:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:50:41.795155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:41.795155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:41.795155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:41.897275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] MFA Rules not processed for user `a72f924bb7cb4aa78f374ef96f6926ad`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:41.906270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:42.083466 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1262/2514] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:41 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:42.385931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:42.387406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:42.420976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e11ff-a666-4d0f-9447-246e07db02f7 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:42.426815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:42.428224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:42.428514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:42.428786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:42.450667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:42.452845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:42.478326 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1253/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:42.769159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:42.807178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc77089-33be-46f5-ad9b-2ce3dd2b93cd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:42.824452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:42.825102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:42.825380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:42.825647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:42.848984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:42.865039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:42.866583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:42.881107 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1263/2516] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:46.451465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:46.466947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8498de1-8c4a-45d6-998f-8618907ad694 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:46.506597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:46.512620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:46.528553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:46.528994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:46.542129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:46.563871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:46.567134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:46.598160 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1254/2517] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:49.227081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:49.230452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:49.261026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a66697-d0cd-4009-a994-bacaddc43767 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:49.281376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:49.282364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:49.282790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:49.283227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] PATH_INFO: `/v3/users/170992795bde4f318bb47ad5d2727ca0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:49.284541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170992795bde4f318bb47ad5d2727ca0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:49.286900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:49.356252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170992795bde4f318bb47ad5d2727ca0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:49.374825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170992795bde4f318bb47ad5d2727ca0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:49.375814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170992795bde4f318bb47ad5d2727ca0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:49.386544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170992795bde4f318bb47ad5d2727ca0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:49.387464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cd21379c-0e2c-4fdd-964d-892e6ce6afa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170992795bde4f318bb47ad5d2727ca0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:49.409409 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1264/2518] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:49 2022] DELETE /identity/v3/users/170992795bde4f318bb47ad5d2727ca0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:49.803641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:49.830991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9be6de-9a81-4818-b9f0-41255c65a571 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:49.994736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:49.997719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:49.998719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:49.999361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] PATH_INFO: `/v3/projects/45fe14a8293e416992d1e6f29ff4d5f5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.002811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fe14a8293e416992d1e6f29ff4d5f5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:50.005333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:50.139354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fe14a8293e416992d1e6f29ff4d5f5', 'request_id': 'req-72266791-1de7-4e69-89c8-ef014a32e665'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:50.142278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:50.156171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fe14a8293e416992d1e6f29ff4d5f5', 'request_id': 'req-72266791-1de7-4e69-89c8-ef014a32e665'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:50.168446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fe14a8293e416992d1e6f29ff4d5f5', 'request_id': 'req-72266791-1de7-4e69-89c8-ef014a32e665'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:50.189079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] The token cache is being invalidate because project 45fe14a8293e416992d1e6f29ff4d5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:50:50.190640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:50.191570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72266791-1de7-4e69-89c8-ef014a32e665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:50.193708 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1255/2519] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:49 2022] DELETE /identity/v3/projects/45fe14a8293e416992d1e6f29ff4d5f5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:50.198969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.199309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.199608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.212161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:50.236144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:50.238123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:50.360638 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1265/2520] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:50.369211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.370103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.370929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.428112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:50.430002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:50.441738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1256/2521] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:50.446162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:50.459818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9e57d-f3c6-4a7c-a7f6-d4fe76eb8fe7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:50.465306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:50.466326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.466848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.467324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.468166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:50:50.468707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:50.470573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:50.492742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1266/2522] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:50:50.497681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:50.510768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fd42d-28ce-48fb-9b92-5b5493eb15ce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:50.523399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:50.524611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.526624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.527860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.530876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:50.536598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:50.599182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1257/2523] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:50:50 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:50.603425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:50.624803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd03505-2abb-4390-a613-54c77fad0fc9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:50.768055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:50.769167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.769832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.770501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.771425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:50.773638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:50.835659 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1267/2524] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:50:50 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:50:50.840964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:50.863405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441cf11-e2ab-470c-ae11-078b0be547c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:50.883064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:50.886100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.886397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.886670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.887341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:50.888978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:50.921072 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1258/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:50.924738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:50.941870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f251da1-0b91-4493-94b4-e4d26b3db395 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:50.949645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49a11c-b855-4d06-a033-3ed0de0d6f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:50.951106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a11c-b855-4d06-a033-3ed0de0d6f29 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:50.951558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a11c-b855-4d06-a033-3ed0de0d6f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:50.951998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49a11c-b855-4d06-a033-3ed0de0d6f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:50.952796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a11c-b855-4d06-a033-3ed0de0d6f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:50.955304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49a11c-b855-4d06-a033-3ed0de0d6f29 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:50.972618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1268/2526] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:50:50.976540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:50.997325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00b56b-7087-44dc-a792-294dabb3acc5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:51.009556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:51.012159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:51.012592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:51.013495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] PATH_INFO: `/v3/projects/a4b218a2276a4bb9acd9c1b0cfa3b5a8/users/f0790d41f1d6452c92dc3d3dcc8d0af6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:51.031081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b218a2276a4bb9acd9c1b0cfa3b5a8, user_id=f0790d41f1d6452c92dc3d3dcc8d0af6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:51.034647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:51.071758 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1259/2527] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:50:50 2022] PUT /identity/v3/projects/a4b218a2276a4bb9acd9c1b0cfa3b5a8/users/f0790d41f1d6452c92dc3d3dcc8d0af6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:50:51.076817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:51.077398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:51.077923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:51.119615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:50:51.124488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:51.293278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1269/2528] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:50:51.304591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:51.306485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:51.492146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442be8b-98c6-4036-94e4-416eb7afbb9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:51.499066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:51.499698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:51.499973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:51.500323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:51.548907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:51.550799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:51.580564 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1260/2529] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:54.859703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:54.861713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:54.898944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c179db-16a8-4a65-bd83-8364105edbf4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:54.951689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:54.956175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:54.956774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:54.957101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:54.966290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:55.109320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:55.111311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:55.148024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:55.173030 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1270/2530] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:56.377064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:56.379240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:56.618651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba0188-da2a-409a-b2e5-fe3490c3b347 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:56.652596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:56.653626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:56.654144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:56.655862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:56.664083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:56.694844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:56.701746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:56.749660 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1261/2531] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:50:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:50:58.828953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:58.833904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:50:58.866228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1091d-9600-4cfd-9bb8-13393a544335 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:58.879859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:58.881383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:58.882703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:58.883145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] PATH_INFO: `/v3/users/a72f924bb7cb4aa78f374ef96f6926ad` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:58.895021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72f924bb7cb4aa78f374ef96f6926ad)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:58.902270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:50:59.046994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72f924bb7cb4aa78f374ef96f6926ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:59.076959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72f924bb7cb4aa78f374ef96f6926ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:59.078935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72f924bb7cb4aa78f374ef96f6926ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:59.095748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72f924bb7cb4aa78f374ef96f6926ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:59.096804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abac25a3-679b-48df-91f2-f0bec9d95171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72f924bb7cb4aa78f374ef96f6926ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:50:59.116782 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1271/2532] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:50:58 2022] DELETE /identity/v3/users/a72f924bb7cb4aa78f374ef96f6926ad => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:50:59.789627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:50:59.807343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:50:59.823120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745b3e3-7adb-4e55-aaac-97f3266a5d46 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:50:59.976477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:50:59.977121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:50:59.977397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:50:59.977665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] PATH_INFO: `/v3/projects/6179c6ca4a3a43f9985b4b1e4c30dc43` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:50:59.982453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6179c6ca4a3a43f9985b4b1e4c30dc43)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:50:59.990699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:00.131897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6179c6ca4a3a43f9985b4b1e4c30dc43', 'request_id': 'req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:00.143389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6179c6ca4a3a43f9985b4b1e4c30dc43', 'request_id': 'req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:00.158241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6179c6ca4a3a43f9985b4b1e4c30dc43', 'request_id': 'req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:00.186345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] The token cache is being invalidate because project 6179c6ca4a3a43f9985b4b1e4c30dc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:00.186752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:00.187444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cef4da5c-541f-4cd1-a9e4-ad7da8f6acc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:00.189493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1262/2533] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:50:59 2022] DELETE /identity/v3/projects/6179c6ca4a3a43f9985b4b1e4c30dc43 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:00.194978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a038-e0eb-4b91-baba-dfb50a56f80f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:00.196044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a038-e0eb-4b91-baba-dfb50a56f80f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:00.196531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347a038-e0eb-4b91-baba-dfb50a56f80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:00.230982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4347a038-e0eb-4b91-baba-dfb50a56f80f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:00.235470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4347a038-e0eb-4b91-baba-dfb50a56f80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:00.465827 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1272/2534] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:00.484137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:00.485281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:00.485862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:00.545645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:00.545645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:00.574434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:00.574598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:00.575066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:00.576862 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1263/2535] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:00.583113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:00.596986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] MFA Rules not processed for user `efecedc77d3048c4a0ec0fe6701f9ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:00.597707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:00.627323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac464d-dc53-42c8-a61f-1a596ac78509 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:00.653022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:00.654611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:00.655407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:00.657045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:00.657839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:00.661179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:00.667884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:00.691070 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1273/2536] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:51:00.720555 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1264/2537] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:00.723980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:00.739762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdfb16-967d-4d30-b80c-9cc5b1ffc0ad None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:00.754285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:00.755265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:00.758112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:00.758603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:00.759881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:00.764431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:00.822269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:00.848636 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1274/2538] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:00 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:00.850291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:00.864430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2372429-88ae-466b-896b-cab03c85d2db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:01.010077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:01.011044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:01.011507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:01.011937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:01.012747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:01.019798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:01.067772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1265/2539] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:00 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:01.068495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:01.082877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282f8d2-9942-41db-8aa0-650c1d40e36a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:01.110557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:01.111346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:01.111636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:01.111987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:01.114975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:01.116633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:01.168804 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1275/2540] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:01.170519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:01.187680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:01.202209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372acd-d4f2-4b4b-8db4-7baf510f3e95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:01.221613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26943c41-36fc-4f3f-832d-7a70fd398c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:01.222661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943c41-36fc-4f3f-832d-7a70fd398c7f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:01.224979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943c41-36fc-4f3f-832d-7a70fd398c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:01.225447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26943c41-36fc-4f3f-832d-7a70fd398c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:01.228752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26943c41-36fc-4f3f-832d-7a70fd398c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:01.230777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26943c41-36fc-4f3f-832d-7a70fd398c7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:01.273927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:01.276748 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1266/2541] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:01.290631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcfbdb-60a2-4c19-8db7-6c58dadf5ff1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:01.308266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:01.309267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:01.312487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:01.313026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] PATH_INFO: `/v3/projects/09d1a1bd5d9d434a8a5e8f94d564515f/users/0868f50723074f2b98f7b1096743f3cc/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:01.375622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d1a1bd5d9d434a8a5e8f94d564515f, user_id=0868f50723074f2b98f7b1096743f3cc, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:01.390363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:01.429254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1276/2542] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:01 2022] PUT /identity/v3/projects/09d1a1bd5d9d434a8a5e8f94d564515f/users/0868f50723074f2b98f7b1096743f3cc/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:01.434550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:01.434843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:01.435122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:01.476050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:01.480166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:01.692019 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1267/2543] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:01.774461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:01.776519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:01.983992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593f7bc-942e-412a-9b81-fa903131bec2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:01.993852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:01.994352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:01.994636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:01.994907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:02.020514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:02.022028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:02.043630 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1277/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:02.616317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:02.617751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:02.813316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd219f-650e-49ed-a060-74bc9e3d3052 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:02.828488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:02.829297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:02.830248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:02.831080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:02.838529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:02.864505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:02.872843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0850aa-3b78-4c74-a9b1-8ceb8f92c837 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:02.877010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:02.881071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:02.896986 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1268/2545] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:03.099453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cf6f6-b61d-4127-b651-06936feccf06 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:03.125684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:03.129846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:03.130134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:03.130404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:03.143680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:03.189324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:03.191097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878062e-1275-4a47-934a-d1734b2b0833 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:03.231263 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1278/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:07.550202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:07.550750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:07.550750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:07.609058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] MFA Rules not processed for user `f0790d41f1d6452c92dc3d3dcc8d0af6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:07.622535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:07.829632 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1269/2547] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:07.840774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:07.841274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:07.841575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:07.899429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] MFA Rules not processed for user `f0790d41f1d6452c92dc3d3dcc8d0af6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:07.900829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:07.927730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1279/2548] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:07.942385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:07.944056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:07.986860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c249b0-2fae-483b-bb20-6f80e4156591 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:07.993534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760559f-79ce-48d7-b090-2447f6c14690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:07.994361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760559f-79ce-48d7-b090-2447f6c14690 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:07.994790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760559f-79ce-48d7-b090-2447f6c14690 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:07.995067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760559f-79ce-48d7-b090-2447f6c14690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:08.018970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760559f-79ce-48d7-b090-2447f6c14690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:08.020751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760559f-79ce-48d7-b090-2447f6c14690 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:08.031970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:08.071396 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1270/2549] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:11.497217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:11.523569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b252f5a-34b6-4b9f-a57e-ff101b8f1672 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:11.532405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:11.533419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:11.534115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:11.534606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:11.537680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:11.569385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:11.571855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0e8a3-54b9-4e58-9ae6-69efc423e20e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:11.600371 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1280/2550] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:16.551610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:16.552686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:16.553924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:16.597411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] MFA Rules not processed for user `837f9940834e4eaeb31c967dba6d762f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:16.599318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:16.697843 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1271/2551] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:17.230815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:17.231390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:17.231770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:17.258379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:17.259827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:17.264251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:17.265881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:17.281206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f037107-58a9-4835-84b9-b15c2696c105 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:17.290883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:17.292746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:17.293781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:17.294307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:17.298360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:17.314345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:17.324719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:17.328412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:17.352291 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1272/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:17.438662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1281/2553] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:51:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:17.454329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:17.457000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:17.634451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f1c0-01f8-48d5-83b6-1f71d0d055a1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:17.646272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbd611-da5d-40cd-ae09-1adffc1c9e16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:17.647230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd611-da5d-40cd-ae09-1adffc1c9e16 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:17.647660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd611-da5d-40cd-ae09-1adffc1c9e16 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:17.648083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbd611-da5d-40cd-ae09-1adffc1c9e16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:17.661976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbd611-da5d-40cd-ae09-1adffc1c9e16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:17.664958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbd611-da5d-40cd-ae09-1adffc1c9e16 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:17.687656 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1273/2554] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:51:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:25.262034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:25.283996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cb7b0-68e2-4679-9597-e6b259d1fd3e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:25.292641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:25.293562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:25.293863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:25.294210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:25.297383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:25.385793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:25.387620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7522c12-5c63-4d26-9bce-3023b165f22e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:25.421062 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1282/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:25.835623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:25.838238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:25.838693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:25.903094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:25.906012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:26.149536 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1274/2556] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:26.158950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:26.159606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:26.160264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:26.196950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:26.199948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:26.238487 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1283/2557] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:27.748964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:27.775819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c691ed5-de14-478e-bcd3-11f4b5c7d8bf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:27.782703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8230296-617c-4416-8926-5f967d832761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:27.783495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8230296-617c-4416-8926-5f967d832761 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:27.783975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8230296-617c-4416-8926-5f967d832761 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:27.784411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8230296-617c-4416-8926-5f967d832761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:27.797523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8230296-617c-4416-8926-5f967d832761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:27.799522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8230296-617c-4416-8926-5f967d832761 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:27.805464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:27.811955 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1275/2558] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:28.978641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:28.980177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:29.011814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dd81e-cfd0-4414-ab95-3a7b3c0bd331 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:29.029512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:29.036767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:29.037047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:29.038319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] PATH_INFO: `/v3/users/bba0b932c2af45c1a4e7fc5c185a64d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:29.040959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba0b932c2af45c1a4e7fc5c185a64d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:29.045193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:29.158446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba0b932c2af45c1a4e7fc5c185a64d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:29.177875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba0b932c2af45c1a4e7fc5c185a64d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:29.179421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba0b932c2af45c1a4e7fc5c185a64d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:29.195452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba0b932c2af45c1a4e7fc5c185a64d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:29.196575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7c6b5504-a01d-4b7a-a811-60dee6b79a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba0b932c2af45c1a4e7fc5c185a64d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:29.232868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1284/2559] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:28 2022] DELETE /identity/v3/users/bba0b932c2af45c1a4e7fc5c185a64d1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:29.866500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8230296-617c-4416-8926-5f967d832761 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:29.885442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8230296-617c-4416-8926-5f967d832761 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:29.975732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:29.976377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:29.976868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:29.977298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] PATH_INFO: `/v3/projects/802d5fbb45b84622acf59c4046f26a8c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:29.982454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] RBAC: Authorizing `identity:delete_project(project_id=802d5fbb45b84622acf59c4046f26a8c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:29.984292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:30.128400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802d5fbb45b84622acf59c4046f26a8c', 'request_id': 'req-54528c10-84e4-4453-be62-723fcc82c33a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:30.157950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802d5fbb45b84622acf59c4046f26a8c', 'request_id': 'req-54528c10-84e4-4453-be62-723fcc82c33a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:30.175614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802d5fbb45b84622acf59c4046f26a8c', 'request_id': 'req-54528c10-84e4-4453-be62-723fcc82c33a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:30.234714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] The token cache is being invalidate because project 802d5fbb45b84622acf59c4046f26a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:30.235301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:30.236190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54528c10-84e4-4453-be62-723fcc82c33a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:30.239109 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1276/2560] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:29 2022] DELETE /identity/v3/projects/802d5fbb45b84622acf59c4046f26a8c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:30.244230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.245625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.246090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.275688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:30.277151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:30.323353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:30.371456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1285/2561] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:30.379993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.380426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.380809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.436872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:30.438625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:30.454465 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1277/2562] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:30.459088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:30.472772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf98b1-c416-4ee7-b474-70de1d8f9103 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:30.498432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:30.499539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.501998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.502535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.504420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:30.505234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:30.507652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:30.536176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1286/2563] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:30.536615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:30.548689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d89e2-0fc4-48fe-9990-5ce6a85f33da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:30.568034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:30.569014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.569778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.570292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.571137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:30.573468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:30.612315 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1278/2564] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:30 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:30.613375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:30.629053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dd546-6908-4169-a2cf-3d640610727f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:30.726066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:30.727187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.727187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.727394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.728113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:30.730357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:30.764060 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1287/2565] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:30 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:30.769242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:30.783977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f2bea-38df-490b-8e83-44bfc5d1e99f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:30.795707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:30.796794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.797319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.797787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.798580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:30.800921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:30.819454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:30.820390 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1279/2566] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:30.833610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802c6c0-3de2-45e5-b141-c9a40c91223f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:30.850233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b546cd-b60c-4044-bf0f-c3678255294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:30.850860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b546cd-b60c-4044-bf0f-c3678255294b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.851135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b546cd-b60c-4044-bf0f-c3678255294b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.851402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b546cd-b60c-4044-bf0f-c3678255294b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:30.852044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b546cd-b60c-4044-bf0f-c3678255294b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:30.854086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b546cd-b60c-4044-bf0f-c3678255294b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:30.881066 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1288/2567] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:30.885778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:30.921061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0582b-dfac-4eae-b134-deff4b93c4e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:30.943500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:30.945593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:30.947540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:30.949296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] PATH_INFO: `/v3/projects/458b1910dc504aadad8fa6fdc9c99b5c/users/fdb4859686e14440b293132eedd0ae3a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:31.011011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] RBAC: Authorizing `identity:create_grant(project_id=458b1910dc504aadad8fa6fdc9c99b5c, user_id=fdb4859686e14440b293132eedd0ae3a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:31.015474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:31.042043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1280/2568] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:30 2022] PUT /identity/v3/projects/458b1910dc504aadad8fa6fdc9c99b5c/users/fdb4859686e14440b293132eedd0ae3a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:31.055064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:31.055313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:31.055590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:31.128400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] MFA Rules not processed for user `fdb4859686e14440b293132eedd0ae3a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:31.130026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:31.248167 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1289/2569] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:31.712589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:31.714935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:31.766975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:31.880568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f14d4-79d8-4974-a247-99f05b7c498c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:31.891588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:31.892399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:31.896001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:31.896372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:31.933600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:31.938265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:31.955337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1281/2570] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:31.968821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:31.970720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:32.032834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:32.034099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:32.135286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcacadb-42e9-4a6e-b94a-710ce6c6b957 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:32.155906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:32.156597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:32.156883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:32.157441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:32.162612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:32.195103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:32.198924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca42ef-a9d4-46ae-9a47-2a85c8127673 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:32.225994 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1290/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:32.230121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941d3a-ddb0-4046-b31d-600b3f593870 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:32.246235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:32.246901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:32.247173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:32.247442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] PATH_INFO: `/v3/users/fdb4859686e14440b293132eedd0ae3a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:32.248605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb4859686e14440b293132eedd0ae3a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:32.251182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:32.367289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb4859686e14440b293132eedd0ae3a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:32.371111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796e90-3eab-41ca-a557-412575725730 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:32.371603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796e90-3eab-41ca-a557-412575725730 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:32.371699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e796e90-3eab-41ca-a557-412575725730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:32.395594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb4859686e14440b293132eedd0ae3a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:32.399822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb4859686e14440b293132eedd0ae3a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:32.409674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb4859686e14440b293132eedd0ae3a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:32.411830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2e796e90-3eab-41ca-a557-412575725730 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:32.413065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e796e90-3eab-41ca-a557-412575725730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:32.414150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4be953ae-69e9-4aed-9c9c-57e436f92c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb4859686e14440b293132eedd0ae3a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:32.459688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1282/2572] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:32 2022] DELETE /identity/v3/users/fdb4859686e14440b293132eedd0ae3a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:51:32.464164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:32.464440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:32.464711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:32.518383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:32.519950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:32.579195 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1291/2573] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:51:32.584379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:32.594670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e796e90-3eab-41ca-a557-412575725730 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:32.598327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e796e90-3eab-41ca-a557-412575725730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:32.652915 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1283/2574] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:32.698473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:32.700662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:32.740829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e796e90-3eab-41ca-a557-412575725730 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:32.872665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d4a8b-f6a7-4a9c-bc7f-8d5b97d35ec1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:32.891693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:32.897369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:32.897857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:32.898378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:32.932408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:32.943628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:32.981722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4e389-1700-45c9-ab9b-f85c898d0940 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:32.984118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e389-1700-45c9-ab9b-f85c898d0940 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:32.985151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e389-1700-45c9-ab9b-f85c898d0940 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:32.986404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1284/2575] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:32.986747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4e389-1700-45c9-ab9b-f85c898d0940 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:33.005728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:33.078117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4e389-1700-45c9-ab9b-f85c898d0940 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:33.079982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4e389-1700-45c9-ab9b-f85c898d0940 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:33.106269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1292/2576] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:51:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:51:34.612598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:34.614120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:34.636405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45390d-00bf-47d8-aa10-dbb078868ea6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:34.658098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:34.658751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:34.659311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:34.660513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] PATH_INFO: `/v3/projects/458b1910dc504aadad8fa6fdc9c99b5c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:34.663321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] RBAC: Authorizing `identity:delete_project(project_id=458b1910dc504aadad8fa6fdc9c99b5c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:34.665220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:34.761149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458b1910dc504aadad8fa6fdc9c99b5c', 'request_id': 'req-11716b07-a747-4270-a9d2-362fcd73056e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:34.770222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458b1910dc504aadad8fa6fdc9c99b5c', 'request_id': 'req-11716b07-a747-4270-a9d2-362fcd73056e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:34.776766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458b1910dc504aadad8fa6fdc9c99b5c', 'request_id': 'req-11716b07-a747-4270-a9d2-362fcd73056e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:34.792959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] The token cache is being invalidate because project 458b1910dc504aadad8fa6fdc9c99b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:34.793716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:34.794691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-11716b07-a747-4270-a9d2-362fcd73056e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:34.797441 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1285/2577] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:34 2022] DELETE /identity/v3/projects/458b1910dc504aadad8fa6fdc9c99b5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:34.802697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:34.803770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:34.804104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:34.840302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:34.842704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:34.936531 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1293/2578] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:51:34.945189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:34.945474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:34.945746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:34.969696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:34.971169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:34.981070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1286/2579] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:34.985704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:34.999111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9645c9-6780-42ea-8cbc-cffa27483e39 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.005522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.006835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.007281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.007716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.008556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:35.009038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.011046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.030143 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1294/2580] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:35.030411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:35.040457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8230c9-1fdf-4f5b-9511-c678e862f50c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.045961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.046886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.047316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.047955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.048756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.051118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.099584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1287/2581] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:35 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:35.101875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:35.117277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a3ad2a-be6f-4673-b52f-ed56e8261a31 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.204524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.205719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.206300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.207060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.208080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.210293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.249225 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1295/2582] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:35 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:35.250158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:35.265747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7f66-80dc-4598-907d-634b8d39a9f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.278155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.279137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.279639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.280521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.281388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.292212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.305878 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1288/2583] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:35.309929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:35.322805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c583a-eda6-4919-a917-527d0239fd48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.331828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94de2a3-f713-4b63-a041-0c2b66fc94a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.332925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94de2a3-f713-4b63-a041-0c2b66fc94a3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.333949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94de2a3-f713-4b63-a041-0c2b66fc94a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.334503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94de2a3-f713-4b63-a041-0c2b66fc94a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.335668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94de2a3-f713-4b63-a041-0c2b66fc94a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.337712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94de2a3-f713-4b63-a041-0c2b66fc94a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.354809 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1296/2584] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:35.357627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:35.378304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870d4c1-434b-46fd-a819-739752dba109 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.388327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.389035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.389316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.389595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] PATH_INFO: `/v3/projects/1400996ab9944664926ea2bbe16be8db/users/6f09aaa5bc7d418d88ea0a41029a1baa/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.425545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:35.434942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1400996ab9944664926ea2bbe16be8db, user_id=6f09aaa5bc7d418d88ea0a41029a1baa, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.438524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.478557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1289/2585] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:35 2022] PUT /identity/v3/projects/1400996ab9944664926ea2bbe16be8db/users/6f09aaa5bc7d418d88ea0a41029a1baa/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:51:35.480156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.480442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.480714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.537629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] MFA Rules not processed for user `6f09aaa5bc7d418d88ea0a41029a1baa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:35.539252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:35.559652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:35.707590 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1297/2586] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:35.772250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:35.774165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:35.887705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7d0df-4c8a-4321-95bf-40ac9be75b6b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:35.894839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2da6c5-4e8a-4165-8119-675ba41e1cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:35.895909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da6c5-4e8a-4165-8119-675ba41e1cb2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:35.896400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da6c5-4e8a-4165-8119-675ba41e1cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:35.896885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da6c5-4e8a-4165-8119-675ba41e1cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:35.926594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2da6c5-4e8a-4165-8119-675ba41e1cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:35.926594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2da6c5-4e8a-4165-8119-675ba41e1cb2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:35.953551 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1290/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:36.747161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:36.857044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b6692-0515-45ad-a8ae-2bcb103c1900 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:36.862518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:36.863478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:36.863955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:36.864335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] PATH_INFO: `/v3/users/6f09aaa5bc7d418d88ea0a41029a1baa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:36.865681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f09aaa5bc7d418d88ea0a41029a1baa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:36.868501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:36.945624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f09aaa5bc7d418d88ea0a41029a1baa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:36.980356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f09aaa5bc7d418d88ea0a41029a1baa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:36.981323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f09aaa5bc7d418d88ea0a41029a1baa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:36.997171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f09aaa5bc7d418d88ea0a41029a1baa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:36.998453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f09aaa5bc7d418d88ea0a41029a1baa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:37.019596 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1298/2588] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:36 2022] DELETE /identity/v3/users/6f09aaa5bc7d418d88ea0a41029a1baa => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:37.028003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:37.028559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:37.028839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:37.061662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:37.063984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:37.168372 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1291/2589] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:37.184221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:37.187420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:37.255346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:37.298310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee016f-c18a-4803-84dd-4ecfa7cc0bcb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:37.304924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af215e3-a40a-4523-8c71-07bbb63fb1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:37.307672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af215e3-a40a-4523-8c71-07bbb63fb1aa service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:37.307978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af215e3-a40a-4523-8c71-07bbb63fb1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:37.308427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af215e3-a40a-4523-8c71-07bbb63fb1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:37.332523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af215e3-a40a-4523-8c71-07bbb63fb1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:37.334348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af215e3-a40a-4523-8c71-07bbb63fb1aa service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:37.362138 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1299/2590] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:38.067784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:38.070082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:38.106672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd907c2a-bec0-4eaf-8068-fe288fa3542f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:38.114892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:38.115585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.115861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.116133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] PATH_INFO: `/v3/projects/1400996ab9944664926ea2bbe16be8db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.117268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1400996ab9944664926ea2bbe16be8db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:38.119314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:38.235982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1400996ab9944664926ea2bbe16be8db', 'request_id': 'req-0c2b2e26-b96a-42b3-aff9-c27b5060652d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:38.248394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1400996ab9944664926ea2bbe16be8db', 'request_id': 'req-0c2b2e26-b96a-42b3-aff9-c27b5060652d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:38.265846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1400996ab9944664926ea2bbe16be8db', 'request_id': 'req-0c2b2e26-b96a-42b3-aff9-c27b5060652d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:38.284132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:38.300856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] The token cache is being invalidate because project 1400996ab9944664926ea2bbe16be8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:38.301219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:38.305504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c2b2e26-b96a-42b3-aff9-c27b5060652d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:38.307686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1292/2591] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:38 2022] DELETE /identity/v3/projects/1400996ab9944664926ea2bbe16be8db => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:38.315119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.315770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.315770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.388592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:38.390307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:38.590098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1300/2592] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:38.599226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.599755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.600030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.636056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:38.639956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:38.660050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1293/2593] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:38.664462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:38.679045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d3e86-14e7-4099-b9bf-cb7fa18f13a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:38.694902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:38.711372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.711801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.711919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.712675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:38.712980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:38.714654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:38.742225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:38.742362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1301/2594] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:38.751932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4b8bb-2b7a-49f3-946b-c843ca114bf9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:38.763662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:38.764293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.764565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.764832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.765467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:38.767746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:38.806795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:38.808898 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1294/2595] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:38 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:51:38.823473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a4fe8-3390-41ce-90d8-6ae5a5f650f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:38.875029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:38.877314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:38.963954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c919d5-e0f9-4e41-8a5a-e637b84dbe81 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:38.971314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:38.971913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c8053-376d-441d-b639-717d1d0b4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:38.972265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.972888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.973013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8053-376d-441d-b639-717d1d0b4f89 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:38.973333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8053-376d-441d-b639-717d1d0b4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:38.973437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] PATH_INFO: `/v3/users/e1dbe55d773a4e60b7ad0f0589cbc9e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.973548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c8053-376d-441d-b639-717d1d0b4f89 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:38.974229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8053-376d-441d-b639-717d1d0b4f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:38.976058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c8053-376d-441d-b639-717d1d0b4f89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:38.978598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dbe55d773a4e60b7ad0f0589cbc9e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:38.981571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:39.023565 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1302/2596] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:38 2022] POST /identity/v3/users => generated 290 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:39.026069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.026069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.026069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.053042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] MFA Rules not processed for user `f0790d41f1d6452c92dc3d3dcc8d0af6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:39.055283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:39.078213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dbe55d773a4e60b7ad0f0589cbc9e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:39.091144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dbe55d773a4e60b7ad0f0589cbc9e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:39.091964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dbe55d773a4e60b7ad0f0589cbc9e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:39.107808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dbe55d773a4e60b7ad0f0589cbc9e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:39.109424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eef17f9a-a3f5-40d6-9288-9e1f5116062a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dbe55d773a4e60b7ad0f0589cbc9e8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:39.111090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:39.138075 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1303/2597] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:39.138075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:39.138075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:39.167058 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1295/2598] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:38 2022] DELETE /identity/v3/users/e1dbe55d773a4e60b7ad0f0589cbc9e8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:39.171785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.172072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.172347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.176825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c7d6d-08f8-4f75-b53d-90b4da854b5a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:39.198123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:39.199345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:39.252503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:39.253330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.253906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.254358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.255145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:39.257212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:39.262936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:39.272667 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1304/2599] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:39.276800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:39.284208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1296/2600] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:51:39.288384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5c4b4-90e6-41ec-8f84-a66b0bf20016 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:39.293276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:39.293937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.294375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.294656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.295663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:39.297328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:39.301951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:39.304444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:39.310167 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1305/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:39.314129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:39.326760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6dd13-4c29-4f79-8a80-be8c2e742964 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:39.331950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd01f3-cc5a-40a5-a058-be80cf9d076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:39.332642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd01f3-cc5a-40a5-a058-be80cf9d076e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.332979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd01f3-cc5a-40a5-a058-be80cf9d076e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.333262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd01f3-cc5a-40a5-a058-be80cf9d076e admin admin] PATH_INFO: `/v3/projects/c813a6b4d51c4c268e9871a292ac33b8/users/3b95983a06784c0092841b61efd66ba4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.352247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd01f3-cc5a-40a5-a058-be80cf9d076e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c813a6b4d51c4c268e9871a292ac33b8, user_id=3b95983a06784c0092841b61efd66ba4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:39.356408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd01f3-cc5a-40a5-a058-be80cf9d076e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:39.372559 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1306/2602] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:39 2022] PUT /identity/v3/projects/c813a6b4d51c4c268e9871a292ac33b8/users/3b95983a06784c0092841b61efd66ba4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:51:39.381760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.382543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.382852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.428192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:39.431743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc0316-3656-4383-9b36-b282d8720181 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:39.431995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:39.511197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:39.513416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.515063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.515568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.614265 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1307/2603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:39.615465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:39.636189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f024f-283d-41ae-ac75-cc8fe134f201 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:39.642888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:39.643274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:39.643557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:39.643826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:39.678582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:39.680048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:39.687533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:39.689182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:39.702521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1308/2604] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:39.721284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1297/2605] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:41.031452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:41.033476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:41.055600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec82cc-a3e2-47f4-ab96-97cfaf9db8c1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:41.070380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:41.071400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:41.071875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:41.072417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] PATH_INFO: `/v3/projects/7f9d23d263bb44b7a600166d113bf63b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:41.078237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9d23d263bb44b7a600166d113bf63b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:41.080837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:41.159667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:41.197023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9d23d263bb44b7a600166d113bf63b', 'request_id': 'req-ade8d147-f8c9-4377-b76a-c0c1097ff615'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.221529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9d23d263bb44b7a600166d113bf63b', 'request_id': 'req-ade8d147-f8c9-4377-b76a-c0c1097ff615'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.242884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9d23d263bb44b7a600166d113bf63b', 'request_id': 'req-ade8d147-f8c9-4377-b76a-c0c1097ff615'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.275723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] The token cache is being invalidate because project 7f9d23d263bb44b7a600166d113bf63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:41.276126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.278214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.281966 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1309/2606] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:41 2022] DELETE /identity/v3/projects/7f9d23d263bb44b7a600166d113bf63b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:41.286528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:41.298744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcce39-a0b6-4ede-a1a1-97b0403e3a46 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:41.427794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:41.451478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:41.452464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:41.454841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:41.455465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] PATH_INFO: `/v3/users/55eec2d84eca4936b2454ab64386086a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:41.460632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=55eec2d84eca4936b2454ab64386086a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:41.468255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:41.573745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55eec2d84eca4936b2454ab64386086a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.584369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55eec2d84eca4936b2454ab64386086a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.585258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55eec2d84eca4936b2454ab64386086a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.594461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55eec2d84eca4936b2454ab64386086a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.595368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-05990d1b-cf20-421d-bd76-766f7d938a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55eec2d84eca4936b2454ab64386086a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:41.621336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1298/2607] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:41 2022] DELETE /identity/v3/users/55eec2d84eca4936b2454ab64386086a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:43.376881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:43.379480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:43.405992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8d147-f8c9-4377-b76a-c0c1097ff615 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:43.528135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:43.529066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:43.529732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:43.530222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] PATH_INFO: `/v3/projects/4776f6cda2924183817b663b1628dece` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:43.536448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4776f6cda2924183817b663b1628dece)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:43.538759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:43.654055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4776f6cda2924183817b663b1628dece', 'request_id': 'req-72ece584-04b1-420e-8275-ec1907dccde5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:43.664203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4776f6cda2924183817b663b1628dece', 'request_id': 'req-72ece584-04b1-420e-8275-ec1907dccde5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:43.679801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4776f6cda2924183817b663b1628dece', 'request_id': 'req-72ece584-04b1-420e-8275-ec1907dccde5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:43.699796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] The token cache is being invalidate because project 4776f6cda2924183817b663b1628dece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:43.700073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:43.701643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-72ece584-04b1-420e-8275-ec1907dccde5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:43.709525 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1310/2608] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:43 2022] DELETE /identity/v3/projects/4776f6cda2924183817b663b1628dece => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:43.710983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:43.712256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:43.712988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:43.756000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:43.757939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:43.908857 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1299/2609] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:43.917866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:43.918165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:43.918432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:43.975102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:43.977613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:43.998720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:44.005224 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1311/2610] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:44.013785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21179faf-9b03-4f50-be59-7b1432de1ecf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:44.030134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:44.030780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.031063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.031334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.032059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:44.032373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:44.034050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:44.064590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:44.071521 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1300/2611] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:44.080143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e0601-4a01-466c-9cf6-418a28f93f71 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:44.095945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:44.096884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.097260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.098260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.099023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:44.106073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:44.163577 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1312/2612] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:44 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:44.167920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:44.178643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e9482-7685-48c9-9d78-396b6d3cfa8f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:44.293571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:44.294656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.297088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.297434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.298474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:44.310975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:44.332865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:44.353620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:44.354696 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1301/2613] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:44 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:44.376550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e53ae-5552-4735-a9bf-6a70a73a85f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:44.393716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:44.395054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.395054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.395418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.396094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:44.397742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:44.431280 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1313/2614] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:44.432547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:44.463444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002a41b-87e8-40cb-8fd8-d630e2820dc3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:44.481672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c27881-dcbb-407b-b1c3-1f05e34649cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:44.482907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27881-dcbb-407b-b1c3-1f05e34649cc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.483408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27881-dcbb-407b-b1c3-1f05e34649cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.484041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c27881-dcbb-407b-b1c3-1f05e34649cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.485740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c27881-dcbb-407b-b1c3-1f05e34649cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:44.489960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c27881-dcbb-407b-b1c3-1f05e34649cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:44.533012 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1302/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:51:44.538409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:44.551725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ecae31-3f04-40cf-978c-12f874e9417b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:44.569587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:44.570823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.571119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.571399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] PATH_INFO: `/v3/projects/aff125dfc3184fac8a9329a50f8234fc/users/0cc6ed0cc9e940a88fa63407c2daf09a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.600229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:44.620586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff125dfc3184fac8a9329a50f8234fc, user_id=0cc6ed0cc9e940a88fa63407c2daf09a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:44.623770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:44.645735 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1314/2616] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:44 2022] PUT /identity/v3/projects/aff125dfc3184fac8a9329a50f8234fc/users/0cc6ed0cc9e940a88fa63407c2daf09a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:44.657829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:44.658696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:44.659261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:44.761272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] MFA Rules not processed for user `0cc6ed0cc9e940a88fa63407c2daf09a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:44.762650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:44.892157 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1303/2617] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:45.635290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:45.637855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:45.848105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74324325-b424-4ea8-82f1-5c73d97c4d1d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:45.857847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b64684-7116-4474-a0c7-770d18949291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:45.858500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64684-7116-4474-a0c7-770d18949291 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:45.858829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64684-7116-4474-a0c7-770d18949291 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:45.859146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b64684-7116-4474-a0c7-770d18949291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:45.875940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b64684-7116-4474-a0c7-770d18949291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:45.878849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b64684-7116-4474-a0c7-770d18949291 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:45.914053 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1315/2618] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:49.797312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:49.914296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370364e-e504-4f42-ad9c-21686911fb74 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:49.918998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:49.919966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:49.920443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:49.921139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] PATH_INFO: `/v3/users/0cc6ed0cc9e940a88fa63407c2daf09a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:49.923033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc6ed0cc9e940a88fa63407c2daf09a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:49.925650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:50.011853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc6ed0cc9e940a88fa63407c2daf09a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:50.029261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc6ed0cc9e940a88fa63407c2daf09a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:50.031339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc6ed0cc9e940a88fa63407c2daf09a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:50.047167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc6ed0cc9e940a88fa63407c2daf09a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:50.058345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc6ed0cc9e940a88fa63407c2daf09a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:50.082881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:50.110547 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1304/2619] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:49 2022] DELETE /identity/v3/users/0cc6ed0cc9e940a88fa63407c2daf09a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:50.115068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:50.115677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:50.115677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:50.154267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:50.155422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:50.286042 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1316/2620] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:50.297028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:50.298787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:50.503271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff039928-5a72-4e2c-b86d-ff10380d6b8c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:50.533463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36570-08c2-44b1-be69-a29ed35771e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:50.534393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36570-08c2-44b1-be69-a29ed35771e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:50.537015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36570-08c2-44b1-be69-a29ed35771e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:50.537338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36570-08c2-44b1-be69-a29ed35771e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:50.571541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36570-08c2-44b1-be69-a29ed35771e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:50.578104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e36570-08c2-44b1-be69-a29ed35771e5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:50.630610 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1305/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:51.591371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:51.592932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:51.606266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138dae5-e538-4e2e-8eb7-86e1b40a3d8a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:51.611249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:51.612351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:51.613130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:51.613821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] PATH_INFO: `/v3/projects/aff125dfc3184fac8a9329a50f8234fc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:51.616111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff125dfc3184fac8a9329a50f8234fc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:51.618218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:51.683138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff125dfc3184fac8a9329a50f8234fc', 'request_id': 'req-fa133fd6-a65e-4e69-9269-5a19d9b0f737'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:51.695911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff125dfc3184fac8a9329a50f8234fc', 'request_id': 'req-fa133fd6-a65e-4e69-9269-5a19d9b0f737'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:51.705767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff125dfc3184fac8a9329a50f8234fc', 'request_id': 'req-fa133fd6-a65e-4e69-9269-5a19d9b0f737'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:51.714515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:51.733522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] The token cache is being invalidate because project aff125dfc3184fac8a9329a50f8234fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:51.734700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:51.736078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa133fd6-a65e-4e69-9269-5a19d9b0f737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:51.739882 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1317/2622] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:51 2022] DELETE /identity/v3/projects/aff125dfc3184fac8a9329a50f8234fc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:51.746340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:51.747352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:51.747928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:51.772204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:51.778249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:51.864823 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1306/2623] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:51.873208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:51.873756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:51.874225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:51.904383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:51.905540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:51.924004 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1318/2624] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:51.924665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:51.937209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef640b-de68-4720-8f6d-1e5c1f0fc5d3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:51.959372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:51.960043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:51.960309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:51.960587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:51.961296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:51.961607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:51.963395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:51.979959 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1307/2625] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:51.981267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:51.991689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac088-7ee1-4c60-82f2-63e5066e7a13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:51.997356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:51.998351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:51.998627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:51.998898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:51.999542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:52.001453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:52.038726 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1319/2626] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:51 2022] POST /identity/v3/projects => generated 395 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:52.040202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:52.051510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9360d-6ce3-45fc-bcb4-20fa6241b7e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:52.150352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:52.150987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.151311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.151584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.152290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:52.154375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:52.180279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1308/2627] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:52 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:51:52.184933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:52.203272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c603b-51c2-41c3-8759-b3c6df0c4635 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:52.209220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:52.210061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.210513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.210811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.211880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:52.214520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:52.253410 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1320/2628] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:52.260090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:52.280797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e2c5b-7a8c-429d-a820-497d87c990d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:52.298541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0462fed-8a5e-4e8b-a5cf-8e7b91be6777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:52.300858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0462fed-8a5e-4e8b-a5cf-8e7b91be6777 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.300858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0462fed-8a5e-4e8b-a5cf-8e7b91be6777 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.300858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0462fed-8a5e-4e8b-a5cf-8e7b91be6777 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.300858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0462fed-8a5e-4e8b-a5cf-8e7b91be6777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:52.303888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0462fed-8a5e-4e8b-a5cf-8e7b91be6777 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:52.322506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:52.340634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1309/2629] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:52.345670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:52.361050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7b943-c801-48db-8199-be4be63f84c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:52.405198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69746d75-17a6-4c1d-a218-f1db4468e3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:52.406142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69746d75-17a6-4c1d-a218-f1db4468e3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.406604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69746d75-17a6-4c1d-a218-f1db4468e3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.406981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69746d75-17a6-4c1d-a218-f1db4468e3cc admin admin] PATH_INFO: `/v3/projects/7d87c98c0e8b438497cb63dce76fd5d0/users/1f5a7f86b9a74e7cacc4d00f9b86d271/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.450831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69746d75-17a6-4c1d-a218-f1db4468e3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d87c98c0e8b438497cb63dce76fd5d0, user_id=1f5a7f86b9a74e7cacc4d00f9b86d271, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:52.461662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69746d75-17a6-4c1d-a218-f1db4468e3cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:52.464532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.465051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.465568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.479669 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1321/2630] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:52 2022] PUT /identity/v3/projects/7d87c98c0e8b438497cb63dce76fd5d0/users/1f5a7f86b9a74e7cacc4d00f9b86d271/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:52.491092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.505159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.505159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.563835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] MFA Rules not processed for user `3b95983a06784c0092841b61efd66ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:52.571284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:52.572409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] MFA Rules not processed for user `1f5a7f86b9a74e7cacc4d00f9b86d271`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:52.573629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:52.745948 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1310/2631] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:52.750753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:52.752869 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1322/2632] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:51:52.756675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:52.866839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3b6a6-f3dc-4739-b055-1c3f363b8015 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:52.884102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:52.884773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:52.885109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:52.885447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:52.886139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:52.899326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:52.915340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:52.917201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:52.995873 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1311/2633] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:52 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:52.997398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:53.087516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cb4da-4500-4dfb-ab87-32ebff4a1309 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:53.128241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:53.170760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce73da-d130-48c3-b4ab-b270cee384b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:53.184591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:53.185295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:53.185540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:53.185772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:53.186947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:53.188906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:53.221849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:53.224187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:53.224710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:53.225382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:53.226279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1312/2634] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:52 2022] POST /identity/v3/users => generated 296 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:53.227201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:53.243968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:53.252788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef8007-a913-4f54-9594-86c4602bd0bc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:53.269409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:53.270316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:53.270599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:53.271360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:53.271668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:53.273342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:53.292258 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1313/2635] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:53.296599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:53.310867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2570591-1ebe-4261-8d9c-4686eb56b1d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:53.337143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:53.338055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:53.338596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:53.342010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] PATH_INFO: `/v3/projects/9ce758c03ffc42cebbf4f710f2b75a7a/users/973ed3157fe940c480abca5709116618/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:53.344887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:53.347357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:53.366414 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1323/2636] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:52 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:51:53.380572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce758c03ffc42cebbf4f710f2b75a7a, user_id=973ed3157fe940c480abca5709116618, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:53.384106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:53.418963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1314/2637] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:53 2022] PUT /identity/v3/projects/9ce758c03ffc42cebbf4f710f2b75a7a/users/973ed3157fe940c480abca5709116618/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:53.426774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:53.447007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad1d2b-d4ea-41a5-ac3b-c5d9852bf232 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:53.610597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:53.611247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:53.611633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:53.611882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:53.614689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:53.616356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:53.643781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1324/2638] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:53.647743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:53.663200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adefd29c-f898-478b-854e-91ef42186e02 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:53.676322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806354-c6fe-48fb-87a4-1c46e5409cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:53.677483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806354-c6fe-48fb-87a4-1c46e5409cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:53.677767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806354-c6fe-48fb-87a4-1c46e5409cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:53.678088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806354-c6fe-48fb-87a4-1c46e5409cb7 admin admin] PATH_INFO: `/v3/projects/9ce758c03ffc42cebbf4f710f2b75a7a/users/973ed3157fe940c480abca5709116618/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:53.680242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806354-c6fe-48fb-87a4-1c46e5409cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce758c03ffc42cebbf4f710f2b75a7a, user_id=973ed3157fe940c480abca5709116618, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:53.683079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806354-c6fe-48fb-87a4-1c46e5409cb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:53.702204 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1315/2639] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:53 2022] PUT /identity/v3/projects/9ce758c03ffc42cebbf4f710f2b75a7a/users/973ed3157fe940c480abca5709116618/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:55.906694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:55.921061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919a1c4-e9e7-437a-9a19-4ba69d86a147 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:56.036213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:56.057929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:56.058850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:56.059334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:56.059810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] PATH_INFO: `/v3/users/1f5a7f86b9a74e7cacc4d00f9b86d271` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:56.061825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f5a7f86b9a74e7cacc4d00f9b86d271)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:56.064746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:56.160490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f5a7f86b9a74e7cacc4d00f9b86d271'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:56.181919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f5a7f86b9a74e7cacc4d00f9b86d271'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:56.182661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f5a7f86b9a74e7cacc4d00f9b86d271'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:56.194485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f5a7f86b9a74e7cacc4d00f9b86d271'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:56.195500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f5a7f86b9a74e7cacc4d00f9b86d271'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:56.217362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1325/2640] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:51:55 2022] DELETE /identity/v3/users/1f5a7f86b9a74e7cacc4d00f9b86d271 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:56.222995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:56.224398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:56.224958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:56.251419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:56.252889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:56.412512 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1316/2641] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:56.424337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:56.441829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:56.592383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e54cc-9cc4-42c2-9748-ac191fb94a20 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:56.604684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555c42c-8547-404d-82e0-141c766f5d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:56.605214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c42c-8547-404d-82e0-141c766f5d76 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:56.605497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c42c-8547-404d-82e0-141c766f5d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:56.605781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555c42c-8547-404d-82e0-141c766f5d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:56.630989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555c42c-8547-404d-82e0-141c766f5d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:56.632620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555c42c-8547-404d-82e0-141c766f5d76 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:56.654193 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1326/2642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:51:57.323551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:57.325054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:57.348732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121d1e6-7edc-467e-ae30-ece6a59b3c17 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:57.358581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:57.359784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:57.360070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:57.360342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] PATH_INFO: `/v3/projects/7d87c98c0e8b438497cb63dce76fd5d0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:57.366675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d87c98c0e8b438497cb63dce76fd5d0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:57.371629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:57.471289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d87c98c0e8b438497cb63dce76fd5d0', 'request_id': 'req-a1c66567-d358-460f-bf07-983bcaec40ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:57.482798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d87c98c0e8b438497cb63dce76fd5d0', 'request_id': 'req-a1c66567-d358-460f-bf07-983bcaec40ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:57.508288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d87c98c0e8b438497cb63dce76fd5d0', 'request_id': 'req-a1c66567-d358-460f-bf07-983bcaec40ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:57.530188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] The token cache is being invalidate because project 7d87c98c0e8b438497cb63dce76fd5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:51:57.530464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:57.531117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1c66567-d358-460f-bf07-983bcaec40ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:51:57.532992 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1317/2643] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:51:57 2022] DELETE /identity/v3/projects/7d87c98c0e8b438497cb63dce76fd5d0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:51:57.539262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:57.539704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:57.539790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:57.585886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:57.587370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:57.673226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1327/2644] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:57.687709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:57.688052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:57.688258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:57.756182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:57.757417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:57.781479 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1318/2645] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:57.786443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:57.800490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c8b17-008a-495e-b802-5fb8044b6cb5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:57.807657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:57.808601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:57.809083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:57.810346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:57.811197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:51:57.811948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:57.816965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:57.830802 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1328/2646] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:51:57.835644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:57.850597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a740-e515-4667-863c-5eb9422fc4d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:57.864195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:57.865004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:57.865357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:57.865698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:57.866517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:57.872743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:57.911532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1319/2647] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:51:57 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:51:57.915496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:57.922120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:57.933960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bc0156-8ca3-43ac-a426-44ea87def96e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:58.100163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:58.120791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:58.121208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:58.121488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:58.122227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:58.124197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:58.187307 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1329/2648] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:51:57 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:51:58.190146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:58.211085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfed7c-0e58-402a-a11b-ccff1a4c7ba7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:58.232615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:58.233404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:58.233705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:58.234006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:58.234872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:58.237014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:58.254750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:51:58.272597 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1320/2649] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:58.275021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:58.304748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2884ccb-6920-4d28-b2c3-350911523d20 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:58.316923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286636ed-3ba3-4e1a-8d27-a98ed1b347cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:58.318091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286636ed-3ba3-4e1a-8d27-a98ed1b347cf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:58.318663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286636ed-3ba3-4e1a-8d27-a98ed1b347cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:58.319151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286636ed-3ba3-4e1a-8d27-a98ed1b347cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:58.320952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286636ed-3ba3-4e1a-8d27-a98ed1b347cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:58.323931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286636ed-3ba3-4e1a-8d27-a98ed1b347cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:58.369982 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1330/2650] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:51:58.374234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:58.392649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5d9876-ed53-41f7-9120-bbe8fb9541f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:58.402810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:58.405861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:58.406199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:58.406543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] PATH_INFO: `/v3/projects/d86df8edf5044361a65c11542c2dc585/users/5d2e129a84e847a0b5c80ad47ca4d233/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:58.432221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86df8edf5044361a65c11542c2dc585, user_id=5d2e129a84e847a0b5c80ad47ca4d233, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:58.435694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:58.460586 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1321/2651] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:51:58 2022] PUT /identity/v3/projects/d86df8edf5044361a65c11542c2dc585/users/5d2e129a84e847a0b5c80ad47ca4d233/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:51:58.466432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85bc7f-6861-48a3-96bd-977a08b65c10 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:58.466837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85bc7f-6861-48a3-96bd-977a08b65c10 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:58.467204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85bc7f-6861-48a3-96bd-977a08b65c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:58.525853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c85bc7f-6861-48a3-96bd-977a08b65c10 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:51:58.527946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c85bc7f-6861-48a3-96bd-977a08b65c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:58.681480 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1331/2652] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:51:58.735092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:51:58.737888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:51:58.899010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7f575-463d-49b3-aaad-43074fe34088 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:51:58.903203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2793-8674-41f6-8335-a9bebbf878af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:51:58.904207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2793-8674-41f6-8335-a9bebbf878af service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:51:58.905155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2793-8674-41f6-8335-a9bebbf878af service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:51:58.905537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2793-8674-41f6-8335-a9bebbf878af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:51:58.932574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2793-8674-41f6-8335-a9bebbf878af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:51:58.934520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2793-8674-41f6-8335-a9bebbf878af service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:51:58.949960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1322/2653] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:01.860792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:01.861545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:01.861545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:01.914975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] MFA Rules not processed for user `837f9940834e4eaeb31c967dba6d762f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:01.916205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:01.990975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8af8c-218a-44b4-9c17-711f671d9c24 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:01.991626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8af8c-218a-44b4-9c17-711f671d9c24 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:01.991626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8af8c-218a-44b4-9c17-711f671d9c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:02.030342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5cb8af8c-218a-44b4-9c17-711f671d9c24 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:02.032402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5cb8af8c-218a-44b4-9c17-711f671d9c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:02.041906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1332/2654] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:02.236238 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1323/2655] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:52:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:02.261231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:02.263114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:02.331908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:02.406682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f7ad-f851-4120-ac8b-dd4373524946 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:02.415784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:02.416849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:02.420956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:02.421402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:02.444774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:02.446428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:02.467931 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1333/2656] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:08.783234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767a52-a9b6-4e92-bd10-cc5c89c6cafe None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:08.784772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767a52-a9b6-4e92-bd10-cc5c89c6cafe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:08.785585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767a52-a9b6-4e92-bd10-cc5c89c6cafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:08.874430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f5767a52-a9b6-4e92-bd10-cc5c89c6cafe None None] MFA Rules not processed for user `973ed3157fe940c480abca5709116618`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:08.876108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5767a52-a9b6-4e92-bd10-cc5c89c6cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:09.145552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1324/2657] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:08 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:09.157307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:09.159686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:09.322486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0826e3c-5744-4124-82a7-c97a500709fb service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:09.328915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:09.330091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:09.330647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:09.331353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:09.334936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:09.544211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:09.545673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:09.560183 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1334/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:52:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:19.128057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:19.553763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=77 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:20.195038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080815-48ae-4d1d-95a6-b4fd0cffa783 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:20.195570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080815-48ae-4d1d-95a6-b4fd0cffa783 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:20.195678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89080815-48ae-4d1d-95a6-b4fd0cffa783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:20.258644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-89080815-48ae-4d1d-95a6-b4fd0cffa783 None None] MFA Rules not processed for user `5d2e129a84e847a0b5c80ad47ca4d233`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:20.261468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89080815-48ae-4d1d-95a6-b4fd0cffa783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:20.481477 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1325/2659] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:20.495134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:20.498322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:20.531925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3c25f-f2fb-4ac7-8df9-d3ca56ad9351 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:20.540689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70782ddf-7400-40e7-ba18-67e21a9729bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:20.545518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782ddf-7400-40e7-ba18-67e21a9729bb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:20.545518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782ddf-7400-40e7-ba18-67e21a9729bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:20.545518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70782ddf-7400-40e7-ba18-67e21a9729bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:20.578197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70782ddf-7400-40e7-ba18-67e21a9729bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:20.589639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70782ddf-7400-40e7-ba18-67e21a9729bb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:20.624128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1335/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:52:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:25.971852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:25.973052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:25.973567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:26.026493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] MFA Rules not processed for user `5d2e129a84e847a0b5c80ad47ca4d233`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:26.028258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:26.050963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1326/2661] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:30.616379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:31.019343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fe48-3bd9-40c6-b510-2a6e33e8141d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:31.019617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fe48-3bd9-40c6-b510-2a6e33e8141d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:31.019874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fe48-3bd9-40c6-b510-2a6e33e8141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:31.079807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f165fe48-3bd9-40c6-b510-2a6e33e8141d None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:31.084518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f165fe48-3bd9-40c6-b510-2a6e33e8141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:31.124054 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1336/2662] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:52:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:31.124448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:31.144844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a26602-2a07-4249-bbfa-c99ecafc20cf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:31.166654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a707010-b597-4b5f-b41b-a3a6d4ac6636 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:31.167205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707010-b597-4b5f-b41b-a3a6d4ac6636 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:31.167481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707010-b597-4b5f-b41b-a3a6d4ac6636 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:31.167754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a707010-b597-4b5f-b41b-a3a6d4ac6636 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:31.199040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a707010-b597-4b5f-b41b-a3a6d4ac6636 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:31.200682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a707010-b597-4b5f-b41b-a3a6d4ac6636 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:31.238624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1327/2663] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:52:31.503461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:31.503461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:31.503715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:31.551131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] MFA Rules not processed for user `f0ea28d9bb3544bca1a3c90d983fe8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:31.552306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:31.759297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1337/2664] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:33.037092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:33.037092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:33.037092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:33.119317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:33.130785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:33.339686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1328/2665] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:36.345154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:36.346962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:36.387581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607aa6c-ead4-43ae-b2b6-475375180c5c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:36.408486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:36.409377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:36.409665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:36.410034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:36.422671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:36.468584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:36.470065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:36.529616 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1338/2666] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:52:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:40.238484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:40.240569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:40.267482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fdf72-0634-40bb-830c-908371e1d4e1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:40.282061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:40.283793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:40.284994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:40.285588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] PATH_INFO: `/v3/users/f0790d41f1d6452c92dc3d3dcc8d0af6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:40.288586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0790d41f1d6452c92dc3d3dcc8d0af6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:40.292888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:40.424590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0790d41f1d6452c92dc3d3dcc8d0af6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:40.438826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0790d41f1d6452c92dc3d3dcc8d0af6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:40.439541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0790d41f1d6452c92dc3d3dcc8d0af6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:40.454055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0790d41f1d6452c92dc3d3dcc8d0af6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:40.455131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0790d41f1d6452c92dc3d3dcc8d0af6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:40.462488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:40.498758 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1329/2667] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:52:40 2022] DELETE /identity/v3/users/f0790d41f1d6452c92dc3d3dcc8d0af6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:52:41.808303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:41.809934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:42.032780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5806e7-0a0d-465a-a29f-36c59d87e2a9 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:42.206977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:42.211197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:42.259656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:42.260322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:42.260598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:42.261044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:42.279220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:42.340419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:42.358204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c9093-7d04-423f-b548-86ea50885144 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:42.370647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:42.371723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:42.372226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:42.373324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] PATH_INFO: `/v3/projects/a4b218a2276a4bb9acd9c1b0cfa3b5a8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:42.378158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b218a2276a4bb9acd9c1b0cfa3b5a8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:42.384079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:42.447255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:42.451151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250d4af-1c6d-417c-8192-9919eb87007f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:42.512792 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1339/2668] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:52:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:42.557471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'request_id': 'req-e337e491-55c8-45a2-8e98-cf1ca4a73988'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:42.586362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'request_id': 'req-e337e491-55c8-45a2-8e98-cf1ca4a73988'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:42.608686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b218a2276a4bb9acd9c1b0cfa3b5a8', 'request_id': 'req-e337e491-55c8-45a2-8e98-cf1ca4a73988'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:42.647314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] The token cache is being invalidate because project a4b218a2276a4bb9acd9c1b0cfa3b5a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:52:42.647737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:42.648503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e337e491-55c8-45a2-8e98-cf1ca4a73988 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:52:42.655489 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1330/2669] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:52:42 2022] DELETE /identity/v3/projects/a4b218a2276a4bb9acd9c1b0cfa3b5a8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:52:42.657408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6faf6-22c3-4a3d-96b8-713f1b6bbfe5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:42.658047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6faf6-22c3-4a3d-96b8-713f1b6bbfe5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:42.658662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6faf6-22c3-4a3d-96b8-713f1b6bbfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:42.717545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-05f6faf6-22c3-4a3d-96b8-713f1b6bbfe5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:42.719560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05f6faf6-22c3-4a3d-96b8-713f1b6bbfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:42.785169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:42.786102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:42.786771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:42.836079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] MFA Rules not processed for user `6c2aa25bffe3421e8a75d88388dd5441`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:42.841182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:42.890303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1340/2670] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:42.893523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:42.899638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:42.900524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:42.957559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:42.961612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:42.996324 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1341/2671] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:42.997625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:43.039797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1331/2672] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:43.041227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb3666-55e3-443f-94a5-4d4536f00fd0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:43.063146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:43.093583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:43.095707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:43.096042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:43.099839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:52:43.100158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:43.101834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:43.172586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:43.172810 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1342/2673] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:52:43.187657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2a841c-b615-44d5-96b1-600480941875 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:43.206478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:43.207192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:43.207789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:43.207789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:43.208362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:43.215311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:43.276149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:43.297196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1332/2674] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:52:43.300526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:43.331517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5712a5-0364-44b4-8da3-92a07ad13960 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:43.541852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:43.541852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:43.541852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:43.542269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:43.555308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:43.562373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:43.642444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1343/2675] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:52:43 2022] POST /identity/v3/users => generated 287 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:52:43.647029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:43.669554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a850df8-9d8b-45a9-95a1-ec62b386eeac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:43.682470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:43.683839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:43.684126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:43.684400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:43.685670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:43.687495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:43.795305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:43.798177 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1333/2676] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:52:43.929989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6d2fc-387e-405e-951b-5cd044a2af68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:43.952431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:43.953340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:43.953786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:43.954743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:43.956338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:43.965185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:44.021270 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1344/2677] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:52:44.023782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:44.028139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:44.031036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:44.039714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf1408-068b-45a7-9e81-2fa6b4d29090 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:44.082159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57630b-2784-4c70-b523-be351a6c9ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:44.082954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57630b-2784-4c70-b523-be351a6c9ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:44.083244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57630b-2784-4c70-b523-be351a6c9ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:44.083521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57630b-2784-4c70-b523-be351a6c9ad7 admin admin] PATH_INFO: `/v3/projects/65837d49e9914967875ca457c466337f/users/62af8e77eeca4ecc942b76ef82bf2ff2/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:44.145247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57630b-2784-4c70-b523-be351a6c9ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65837d49e9914967875ca457c466337f, user_id=62af8e77eeca4ecc942b76ef82bf2ff2, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:44.150296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57630b-2784-4c70-b523-be351a6c9ad7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:44.169915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:44.218930 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1334/2678] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:52:44 2022] PUT /identity/v3/projects/65837d49e9914967875ca457c466337f/users/62af8e77eeca4ecc942b76ef82bf2ff2/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:52:44.231111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db912-97e1-4fb0-870d-cb060c5d8a42 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:44.233497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db912-97e1-4fb0-870d-cb060c5d8a42 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:44.237835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db912-97e1-4fb0-870d-cb060c5d8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:44.367614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3d1db912-97e1-4fb0-870d-cb060c5d8a42 None None] MFA Rules not processed for user `62af8e77eeca4ecc942b76ef82bf2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:44.376438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d1db912-97e1-4fb0-870d-cb060c5d8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:44.442257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2d1e7-10ca-4487-aa62-12fbfd378387 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:44.636221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1335/2679] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:44.651937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:44.652539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:44.652984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:44.674451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:44.676102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:44.676486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:44.676866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:44.678910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:44.690259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] MFA Rules not processed for user `62af8e77eeca4ecc942b76ef82bf2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:52:44.698779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:44.728178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1336/2680] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:52:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:52:44.818792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:44.820464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492e406-2390-4858-a8fb-ca0d5ce1b377 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:44.856516 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1345/2681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:52:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:44.931191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:52:44.932847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:52:44.978879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf6728-b2a6-437a-89ec-1f27e3cd2144 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:52:44.998167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f5b85-6329-4ddf-8bed-e9b35bbd94ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:52:45.003395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f5b85-6329-4ddf-8bed-e9b35bbd94ad service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:52:45.006751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f5b85-6329-4ddf-8bed-e9b35bbd94ad service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:52:45.008388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f5b85-6329-4ddf-8bed-e9b35bbd94ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:52:45.037247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f5b85-6329-4ddf-8bed-e9b35bbd94ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:52:45.039351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f5b85-6329-4ddf-8bed-e9b35bbd94ad service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:52:45.052670 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1337/2682] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:52:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:52:54.831374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=77 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:52:55.047123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:02.285772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:02.287270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:02.287897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:02.342730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] MFA Rules not processed for user `3b95983a06784c0092841b61efd66ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:02.350881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:02.492151 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1346/2683] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:02.493448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:02.494279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:02.494727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:02.529531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] MFA Rules not processed for user `3b95983a06784c0092841b61efd66ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:02.531068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:02.552249 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1338/2684] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:07.817344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:07.819003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:07.940463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65363f71-95cf-45f0-909a-abd93caf5a04 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:07.959051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:07.959732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:07.960012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:07.960287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] PATH_INFO: `/v3/users/837f9940834e4eaeb31c967dba6d762f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:07.961622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=837f9940834e4eaeb31c967dba6d762f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:07.963665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:08.060687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837f9940834e4eaeb31c967dba6d762f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:08.095893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837f9940834e4eaeb31c967dba6d762f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:08.096935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837f9940834e4eaeb31c967dba6d762f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:08.118092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837f9940834e4eaeb31c967dba6d762f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:08.119579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837f9940834e4eaeb31c967dba6d762f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:08.155021 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1347/2685] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:07 2022] DELETE /identity/v3/users/837f9940834e4eaeb31c967dba6d762f => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:08.424658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:08.426799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:08.514067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91165ff9-edf8-4f71-a184-38ec88757f82 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:08.623678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:08.624862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:08.625311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:08.628591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:08.633566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:08.846098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:08.847740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086c979-e3a0-47c7-ad47-0bd7a9a56a2c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:08.868594 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1339/2686] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:08.968677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:08.972431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:09.049101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:09.133171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d359766-f722-422c-bc84-7e14b1751683 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:09.138782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:09.139361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:09.139682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:09.140024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] PATH_INFO: `/v3/projects/0b30ce428766445d9d0d45f350ae1024` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:09.141249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b30ce428766445d9d0d45f350ae1024)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:09.143853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:09.221030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b30ce428766445d9d0d45f350ae1024', 'request_id': 'req-5368e9ae-923d-4156-9d9d-c72fa77fc88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:09.229568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b30ce428766445d9d0d45f350ae1024', 'request_id': 'req-5368e9ae-923d-4156-9d9d-c72fa77fc88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:09.235969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b30ce428766445d9d0d45f350ae1024', 'request_id': 'req-5368e9ae-923d-4156-9d9d-c72fa77fc88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:09.262410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] The token cache is being invalidate because project 0b30ce428766445d9d0d45f350ae1024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:09.263455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:09.265080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5368e9ae-923d-4156-9d9d-c72fa77fc88e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:09.271837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1348/2687] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:08 2022] DELETE /identity/v3/projects/0b30ce428766445d9d0d45f350ae1024 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:09.272728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:09.273085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:09.273520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:09.306572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:09.308801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:09.440933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:09.482939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:09.483604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:09.483838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:09.493937 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1340/2688] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:09.515371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:09.518353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:09.568381 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1349/2689] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:09.568837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:09.581661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef34c1b-2e4a-4fd2-9cd6-8129b6526937 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:09.616394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601550f4-9880-4177-9105-7132783b653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:09.617341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601550f4-9880-4177-9105-7132783b653b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:09.617341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601550f4-9880-4177-9105-7132783b653b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:09.617593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601550f4-9880-4177-9105-7132783b653b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:09.618412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601550f4-9880-4177-9105-7132783b653b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:09.618729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601550f4-9880-4177-9105-7132783b653b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:09.620670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601550f4-9880-4177-9105-7132783b653b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:09.635943 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1341/2690] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:09.641576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:09.658414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd58c1-bdd0-42e5-a460-18395a29a9ce None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:09.672747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:09.674826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:09.676520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:09.677238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:09.678253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:09.691133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:09.730185 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1350/2691] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:09 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:09.735341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601550f4-9880-4177-9105-7132783b653b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:09.750707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601550f4-9880-4177-9105-7132783b653b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:09.899048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:09.899990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:09.900597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:09.901129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:09.903950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:09.908028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:09.980633 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1342/2692] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:09 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:09.994212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:10.017457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893de9f-2bc8-4367-bf6f-d0d4a591f3c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:10.034560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:10.035435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:10.035559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:10.035786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:10.037100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:10.038954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:10.061836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:10.062629 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1351/2693] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:10.091107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c66d5-8493-4cc7-b33c-d693294cf1ee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:10.115347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093205f-7015-45da-b015-6c327076bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:10.116279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093205f-7015-45da-b015-6c327076bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:10.116560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093205f-7015-45da-b015-6c327076bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:10.116836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093205f-7015-45da-b015-6c327076bdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:10.117692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093205f-7015-45da-b015-6c327076bdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:10.119356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0093205f-7015-45da-b015-6c327076bdd5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:10.151238 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1343/2694] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:53:10.151713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:10.163190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4471cd-1505-4afc-83be-852e205886a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:10.169158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:10.169876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:10.170163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:10.170443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] PATH_INFO: `/v3/projects/437ad319907448b18f600f6ac741e5f9/users/891d9b18b58c461c99251a545e64c4a4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:10.194568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=437ad319907448b18f600f6ac741e5f9, user_id=891d9b18b58c461c99251a545e64c4a4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:10.199145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:10.274514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1352/2695] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:10 2022] PUT /identity/v3/projects/437ad319907448b18f600f6ac741e5f9/users/891d9b18b58c461c99251a545e64c4a4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:10.277583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:10.277583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:10.277870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:10.317106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] MFA Rules not processed for user `891d9b18b58c461c99251a545e64c4a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:10.318386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:10.444864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1344/2696] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:10.459610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:10.462701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:10.606981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:10.695596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22ef74-55bc-49ad-92a3-7db7fee2fe06 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:10.708462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1137df0-a571-4b2d-88b2-9d5608381829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:10.709096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1137df0-a571-4b2d-88b2-9d5608381829 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:10.709374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1137df0-a571-4b2d-88b2-9d5608381829 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:10.709643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1137df0-a571-4b2d-88b2-9d5608381829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:10.719131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1137df0-a571-4b2d-88b2-9d5608381829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:10.720200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1137df0-a571-4b2d-88b2-9d5608381829 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:10.732942 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1353/2697] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:10.822946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:10.825199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:10.974154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:11.054238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08c119-7939-4799-a7e2-2f41cbc3f7e5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:11.070626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:11.073038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:11.073339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:11.073619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] PATH_INFO: `/v3/users/efecedc77d3048c4a0ec0fe6701f9ccc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:11.079761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efecedc77d3048c4a0ec0fe6701f9ccc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:11.096090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:11.272430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efecedc77d3048c4a0ec0fe6701f9ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:11.288443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efecedc77d3048c4a0ec0fe6701f9ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:11.289349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efecedc77d3048c4a0ec0fe6701f9ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:11.305908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efecedc77d3048c4a0ec0fe6701f9ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:11.307956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efecedc77d3048c4a0ec0fe6701f9ccc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:11.362155 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1345/2698] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:10 2022] DELETE /identity/v3/users/efecedc77d3048c4a0ec0fe6701f9ccc => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:11.364021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:11.364803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:11.365313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:11.390303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:11.392031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:11.570520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:11.571978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:11.574870 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1354/2699] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:11.713101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e04d4-b141-4f63-8bd6-c008c58a9ad3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:11.722235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:11.723321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:11.723768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:11.724245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:11.744252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:11.747920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:11.775714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1346/2700] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:12.360481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:12.362119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:12.387098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f23de1-d0f7-4ae1-822e-f8b2ddc5e7c3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:12.406373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:12.406373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:12.406373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:12.406373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] PATH_INFO: `/v3/projects/bb5aec15c4e844b2872c9eab52f69482` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:12.406714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5aec15c4e844b2872c9eab52f69482)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:12.431798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:12.633099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5aec15c4e844b2872c9eab52f69482', 'request_id': 'req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:12.662164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5aec15c4e844b2872c9eab52f69482', 'request_id': 'req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:12.674620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5aec15c4e844b2872c9eab52f69482', 'request_id': 'req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:12.703796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:12.706458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:12.722238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] The token cache is being invalidate because project bb5aec15c4e844b2872c9eab52f69482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:12.722858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:12.723356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91921d9-5876-4660-a4aa-0ee14127b4fe service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:12.723779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:12.728290 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1355/2701] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:12 2022] DELETE /identity/v3/projects/bb5aec15c4e844b2872c9eab52f69482 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:12.732873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:12.735729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:12.809122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:12.809944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:12.810289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:12.810630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] PATH_INFO: `/v3/users/891d9b18b58c461c99251a545e64c4a4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:12.813083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891d9b18b58c461c99251a545e64c4a4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:12.818890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:12.853683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8de7b35-e54d-4f8a-8273-317a12fbe5fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:12.860508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:12.861373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:12.861840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:12.862117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] PATH_INFO: `/v3/users/13849b751a7141e9900d3999a3693b38` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:12.863285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13849b751a7141e9900d3999a3693b38)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:12.864647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:12.869664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:12.873878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:12.994941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891d9b18b58c461c99251a545e64c4a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.008155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891d9b18b58c461c99251a545e64c4a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.008796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891d9b18b58c461c99251a545e64c4a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.037607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891d9b18b58c461c99251a545e64c4a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.038587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0807938e-ab18-4452-9bbf-2eaf4165b447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891d9b18b58c461c99251a545e64c4a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.048070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13849b751a7141e9900d3999a3693b38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.100918 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1347/2702] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:12 2022] DELETE /identity/v3/users/891d9b18b58c461c99251a545e64c4a4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:13.106264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:13.106782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:13.107253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:13.114407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13849b751a7141e9900d3999a3693b38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.118339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13849b751a7141e9900d3999a3693b38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.174098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13849b751a7141e9900d3999a3693b38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.187726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13849b751a7141e9900d3999a3693b38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:13.190216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:13.191785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:13.228076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1356/2703] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:12 2022] DELETE /identity/v3/users/13849b751a7141e9900d3999a3693b38 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:13.440784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1348/2704] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:13.463772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:13.465463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:13.593253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c109c-e2a2-4648-a9b6-73b48fbbd031 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:13.598077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2375f-80bf-46bb-8820-22bec2616e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:13.599179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2375f-80bf-46bb-8820-22bec2616e2f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:13.599603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2375f-80bf-46bb-8820-22bec2616e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:13.599883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2375f-80bf-46bb-8820-22bec2616e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:13.686874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2375f-80bf-46bb-8820-22bec2616e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:13.688299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2375f-80bf-46bb-8820-22bec2616e2f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:13.701768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1357/2705] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:13.887460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:13.888978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:13.923163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb6e63-181d-4edf-b64e-675b11af778b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:13.932363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:13.933304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:13.935622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:13.936168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] PATH_INFO: `/v3/projects/07f22d73ce564906bfcb14f79df2912e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:13.939879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f22d73ce564906bfcb14f79df2912e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:13.952038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:14.088496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f22d73ce564906bfcb14f79df2912e', 'request_id': 'req-d8b86271-7583-49af-910d-2350469d307d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:14.089737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:14.103679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f22d73ce564906bfcb14f79df2912e', 'request_id': 'req-d8b86271-7583-49af-910d-2350469d307d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:14.118226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f22d73ce564906bfcb14f79df2912e', 'request_id': 'req-d8b86271-7583-49af-910d-2350469d307d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:14.150875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] The token cache is being invalidate because project 07f22d73ce564906bfcb14f79df2912e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:14.151710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:14.152391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8b86271-7583-49af-910d-2350469d307d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:14.159399 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1349/2706] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:13 2022] DELETE /identity/v3/projects/07f22d73ce564906bfcb14f79df2912e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:14.161544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.161968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.162608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.179885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:14.230320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:14.232034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:14.397517 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1358/2707] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:14.404875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.405350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.405506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.458148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:14.459388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:14.478860 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1350/2708] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:14.482947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:14.499992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b35b1-a0b4-479c-8150-b18cd0c5d85b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:14.511299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:14.514400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.514785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.515161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.515940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:14.520324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:14.522330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:14.551523 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1359/2709] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:14.553010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:14.566866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117ae94-cd61-430e-b4f1-05da893b6714 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:14.585561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:14.586243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.586524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.586798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.587465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:14.589417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:14.659185 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1351/2710] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:14 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:53:14.663177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:14.688463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87546542-a0a7-44b6-a2b4-e9446f57374e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:14.772447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:14.773467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.774005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.774500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.775365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:14.777586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:14.814271 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1360/2711] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:14 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:14.818151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:14.829409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8d931-6317-41f6-b7d1-95d34524803b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:14.852956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:14.853705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.854122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.854975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.855530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:14.860003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:14.884745 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1352/2712] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:14.886531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:14.897415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8bba0-500e-417c-be93-74e75f9325e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:14.916608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0676427-73f6-4db1-93be-0e559a037b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:14.917329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676427-73f6-4db1-93be-0e559a037b4e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:14.917739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676427-73f6-4db1-93be-0e559a037b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:14.918250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0676427-73f6-4db1-93be-0e559a037b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:14.919022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676427-73f6-4db1-93be-0e559a037b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:14.920910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0676427-73f6-4db1-93be-0e559a037b4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:14.952847 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1361/2713] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:14.954876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:14.979194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f46be-4551-4174-bc60-c9bd593de76b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:15.006372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:15.008524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.009764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.016751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] PATH_INFO: `/v3/projects/627f11df037f4961b544069f7afce541/users/4fa5fe325c864935a38ea2f07eca8c03/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:15.063972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627f11df037f4961b544069f7afce541, user_id=4fa5fe325c864935a38ea2f07eca8c03, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:15.072064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:15.118043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1353/2714] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:14 2022] PUT /identity/v3/projects/627f11df037f4961b544069f7afce541/users/4fa5fe325c864935a38ea2f07eca8c03/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:15.128562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.129210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.129943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:15.196268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] MFA Rules not processed for user `4fa5fe325c864935a38ea2f07eca8c03`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:15.197543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:15.320701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:15.345893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1362/2715] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:15.348113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:15.532412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eef58f-3ef2-4c5f-ad67-fc09ee39f6d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:15.575293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:15.575293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.575293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.575293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:15.575834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:15.586257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:15.667464 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1354/2716] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:15.671498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:15.693315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c23b46b-0966-4cdf-820c-be0e9684598b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:15.732036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:15.741666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:15.855156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:15.855156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.855156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.855156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:15.855696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:15.859017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:15.896347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3cf1c1-80e4-4cec-b1ad-e5b82c766a95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:15.910343 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1363/2717] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:15 2022] POST /identity/v3/users => generated 299 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:15.914258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:15.915418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:15.916088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.916370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.916642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] PATH_INFO: `/v3/projects/437ad319907448b18f600f6ac741e5f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:15.917854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=437ad319907448b18f600f6ac741e5f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:15.919815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:15.921557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:15.931604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23dc5ee-1a73-45ea-af06-5f627af1a5f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:15.952223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:15.953171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.953314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.953589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:15.954349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:15.956606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:15.971837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1364/2718] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:53:15.975865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:15.988695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b950a-6a56-46fa-b08f-9cce83cedf30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:15.996864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:15.997945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:15.998361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:15.998765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] PATH_INFO: `/v3/projects/09431a0263ff47b890c4577923d3f9a9/users/297394e69aca4e8dbc0e20ac8bb1fe74/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.021335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09431a0263ff47b890c4577923d3f9a9, user_id=297394e69aca4e8dbc0e20ac8bb1fe74, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:16.024992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:16.050309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '437ad319907448b18f600f6ac741e5f9', 'request_id': 'req-65876445-eb63-4e74-9c49-1ecea56ca33e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:16.054897 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1365/2719] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:15 2022] PUT /identity/v3/projects/09431a0263ff47b890c4577923d3f9a9/users/297394e69aca4e8dbc0e20ac8bb1fe74/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:16.058647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:16.068291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '437ad319907448b18f600f6ac741e5f9', 'request_id': 'req-65876445-eb63-4e74-9c49-1ecea56ca33e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:16.078338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '437ad319907448b18f600f6ac741e5f9', 'request_id': 'req-65876445-eb63-4e74-9c49-1ecea56ca33e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:16.102991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] The token cache is being invalidate because project 437ad319907448b18f600f6ac741e5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:16.104802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:16.110624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65876445-eb63-4e74-9c49-1ecea56ca33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:16.116355 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1355/2720] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:15 2022] DELETE /identity/v3/projects/437ad319907448b18f600f6ac741e5f9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:16.123146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a046da-b418-42f5-a7ec-d53448d54c09 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.123432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a046da-b418-42f5-a7ec-d53448d54c09 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.124381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a046da-b418-42f5-a7ec-d53448d54c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.170854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f027a6-549d-40b4-9b67-554c2868082b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:16.177678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:16.178467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.178801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.179073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.179726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:16.180928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f9a046da-b418-42f5-a7ec-d53448d54c09 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:16.181341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:16.185526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f9a046da-b418-42f5-a7ec-d53448d54c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:16.194924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1366/2721] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:16.200342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:16.204028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:16.206784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1356/2722] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:16.217132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.217419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.217688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.245917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4969dd-6afc-48db-9a55-77016217c1ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:16.262468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7cd52-ae9d-4f85-bdeb-075825b640d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:16.263170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7cd52-ae9d-4f85-bdeb-075825b640d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.263452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7cd52-ae9d-4f85-bdeb-075825b640d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.263728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7cd52-ae9d-4f85-bdeb-075825b640d1 admin admin] PATH_INFO: `/v3/projects/09431a0263ff47b890c4577923d3f9a9/users/297394e69aca4e8dbc0e20ac8bb1fe74/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.266577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7cd52-ae9d-4f85-bdeb-075825b640d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09431a0263ff47b890c4577923d3f9a9, user_id=297394e69aca4e8dbc0e20ac8bb1fe74, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:16.269681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7cd52-ae9d-4f85-bdeb-075825b640d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:16.272990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:16.274454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:16.303196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1357/2723] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:16.307607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:16.313762 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1367/2724] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:16 2022] PUT /identity/v3/projects/09431a0263ff47b890c4577923d3f9a9/users/297394e69aca4e8dbc0e20ac8bb1fe74/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:16.322870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b66d11-9e35-439d-9441-08c3b494e122 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:16.325488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.325844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.326127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.397626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] MFA Rules not processed for user `297394e69aca4e8dbc0e20ac8bb1fe74`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:16.399252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:16.464023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:16.495885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:16.496533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.496811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.497081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.497743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:16.498076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:16.499739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:16.548166 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1358/2725] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:16.549202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:16.573370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8d449-5c4c-43a0-ab26-ebc3ef146965 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:16.587211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:16.587856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.588136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.588412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.589611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:16.591687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:16.604697 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1368/2726] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:16.654123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1359/2727] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:16 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:16.654662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:16.683442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cda17-ab3f-4d0a-bcb7-38b7af105290 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:16.917234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:16.918161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:16.918572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:16.918849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:16.919862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:16.922391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:17.022842 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1369/2728] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:16 2022] POST /identity/v3/users => generated 288 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:53:17.024274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:17.051129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba86434-408d-4566-b1c1-6d403fdd3a0e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:17.075032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:17.077051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:17.085440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:17.086408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.086855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.087295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.088135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:17.090230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:17.109184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1360/2729] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:17.113439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:17.137351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d6e8b-d6f9-4cfb-884f-ec48bb0063f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:17.154143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:17.155087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.155500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.155734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.156429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:17.158326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:17.183235 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1361/2730] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:53:17.188340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:17.209045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d556b5d-71dc-4177-a501-a34cb88d0ef1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:17.226706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8459d4-5776-4541-be99-d5569079e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:17.227341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8459d4-5776-4541-be99-d5569079e861 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.227776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8459d4-5776-4541-be99-d5569079e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.227906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8459d4-5776-4541-be99-d5569079e861 admin admin] PATH_INFO: `/v3/projects/510a17ba8db3409fa425fe14df06b8e4/users/eb69e4365fa5420aa8ca5b539924a1c5/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.259244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8459d4-5776-4541-be99-d5569079e861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=510a17ba8db3409fa425fe14df06b8e4, user_id=eb69e4365fa5420aa8ca5b539924a1c5, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:17.262117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8459d4-5776-4541-be99-d5569079e861 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:17.290890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1362/2731] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:17 2022] PUT /identity/v3/projects/510a17ba8db3409fa425fe14df06b8e4/users/eb69e4365fa5420aa8ca5b539924a1c5/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:53:17.303894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.304210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.304488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.323426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:17.370985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] MFA Rules not processed for user `eb69e4365fa5420aa8ca5b539924a1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:17.372449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:17.499477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9ff1d-d193-410f-b8c5-0fd686ec8baa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:17.521268 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1363/2732] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:17.521268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:17.521268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:17.638380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:17.672723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:17.673871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.674332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.674589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.710622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcce71-817d-4b7d-8c14-590a2e0323b1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:17.724836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:17.725481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.725765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.726089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.728006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:17.752289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:17.753845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:17.778946 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1364/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:17.789973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:17.795724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:17.821332 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1370/2734] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:53:17.900213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:17.902789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:17.928042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2021ec6-1e49-49eb-99dc-35590b60fe4c service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:17.947274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e326eb9-b50d-4d67-aa03-832ddad02956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:17.948285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e326eb9-b50d-4d67-aa03-832ddad02956 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:17.950709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e326eb9-b50d-4d67-aa03-832ddad02956 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:17.952157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e326eb9-b50d-4d67-aa03-832ddad02956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:17.990826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e326eb9-b50d-4d67-aa03-832ddad02956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:17.992796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e326eb9-b50d-4d67-aa03-832ddad02956 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:18.022269 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1365/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:19.086759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:19.251212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffee034-72f1-429a-9e40-20f6fc0f657b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:19.257737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:19.258815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:19.259324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:19.259811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] PATH_INFO: `/v3/users/4fa5fe325c864935a38ea2f07eca8c03` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:19.266416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa5fe325c864935a38ea2f07eca8c03)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:19.269049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:19.377540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa5fe325c864935a38ea2f07eca8c03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:19.403750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa5fe325c864935a38ea2f07eca8c03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:19.404871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa5fe325c864935a38ea2f07eca8c03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:19.421379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa5fe325c864935a38ea2f07eca8c03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:19.433447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa5fe325c864935a38ea2f07eca8c03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:19.455749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:19.462437 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1371/2736] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:19 2022] DELETE /identity/v3/users/4fa5fe325c864935a38ea2f07eca8c03 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:19.466737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:19.467519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:19.467519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:19.500331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:19.504150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:19.586953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:19.626985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1366/2737] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:19.690035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:19.691765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:19.850644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7564d2d-3e0c-42b6-b868-9a632a96c5eb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:19.860170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:19.861093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:19.862145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:19.862549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:19.913199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:19.916939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:19.935703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1372/2738] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:20.889092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:20.890604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:20.911511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3268-6f7f-4166-a303-f006eb046d88 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:20.935533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:20.936534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:20.937091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:20.937745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] PATH_INFO: `/v3/projects/627f11df037f4961b544069f7afce541` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:20.940652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627f11df037f4961b544069f7afce541)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:20.943089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:21.023837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627f11df037f4961b544069f7afce541', 'request_id': 'req-e9dc72e0-ab22-4a20-b8de-cffe8802e503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.032985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627f11df037f4961b544069f7afce541', 'request_id': 'req-e9dc72e0-ab22-4a20-b8de-cffe8802e503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.042342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627f11df037f4961b544069f7afce541', 'request_id': 'req-e9dc72e0-ab22-4a20-b8de-cffe8802e503'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.074956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] The token cache is being invalidate because project 627f11df037f4961b544069f7afce541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:21.076195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.078562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.083114 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1367/2739] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:20 2022] DELETE /identity/v3/projects/627f11df037f4961b544069f7afce541 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:21.087167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:21.104008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fadae-2cd6-4c44-a317-20d012dcdb36 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:21.274830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:21.275491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:21.275770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:21.276044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] PATH_INFO: `/v3/users/297394e69aca4e8dbc0e20ac8bb1fe74` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:21.279035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=297394e69aca4e8dbc0e20ac8bb1fe74)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:21.281493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:21.390411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297394e69aca4e8dbc0e20ac8bb1fe74'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.408673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297394e69aca4e8dbc0e20ac8bb1fe74'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.409985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297394e69aca4e8dbc0e20ac8bb1fe74'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.420234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297394e69aca4e8dbc0e20ac8bb1fe74'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.421113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1a4a9aa0-4e8e-4af7-b71b-669c03880d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297394e69aca4e8dbc0e20ac8bb1fe74'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.444618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1373/2740] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:21 2022] DELETE /identity/v3/users/297394e69aca4e8dbc0e20ac8bb1fe74 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:21.551514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:21.554803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:21.576664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc72e0-ab22-4a20-b8de-cffe8802e503 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:21.657417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:21.658482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:21.659628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:21.660198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] PATH_INFO: `/v3/users/eb69e4365fa5420aa8ca5b539924a1c5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:21.664707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb69e4365fa5420aa8ca5b539924a1c5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:21.668575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:21.729418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb69e4365fa5420aa8ca5b539924a1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.741659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb69e4365fa5420aa8ca5b539924a1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.743146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb69e4365fa5420aa8ca5b539924a1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.752594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb69e4365fa5420aa8ca5b539924a1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.753466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb69e4365fa5420aa8ca5b539924a1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:21.763066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:21.777287 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1368/2741] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:21 2022] DELETE /identity/v3/users/eb69e4365fa5420aa8ca5b539924a1c5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:21.782016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:21.782424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:21.783624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:21.811529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:21.812953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:21.846022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:21.861516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:21.866609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:21.983331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1374/2742] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:21.991748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:22.000987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:22.170575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a535ca-3581-4ea9-a6ec-3cb430d52ff5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:22.177564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:22.178328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.178617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.178890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] PATH_INFO: `/v3/projects/09431a0263ff47b890c4577923d3f9a9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.180264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09431a0263ff47b890c4577923d3f9a9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:22.184230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:22.194593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d4a88-b97e-4162-a964-d75e0274a1f3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:22.203928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:22.204663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.204964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.205239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.227349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:22.229297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:22.257586 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1375/2743] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:22.258684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:22.262864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:22.266787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09431a0263ff47b890c4577923d3f9a9', 'request_id': 'req-89b83355-c219-41e8-a005-b4bd8acfc1f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:22.275785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09431a0263ff47b890c4577923d3f9a9', 'request_id': 'req-89b83355-c219-41e8-a005-b4bd8acfc1f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:22.283330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09431a0263ff47b890c4577923d3f9a9', 'request_id': 'req-89b83355-c219-41e8-a005-b4bd8acfc1f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:22.323676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] The token cache is being invalidate because project 09431a0263ff47b890c4577923d3f9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:22.325626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:22.328499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b83355-c219-41e8-a005-b4bd8acfc1f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:22.336257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1369/2744] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:21 2022] DELETE /identity/v3/projects/09431a0263ff47b890c4577923d3f9a9 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:22.341271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088975-24be-4951-9ce0-f82c4a423af2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.341764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088975-24be-4951-9ce0-f82c4a423af2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.342244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec088975-24be-4951-9ce0-f82c4a423af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.392207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec088975-24be-4951-9ce0-f82c4a423af2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:22.393885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec088975-24be-4951-9ce0-f82c4a423af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:22.419249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64933145-ce08-40d7-8993-ca3a93cdf114 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:22.528889 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1370/2745] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:22.538575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.538966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.539304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.569300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:22.570509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.573179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.574283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.578963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:22.594907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:22.598176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:22.601223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:22.602250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:22.603491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:22.620191 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1376/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:22.623897 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1371/2747] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:22.628304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:22.656189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d6eea9-24de-4245-988b-a72a8975d9f5 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:22.671303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:22.672226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.672719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.673833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.674722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:22.675791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:22.681169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:22.706671 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1377/2748] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:22.711101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:22.724370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4dd14-93a7-4bab-8eb2-d89281193f66 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:22.732490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:22.733430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.733990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.734607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.735848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:22.740654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:22.769570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:22.791861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1372/2749] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:22 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:22.795543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:22.817903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257a242-0f42-42b2-8ddb-e8e1b1263b41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:22.992508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:22.993341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:22.993876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:22.994239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:22.996827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:23.005700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:23.083642 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1378/2750] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:22 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:23.086601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:23.108867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03ecb8-dabf-4244-82b2-d850ab693c34 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:23.124678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:23.125318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:23.125592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:23.125888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:23.133775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:23.141392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:23.175720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1373/2751] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:23.180296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:23.197470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b203007-caf8-4c56-be0a-06c0a436b230 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:23.220839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4929910-63bb-4430-8c4e-2c78178dcdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:23.221539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929910-63bb-4430-8c4e-2c78178dcdff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:23.221842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929910-63bb-4430-8c4e-2c78178dcdff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:23.222116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4929910-63bb-4430-8c4e-2c78178dcdff admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:23.226557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929910-63bb-4430-8c4e-2c78178dcdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:23.230497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4929910-63bb-4430-8c4e-2c78178dcdff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:23.260308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1379/2752] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:23.263904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:23.276597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f07457-dacb-4067-a809-ce6044a20e9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:23.308022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:23.308804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:23.309061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:23.309341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] PATH_INFO: `/v3/projects/4935f9a2442d43a8bfc4e2a18c542c08/users/aa3cb8ca820c4976beb0f156d53c6bdd/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:23.355314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4935f9a2442d43a8bfc4e2a18c542c08, user_id=aa3cb8ca820c4976beb0f156d53c6bdd, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:23.358359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:23.396998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1374/2753] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:23 2022] PUT /identity/v3/projects/4935f9a2442d43a8bfc4e2a18c542c08/users/aa3cb8ca820c4976beb0f156d53c6bdd/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:23.399918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:23.400202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:23.400515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:23.462420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] MFA Rules not processed for user `aa3cb8ca820c4976beb0f156d53c6bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:23.463668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:23.646369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:23.648315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:23.701194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1380/2754] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:23.703330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:23.804336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bcb459-4742-4522-a124-f7c071bf5893 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:23.806188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:23.815048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:23.815717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:23.815994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:23.816264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] PATH_INFO: `/v3/projects/510a17ba8db3409fa425fe14df06b8e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:23.818513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=510a17ba8db3409fa425fe14df06b8e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:23.820404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:23.827463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed64620-4508-4105-8c51-dcb94bf63cbb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:23.833214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:23.834107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:23.834418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:23.836388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:23.837066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:23.839036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:23.879824 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1381/2755] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:23 2022] POST /identity/v3/projects => generated 393 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:23.884928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:23.948522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '510a17ba8db3409fa425fe14df06b8e4', 'request_id': 'req-36b0839b-c7ef-4f81-8976-29c792f0f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:23.962792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '510a17ba8db3409fa425fe14df06b8e4', 'request_id': 'req-36b0839b-c7ef-4f81-8976-29c792f0f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:23.986048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '510a17ba8db3409fa425fe14df06b8e4', 'request_id': 'req-36b0839b-c7ef-4f81-8976-29c792f0f67f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:24.008087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] The token cache is being invalidate because project 510a17ba8db3409fa425fe14df06b8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:24.008358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:24.010177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36b0839b-c7ef-4f81-8976-29c792f0f67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:24.015884 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1375/2756] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:23 2022] DELETE /identity/v3/projects/510a17ba8db3409fa425fe14df06b8e4 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:24.019436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c545d-7409-42b1-b3c9-d4e9278f8aab None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.019718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c545d-7409-42b1-b3c9-d4e9278f8aab None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.019989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c545d-7409-42b1-b3c9-d4e9278f8aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.080938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d78c545d-7409-42b1-b3c9-d4e9278f8aab None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:24.082234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d78c545d-7409-42b1-b3c9-d4e9278f8aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:24.123525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcf4db-acc9-4ac1-9207-5a1c458c4aec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.176390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:24.199974 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1376/2757] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:24.211264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.212484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.213259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.248312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:24.251213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:24.272082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1377/2758] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:24.273784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.281915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.283251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.283983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.284479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.285592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.288561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.305220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb08eb-2abc-4810-b441-f78917ba5768 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.313390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.316672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.317180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.317924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.318828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:24.322018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.324571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.337538 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1382/2759] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:23 2022] POST /identity/v3/users => generated 303 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:24.341096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.344863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:24.364907 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1378/2760] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:24.370946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.382382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0695e4d-31fb-4728-9fee-ac8a609c393a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.389059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b35d3-86fa-4df2-a91b-6d2a5c797237 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.397071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.398675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.399243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.399552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.400127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.400324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.400658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.401931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.402177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.402712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.405354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.409123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.446219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1379/2761] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:24 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:24.450930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.453121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1383/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:53:24.458178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.478227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96342-d71d-485a-8c70-02a6219e2664 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.590550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.591912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.592199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.592471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] PATH_INFO: `/v3/projects/6261a84493fc4d899db9a8cf867bbcbd/users/68cbb5d8a2eb4f61be50e6f23cc3054d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.599532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:24.624738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6261a84493fc4d899db9a8cf867bbcbd, user_id=68cbb5d8a2eb4f61be50e6f23cc3054d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.627555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.643866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35181542-1fb2-49f2-96f4-3d01f4c3bd52 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.651071 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1384/2763] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:24 2022] PUT /identity/v3/projects/6261a84493fc4d899db9a8cf867bbcbd/users/68cbb5d8a2eb4f61be50e6f23cc3054d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:24.654841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.797710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.798830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.799254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.799882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.800698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.802942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.811783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b8e16-6e09-47a3-80a7-59df430d3d5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.827788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.828424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.828684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.828955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.830264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.842504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.862160 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1380/2764] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:24 2022] POST /identity/v3/users => generated 290 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:24.866375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.876663 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1385/2765] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:24.880891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.887385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800c35a-193c-43da-afad-7a11ea3921d1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.893018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.893652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.893960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.894232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.894878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.896505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.925023 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1381/2766] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:53:24.926077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.926856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20416732-51cf-45e9-8974-2290113fd0bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.940051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a270c18-631f-4641-ad1f-372748d4a673 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:24.943392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f0530f-ae44-436a-ac05-8130147cbaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.945869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0530f-ae44-436a-ac05-8130147cbaa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.947133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0530f-ae44-436a-ac05-8130147cbaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.947514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f0530f-ae44-436a-ac05-8130147cbaa8 admin admin] PATH_INFO: `/v3/projects/6261a84493fc4d899db9a8cf867bbcbd/users/68cbb5d8a2eb4f61be50e6f23cc3054d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.951096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0530f-ae44-436a-ac05-8130147cbaa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6261a84493fc4d899db9a8cf867bbcbd, user_id=68cbb5d8a2eb4f61be50e6f23cc3054d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.951927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:24.954294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.954943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.955397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.956528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:24.956959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f0530f-ae44-436a-ac05-8130147cbaa8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.958627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:24.972112 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1382/2767] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:24.981722 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1386/2768] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:24 2022] PUT /identity/v3/projects/6261a84493fc4d899db9a8cf867bbcbd/users/68cbb5d8a2eb4f61be50e6f23cc3054d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:24.981986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:24.983569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122372-02a5-43b8-a6e7-d2a319e9447f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:24.983922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122372-02a5-43b8-a6e7-d2a319e9447f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:24.984261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01122372-02a5-43b8-a6e7-d2a319e9447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:24.995821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febab04-317e-4b4c-8ba9-d25d5797d3dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:25.027447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01122372-02a5-43b8-a6e7-d2a319e9447f None None] MFA Rules not processed for user `68cbb5d8a2eb4f61be50e6f23cc3054d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:25.028701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01122372-02a5-43b8-a6e7-d2a319e9447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.033465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:25.117264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c0f37-0140-4741-aa6d-16cb6f1bc3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:25.118024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0f37-0140-4741-aa6d-16cb6f1bc3d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:25.118304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0f37-0140-4741-aa6d-16cb6f1bc3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:25.118576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c0f37-0140-4741-aa6d-16cb6f1bc3d5 admin admin] PATH_INFO: `/v3/projects/87111b9e962d4606a29bc7ad37b8d484/users/2bccf42abb184f15ae36a855e0d8e68f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:25.162106 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1387/2769] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:25.162330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0f37-0140-4741-aa6d-16cb6f1bc3d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87111b9e962d4606a29bc7ad37b8d484, user_id=2bccf42abb184f15ae36a855e0d8e68f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:25.162330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c0f37-0140-4741-aa6d-16cb6f1bc3d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:25.164067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:25.164928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:25.165254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:25.184742 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1383/2770] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:24 2022] PUT /identity/v3/projects/87111b9e962d4606a29bc7ad37b8d484/users/2bccf42abb184f15ae36a855e0d8e68f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:53:25.190588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e11b1-fd51-44ab-8d68-fcb3325f9d50 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:25.191040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e11b1-fd51-44ab-8d68-fcb3325f9d50 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:25.191457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e11b1-fd51-44ab-8d68-fcb3325f9d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:25.191977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] MFA Rules not processed for user `aa3cb8ca820c4976beb0f156d53c6bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:25.193438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.218818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-722e11b1-fd51-44ab-8d68-fcb3325f9d50 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:25.221235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-722e11b1-fd51-44ab-8d68-fcb3325f9d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.272582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:25.290889 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1388/2771] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:25.303454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:25.306389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.380703 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1384/2772] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:25.382299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a092-1592-4972-b531-837e169ca15d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:25.382593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a092-1592-4972-b531-837e169ca15d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:25.382867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900a092-1592-4972-b531-837e169ca15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:25.435027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6900a092-1592-4972-b531-837e169ca15d None None] MFA Rules not processed for user `5d2e129a84e847a0b5c80ad47ca4d233`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:25.436594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6900a092-1592-4972-b531-837e169ca15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.464866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d95bc-eead-4dec-a125-0b40e91647a3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:25.499888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:25.500540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:25.500821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:25.501091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:25.509233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.534158 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1385/2773] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:25.535322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a092-1592-4972-b531-837e169ca15d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:25.537164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6900a092-1592-4972-b531-837e169ca15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:25.538673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:25.540291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:25.598085 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1389/2774] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:25 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:25.643442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900a092-1592-4972-b531-837e169ca15d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:25.649228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d245c-89a4-40e8-b6f0-ec0543aa5136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:25.649742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d245c-89a4-40e8-b6f0-ec0543aa5136 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:25.650222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d245c-89a4-40e8-b6f0-ec0543aa5136 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:25.650412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d245c-89a4-40e8-b6f0-ec0543aa5136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:25.658223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:25.665734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d245c-89a4-40e8-b6f0-ec0543aa5136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:25.667739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445d245c-89a4-40e8-b6f0-ec0543aa5136 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:25.717048 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1386/2775] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:33.467482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:33.469573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:33.653220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05669034-b2e4-4b99-83f3-267198c4a6fa service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:33.684130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:33.685063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:33.685548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:33.686040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:33.689417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:33.733279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:33.735206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:33.760867 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1390/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:53:35.695199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:39.302582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:39.303204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:39.303204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:39.366304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:39.370082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:39.568553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1387/2777] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:53:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 02:53:39.669888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:39.672004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:39.893954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61b3c6-822a-4e16-bf66-26cd7fd9ed20 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:39.913640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186935b-1e82-49ad-977f-72e9e67cffc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:39.914379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186935b-1e82-49ad-977f-72e9e67cffc8 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:39.914671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186935b-1e82-49ad-977f-72e9e67cffc8 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:39.914946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186935b-1e82-49ad-977f-72e9e67cffc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:39.930575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186935b-1e82-49ad-977f-72e9e67cffc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:39.934404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186935b-1e82-49ad-977f-72e9e67cffc8 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:39.946636 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1391/2778] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:53:40.859250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:40.859250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:40.899215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b469ffb-c621-4297-9c6f-ac7e7198ae64 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:40.918222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:40.921070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:40.921357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:40.921634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] PATH_INFO: `/v3/users/62af8e77eeca4ecc942b76ef82bf2ff2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:40.928725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=62af8e77eeca4ecc942b76ef82bf2ff2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:40.944586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:41.100095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62af8e77eeca4ecc942b76ef82bf2ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:41.121696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62af8e77eeca4ecc942b76ef82bf2ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:41.122394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62af8e77eeca4ecc942b76ef82bf2ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:41.135826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62af8e77eeca4ecc942b76ef82bf2ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:41.136706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62af8e77eeca4ecc942b76ef82bf2ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:41.201239 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1388/2779] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:40 2022] DELETE /identity/v3/users/62af8e77eeca4ecc942b76ef82bf2ff2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:41.203529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d6eb-6806-451a-9de3-ba7348c5e9c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:41.204032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d6eb-6806-451a-9de3-ba7348c5e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:41.204311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8d6eb-6806-451a-9de3-ba7348c5e9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:41.215028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:41.239267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c7f8d6eb-6806-451a-9de3-ba7348c5e9c7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:41.241013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c7f8d6eb-6806-451a-9de3-ba7348c5e9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:41.360351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1392/2780] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:41.751920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:41.754482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:41.939643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e29cfb-2650-4565-8b61-d0cd27eb4ddb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:41.949570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:41.950280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:41.950566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:41.950852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:41.980743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:41.982253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:42.004499 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1389/2781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:45.098006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927de4-ece2-4994-8627-9b674caddd15 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:45.098527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927de4-ece2-4994-8627-9b674caddd15 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:45.098637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927de4-ece2-4994-8627-9b674caddd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:45.161901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-20927de4-ece2-4994-8627-9b674caddd15 None None] MFA Rules not processed for user `2bccf42abb184f15ae36a855e0d8e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:45.163380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20927de4-ece2-4994-8627-9b674caddd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:45.174912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:45.177407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:45.213980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592ce5a6-1891-4a4b-8e6a-6e62033031f3 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:45.227386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:45.230173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:45.231883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:45.232458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] PATH_INFO: `/v3/projects/65837d49e9914967875ca457c466337f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:45.236970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] RBAC: Authorizing `identity:delete_project(project_id=65837d49e9914967875ca457c466337f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:45.246152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:45.262782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:45.362715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65837d49e9914967875ca457c466337f', 'request_id': 'req-201720e7-c064-4309-9db1-bece0d80131b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:45.382484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65837d49e9914967875ca457c466337f', 'request_id': 'req-201720e7-c064-4309-9db1-bece0d80131b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:45.384212 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1393/2782] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:45.401069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65837d49e9914967875ca457c466337f', 'request_id': 'req-201720e7-c064-4309-9db1-bece0d80131b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:45.433307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] The token cache is being invalidate because project 65837d49e9914967875ca457c466337f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:45.434297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:45.435661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-201720e7-c064-4309-9db1-bece0d80131b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:45.443173 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1390/2783] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:45 2022] DELETE /identity/v3/projects/65837d49e9914967875ca457c466337f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:45.444405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:45.444921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:45.445195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:45.474788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:45.476058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:45.619594 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1394/2784] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:45.627985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:45.628270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:45.628549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:45.651441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:45.653883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:45.672578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:45.687336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1391/2785] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:45.689959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedce4ca-9251-45fa-b8ee-a9753997deeb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:45.696451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:45.698052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:45.698512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:45.698955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:45.699778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:45.700265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:45.703080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:45.730349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:45.735303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1395/2786] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:45.742014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc4f7-4efa-4b49-95f2-6a5d975cce5c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:45.747604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:45.748452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:45.749427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:45.750060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:45.750973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:45.753300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:45.823288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:45.823440 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1392/2787] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:45 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:53:45.835986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef363565-7afd-4ca5-bfd9-a617522a4e53 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:45.915184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:46.046011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:46.046963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:46.047115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:46.047483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:46.048610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:46.051227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:46.065385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:46.067690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:46.105612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1396/2788] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:45 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:53:46.109532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:46.136802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a6158-4d23-4783-817b-9942ebaff3da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:46.156599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:46.158438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:46.159603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:46.160463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:46.161889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:46.170577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:46.202402 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1397/2789] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:53:46.206563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:46.231221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ba4c9-58ce-4f8d-978b-2ffa253d8fd4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:46.233770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a868450-cdb7-422e-9006-2532a2345d5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:46.246471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:46.247500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:46.247946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:46.248386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:46.248996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:46.253355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:46.254977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:46.256666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:46.257059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:46.257879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:46.269215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:46.316288 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1398/2790] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:46.319083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:46.344780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47baaac-8bea-4815-bcfe-3ea06d4ee275 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:46.357189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:46.358087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:46.358199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:46.358470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] PATH_INFO: `/v3/projects/f959dfbad27a49dbb4f6d35a6eec8171/users/aae2f9b7079e4fe1b09ef78134c1d055/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:46.390244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:46.392519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f2383e-5816-4286-b79b-115d34119aee service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:46.402548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f959dfbad27a49dbb4f6d35a6eec8171, user_id=aae2f9b7079e4fe1b09ef78134c1d055, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:46.407762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:46.416614 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1393/2791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:53:46.443121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3eb99-4226-46cd-84a2-160aad0ce63c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:46.444440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3eb99-4226-46cd-84a2-160aad0ce63c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:46.444884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3eb99-4226-46cd-84a2-160aad0ce63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:46.450060 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1399/2792] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:46 2022] PUT /identity/v3/projects/f959dfbad27a49dbb4f6d35a6eec8171/users/aae2f9b7079e4fe1b09ef78134c1d055/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:46.460803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:46.505469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6dc3eb99-4226-46cd-84a2-160aad0ce63c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:46.507490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6dc3eb99-4226-46cd-84a2-160aad0ce63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:46.664618 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1394/2793] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:46.879454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:46.881704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:47.115373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec52328-a66d-460c-9668-536f2729824e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:47.134461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2f939-365a-4393-ade0-024506426a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:47.137980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f939-365a-4393-ade0-024506426a87 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:47.138108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f939-365a-4393-ade0-024506426a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:47.138341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2f939-365a-4393-ade0-024506426a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:47.153690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f939-365a-4393-ade0-024506426a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:47.156013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2f939-365a-4393-ade0-024506426a87 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:47.177410 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1400/2794] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:48.983461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:48.984815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:48.985495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:49.083091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] MFA Rules not processed for user `aae2f9b7079e4fe1b09ef78134c1d055`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:49.084640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:49.280097 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1395/2795] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:49.295953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:49.296537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:49.296537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:49.382206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] MFA Rules not processed for user `aae2f9b7079e4fe1b09ef78134c1d055`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:49.383385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:49.406022 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1401/2796] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:50.352906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:50.354412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:50.652538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:50.659980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776432d-233a-4a21-ad7f-7bd20f487e84 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:50.671868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:50.672752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:50.676257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:50.676738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:50.696558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:50.698488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:50.722783 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1396/2797] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:50.859373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:50.881630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9a8e-725d-41a3-812d-44d6909b91e6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:50.896448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:50.897094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:50.897375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:50.897646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:50.902236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:51.003579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:51.014568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:51.018796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1136c7a-e82d-4304-8f06-9940c704f26f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:51.057488 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1402/2798] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:53.519056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:53.520560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:53.705377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b26c80-f1c0-48a2-bc75-33240a6094cc service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:53.716249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:53.719095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:53.720410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:53.725871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:53.727459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:53.756759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:53.759720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:53.789240 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1397/2799] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:53.987142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:53.987642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:53.987741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:54.026802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] MFA Rules not processed for user `2bccf42abb184f15ae36a855e0d8e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:54.028583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:54.099647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:54.189517 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1403/2800] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:54.230000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f92b-0929-4377-8720-3240828d1dd3 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:54.240925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:54.242133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:54.242415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:54.243970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] PATH_INFO: `/v3/users/aae2f9b7079e4fe1b09ef78134c1d055` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:54.248393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae2f9b7079e4fe1b09ef78134c1d055)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:54.249195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:54.362744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae2f9b7079e4fe1b09ef78134c1d055'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:54.390176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae2f9b7079e4fe1b09ef78134c1d055'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:54.392160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae2f9b7079e4fe1b09ef78134c1d055'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:54.410660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae2f9b7079e4fe1b09ef78134c1d055'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:54.412542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae2f9b7079e4fe1b09ef78134c1d055'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:54.464336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1398/2801] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:54 2022] DELETE /identity/v3/users/aae2f9b7079e4fe1b09ef78134c1d055 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:54.833499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:54.851111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89fe5f-8d3d-4c66-8de0-414f07727ee8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:54.968988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:54.969785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:54.970174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:54.970590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:54.972768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:55.095133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:55.098004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:55.117041 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1404/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:55.137447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:55.139264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:55.246419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:55.248234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:55.253770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:55.340605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f0cbb-cf3e-4890-b365-549504c48f1b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:55.341044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c6669-7e2c-45dc-b6f0-0ff4ceabe67a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:55.347533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:55.348304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:55.349164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:55.349554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:55.352640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:55.356353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:55.356984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:55.357283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:55.357559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] PATH_INFO: `/v3/projects/f959dfbad27a49dbb4f6d35a6eec8171` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:55.359636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f959dfbad27a49dbb4f6d35a6eec8171)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:55.366090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:55.378024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:55.382101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fc326-bb08-429f-b1a8-92ef9e8a8d23 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:55.398426 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1405/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:55.473843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f959dfbad27a49dbb4f6d35a6eec8171', 'request_id': 'req-73882b5b-b078-4dd0-b66d-8f26a254dc06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:55.491026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f959dfbad27a49dbb4f6d35a6eec8171', 'request_id': 'req-73882b5b-b078-4dd0-b66d-8f26a254dc06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:55.498300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f959dfbad27a49dbb4f6d35a6eec8171', 'request_id': 'req-73882b5b-b078-4dd0-b66d-8f26a254dc06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:55.518758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] The token cache is being invalidate because project f959dfbad27a49dbb4f6d35a6eec8171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:53:55.519380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:55.520477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-73882b5b-b078-4dd0-b66d-8f26a254dc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:55.522918 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1399/2804] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:55 2022] DELETE /identity/v3/projects/f959dfbad27a49dbb4f6d35a6eec8171 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:55.528137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:55.533349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:55.534205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:55.585390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:55.675968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:55.678790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:55.822779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1406/2805] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:55.832151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:55.832410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:55.833329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:55.871942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:55.873225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:55.884519 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1400/2806] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:55.888568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:55.899888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e7cba-e5bd-48c6-b773-a5c53abe65f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:55.905746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:55.906404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:55.906682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:55.907014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:55.907864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:53:55.908174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:55.909986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:55.926511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1407/2807] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:53:55.929172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:55.940817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c620323-42ae-4dbc-8c2b-cbbda4c74afe None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:55.948674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:55.949356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:55.949680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:55.949996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:55.950671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:55.952803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:55.997628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1401/2808] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:53:55 2022] POST /identity/v3/projects => generated 361 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:53:56.002115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:56.015637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0cb08-a42e-4633-988b-f32c76868581 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:56.145753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:56.146572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:56.147203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:56.147203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:56.150861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:56.153086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:56.185314 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1408/2809] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:53:56 2022] POST /identity/v3/users => generated 281 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:53:56.190638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:56.216459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc68e69-f199-4563-a125-afbee9f39545 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:56.240741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:56.241175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:56.241516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:56.241700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:56.242452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:56.244258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:56.267148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:56.267587 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1402/2810] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:56.283160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee594d3-90c8-4b19-9cc9-98932bf39e7d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:56.294570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d89c58-236b-490b-a981-a647840fd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:56.296366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89c58-236b-490b-a981-a647840fd3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:56.296366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89c58-236b-490b-a981-a647840fd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:56.296780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d89c58-236b-490b-a981-a647840fd3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:56.297437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89c58-236b-490b-a981-a647840fd3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:56.306342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d89c58-236b-490b-a981-a647840fd3e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:56.327653 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1409/2811] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:53:56.333762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:56.352899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1a71-9215-4f7c-8d0d-15c2e53bc7a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:56.364895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:56.365699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:56.367121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:56.367452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] PATH_INFO: `/v3/projects/f075fbefd05b49e49f34bda5f56bb750/users/654e948abc2244cb97cbe378745c9dc7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:56.401012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f075fbefd05b49e49f34bda5f56bb750, user_id=654e948abc2244cb97cbe378745c9dc7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:56.404532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:56.427219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1403/2812] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:53:56 2022] PUT /identity/v3/projects/f075fbefd05b49e49f34bda5f56bb750/users/654e948abc2244cb97cbe378745c9dc7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:56.438084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b9ea-d900-48c5-944e-11508b8c85ff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:56.438449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b9ea-d900-48c5-944e-11508b8c85ff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:56.438739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929b9ea-d900-48c5-944e-11508b8c85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:56.492352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8929b9ea-d900-48c5-944e-11508b8c85ff None None] MFA Rules not processed for user `654e948abc2244cb97cbe378745c9dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:56.493588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8929b9ea-d900-48c5-944e-11508b8c85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:56.551638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:56.609271 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1410/2813] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:53:57.236726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:57.354779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:53:57.375648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af2d07-0cda-4c46-908c-ea791fe9f1f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:57.384555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:57.385291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:57.385735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:57.386172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] PATH_INFO: `/v3/users/654e948abc2244cb97cbe378745c9dc7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:57.387711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] RBAC: Authorizing `identity:delete_user(user_id=654e948abc2244cb97cbe378745c9dc7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:57.389978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:57.465281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654e948abc2244cb97cbe378745c9dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:57.476007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654e948abc2244cb97cbe378745c9dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:57.477096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654e948abc2244cb97cbe378745c9dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:57.495716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654e948abc2244cb97cbe378745c9dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:57.498459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654e948abc2244cb97cbe378745c9dc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:57.539527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1404/2814] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:53:57 2022] DELETE /identity/v3/users/654e948abc2244cb97cbe378745c9dc7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:53:57.541352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:57.541867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:57.542202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:57.576747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:53:57.578105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:57.667826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1411/2815] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:53:57.679566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:57.681663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:57.787838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c114-7a75-4dc0-aaaf-7508e632d55f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:57.797873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc70fd8-4373-422b-a3a3-fd9d41c81bf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:57.798589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70fd8-4373-422b-a3a3-fd9d41c81bf9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:57.798868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70fd8-4373-422b-a3a3-fd9d41c81bf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:57.800897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc70fd8-4373-422b-a3a3-fd9d41c81bf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:57.814953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70fd8-4373-422b-a3a3-fd9d41c81bf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:57.816434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc70fd8-4373-422b-a3a3-fd9d41c81bf9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:57.830248 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1405/2816] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:53:59.499995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:53:59.501140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:53:59.526728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a772e7e8-cc39-4ed5-afbd-582d908e6f46 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:53:59.542862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:53:59.544761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:53:59.545213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:53:59.545659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] PATH_INFO: `/v3/projects/f075fbefd05b49e49f34bda5f56bb750` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:53:59.551296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f075fbefd05b49e49f34bda5f56bb750)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:53:59.553662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:53:59.929503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f075fbefd05b49e49f34bda5f56bb750', 'request_id': 'req-76a7dc27-9b68-42b8-b736-d317896893b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:53:59.951666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f075fbefd05b49e49f34bda5f56bb750', 'request_id': 'req-76a7dc27-9b68-42b8-b736-d317896893b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:00.038042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f075fbefd05b49e49f34bda5f56bb750', 'request_id': 'req-76a7dc27-9b68-42b8-b736-d317896893b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:00.080319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] The token cache is being invalidate because project f075fbefd05b49e49f34bda5f56bb750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:00.082368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:00.083796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76a7dc27-9b68-42b8-b736-d317896893b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:00.096655 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1412/2817] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:53:59 2022] DELETE /identity/v3/projects/f075fbefd05b49e49f34bda5f56bb750 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:00.099591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.100812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.101528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.166818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:00.168147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:00.332493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1406/2818] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:00.333191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.333656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.333860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.371664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:00.374290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:00.398830 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1413/2819] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:00.400262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:00.417136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2109-4d87-429c-825b-2aa7a8a3cbbb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:00.430055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:00.430754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.431036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.431313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.434033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:00.435431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:00.438462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:00.469262 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1407/2820] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:00.470922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:00.483582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7fb27-e4e9-4857-9f4d-d3c2bac034a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:00.491022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:00.492056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.492603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.493261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.502749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:00.508716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:00.583576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:00.584113 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1414/2821] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:00 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:00.591067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:00.607142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e943-260a-488e-87b7-5a9241b12771 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:00.760369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:00.761107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.761483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.761879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.762622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:00.764691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:00.809747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1408/2822] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:00 2022] POST /identity/v3/users => generated 284 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:00.810910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:00.832551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c7ce16-8d79-4de7-b89b-d7d17e1a7fb3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:00.844112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:00.844851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.845135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.845408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.846091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:00.851370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:00.884787 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1415/2823] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:00.886125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:00.910702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c71a47-887a-49f2-a93d-057928799a4e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:00.937260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e6df6-17d8-4181-83b6-a1fa9f905dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:00.938533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6df6-17d8-4181-83b6-a1fa9f905dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:00.939227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6df6-17d8-4181-83b6-a1fa9f905dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:00.939824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e6df6-17d8-4181-83b6-a1fa9f905dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:00.943138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6df6-17d8-4181-83b6-a1fa9f905dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:00.950519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e6df6-17d8-4181-83b6-a1fa9f905dc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:00.977364 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1409/2824] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:00.978282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:00.992226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb7932-5d3b-490a-ad39-fa5779f37bf8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:01.010926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:01.011632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:01.011913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:01.012274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] PATH_INFO: `/v3/projects/54d74537c66244c5bf7fbe36bdb9aa84/users/e0be2cb29e5c4c438d406cc01361a52d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:01.052969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d74537c66244c5bf7fbe36bdb9aa84, user_id=e0be2cb29e5c4c438d406cc01361a52d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:01.055863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:01.082236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:01.089533 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1416/2825] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:00 2022] PUT /identity/v3/projects/54d74537c66244c5bf7fbe36bdb9aa84/users/e0be2cb29e5c4c438d406cc01361a52d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:01.100933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:01.101591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:01.101591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:01.172671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] MFA Rules not processed for user `e0be2cb29e5c4c438d406cc01361a52d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:01.174123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:01.366174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1410/2826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:01.373367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:01.376509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:01.518228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e3dd0-f4fa-4421-8d29-a81b1ab01551 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:01.528943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d376d-3f77-4595-8b01-7a7bc53f12ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:01.530079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d376d-3f77-4595-8b01-7a7bc53f12ed service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:01.531686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d376d-3f77-4595-8b01-7a7bc53f12ed service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:01.532493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d376d-3f77-4595-8b01-7a7bc53f12ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:01.561459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d376d-3f77-4595-8b01-7a7bc53f12ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:01.564023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d376d-3f77-4595-8b01-7a7bc53f12ed service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:01.608349 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1417/2827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:03.701037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:03.710856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:03.857790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ce18a-b8f9-4adc-b374-3e9d0256af06 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:03.865330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:03.865885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:03.866134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:03.866374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] PATH_INFO: `/v3/users/aa3cb8ca820c4976beb0f156d53c6bdd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:03.867568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3cb8ca820c4976beb0f156d53c6bdd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:03.869704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:03.908105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:03.998467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3cb8ca820c4976beb0f156d53c6bdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:04.029759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3cb8ca820c4976beb0f156d53c6bdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:04.031596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3cb8ca820c4976beb0f156d53c6bdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:04.052431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3cb8ca820c4976beb0f156d53c6bdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:04.056606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3cb8ca820c4976beb0f156d53c6bdd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:04.093214 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1411/2828] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:03 2022] DELETE /identity/v3/users/aa3cb8ca820c4976beb0f156d53c6bdd => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:04.098631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:04.101413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:04.102187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:04.145151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:04.150970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:04.339824 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1418/2829] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:04.351394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:04.354028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:04.520072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9031297f-1222-4644-9f0e-e4bf3f18dd3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:04.524551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85036259-814e-4d39-9be4-21154955695d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:04.525522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85036259-814e-4d39-9be4-21154955695d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:04.525657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85036259-814e-4d39-9be4-21154955695d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:04.526054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85036259-814e-4d39-9be4-21154955695d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:04.555188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85036259-814e-4d39-9be4-21154955695d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:04.556815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85036259-814e-4d39-9be4-21154955695d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:04.572630 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1412/2830] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:05.625400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:05.627976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:05.654570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef0e42-e101-4cf9-9d15-5dd7cbb585de None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:05.680272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:05.681252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:05.682555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:05.683042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] PATH_INFO: `/v3/projects/4935f9a2442d43a8bfc4e2a18c542c08` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:05.685117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4935f9a2442d43a8bfc4e2a18c542c08)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:05.688755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:05.802464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4935f9a2442d43a8bfc4e2a18c542c08', 'request_id': 'req-16425528-0d08-44aa-ba82-fc9e81edb5ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:05.816161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4935f9a2442d43a8bfc4e2a18c542c08', 'request_id': 'req-16425528-0d08-44aa-ba82-fc9e81edb5ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:05.833307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4935f9a2442d43a8bfc4e2a18c542c08', 'request_id': 'req-16425528-0d08-44aa-ba82-fc9e81edb5ad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:05.847395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:05.847897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:05.847965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:05.869006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] The token cache is being invalidate because project 4935f9a2442d43a8bfc4e2a18c542c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:05.871046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:05.872083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:05.875721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:05.877527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:05.879090 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1419/2831] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:05 2022] DELETE /identity/v3/projects/4935f9a2442d43a8bfc4e2a18c542c08 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:05.882823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:05.885782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:05.977887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:06.050222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16425528-0d08-44aa-ba82-fc9e81edb5ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:06.056390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:06.057249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:06.057635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:06.058011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] PATH_INFO: `/v3/users/68cbb5d8a2eb4f61be50e6f23cc3054d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:06.059646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1413/2832] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:54:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:06.068249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cbb5d8a2eb4f61be50e6f23cc3054d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:06.071265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:06.077975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:06.081377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:06.147857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cbb5d8a2eb4f61be50e6f23cc3054d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:06.165119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cbb5d8a2eb4f61be50e6f23cc3054d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:06.166270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cbb5d8a2eb4f61be50e6f23cc3054d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:06.175626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cbb5d8a2eb4f61be50e6f23cc3054d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:06.178054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cbb5d8a2eb4f61be50e6f23cc3054d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:06.185293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:06.206647 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1420/2833] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:05 2022] DELETE /identity/v3/users/68cbb5d8a2eb4f61be50e6f23cc3054d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:06.246057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9db028a-06d7-45d5-bd8b-cb1f191f01e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:06.372230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:06.373716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:06.374129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:06.374466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:06.376967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:06.497740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:06.501779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:06.521719 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1414/2834] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:54:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:07.010917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.012874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:07.057474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.060285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:07.265527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202f06d-5f14-4f5f-a5f3-1c115442c33f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.275482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f454d4e-ac40-43c2-abc2-795f769067c0 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.282561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.283769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.284342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.284681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] PATH_INFO: `/v3/projects/6261a84493fc4d899db9a8cf867bbcbd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.286104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6261a84493fc4d899db9a8cf867bbcbd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:07.288083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:07.289070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.289889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.290244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.291700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.292818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:07.328774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:07.372505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:07.375288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6261a84493fc4d899db9a8cf867bbcbd', 'request_id': 'req-bf75ad54-d231-4045-a7bc-fcb18032d1a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:07.385504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6261a84493fc4d899db9a8cf867bbcbd', 'request_id': 'req-bf75ad54-d231-4045-a7bc-fcb18032d1a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:07.402591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6261a84493fc4d899db9a8cf867bbcbd', 'request_id': 'req-bf75ad54-d231-4045-a7bc-fcb18032d1a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:07.417157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:07.424320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59dd1e-184e-4f46-b6e7-fdb054cd1976 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:07.429631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] The token cache is being invalidate because project 6261a84493fc4d899db9a8cf867bbcbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:07.429972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:07.430793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bf75ad54-d231-4045-a7bc-fcb18032d1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:07.433842 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1421/2835] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:07 2022] DELETE /identity/v3/projects/6261a84493fc4d899db9a8cf867bbcbd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:07.439342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.439904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.440255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.443254 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1415/2836] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:54:07.468846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:07.472128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:07.572456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1422/2837] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:07.582821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.583130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.583619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.610485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:07.612050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:07.625877 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1416/2838] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:07.627399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.641663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a0e53-fdb4-4a03-b963-345c43ecf38a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.646808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.647428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.647848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.648122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.651781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:07.651781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:07.656237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:07.673968 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1423/2839] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:07.677081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.692121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6e3be-6a94-46fb-8dd9-0b02da074de7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.697862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeeb854-fcdb-4be2-a13b-999670e32a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.698929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb854-fcdb-4be2-a13b-999670e32a8f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.699261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb854-fcdb-4be2-a13b-999670e32a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.700375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeeb854-fcdb-4be2-a13b-999670e32a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.700935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeb854-fcdb-4be2-a13b-999670e32a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:07.703107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeeb854-fcdb-4be2-a13b-999670e32a8f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:07.743616 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1417/2840] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:07 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:07.746011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.757831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee5961-b277-4995-a31f-fc07f9621d10 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.849282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.849675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.850053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.884830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.885504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.885766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.886124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.886834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:07.888978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:07.928949 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1424/2841] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:07 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:07.933606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.949219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94b4f-0def-4d4b-8ca7-8c89fc86be4b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.955592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.956644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.956990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.957366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:07.958245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:07.960103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:07.978178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1425/2842] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:07.980860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:07.992009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3d985-9718-49a4-a04c-8af2e9c2637b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:07.998617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:07.999319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:07.999544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:07.999817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:08.000557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:08.002889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:08.016154 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1426/2843] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:08.020617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:08.042846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdcab8-3ee4-4706-801b-6f262a7f4179 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:08.050910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80263c10-d247-4a96-93ae-02b45276ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:08.051605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263c10-d247-4a96-93ae-02b45276ac70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:08.051884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263c10-d247-4a96-93ae-02b45276ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:08.052162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80263c10-d247-4a96-93ae-02b45276ac70 admin admin] PATH_INFO: `/v3/projects/3db6abb0364849a69995e2b2e1a768e4/users/fcfa1de5bf16499b833ee84f857c1cec/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:08.090910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80263c10-d247-4a96-93ae-02b45276ac70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3db6abb0364849a69995e2b2e1a768e4, user_id=fcfa1de5bf16499b833ee84f857c1cec, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:08.093566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80263c10-d247-4a96-93ae-02b45276ac70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:08.124666 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1427/2844] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:08 2022] PUT /identity/v3/projects/3db6abb0364849a69995e2b2e1a768e4/users/fcfa1de5bf16499b833ee84f857c1cec/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:08.126410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:08.126694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:08.126964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:08.131994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:08.133312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:08.141879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:08.185643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] MFA Rules not processed for user `fcfa1de5bf16499b833ee84f857c1cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:08.187707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:08.283379 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1418/2845] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:08.326844 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1428/2846] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:08.332881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:08.489749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d41f46-5db5-4a71-9dbd-5f258ed7c716 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:08.498575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:08.499217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:08.499488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:08.499801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:08.500512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:08.503009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:08.562717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1419/2847] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:08 2022] POST /identity/v3/projects => generated 379 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:08.567421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:08.583098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e040dfd-3cd8-4e0f-9c70-11c594371685 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:08.744510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:08.746919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:08.747276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:08.747642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:08.749944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:08.754530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:08.826133 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1429/2848] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:08 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:08.827020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:08.890062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482eec19-7eab-4656-a6e4-09e554ea9a95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:08.902151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:08.912569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:08.913982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:08.914445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:08.915582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:08.922667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:08.963128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1420/2849] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:54:08.967278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:08.983472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d53460-45a3-44ed-9f59-b044cac38ce7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:08.990152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:08.990978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:08.991128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:08.991492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] PATH_INFO: `/v3/projects/3340b1adfeb6467b9e3be2ac8eaea4fd/users/29a59d11ede3462a8b2b65f26854dca7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:09.014659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3340b1adfeb6467b9e3be2ac8eaea4fd, user_id=29a59d11ede3462a8b2b65f26854dca7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:09.018475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:09.044322 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1430/2850] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:08 2022] PUT /identity/v3/projects/3340b1adfeb6467b9e3be2ac8eaea4fd/users/29a59d11ede3462a8b2b65f26854dca7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:09.048724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:09.056688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:09.061228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e93b3-1c0c-448d-9a2e-11ae2c5b50f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:09.153577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c0a03-23e7-411b-9c51-269df3baa313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:09.155525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0a03-23e7-411b-9c51-269df3baa313 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:09.155952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0a03-23e7-411b-9c51-269df3baa313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:09.156838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c0a03-23e7-411b-9c51-269df3baa313 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:09.157832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0a03-23e7-411b-9c51-269df3baa313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:09.159852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c0a03-23e7-411b-9c51-269df3baa313 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:09.180142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:09.180469 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1421/2851] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:09.194892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86131bfa-8365-4ea7-8c6e-e81eae0b2d5c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:09.201150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:09.202136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:09.202486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:09.202898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] PATH_INFO: `/v3/projects/3340b1adfeb6467b9e3be2ac8eaea4fd/users/29a59d11ede3462a8b2b65f26854dca7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:09.205627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3340b1adfeb6467b9e3be2ac8eaea4fd, user_id=29a59d11ede3462a8b2b65f26854dca7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:09.208844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:09.234769 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1431/2852] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:09 2022] PUT /identity/v3/projects/3340b1adfeb6467b9e3be2ac8eaea4fd/users/29a59d11ede3462a8b2b65f26854dca7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:09.237394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:09.237711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:09.238030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:09.277174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] MFA Rules not processed for user `29a59d11ede3462a8b2b65f26854dca7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:09.278449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:09.376371 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1422/2853] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:10.355239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:10.362026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:10.479069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:10.508335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb59734-9ced-4f30-8d10-a407dfd86c45 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:10.514700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb768b5-bae0-4334-8f91-79190821274b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:10.515526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb768b5-bae0-4334-8f91-79190821274b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:10.515786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb768b5-bae0-4334-8f91-79190821274b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:10.516240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb768b5-bae0-4334-8f91-79190821274b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:10.525529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb768b5-bae0-4334-8f91-79190821274b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:10.527149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb768b5-bae0-4334-8f91-79190821274b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:10.540278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1432/2854] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:12.154956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:12.291104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9fe2d-891c-425f-8b9e-1cad98c038a5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:12.295760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:12.296407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:12.296700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:12.296951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] PATH_INFO: `/v3/users/fcfa1de5bf16499b833ee84f857c1cec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:12.306341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcfa1de5bf16499b833ee84f857c1cec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:12.308345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:12.364273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:12.403294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcfa1de5bf16499b833ee84f857c1cec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:12.422420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcfa1de5bf16499b833ee84f857c1cec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:12.430455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcfa1de5bf16499b833ee84f857c1cec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:12.464920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcfa1de5bf16499b833ee84f857c1cec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:12.467608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcfa1de5bf16499b833ee84f857c1cec'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:12.532264 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1423/2855] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:12 2022] DELETE /identity/v3/users/fcfa1de5bf16499b833ee84f857c1cec => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:12.535260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:12.536213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:12.536213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:12.572506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:12.574036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:12.691585 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1433/2856] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:12.704341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:12.706075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:12.826875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902102f7-1ad4-49c5-ac9e-23d4488e3f1e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:12.838799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:12.839441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:12.839720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:12.839992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:12.863208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:12.865278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:12.897421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1424/2857] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:13.428610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:13.430156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:13.443506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8321948-503e-4e0d-8f45-98415bbd5fcf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:13.451719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:13.452520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:13.452909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:13.453956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] PATH_INFO: `/v3/projects/3db6abb0364849a69995e2b2e1a768e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:13.472738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3db6abb0364849a69995e2b2e1a768e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:13.477624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:13.659061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3db6abb0364849a69995e2b2e1a768e4', 'request_id': 'req-7f99d556-d58c-462a-8bea-5d058b40e6a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.671762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3db6abb0364849a69995e2b2e1a768e4', 'request_id': 'req-7f99d556-d58c-462a-8bea-5d058b40e6a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.681868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3db6abb0364849a69995e2b2e1a768e4', 'request_id': 'req-7f99d556-d58c-462a-8bea-5d058b40e6a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.706201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] The token cache is being invalidate because project 3db6abb0364849a69995e2b2e1a768e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:13.706496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.707521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.710703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1434/2858] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:13 2022] DELETE /identity/v3/projects/3db6abb0364849a69995e2b2e1a768e4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:13.714705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:13.728576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7b3f4-55dc-4c40-a39f-322ee2956ac3 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:13.821638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:13.822504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:13.822853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:13.823125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] PATH_INFO: `/v3/users/29a59d11ede3462a8b2b65f26854dca7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:13.824769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a59d11ede3462a8b2b65f26854dca7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:13.829381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:13.940582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a59d11ede3462a8b2b65f26854dca7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.944072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:13.953193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a59d11ede3462a8b2b65f26854dca7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.954614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a59d11ede3462a8b2b65f26854dca7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.972340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a59d11ede3462a8b2b65f26854dca7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:13.973176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7645ff9-e9b7-4b78-9ff7-07e1e4f48dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a59d11ede3462a8b2b65f26854dca7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:14.017427 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1425/2859] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:13 2022] DELETE /identity/v3/users/29a59d11ede3462a8b2b65f26854dca7 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:14.435856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:14.437464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:14.450987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99d556-d58c-462a-8bea-5d058b40e6a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:14.584048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:14.598351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:14.599020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:14.599303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:14.599582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] PATH_INFO: `/v3/projects/3340b1adfeb6467b9e3be2ac8eaea4fd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:14.602072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3340b1adfeb6467b9e3be2ac8eaea4fd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:14.603998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:14.670747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3340b1adfeb6467b9e3be2ac8eaea4fd', 'request_id': 'req-32d030df-d6aa-4006-880e-e2fe6888d825'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:14.680537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3340b1adfeb6467b9e3be2ac8eaea4fd', 'request_id': 'req-32d030df-d6aa-4006-880e-e2fe6888d825'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:14.689481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3340b1adfeb6467b9e3be2ac8eaea4fd', 'request_id': 'req-32d030df-d6aa-4006-880e-e2fe6888d825'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:14.721567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] The token cache is being invalidate because project 3340b1adfeb6467b9e3be2ac8eaea4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:14.722051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:14.722842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-32d030df-d6aa-4006-880e-e2fe6888d825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:14.725253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1435/2860] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:14 2022] DELETE /identity/v3/projects/3340b1adfeb6467b9e3be2ac8eaea4fd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:14.730585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:14.731564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:14.732079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:14.759404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:14.761110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:14.856009 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1426/2861] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:14.911018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:14.911297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:14.912035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:14.934021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:14.935518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:14.946757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1436/2862] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:14.948150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:14.960100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f4d05-c6da-4dd5-b38d-29f89f9bfefc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:14.965048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:14.965928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:14.966207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:14.966475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:14.967132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:14.967434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:14.969245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:14.982200 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1427/2863] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:14.986648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:14.997315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2fd3d-4bfa-4065-8e8a-e12f1dfc5381 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:15.002594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:15.003222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.003502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.003774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.004431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:15.006712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:15.052947 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1437/2864] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:14 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:15.057514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:15.070278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2db09-a9ce-4ce7-a530-dfaab09e2870 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:15.142912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:15.143782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.144191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.144559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.145291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:15.148488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:15.184692 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1428/2865] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:15 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:15.189844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:15.200132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5c312-5778-4470-ab30-e22c2799f4a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:15.205715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:15.206469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.206746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.207020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.207664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:15.209246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:15.227015 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1438/2866] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:15.228030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:15.239552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b12c29-ad52-41de-aba2-821228d1fdbb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:15.244392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fdabc-81ae-4e04-9b25-7ffd9791b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:15.245172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fdabc-81ae-4e04-9b25-7ffd9791b750 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.246745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fdabc-81ae-4e04-9b25-7ffd9791b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.246745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fdabc-81ae-4e04-9b25-7ffd9791b750 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.247178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fdabc-81ae-4e04-9b25-7ffd9791b750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:15.249294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fdabc-81ae-4e04-9b25-7ffd9791b750 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:15.265971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1429/2867] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:15.267364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:15.278536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7eab-a204-4d58-9e3b-c802b15dfc18 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:15.286363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:15.287294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.287738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.288173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] PATH_INFO: `/v3/projects/d7aec6191ee4471ebb8c025e8ccb7c6b/users/44e2123a4d8b47569d4a1961b66c6185/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.306202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7aec6191ee4471ebb8c025e8ccb7c6b, user_id=44e2123a4d8b47569d4a1961b66c6185, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:15.309356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:15.325272 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1439/2868] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:15 2022] PUT /identity/v3/projects/d7aec6191ee4471ebb8c025e8ccb7c6b/users/44e2123a4d8b47569d4a1961b66c6185/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:15.335950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0fb15-5681-4e7b-97c5-1ed600e279c2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.336238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0fb15-5681-4e7b-97c5-1ed600e279c2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.336505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0fb15-5681-4e7b-97c5-1ed600e279c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.370864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82c0fb15-5681-4e7b-97c5-1ed600e279c2 None None] MFA Rules not processed for user `44e2123a4d8b47569d4a1961b66c6185`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:15.372704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82c0fb15-5681-4e7b-97c5-1ed600e279c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:15.398060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:15.477927 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1430/2869] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:15.489272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:15.491361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:15.626101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd805ab-fd84-4071-8c93-2f9b85c39d27 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:15.632459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:15.633145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.633484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.633832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.642333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:15.644140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:15.656926 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1440/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:15.853835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe4ed-91c0-4adf-b590-29bdb0c417eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:15.854441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe4ed-91c0-4adf-b590-29bdb0c417eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:15.854596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfe4ed-91c0-4adf-b590-29bdb0c417eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:15.894573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4adfe4ed-91c0-4adf-b590-29bdb0c417eb None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:15.896244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4adfe4ed-91c0-4adf-b590-29bdb0c417eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:15.994380 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1431/2871] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:54:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:16.009651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:16.014664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:16.028186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:16.113134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ea92a-2a09-47c6-aa7e-b51b1e159d9b service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:16.118745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f478136-42f4-4c6e-952f-9b555fedec22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:16.119842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f478136-42f4-4c6e-952f-9b555fedec22 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:16.120141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f478136-42f4-4c6e-952f-9b555fedec22 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:16.120727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f478136-42f4-4c6e-952f-9b555fedec22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:16.133526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f478136-42f4-4c6e-952f-9b555fedec22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:16.135408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f478136-42f4-4c6e-952f-9b555fedec22 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:16.146189 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1441/2872] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:16.306055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:16.306469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:16.306755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:16.329782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] MFA Rules not processed for user `44e2123a4d8b47569d4a1961b66c6185`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:16.331637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:16.341833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1432/2873] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:16.699622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:16.700208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:16.701189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:16.735304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:16.737883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:16.748515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1442/2874] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:54:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:16.763476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:16.778958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bed3ef-e283-4ae1-a8c4-6ee341083538 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:16.786731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893095-6e22-4001-a29c-bc960cbe941e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:16.787480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893095-6e22-4001-a29c-bc960cbe941e service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:16.787786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893095-6e22-4001-a29c-bc960cbe941e service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:16.788152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893095-6e22-4001-a29c-bc960cbe941e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:16.798606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893095-6e22-4001-a29c-bc960cbe941e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:16.800556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893095-6e22-4001-a29c-bc960cbe941e service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:16.818538 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1433/2875] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:54:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:16.970857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:17.084570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63498422-b7b8-49bb-970a-fedc82d43b1c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:17.089860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:17.090855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:17.091432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:17.092317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] PATH_INFO: `/v3/users/44e2123a4d8b47569d4a1961b66c6185` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:17.094310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e2123a4d8b47569d4a1961b66c6185)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:17.097789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:17.173821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e2123a4d8b47569d4a1961b66c6185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:17.191013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e2123a4d8b47569d4a1961b66c6185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:17.191868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e2123a4d8b47569d4a1961b66c6185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:17.201275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e2123a4d8b47569d4a1961b66c6185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:17.202169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e2123a4d8b47569d4a1961b66c6185'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:17.224745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1443/2876] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:16 2022] DELETE /identity/v3/users/44e2123a4d8b47569d4a1961b66c6185 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:17.231251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:17.232167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:17.233028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:17.316180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:17.318008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:17.505784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1434/2877] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:17.513410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:17.515562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:17.565410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:17.638250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb1815-321f-4279-9289-27fe6352f0e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:17.645540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863fa92-846b-4ab6-b3f8-3c2a271c0161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:17.646465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863fa92-846b-4ab6-b3f8-3c2a271c0161 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:17.646836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863fa92-846b-4ab6-b3f8-3c2a271c0161 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:17.647822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863fa92-846b-4ab6-b3f8-3c2a271c0161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:17.659935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863fa92-846b-4ab6-b3f8-3c2a271c0161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:17.663655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e863fa92-846b-4ab6-b3f8-3c2a271c0161 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:17.678514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1444/2878] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:19.973522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:19.975442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:20.012721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535a6e-e3c9-41c8-b213-43eadda0e31b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:20.027289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:20.027951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.028232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.028508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] PATH_INFO: `/v3/projects/d7aec6191ee4471ebb8c025e8ccb7c6b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.032310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7aec6191ee4471ebb8c025e8ccb7c6b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:20.034324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:20.128292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:20.132577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7aec6191ee4471ebb8c025e8ccb7c6b', 'request_id': 'req-67024ac2-54f8-45dd-b0d2-79170b3e08e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:20.142557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7aec6191ee4471ebb8c025e8ccb7c6b', 'request_id': 'req-67024ac2-54f8-45dd-b0d2-79170b3e08e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:20.150593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7aec6191ee4471ebb8c025e8ccb7c6b', 'request_id': 'req-67024ac2-54f8-45dd-b0d2-79170b3e08e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:20.171574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] The token cache is being invalidate because project d7aec6191ee4471ebb8c025e8ccb7c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:20.172249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:20.173446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67024ac2-54f8-45dd-b0d2-79170b3e08e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:20.181852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1435/2879] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:19 2022] DELETE /identity/v3/projects/d7aec6191ee4471ebb8c025e8ccb7c6b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:20.186776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.187318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.187522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.242682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:20.244101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:20.398770 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1445/2880] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:20.400458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.400756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.401039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.462835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:20.464173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:20.480881 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1436/2881] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:20.483066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:20.495797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b2374-f103-4b91-b179-6c7695120d58 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:20.510219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:20.510830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.511113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.511388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.512046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:20.513113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:20.514826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:20.534497 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1446/2882] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:20.535646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:20.549724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2d196-8d1c-4318-bae9-08a7e6672ff4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:20.561950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:20.562732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.562883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.563281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.564121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:20.566058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:20.646546 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1437/2883] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:20 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:20.647959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:20.664463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a9d8a-951e-4d5a-a697-677b8cd969ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:20.871970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:20.872784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.873389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.874672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.875824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:20.878762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:20.930703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1447/2884] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:20 2022] POST /identity/v3/users => generated 301 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:20.931948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:20.953720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359117eb-4bec-4b75-b872-dad30276d803 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:20.960568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:20.961358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:20.961775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:20.963229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:20.964642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:20.966475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:21.001702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:21.022111 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1438/2885] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:21.022668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae84ff-016f-41fb-9655-1075e87305ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:21.039374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4428a-4186-4792-ae4b-d8fa8e0f2ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:21.039912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4428a-4186-4792-ae4b-d8fa8e0f2ecc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:21.040185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4428a-4186-4792-ae4b-d8fa8e0f2ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:21.040451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4428a-4186-4792-ae4b-d8fa8e0f2ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:21.041102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4428a-4186-4792-ae4b-d8fa8e0f2ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:21.052864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4428a-4186-4792-ae4b-d8fa8e0f2ecc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:21.099389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1448/2886] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:54:21.100832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:21.148635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecedfe-52dc-4f9a-9b41-c57a718591df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:21.171796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:21.172667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:21.173016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:21.173358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] PATH_INFO: `/v3/projects/47073c9231a7489aa0a1ff3d6496366f/users/5b42df0e125d40ab9d1264c5b3c94ed1/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:21.215645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47073c9231a7489aa0a1ff3d6496366f, user_id=5b42df0e125d40ab9d1264c5b3c94ed1, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:21.218645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:21.245702 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1439/2887] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:21 2022] PUT /identity/v3/projects/47073c9231a7489aa0a1ff3d6496366f/users/5b42df0e125d40ab9d1264c5b3c94ed1/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:21.250602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:21.251372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:21.251372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:21.288000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:21.289558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:21.329293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:21.410802 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1449/2888] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:21.422630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:21.424925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:21.528777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f4c6c-03c6-453a-89f0-c9486bd97d0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:21.533975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70afa04-3624-41e3-bdd4-7441fb10322c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:21.534834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70afa04-3624-41e3-bdd4-7441fb10322c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:21.535174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70afa04-3624-41e3-bdd4-7441fb10322c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:21.535548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70afa04-3624-41e3-bdd4-7441fb10322c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:21.553517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70afa04-3624-41e3-bdd4-7441fb10322c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:21.555180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70afa04-3624-41e3-bdd4-7441fb10322c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:21.617324 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1440/2889] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:25.392989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:25.395398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:25.416803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd8183-3a41-4f58-8cd2-959068af1bb9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:25.433356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:25.435119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:25.435980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:25.436762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] PATH_INFO: `/v3/users/e0be2cb29e5c4c438d406cc01361a52d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:25.439995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0be2cb29e5c4c438d406cc01361a52d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:25.448979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:25.589068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0be2cb29e5c4c438d406cc01361a52d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:25.629544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0be2cb29e5c4c438d406cc01361a52d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:25.635139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0be2cb29e5c4c438d406cc01361a52d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:25.658375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0be2cb29e5c4c438d406cc01361a52d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:25.659278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0be2cb29e5c4c438d406cc01361a52d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:25.697004 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1450/2890] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:25 2022] DELETE /identity/v3/users/e0be2cb29e5c4c438d406cc01361a52d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:25.699085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:25.699085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:25.699512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:25.739210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:25.742189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:25.866273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1441/2891] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:25.936931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:25.944629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:26.101840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e6821-9221-441e-978d-4f8dd4ce18c8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:26.106572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5165ae-4fb7-4be5-ae08-1f343713cfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:26.107330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5165ae-4fb7-4be5-ae08-1f343713cfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:26.107709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5165ae-4fb7-4be5-ae08-1f343713cfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:26.108069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5165ae-4fb7-4be5-ae08-1f343713cfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:26.164203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5165ae-4fb7-4be5-ae08-1f343713cfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:26.170414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5165ae-4fb7-4be5-ae08-1f343713cfa8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:26.197381 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1451/2892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:27.633689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:27.635725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:27.678827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a207-246a-423c-8a52-8da5822376a5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:27.690673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:27.691370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:27.691635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:27.691953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] PATH_INFO: `/v3/projects/54d74537c66244c5bf7fbe36bdb9aa84` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:27.696825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d74537c66244c5bf7fbe36bdb9aa84)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:27.699018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:27.713734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:27.835841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d74537c66244c5bf7fbe36bdb9aa84', 'request_id': 'req-825ee8c5-dd93-4956-a0fc-58e89d7e636e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:27.853257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d74537c66244c5bf7fbe36bdb9aa84', 'request_id': 'req-825ee8c5-dd93-4956-a0fc-58e89d7e636e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:27.888124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d74537c66244c5bf7fbe36bdb9aa84', 'request_id': 'req-825ee8c5-dd93-4956-a0fc-58e89d7e636e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:27.924237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] The token cache is being invalidate because project 54d74537c66244c5bf7fbe36bdb9aa84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:27.924548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:27.926000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-825ee8c5-dd93-4956-a0fc-58e89d7e636e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:27.939701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:27.940172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:27.940505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:27.941972 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1442/2893] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:27 2022] DELETE /identity/v3/projects/54d74537c66244c5bf7fbe36bdb9aa84 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:27.981709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:27.983241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:28.081750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:28.212574 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1452/2894] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:28.223152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.223407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.223716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.261986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:28.264225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:28.282018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1443/2895] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:28.283796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:28.296315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268eeb1-13b3-4a03-aa56-ad9366a47a2b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:28.301716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:28.302391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.302671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.302948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.303612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:28.304972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:28.305711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:28.330831 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1453/2896] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:28.332047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:28.354103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773665b-19c7-460c-af6d-93c43f2e35df None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:28.368530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:28.369292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.370849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.371139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.373194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:28.378604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:28.429532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1444/2897] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:28 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:28.433371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:28.449352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5232b-64d5-45c6-b7ab-9e375f1a16f6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:28.619984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:28.620850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.621132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.622257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.622933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:28.626175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:28.667932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:28.672111 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1454/2898] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:28 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:28.688634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f659e1f-2666-4aab-9674-9a1cf5f130a4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:28.707265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:28.707904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.708201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.712920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.713716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:28.715383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:28.751724 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1445/2899] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:28.754522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:28.768800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41cb9e-f066-40d6-9119-66ad5ccd5a73 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:28.783205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ca3df-27aa-4907-8f3a-d43a0ec280f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:28.783966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca3df-27aa-4907-8f3a-d43a0ec280f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.784254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca3df-27aa-4907-8f3a-d43a0ec280f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.784555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ca3df-27aa-4907-8f3a-d43a0ec280f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.785211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca3df-27aa-4907-8f3a-d43a0ec280f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:28.786873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ca3df-27aa-4907-8f3a-d43a0ec280f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:28.800478 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1455/2900] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:28.804442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:28.815642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c352178-c4ad-4856-b294-026c32e37816 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:28.820947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:28.821941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.822479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.822954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] PATH_INFO: `/v3/projects/584b1a41ffcb4542bad9813c7751e6f4/users/c541a664443d497eb223d10ed2cdf3cb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.849267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=584b1a41ffcb4542bad9813c7751e6f4, user_id=c541a664443d497eb223d10ed2cdf3cb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:28.853244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:28.892408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1446/2901] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:28 2022] PUT /identity/v3/projects/584b1a41ffcb4542bad9813c7751e6f4/users/c541a664443d497eb223d10ed2cdf3cb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:28.903790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:28.904118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:28.904449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:28.963327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] MFA Rules not processed for user `c541a664443d497eb223d10ed2cdf3cb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:28.966150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:29.127494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1456/2902] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:29.131970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:29.178301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:29.180667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:29.304006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:29.316709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5192e-6152-4a5e-bfe6-5d6b8f556ce6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:29.337171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:29.340641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:29.341978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:29.342716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:29.343918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:29.347440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:29.408869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1447/2903] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:29 2022] POST /identity/v3/projects => generated 371 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:29.414511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:29.441724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c7551-af69-4e89-aa11-73af1a959f77 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:29.466292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:29.591193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75549009-d28a-4076-a2fb-bcd32dff978b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:29.598988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:29.599736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:29.600121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:29.600517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:29.601268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:29.610164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:29.624974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:29.626316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:29.626708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:29.627223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:29.631005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:29.638888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1448/2904] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:29 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:29.643101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:29.662834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:29.664725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:29.668039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920165c-4853-4697-9e35-1ae7fec4a20c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:29.689030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:29.689671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:29.689985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:29.690259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:29.692362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:29.694102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:29.711154 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1457/2905] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:54:29.743497 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1449/2906] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:29.748132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:29.768768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d61e6d-ab45-47e2-ac12-a5dc40df9477 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:29.781715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:29.782629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:29.782926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:29.783207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] PATH_INFO: `/v3/projects/5abf156f3ac540ed884e57cef8c471a0/users/75d5d98bc2704336b245f61d8b5a411b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:29.826871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abf156f3ac540ed884e57cef8c471a0, user_id=75d5d98bc2704336b245f61d8b5a411b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:29.830508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:29.860175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1458/2907] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:29 2022] PUT /identity/v3/projects/5abf156f3ac540ed884e57cef8c471a0/users/75d5d98bc2704336b245f61d8b5a411b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:29.864450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:29.885974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba9804-6a8e-45ec-a9a8-b18286c1c611 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.006448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f9501-1702-42a9-93a3-4be9ffd669f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.007213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9501-1702-42a9-93a3-4be9ffd669f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.007924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9501-1702-42a9-93a3-4be9ffd669f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.008306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f9501-1702-42a9-93a3-4be9ffd669f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.009146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f9501-1702-42a9-93a3-4be9ffd669f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.011149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f9501-1702-42a9-93a3-4be9ffd669f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.027413 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1450/2908] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:30.031334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.044254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60a0f7-648c-4a68-94e4-a00b7120cbb8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.050231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.051211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.051639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.052055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] PATH_INFO: `/v3/projects/5abf156f3ac540ed884e57cef8c471a0/users/75d5d98bc2704336b245f61d8b5a411b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.054346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5abf156f3ac540ed884e57cef8c471a0, user_id=75d5d98bc2704336b245f61d8b5a411b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.057233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.073063 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1459/2909] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:30 2022] PUT /identity/v3/projects/5abf156f3ac540ed884e57cef8c471a0/users/75d5d98bc2704336b245f61d8b5a411b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:30.083473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.084502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.085224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.142459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] MFA Rules not processed for user `75d5d98bc2704336b245f61d8b5a411b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:30.143960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:30.262756 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1451/2910] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:30.267107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.283156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a364a9f-e10c-4dc4-8bb4-f29c57634f94 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.288833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.290135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.290893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.291581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.293864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.295144 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.295144 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:30.295144 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:30.306853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.327394 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1460/2911] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:30 2022] POST /identity/v3/services => generated 288 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:30.331966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.354795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bf1dc-c8ff-4641-8811-33a354ae6a89 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.396986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.398044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.398593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.399074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.400947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.403033 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.403033 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:30.403033 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:30.405577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.417194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:30.435702 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1452/2912] 10.222.0.16 () {60 vars in 1213 bytes} [Sat Oct 29 02:54:30 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:30.440228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.453300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61587493-5ffe-4584-8a57-5f59221cc0b3 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.459969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.460907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.461487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.462410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.463660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.466160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.490175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1461/2913] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:30 2022] POST /identity/v3/services => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:30.494505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.511420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b4f59-1691-4837-8d5d-9b3c82cca131 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.537076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.539681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.540832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.541572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.550613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.553049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.587266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1453/2914] 10.222.0.16 () {60 vars in 1213 bytes} [Sat Oct 29 02:54:30 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:30.589842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.608896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6207271-7de2-4b96-9eca-3f6876f07b3f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.616435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.617511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.618039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.618600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.619679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.623475 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.623475 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:30.623475 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:30.627262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.638409 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1462/2915] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Oct 29 02:54:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 764 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:30.642933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.658166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27926666-9012-427d-a0c9-8e115d7b5cf9 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.680895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.684422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.686642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.687569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.691076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=42f471eed79a40b8af74b9171d3f2b0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.693012 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.693012 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:30.693012 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:30.694640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.708142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1454/2916] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Oct 29 02:54:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c => generated 333 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:30.712022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.723937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce25e0-5d9d-46e2-9c01-845ec4a55c27 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.730180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.730991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.731285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.731729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.733335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=42f471eed79a40b8af74b9171d3f2b0c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.734513 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.734513 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:30.734513 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:30.736537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.744711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1463/2917] 10.222.0.16 () {58 vars in 1291 bytes} [Sat Oct 29 02:54:30 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c => generated 0 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 29 02:54:30.748988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.761224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac7e99-6cb8-45cd-86cc-6e5889064d8b tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.767762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.768479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.768894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.769238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.769834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=42f471eed79a40b8af74b9171d3f2b0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.771629 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.771629 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:30.771629 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:30.773118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.788514 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1455/2918] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:54:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:30.793647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.805711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2a571-fb8a-44a8-a684-42b0435803a8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.810694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.811446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.811797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.812134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.812919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.814656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.825032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.835923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b11173-ac60-47ee-9261-06e2e31bdc5e tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.836616 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1464/2919] 10.222.0.16 () {58 vars in 1191 bytes} [Sat Oct 29 02:54:30 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:30.841929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.842714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.843092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.843405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.844119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=42f471eed79a40b8af74b9171d3f2b0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.845910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Could not find Endpoint Group: 42f471eed79a40b8af74b9171d3f2b0c.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 42f471eed79a40b8af74b9171d3f2b0c. Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 29 02:54:30.858750 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 29 02:54:30.859895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 29 02:54:30.859895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 29 02:54:30.859895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 29 02:54:30.859895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 29 02:54:30.859895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 42f471eed79a40b8af74b9171d3f2b0c. Oct 29 02:54:30.859895 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 02:54:30.866612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.874214 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1456/2920] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:54:30 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/42f471eed79a40b8af74b9171d3f2b0c => generated 120 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 02:54:30.881239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8155210-e015-4189-a377-c26bb3e6ad7d tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:30.892388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:30.893149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:30.893500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:30.893954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services/d684fa33047e407cafe6777c8b541597` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:30.894534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d684fa33047e407cafe6777c8b541597)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:30.895705 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:30.895705 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:30.895705 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:30.897663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:30.944430 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1465/2921] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:30 2022] DELETE /identity/v3/services/d684fa33047e407cafe6777c8b541597 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:30.945200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:30.961791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487792-9e89-4f38-9672-1ea9986ddf96 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.012951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.016053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.017494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.018057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.032767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.035305 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:31.035305 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:31.035305 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:31.036988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.079195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.091893 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1457/2922] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:30 2022] POST /identity/v3/services => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:31.094677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae37ff-88a1-4c67-8e58-27bd84b44db1 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.116103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:31.135591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.136663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.137123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.137679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.138648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.141083 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:31.141083 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:31.141083 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:31.142576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.166668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.167983 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1466/2923] 10.222.0.16 () {60 vars in 1213 bytes} [Sat Oct 29 02:54:31 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:31.182663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ef92-05c4-4499-813c-b07535eb376f tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.189604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.190292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.190972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.191260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.191981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.193984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.250197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.256875 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1458/2924] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:31 2022] POST /identity/v3/services => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:31.265022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a4414-376e-43f4-a1bb-2ade4e2b73c7 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.295998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.297836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.298413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.298909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93aefc2c6ae84c2e8e1890a7109fe5da` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.299867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=93aefc2c6ae84c2e8e1890a7109fe5da)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.301137 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:31.301137 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:31.301137 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:31.302456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.340484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.350153 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1467/2925] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Oct 29 02:54:31 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/93aefc2c6ae84c2e8e1890a7109fe5da => generated 335 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:31.357410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b4601-bf88-4aab-971b-5503750c28da tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.384335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.385043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.386404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.386686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services/b87c00fa8fcd42d4ba2f731e88b77a45` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.388741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b87c00fa8fcd42d4ba2f731e88b77a45)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.391454 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:31.391454 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:31.391454 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:31.393112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.450260 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1459/2926] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:31 2022] DELETE /identity/v3/services/b87c00fa8fcd42d4ba2f731e88b77a45 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:31.454419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.486294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826871e-1b40-4047-9fb8-bce0e8df6492 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.499365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.500480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.500769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.501048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/93aefc2c6ae84c2e8e1890a7109fe5da` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.501649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=93aefc2c6ae84c2e8e1890a7109fe5da)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.503079 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:31.503079 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:31.503079 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:31.503617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.516849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1468/2927] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:54:31 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/93aefc2c6ae84c2e8e1890a7109fe5da => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:31.521579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.544706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f28b7e-5ac7-4509-b1b9-a14b18b805d8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.560536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.561678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.571984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.572467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services/1b1e5ba021ee429d847b5d46632fb63e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.573205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1b1e5ba021ee429d847b5d46632fb63e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.575855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.621127 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1460/2928] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:31 2022] DELETE /identity/v3/services/1b1e5ba021ee429d847b5d46632fb63e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:31.626481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.636677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05215c2-be47-40d4-b216-5b29351a3c23 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.670583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.671454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.672130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.672616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e00a39df3e1f4368adacb4d830f41af1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.673460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e00a39df3e1f4368adacb4d830f41af1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.675343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.697880 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1469/2929] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 02:54:31 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e00a39df3e1f4368adacb4d830f41af1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:31.700148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:31.714522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0d07c-e9a4-4c3f-a78d-9ba6b4feb9e8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:31.722321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f894904-7226-4151-ab89-bc6d5182e2f8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75d5d98bc2704336b245f61d8b5a411b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5abf156f3ac540ed884e57cef8c471a0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:31.723027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894904-7226-4151-ab89-bc6d5182e2f8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:31.723633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894904-7226-4151-ab89-bc6d5182e2f8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:31.723996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f894904-7226-4151-ab89-bc6d5182e2f8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] PATH_INFO: `/v3/services/421ae06fbd664aacabcdc326346106d9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:31.724591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894904-7226-4151-ab89-bc6d5182e2f8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorizing `identity:delete_service(service_id=421ae06fbd664aacabcdc326346106d9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:31.727683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f894904-7226-4151-ab89-bc6d5182e2f8 tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:31.787778 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1461/2930] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:31 2022] DELETE /identity/v3/services/421ae06fbd664aacabcdc326346106d9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:31.789779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:32.040116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df27b44-17b5-41e7-8ad3-d280d54b135a tempest-EndPointGroupsTest-835078778 tempest-EndPointGroupsTest-835078778-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:32.067274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:32.068254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:32.069320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:32.069688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] PATH_INFO: `/v3/users/c541a664443d497eb223d10ed2cdf3cb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:32.071800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c541a664443d497eb223d10ed2cdf3cb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:32.073830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:32.142180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c541a664443d497eb223d10ed2cdf3cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:32.160292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c541a664443d497eb223d10ed2cdf3cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:32.161379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c541a664443d497eb223d10ed2cdf3cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:32.170699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=13 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:32.173693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c541a664443d497eb223d10ed2cdf3cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:32.174958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c541a664443d497eb223d10ed2cdf3cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:32.206058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1470/2931] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:31 2022] DELETE /identity/v3/users/c541a664443d497eb223d10ed2cdf3cb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:32.210480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:32.211148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:32.211601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:32.268412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:32.271274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:32.437737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1462/2932] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:32.459233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:32.460693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:32.626791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e9a97-947e-41d1-b710-9b2176f4ad54 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:32.639481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:32.640739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:32.641069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:32.641378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:32.665155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:32.667212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:32.698134 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1471/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:34.427938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:34.430810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:34.447203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:34.457031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0391b-5ec1-4937-8b8f-cd03239d4268 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:34.465165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:34.466252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:34.466774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:34.467343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] PATH_INFO: `/v3/projects/584b1a41ffcb4542bad9813c7751e6f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:34.468984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=584b1a41ffcb4542bad9813c7751e6f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:34.472118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:34.626760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584b1a41ffcb4542bad9813c7751e6f4', 'request_id': 'req-b64a86cd-02ea-43e6-bc3f-f54c6e916434'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:34.641618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584b1a41ffcb4542bad9813c7751e6f4', 'request_id': 'req-b64a86cd-02ea-43e6-bc3f-f54c6e916434'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:34.660141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584b1a41ffcb4542bad9813c7751e6f4', 'request_id': 'req-b64a86cd-02ea-43e6-bc3f-f54c6e916434'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:34.685661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] The token cache is being invalidate because project 584b1a41ffcb4542bad9813c7751e6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:34.686092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:34.686948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b64a86cd-02ea-43e6-bc3f-f54c6e916434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:34.694119 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1463/2934] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:34 2022] DELETE /identity/v3/projects/584b1a41ffcb4542bad9813c7751e6f4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:34.695903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:34.710902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f6c37-5e78-4c67-bfce-9280c479c464 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:34.797142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:34.798138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:34.798419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:34.798691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] PATH_INFO: `/v3/users/75d5d98bc2704336b245f61d8b5a411b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:34.800417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d5d98bc2704336b245f61d8b5a411b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:34.802833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:34.965998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d5d98bc2704336b245f61d8b5a411b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:35.000794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d5d98bc2704336b245f61d8b5a411b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:35.002869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d5d98bc2704336b245f61d8b5a411b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:35.047902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d5d98bc2704336b245f61d8b5a411b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:35.052364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d5d98bc2704336b245f61d8b5a411b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:35.088244 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1472/2935] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:34 2022] DELETE /identity/v3/users/75d5d98bc2704336b245f61d8b5a411b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:35.424441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e59b-b575-4006-85ba-f62186324051 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:35.428401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e59b-b575-4006-85ba-f62186324051 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:35.431923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56e59b-b575-4006-85ba-f62186324051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:35.522433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-af56e59b-b575-4006-85ba-f62186324051 None None] MFA Rules not processed for user `5b42df0e125d40ab9d1264c5b3c94ed1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:35.527661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af56e59b-b575-4006-85ba-f62186324051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:35.712368 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1464/2936] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:36.129423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:36.130986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:36.138394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:36.308852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56e59b-b575-4006-85ba-f62186324051 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:36.311355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af56e59b-b575-4006-85ba-f62186324051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:36.371395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e879-a5be-41ba-b02b-3b192162c088 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:36.380072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e6eb1-ad90-42d3-97c8-ecf0a6fe6b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:36.380693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e6eb1-ad90-42d3-97c8-ecf0a6fe6b6a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:36.381525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e6eb1-ad90-42d3-97c8-ecf0a6fe6b6a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:36.381837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e6eb1-ad90-42d3-97c8-ecf0a6fe6b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:36.395466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e6eb1-ad90-42d3-97c8-ecf0a6fe6b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:36.398326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e6eb1-ad90-42d3-97c8-ecf0a6fe6b6a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:36.414405 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1473/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:36.474234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56e59b-b575-4006-85ba-f62186324051 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:36.481409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:36.482107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:36.482383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:36.482710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] PATH_INFO: `/v3/projects/5abf156f3ac540ed884e57cef8c471a0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:36.484135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5abf156f3ac540ed884e57cef8c471a0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:36.486466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:36.527962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:36.614444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5abf156f3ac540ed884e57cef8c471a0', 'request_id': 'req-ae376359-c003-445d-87e9-9c275b47c76c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:36.639448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5abf156f3ac540ed884e57cef8c471a0', 'request_id': 'req-ae376359-c003-445d-87e9-9c275b47c76c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:36.673589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5abf156f3ac540ed884e57cef8c471a0', 'request_id': 'req-ae376359-c003-445d-87e9-9c275b47c76c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:36.719725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] The token cache is being invalidate because project 5abf156f3ac540ed884e57cef8c471a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:36.722125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:36.726777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ae376359-c003-445d-87e9-9c275b47c76c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:36.733945 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1465/2938] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:36 2022] DELETE /identity/v3/projects/5abf156f3ac540ed884e57cef8c471a0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:36.735733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:36.736611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:36.736911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:36.785019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:36.787098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:36.904275 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1474/2939] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:36.914918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:36.915624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:36.916077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:36.984352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:36.988299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:37.008746 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1466/2940] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:37.013329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.028554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c759a-6556-450b-b9e4-fc99afbd8886 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.041032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.042108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.042849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.043440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.044582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:37.045268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.048199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:37.065587 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1475/2941] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:37.070430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.084437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788a0fe-1f1c-4976-ac6c-358f6b6ba415 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.103985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.105129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.105571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.106191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.107035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.109436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:37.175562 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1467/2942] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:37 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:37.177071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.194546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7292fc-ba2c-4da7-b40d-5823c1a7cfcf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.404414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.408861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.409376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.409938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.410884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.413364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:37.433513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:37.458492 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1476/2943] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:37 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:37.464349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.483115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3135b0d-44d1-46f4-b3a7-534080044fad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.499455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.499455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.499455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.499455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.504956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.504956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:37.527266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1468/2944] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:37.529670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.547203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db98a3-034f-4ad5-abaf-df59ef330c21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.556620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fcaab-5efd-44a6-9476-92e7de44101a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.557640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fcaab-5efd-44a6-9476-92e7de44101a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.562180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fcaab-5efd-44a6-9476-92e7de44101a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.562783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fcaab-5efd-44a6-9476-92e7de44101a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.563817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fcaab-5efd-44a6-9476-92e7de44101a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.567683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fcaab-5efd-44a6-9476-92e7de44101a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:37.596541 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1477/2945] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:37.601458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.616278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71891f1f-c0d9-4071-b966-9038def50d2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.627843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.628779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.629387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.630491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] PATH_INFO: `/v3/projects/f94801ae769e49b8b228888634b83c7d/users/ad7131f34cb54caa93a6cdbe4d740da6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.650137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94801ae769e49b8b228888634b83c7d, user_id=ad7131f34cb54caa93a6cdbe4d740da6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.656952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:37.686397 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1469/2946] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:37 2022] PUT /identity/v3/projects/f94801ae769e49b8b228888634b83c7d/users/ad7131f34cb54caa93a6cdbe4d740da6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:37.701157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.701409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.701715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.737425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] MFA Rules not processed for user `ad7131f34cb54caa93a6cdbe4d740da6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:37.738958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:37.844852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1478/2947] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:37.850184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:37.943862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ac68c-5ed0-4aa0-9b52-1477f3c25690 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:37.951391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:37.952167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:37.952547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:37.953002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:37.953839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:37.957325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.001431 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1470/2948] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:37 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:38.006412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.023315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56024ce-f145-4231-b4db-2cc7c077d864 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.180496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.181939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.182491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.182950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.183763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.186710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.223860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1479/2949] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:38 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:38.228608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.242111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367ff93-8431-4b81-b78d-eacdb12d171e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.257346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.260457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.260770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.261101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.261852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.267747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.295013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.308035 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1471/2950] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:54:38.314737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f58f7b-77ad-4d27-ab78-8c7cd7b0cae0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.324256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.326226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.326391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.326653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] PATH_INFO: `/v3/projects/d1eef19a74064c0f923f6ab392ba334f/users/a7fa1fa2094c4ad7969c702730183e64/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.351565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1eef19a74064c0f923f6ab392ba334f, user_id=a7fa1fa2094c4ad7969c702730183e64, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.356773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.386451 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1480/2951] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:38 2022] PUT /identity/v3/projects/d1eef19a74064c0f923f6ab392ba334f/users/a7fa1fa2094c4ad7969c702730183e64/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:38.390983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.401453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb08a5-69f5-46bd-ae24-4540171a5fbb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.416843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:38.500464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0e805-a150-4ee3-8cb2-3c3fcfd4fe9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.502616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e805-a150-4ee3-8cb2-3c3fcfd4fe9e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.503060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e805-a150-4ee3-8cb2-3c3fcfd4fe9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.503513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0e805-a150-4ee3-8cb2-3c3fcfd4fe9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.504323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0e805-a150-4ee3-8cb2-3c3fcfd4fe9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.506184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0e805-a150-4ee3-8cb2-3c3fcfd4fe9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.531965 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1472/2952] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:38.536328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.576363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47abfd-89ee-4b10-a231-251ac241c8ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.582926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.583338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.583833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.584056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] PATH_INFO: `/v3/projects/d1eef19a74064c0f923f6ab392ba334f/users/a7fa1fa2094c4ad7969c702730183e64/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.590147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1eef19a74064c0f923f6ab392ba334f, user_id=a7fa1fa2094c4ad7969c702730183e64, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.602601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.635241 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1481/2953] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:38 2022] PUT /identity/v3/projects/d1eef19a74064c0f923f6ab392ba334f/users/a7fa1fa2094c4ad7969c702730183e64/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:38.647662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.652958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.653347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.696921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] MFA Rules not processed for user `a7fa1fa2094c4ad7969c702730183e64`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:38.698037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:38.822388 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1473/2954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:38.827396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.843604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a707af-6135-43b1-857d-4d1dc8cd203f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.849590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.850517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.850864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.851229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.852385 n-d-862964-4 devstack@keystone.service[82079]: WARNING oslo_log.versionutils [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:38.852978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.854304 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:38.854304 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:38.854304 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:38.857559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.903811 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1482/2955] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:38 2022] POST /identity/v3/policies => generated 229 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:38.907777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.917541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e6303-cdd5-4de1-8090-2af602705a25 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.923995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.925397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.925685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.925991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies/5cfd184fb3fe4758a3254111f247cf75` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:38.927128 n-d-862964-4 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:38.928407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=5cfd184fb3fe4758a3254111f247cf75)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:38.930331 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:38.930331 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:38.930331 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:38.931302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:38.975011 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1474/2956] 10.222.0.16 () {60 vars in 1252 bytes} [Sat Oct 29 02:54:38 2022] PATCH /identity/v3/policies/5cfd184fb3fe4758a3254111f247cf75 => generated 236 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:38.979929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:38.992397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dbfa88-08ba-4286-b468-6ad1e6e2460e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:38.998381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:38.999043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:38.999420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:38.999701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies/5cfd184fb3fe4758a3254111f247cf75` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.000675 n-d-862964-4 devstack@keystone.service[82079]: WARNING oslo_log.versionutils [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:39.001619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=5cfd184fb3fe4758a3254111f247cf75)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.003011 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:39.003011 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:39.003011 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:39.004019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.021048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.028113 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1483/2957] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 02:54:38 2022] GET /identity/v3/policies/5cfd184fb3fe4758a3254111f247cf75 => generated 236 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:39.033789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa268598-588b-43ec-bf2b-21bbfab5d70b tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.040464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.041204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.041492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.041895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies/5cfd184fb3fe4758a3254111f247cf75` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.042872 n-d-862964-4 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:39.043531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=5cfd184fb3fe4758a3254111f247cf75)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.044854 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:39.044854 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:39.044854 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:39.045773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.082688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.083815 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1475/2958] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:39 2022] DELETE /identity/v3/policies/5cfd184fb3fe4758a3254111f247cf75 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:39.090803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:39.097490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ce9f8-9fcc-4710-80e6-828a0525ec4e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.115890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.117756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.118126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.120248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.124560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.129420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.169680 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1484/2959] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:39 2022] POST /identity/v3/policies => generated 230 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:39.174343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.191485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7046a1-38af-48e8-b392-5016583948ff tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.203867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.204480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.205207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.205207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.210920 n-d-862964-4 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:39.211363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.214512 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:39.214512 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:39.214512 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:39.215445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.286608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.291323 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1476/2960] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:39 2022] POST /identity/v3/policies => generated 230 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:39.302730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9bc86-462a-419d-b5ed-6dbf830883cb tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.320796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.325354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.325693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.325973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.327193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.329178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.366725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.378025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1485/2961] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:39 2022] POST /identity/v3/policies => generated 228 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:39.423711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627a483-32bb-4c36-85be-0ce59170c485 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.445503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.446761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.447197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.447622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.452746 n-d-862964-4 devstack@keystone.service[82080]: WARNING oslo_log.versionutils [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:39.453442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.457998 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:39.457998 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 02:54:39.457998 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 02:54:39.459290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.526607 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1477/2962] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 02:54:39 2022] GET /identity/v3/policies => generated 764 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:54:39.531264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.547150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c234979-34d8-4f85-b521-ccac5f190797 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.565521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.566269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.566553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.566934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies/b96549a317944e1fb0e452ad619f64b9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.567745 n-d-862964-4 devstack@keystone.service[82079]: WARNING oslo_log.versionutils [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 29 02:54:39.568362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b96549a317944e1fb0e452ad619f64b9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.569618 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:39.569618 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:39.569618 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:39.575042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.621913 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1486/2963] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:39 2022] DELETE /identity/v3/policies/b96549a317944e1fb0e452ad619f64b9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:39.626761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.652791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d567fdfc-54d6-40dc-a3f3-858d5c1cdc28 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.670837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.671498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.671833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.672108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies/de3ef9386efd4913b7c467a6f42cbe22` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.673198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=de3ef9386efd4913b7c467a6f42cbe22)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.678192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.722100 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1478/2964] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:39 2022] DELETE /identity/v3/policies/de3ef9386efd4913b7c467a6f42cbe22 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:39.725433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.740755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee4023-5f94-4d39-a603-202297f0ad0e tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.743568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e901a7-31d7-41b2-84f3-3556e944b9d8 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7fa1fa2094c4ad7969c702730183e64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd1eef19a74064c0f923f6ab392ba334f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.744909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e901a7-31d7-41b2-84f3-3556e944b9d8 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.746049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e901a7-31d7-41b2-84f3-3556e944b9d8 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.746548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e901a7-31d7-41b2-84f3-3556e944b9d8 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] PATH_INFO: `/v3/policies/abde373970604e1289193094e22e5a9d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.748136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e901a7-31d7-41b2-84f3-3556e944b9d8 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=abde373970604e1289193094e22e5a9d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.750068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e901a7-31d7-41b2-84f3-3556e944b9d8 tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:39.768803 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1487/2965] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:39 2022] DELETE /identity/v3/policies/abde373970604e1289193094e22e5a9d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:39.777487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:39.900513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:39.973626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f58a-27f8-4ae9-86aa-5a7614ed480a tempest-PoliciesTestJSON-2122966931 tempest-PoliciesTestJSON-2122966931-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:39.978961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:39.979633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:39.979909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:39.980180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] PATH_INFO: `/v3/users/ad7131f34cb54caa93a6cdbe4d740da6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:39.981591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7131f34cb54caa93a6cdbe4d740da6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:39.983679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:40.091605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7131f34cb54caa93a6cdbe4d740da6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:40.108994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7131f34cb54caa93a6cdbe4d740da6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:40.110269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7131f34cb54caa93a6cdbe4d740da6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:40.126574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7131f34cb54caa93a6cdbe4d740da6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:40.128249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7131f34cb54caa93a6cdbe4d740da6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:40.172953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1479/2966] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:39 2022] DELETE /identity/v3/users/ad7131f34cb54caa93a6cdbe4d740da6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:40.179705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4afb4-f329-4310-a8ff-10a2ba7b6027 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:40.179998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4afb4-f329-4310-a8ff-10a2ba7b6027 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:40.180386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4afb4-f329-4310-a8ff-10a2ba7b6027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:40.217596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3cf4afb4-f329-4310-a8ff-10a2ba7b6027 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:40.222443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3cf4afb4-f329-4310-a8ff-10a2ba7b6027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:40.391640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1488/2967] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:40.402650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:40.404607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:40.572824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d13c7-75b6-488d-8cdb-9f1a7479c2ee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:40.590535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:40.591299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:40.591582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:40.591858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:40.644090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:40.648503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:40.677666 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1480/2968] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:41.329047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:41.329399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:41.329675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:41.378098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:41.379828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:41.522339 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1489/2969] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:54:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:41.569220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:41.570760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:41.739526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:41.741085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:41.754927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:41.770340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c858bc7f-ac76-4027-bc58-426568c9e9c8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:41.780172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:41.781459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:41.781459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:41.781745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] PATH_INFO: `/v3/projects/f94801ae769e49b8b228888634b83c7d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:41.784321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94801ae769e49b8b228888634b83c7d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:41.789977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:41.869740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9595dc-ed1f-4921-bea9-c68a80678cf8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:41.884216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:41.884852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:41.885124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:41.885395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:41.886040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:41.902001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94801ae769e49b8b228888634b83c7d', 'request_id': 'req-5daea0e9-2cd2-496b-be61-2668a02c5810'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:41.905284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:41.908251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:41.918412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94801ae769e49b8b228888634b83c7d', 'request_id': 'req-5daea0e9-2cd2-496b-be61-2668a02c5810'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:41.936460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94801ae769e49b8b228888634b83c7d', 'request_id': 'req-5daea0e9-2cd2-496b-be61-2668a02c5810'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:41.948574 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1481/2970] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:54:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:54:41.972393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] The token cache is being invalidate because project f94801ae769e49b8b228888634b83c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:41.974856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:41.977099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:41.981978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1490/2971] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:41 2022] DELETE /identity/v3/projects/f94801ae769e49b8b228888634b83c7d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:41.986352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:42.015739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9902a7-75c7-42c3-9123-88fd93d0f3b5 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:42.145518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:42.146511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:42.147630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:42.148459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] PATH_INFO: `/v3/users/a7fa1fa2094c4ad7969c702730183e64` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:42.150551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fa1fa2094c4ad7969c702730183e64)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:42.153748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:42.260611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fa1fa2094c4ad7969c702730183e64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:42.283297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fa1fa2094c4ad7969c702730183e64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:42.285575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fa1fa2094c4ad7969c702730183e64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:42.302292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fa1fa2094c4ad7969c702730183e64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:42.303581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-50bf3ce4-8d39-448f-bffa-5eeb271c4fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fa1fa2094c4ad7969c702730183e64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:42.357946 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1482/2972] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:41 2022] DELETE /identity/v3/users/a7fa1fa2094c4ad7969c702730183e64 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:42.974549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:42.976035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:43.011041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daea0e9-2cd2-496b-be61-2668a02c5810 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:43.291433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:43.292991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:43.293423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:43.293860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] PATH_INFO: `/v3/projects/d1eef19a74064c0f923f6ab392ba334f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:43.296196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1eef19a74064c0f923f6ab392ba334f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:43.298872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:43.412539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1eef19a74064c0f923f6ab392ba334f', 'request_id': 'req-6ef875dc-5849-4327-a739-5e164bd63462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:43.427313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1eef19a74064c0f923f6ab392ba334f', 'request_id': 'req-6ef875dc-5849-4327-a739-5e164bd63462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:43.442838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1eef19a74064c0f923f6ab392ba334f', 'request_id': 'req-6ef875dc-5849-4327-a739-5e164bd63462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:43.469542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] The token cache is being invalidate because project d1eef19a74064c0f923f6ab392ba334f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:43.469883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:43.472347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ef875dc-5849-4327-a739-5e164bd63462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:43.480311 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1491/2973] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:42 2022] DELETE /identity/v3/projects/d1eef19a74064c0f923f6ab392ba334f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:43.482222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:43.482723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:43.482798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:43.523624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:43.524661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:43.701098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:43.754784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1483/2974] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:43.756736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:43.757102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:43.757411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:43.821852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:43.823141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:43.867060 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1492/2975] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:43.870310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:43.891456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b91ec-2aa0-43b5-85b7-0312391fc816 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:43.902768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:43.904970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:43.905406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:43.905884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:43.906907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:43.907354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:43.917841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:43.960326 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1484/2976] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:43.960580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:43.977684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70253b4-875f-4c7c-9f75-2cd476a46c34 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:44.003659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:44.007558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:44.007940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:44.008896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:44.010994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:44.014036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:44.107408 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1493/2977] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:43 2022] POST /identity/v3/projects => generated 395 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:44.111564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:44.137321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9a014-13f5-44a8-bb8c-8f4de21cb6dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:44.274227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:44.276188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:44.372159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:44.382938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:44.386562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:44.386964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:44.397794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:44.398578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:44.400642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:44.499974 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1485/2978] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:44 2022] POST /identity/v3/users => generated 298 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:44.501940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:44.511955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8c98a-ab7e-4421-b4bb-7ce9612fac4e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:44.532448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:44.533134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:44.533412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:44.533683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] PATH_INFO: `/v3/users/5d2e129a84e847a0b5c80ad47ca4d233` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:44.550831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2e129a84e847a0b5c80ad47ca4d233)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:44.552750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:44.565256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0105a6-4093-4692-991e-05b0a66cadb0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:44.599972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:44.603233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:44.608869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:44.610867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:44.617398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:44.619992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:44.647629 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1486/2979] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:44.661742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:44.672154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2e129a84e847a0b5c80ad47ca4d233'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:44.700052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eacbfd-5803-434a-bfae-d658beb2f51e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:44.715496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2e129a84e847a0b5c80ad47ca4d233'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:44.724624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2e129a84e847a0b5c80ad47ca4d233'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:44.728009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5797ca-4236-4f07-9478-aa21f8590aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:44.728173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5797ca-4236-4f07-9478-aa21f8590aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:44.733144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5797ca-4236-4f07-9478-aa21f8590aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:44.734293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5797ca-4236-4f07-9478-aa21f8590aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:44.738140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5797ca-4236-4f07-9478-aa21f8590aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:44.747949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2e129a84e847a0b5c80ad47ca4d233'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:44.754504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5797ca-4236-4f07-9478-aa21f8590aa6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:44.756154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2e129a84e847a0b5c80ad47ca4d233'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:44.775842 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1494/2980] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:44 2022] DELETE /identity/v3/users/5d2e129a84e847a0b5c80ad47ca4d233 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:44.801664 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1487/2981] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:44.806034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:44.806034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:44.966999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2558c-341b-4798-9129-709778b8b9c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:44.972875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:44.973575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:44.973900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:44.974173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] PATH_INFO: `/v3/projects/48d9c0fba73a4d50b8e2d8292406c46f/users/515107a9473a4848847f70a4a77699a0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:45.008637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48d9c0fba73a4d50b8e2d8292406c46f, user_id=515107a9473a4848847f70a4a77699a0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:45.010921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:45.050115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1495/2982] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:44 2022] PUT /identity/v3/projects/48d9c0fba73a4d50b8e2d8292406c46f/users/515107a9473a4848847f70a4a77699a0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:45.051779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:45.055382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:45.055834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:45.198555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] MFA Rules not processed for user `515107a9473a4848847f70a4a77699a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:45.199829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:45.503769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:45.504455 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1488/2983] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:45.600933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:45.667772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910576a-2b8e-4e05-bf19-588d5a5200b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:45.679523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:45.680317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:45.680746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:45.681118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:45.685179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:45.687648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:45.750175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1496/2984] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:45 2022] POST /identity/v3/projects => generated 395 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:45.754197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:45.779334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c68f21-9d1a-4d71-8358-efb9e884032a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:45.867710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:45.919546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:45.922339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:45.922865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:45.923214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:45.923888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:45.926064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:46.016688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1489/2985] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:45 2022] POST /identity/v3/users => generated 304 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:46.018445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:46.054845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772fc36-aad3-4761-a1bf-aef3b5bddf38 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:46.090590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:46.093075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:46.094092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:46.095932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:46.096939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:46.100893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:46.131775 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1497/2986] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:46.166543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:46.195906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aba7c4-0c3a-40e8-81b5-4fab751f0133 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:46.211245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:46.214715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:46.215189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:46.215481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] PATH_INFO: `/v3/projects/b237dbe568334799984ac86299e4c012/users/f4dc34742d074765a63e43abccf7cd81/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:46.261276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b237dbe568334799984ac86299e4c012, user_id=f4dc34742d074765a63e43abccf7cd81, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:46.268998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:46.301307 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1490/2987] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:46 2022] PUT /identity/v3/projects/b237dbe568334799984ac86299e4c012/users/f4dc34742d074765a63e43abccf7cd81/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:46.306637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:46.334334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aecaf1-6184-4098-adae-d86bcddf19b2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:46.571474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bfc5f7-d3b4-4902-8774-1f972c99944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:46.572434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfc5f7-d3b4-4902-8774-1f972c99944a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:46.572434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfc5f7-d3b4-4902-8774-1f972c99944a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:46.572849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bfc5f7-d3b4-4902-8774-1f972c99944a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:46.573846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfc5f7-d3b4-4902-8774-1f972c99944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:46.575746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bfc5f7-d3b4-4902-8774-1f972c99944a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:46.618780 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1498/2988] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:46.623899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:46.645306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d018ecb-621c-471c-8a8e-93e6b0ede7f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:46.657272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:46.659670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:46.660107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:46.661233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] PATH_INFO: `/v3/projects/b237dbe568334799984ac86299e4c012/users/f4dc34742d074765a63e43abccf7cd81/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:46.666221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b237dbe568334799984ac86299e4c012, user_id=f4dc34742d074765a63e43abccf7cd81, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:46.677080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:46.711775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1491/2989] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:46 2022] PUT /identity/v3/projects/b237dbe568334799984ac86299e4c012/users/f4dc34742d074765a63e43abccf7cd81/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:46.723800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:46.724094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:46.724428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:46.730941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:46.732968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:46.846453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] MFA Rules not processed for user `f4dc34742d074765a63e43abccf7cd81`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:46.854772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:46.943566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c1eb-4698-4aea-b24f-940d5d4d7d09 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:46.961590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:46.962790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:46.963187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:46.965908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] PATH_INFO: `/v3/projects/d86df8edf5044361a65c11542c2dc585` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:46.980556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86df8edf5044361a65c11542c2dc585)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:46.986240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:47.061255 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1499/2990] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:47.062976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.142320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:47.162613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86df8edf5044361a65c11542c2dc585', 'request_id': 'req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:47.178726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86df8edf5044361a65c11542c2dc585', 'request_id': 'req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:47.195065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86df8edf5044361a65c11542c2dc585', 'request_id': 'req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:47.217026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8134e-0852-4b83-b863-4e9fe6a47a6e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:47.228069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] The token cache is being invalidate because project d86df8edf5044361a65c11542c2dc585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:47.241777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:47.247080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e4ae1df-34f2-44a1-9c56-a4991c4470a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:47.255437 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1492/2991] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:46 2022] DELETE /identity/v3/projects/d86df8edf5044361a65c11542c2dc585 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:47.262537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daab1b-eeac-4a2b-845a-e49c143055c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.263341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daab1b-eeac-4a2b-845a-e49c143055c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.265118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03daab1b-eeac-4a2b-845a-e49c143055c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.326730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03daab1b-eeac-4a2b-845a-e49c143055c7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:47.328442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03daab1b-eeac-4a2b-845a-e49c143055c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:47.354612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515107a9473a4848847f70a4a77699a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c0fba73a4d50b8e2d8292406c46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:47.355240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.355530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.355803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.356444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 29 02:54:47.372837 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 29 02:54:47.373705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.381016 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1500/2992] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/projects => generated 136 bytes in 318 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 29 02:54:47.381725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.392082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:47.413097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:47.587278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1493/2993] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:47.604467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.605057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.605535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.629964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd290f1c-f6ad-4dd3-a5f4-2851038b7f68 tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:47.647334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc34742d074765a63e43abccf7cd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b237dbe568334799984ac86299e4c012', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:47.652257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:47.653534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.654439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:47.654844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.660081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.660931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:47.663091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invalid input for field 'name': '' is too short Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'minLength' in schema['properties']['name']: Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: On instance['name']: Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'minLength' in schema['properties']['name']: Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: On instance['name']: Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: '' Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application '' Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.689394 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 02:54:47.690875 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application '' Oct 29 02:54:47.692297 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.694307 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1501/2994] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/projects => generated 283 bytes in 313 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 02:54:47.717940 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1494/2995] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:47.718446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.719875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.731371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b4412-e096-4c9e-bd0b-cce7e10f1ccd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:47.738834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:47.739775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.740231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.740680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.741515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:47.742054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:47.745667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:47.754738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7f98b-8a7c-4dc5-9ebe-e50866ee693b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:47.776065 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1495/2996] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:54:47.778173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.784568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc34742d074765a63e43abccf7cd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b237dbe568334799984ac86299e4c012', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:47.788025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.792099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.792488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.795414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:47.799662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:47.825054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b51d1d-c390-4928-9383-85160cb9ad4d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:47.831556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:47.834854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.835002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.835911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.837173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:47.839152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'maxLength' in schema['properties']['name']: Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: On instance['name']: Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'maxLength' in schema['properties']['name']: Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: On instance['name']: Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 29 02:54:47.857907 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:47.859508 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 02:54:47.860637 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:47.863612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1502/2997] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/projects => generated 412 bytes in 154 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 02:54:47.876198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.897788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03413f-caf5-4fee-9890-4302836f7dfc tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:47.923934 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1496/2998] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/projects => generated 379 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:47.924969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:47.929428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc34742d074765a63e43abccf7cd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b237dbe568334799984ac86299e4c012', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:47.936566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:47.937228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:47.938996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] PATH_INFO: `/v3/projects/3bb17b21eec045b4832118657b2c0bf3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:47.974663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3bb17b21eec045b4832118657b2c0bf3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:47.987769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Could not find project: 3bb17b21eec045b4832118657b2c0bf3.: keystone.exception.ProjectNotFound: Could not find project: 3bb17b21eec045b4832118657b2c0bf3. Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 29 02:54:48.039223 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3bb17b21eec045b4832118657b2c0bf3. Oct 29 02:54:48.040144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.048514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1503/2999] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:47 2022] DELETE /identity/v3/projects/3bb17b21eec045b4832118657b2c0bf3 => generated 113 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 02:54:48.049615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.055347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:48.100822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89069b-e072-4fac-ab33-c6c30052f30b tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.123673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6cb6e-3082-4288-9d77-0a0b47133658 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.134815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.139315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.139702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.140048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.141161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.147400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.218711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '515107a9473a4848847f70a4a77699a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48d9c0fba73a4d50b8e2d8292406c46f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.219450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.219794 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1497/3000] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:47 2022] POST /identity/v3/users => generated 290 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:48.219939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.221030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.221325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.221933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 29 02:54:48.231767 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._list_projects() Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 29 02:54:48.232903 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.248183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b28fe-fac3-404c-9c3e-727a6cb5afe5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.249285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1504/3001] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 02:54:48 2022] GET /identity/v3/projects => generated 135 bytes in 200 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 29 02:54:48.257282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.266144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.267020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.267463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.267870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.268652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.270446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.300074 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1498/3002] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:48.301293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.328658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b82513d-7327-4778-8392-13e615a0bc87 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.329863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:48.343306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.343948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.344221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.344477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.347527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.349465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.377118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1499/3003] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:48.382922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.404837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19c247-a032-41ff-83af-c7d32b080d44 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.417637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff5f5-1a6a-4aee-afa8-da1b65223480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.418337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff5f5-1a6a-4aee-afa8-da1b65223480 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.418612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff5f5-1a6a-4aee-afa8-da1b65223480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.418879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff5f5-1a6a-4aee-afa8-da1b65223480 admin admin] PATH_INFO: `/v3/projects/616962eaa7c0469bb81953b54e70afad/users/fceb096cc5414b3a9d7300fefeb90dff/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.446983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc987c0-af76-43d4-8294-38e5b45ba87b tempest-ProjectsNegativeStaticTestJSON-599450193 tempest-ProjectsNegativeStaticTestJSON-599450193-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.461061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc34742d074765a63e43abccf7cd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b237dbe568334799984ac86299e4c012', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.462112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.462394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.462669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.463307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.466467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.467578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff5f5-1a6a-4aee-afa8-da1b65223480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616962eaa7c0469bb81953b54e70afad, user_id=fceb096cc5414b3a9d7300fefeb90dff, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.470561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff5f5-1a6a-4aee-afa8-da1b65223480 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.498182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1500/3004] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:48 2022] PUT /identity/v3/projects/616962eaa7c0469bb81953b54e70afad/users/fceb096cc5414b3a9d7300fefeb90dff/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:48.503758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.504037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.504309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.541502 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1505/3005] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:48 2022] POST /identity/v3/projects => generated 359 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:48.545862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.550770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:48.551981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:48.587644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:48.685285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8ee34-eae4-407d-b2f1-d2a3dc4f5f79 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.693116 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1501/3006] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:48.700767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.702288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:48.713394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc34742d074765a63e43abccf7cd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b237dbe568334799984ac86299e4c012', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.715085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.719768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.720471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.721393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.724182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.761772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.sql.core [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2115975968' for key 'project.ixu_project_name_domain_id'") Oct 29 02:54:48.761772 n-d-862964-4 devstack@keystone.service[82079]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:54:48.761772 n-d-862964-4 devstack@keystone.service[82079]: [parameters: {'id': '8b5c5f584df9451cbc006a266cb80ba3', 'name': 'tempest-project-dup-2115975968', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 02:54:48.761772 n-d-862964-4 devstack@keystone.service[82079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2115975968, project id 8b5c5f584df9451cbc006a266cb80ba3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2115975968, project id 8b5c5f584df9451cbc006a266cb80ba3. Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:54:48.774670 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-2115975968' for key 'project.ixu_project_name_domain_id'") Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 02:54:48.775503 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application yield resource Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application next(self.gen) Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise self.value Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 02:54:48.776375 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application session.commit() Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.session.flush() Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application compat.raise_( Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 02:54:48.777320 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 02:54:48.778953 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application conn.query(q) Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result.read() Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 02:54:48.779791 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-2115975968' for key 'project.ixu_project_name_domain_id'") Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [parameters: {'id': '8b5c5f584df9451cbc006a266cb80ba3', 'name': 'tempest-project-dup-2115975968', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:48.780874 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-2115975968 at domain ID default. Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:48.781679 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-2115975968, project id 8b5c5f584df9451cbc006a266cb80ba3. Oct 29 02:54:48.786383 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:48.790875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1506/3007] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:48 2022] POST /identity/v3/projects => generated 285 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 02:54:48.795067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:48.808301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7de6d-5b25-4687-8094-d825bd32434d tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.816202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4dc34742d074765a63e43abccf7cd81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b237dbe568334799984ac86299e4c012', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.817522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.818088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.819817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] PATH_INFO: `/v3/projects/67188a549eb1458087e5b74de1d9214f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.823321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorizing `identity:delete_project(project_id=67188a549eb1458087e5b74de1d9214f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.825895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.837771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b097ed-781e-434d-9cbf-22bb7337939c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:48.852429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:48.861021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:48.861319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:48.861736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:48.875611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:48.877512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:48.897045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1502/3008] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:48.966358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67188a549eb1458087e5b74de1d9214f', 'request_id': 'req-29008797-2546-45ee-85aa-ae0ddb241197'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:48.975075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67188a549eb1458087e5b74de1d9214f', 'request_id': 'req-29008797-2546-45ee-85aa-ae0ddb241197'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:48.986724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67188a549eb1458087e5b74de1d9214f', 'request_id': 'req-29008797-2546-45ee-85aa-ae0ddb241197'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.008624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] The token cache is being invalidate because project 67188a549eb1458087e5b74de1d9214f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:49.009080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.011768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-29008797-2546-45ee-85aa-ae0ddb241197 tempest-ProjectsNegativeStaticTestJSON-556703049 tempest-ProjectsNegativeStaticTestJSON-556703049-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.020701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:49.022708 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1507/3009] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:48 2022] DELETE /identity/v3/projects/67188a549eb1458087e5b74de1d9214f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:49.024170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:49.043738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97c86c-2202-4fc1-8e7f-d7913ebb3aa7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:49.187773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:49.188476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:49.188778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:49.189540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] PATH_INFO: `/v3/users/515107a9473a4848847f70a4a77699a0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:49.190827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=515107a9473a4848847f70a4a77699a0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:49.192935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:49.261130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '515107a9473a4848847f70a4a77699a0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.274435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '515107a9473a4848847f70a4a77699a0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.275934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '515107a9473a4848847f70a4a77699a0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.291040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '515107a9473a4848847f70a4a77699a0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.291953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '515107a9473a4848847f70a4a77699a0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:49.294610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:49.335538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:49.336009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:49.336088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:49.339227 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1503/3010] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:49 2022] DELETE /identity/v3/users/515107a9473a4848847f70a4a77699a0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:49.371030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:49.372860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:49.389012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:49.538760 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1508/3011] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:49.562112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:49.563970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:49.806477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cfa6f-7155-44ca-803a-d56aec6a3700 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:49.823667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:49.824457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:49.824863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:49.825041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:49.878914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:49.886548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:49.951867 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1504/3012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:50.949636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:50.951458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:50.977193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:50.979363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:51.031877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf29ec-f74e-422f-8efd-5fa5b7835039 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:51.041896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbc705-9869-48c2-918d-c579067dc3a9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:51.064554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:51.064809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:51.065304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:51.065458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:51.065680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:51.068764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] PATH_INFO: `/v3/projects/48d9c0fba73a4d50b8e2d8292406c46f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:51.068764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48d9c0fba73a4d50b8e2d8292406c46f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:51.071031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:51.072257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:51.073190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] PATH_INFO: `/v3/users/5b42df0e125d40ab9d1264c5b3c94ed1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:51.078230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b42df0e125d40ab9d1264c5b3c94ed1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:51.086160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:51.210898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48d9c0fba73a4d50b8e2d8292406c46f', 'request_id': 'req-d95d5e16-f14b-43fa-81bc-962fcdc4f705'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.218579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b42df0e125d40ab9d1264c5b3c94ed1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.238205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b42df0e125d40ab9d1264c5b3c94ed1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.239459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b42df0e125d40ab9d1264c5b3c94ed1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.254934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48d9c0fba73a4d50b8e2d8292406c46f', 'request_id': 'req-d95d5e16-f14b-43fa-81bc-962fcdc4f705'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.283347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48d9c0fba73a4d50b8e2d8292406c46f', 'request_id': 'req-d95d5e16-f14b-43fa-81bc-962fcdc4f705'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.300635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b42df0e125d40ab9d1264c5b3c94ed1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.303076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b42df0e125d40ab9d1264c5b3c94ed1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.328788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] The token cache is being invalidate because project 48d9c0fba73a4d50b8e2d8292406c46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:51.332958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.334606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.346416 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1509/3013] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:50 2022] DELETE /identity/v3/projects/48d9c0fba73a4d50b8e2d8292406c46f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:51.351773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:51.354774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:51.373646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1505/3014] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:50 2022] DELETE /identity/v3/users/5b42df0e125d40ab9d1264c5b3c94ed1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:51.556036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d5e16-f14b-43fa-81bc-962fcdc4f705 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:51.650684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:51.690748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:51.698332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:51.698332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:51.698332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] PATH_INFO: `/v3/users/f4dc34742d074765a63e43abccf7cd81` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:51.698332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4dc34742d074765a63e43abccf7cd81)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:51.699378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:51.801243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4dc34742d074765a63e43abccf7cd81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.834212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:51.835774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:51.836525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4dc34742d074765a63e43abccf7cd81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.838118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4dc34742d074765a63e43abccf7cd81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.857579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4dc34742d074765a63e43abccf7cd81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.858582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36fbcedb-e051-479c-a97b-e71712c085f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4dc34742d074765a63e43abccf7cd81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:51.872846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac0c8d5-95a6-4b4c-b945-1342a115f6cb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:51.883830 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1510/3015] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:51 2022] DELETE /identity/v3/users/f4dc34742d074765a63e43abccf7cd81 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:51.887544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:51.888433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:51.889488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:51.889863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] PATH_INFO: `/v3/projects/47073c9231a7489aa0a1ff3d6496366f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:51.892076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=47073c9231a7489aa0a1ff3d6496366f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:51.895070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:52.029756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47073c9231a7489aa0a1ff3d6496366f', 'request_id': 'req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:52.034537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:52.050884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47073c9231a7489aa0a1ff3d6496366f', 'request_id': 'req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:52.059421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47073c9231a7489aa0a1ff3d6496366f', 'request_id': 'req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:52.082475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] The token cache is being invalidate because project 47073c9231a7489aa0a1ff3d6496366f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:52.082818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:52.089742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9a90a8d-3654-4e13-a484-1ee80bcba2cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:52.091595 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1506/3016] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:51 2022] DELETE /identity/v3/projects/47073c9231a7489aa0a1ff3d6496366f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:52.097543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:52.098052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:52.098147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:52.149986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:52.153369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:52.362958 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1511/3017] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:52.363165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:52.363556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:52.363922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:52.420155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:52.425394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:52.469661 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1507/3018] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:52.470973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:52.487776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a329d41-bb0a-466e-874a-c99fc213424d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:52.512011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:52.512667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:52.512931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:52.513192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:52.513877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:52.514175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:52.515847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:52.544604 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1512/3019] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:52.549638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:52.568745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de2bc0-aaef-45fe-a368-ed54b2c8b164 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:52.585027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:52.585685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:52.585985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:52.586256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:52.586895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:52.588836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:52.667466 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1508/3020] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:52 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:52.681941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:52.701537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:52.703449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:52.710787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf38202-a515-4510-93d3-7f434b6ae931 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:52.839634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b265179-11dd-471d-b853-eb2fa7f687a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:52.852653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:52.858015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:52.858550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:52.859308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] PATH_INFO: `/v3/projects/b237dbe568334799984ac86299e4c012` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:52.863143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b237dbe568334799984ac86299e4c012)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:52.866028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:52.878149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:52.908579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:52.909222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:52.912619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:52.913275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:52.913998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:52.920171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:52.992179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1513/3021] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:52 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:52.994819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.003793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b237dbe568334799984ac86299e4c012', 'request_id': 'req-1cf001c9-7431-4406-985c-87d7cfd79eba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:53.015155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c27375-24a2-4107-9af9-5c6c2a2d1089 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.021208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b237dbe568334799984ac86299e4c012', 'request_id': 'req-1cf001c9-7431-4406-985c-87d7cfd79eba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:53.032813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b237dbe568334799984ac86299e4c012', 'request_id': 'req-1cf001c9-7431-4406-985c-87d7cfd79eba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:53.055718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] The token cache is being invalidate because project b237dbe568334799984ac86299e4c012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:53.056040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:53.058180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1cf001c9-7431-4406-985c-87d7cfd79eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:53.062901 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1509/3022] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:52 2022] DELETE /identity/v3/projects/b237dbe568334799984ac86299e4c012 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:53.068048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca58eab-309a-482c-b3a2-d1b2696ae40c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.068336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca58eab-309a-482c-b3a2-d1b2696ae40c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.068717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca58eab-309a-482c-b3a2-d1b2696ae40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.114678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3ca58eab-309a-482c-b3a2-d1b2696ae40c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:53.116103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ca58eab-309a-482c-b3a2-d1b2696ae40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:53.136261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.137828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.138345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.138766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.141483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.143852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:53.157393 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1514/3023] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:53.162750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.164963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:53.204162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:53.220451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2f9bc-66df-4eff-958c-f2cd63f91230 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.229233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.230253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.233550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.234111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.240625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.243173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:53.262926 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1515/3024] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:53.265246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.281317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63b55-1113-49d4-99a5-362624cc6b75 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.287784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1510/3025] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:53.300234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.300580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.300856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.308202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a948124-f69d-43e9-9ef3-88fdfaa05b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.309349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948124-f69d-43e9-9ef3-88fdfaa05b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.310524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948124-f69d-43e9-9ef3-88fdfaa05b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.310990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a948124-f69d-43e9-9ef3-88fdfaa05b15 admin admin] PATH_INFO: `/v3/projects/d258485a019d4cd7a4eb4478bd6a1a8e/users/16a5ce2c60f24e0bb188f1698ea99ec2/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.339764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948124-f69d-43e9-9ef3-88fdfaa05b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d258485a019d4cd7a4eb4478bd6a1a8e, user_id=16a5ce2c60f24e0bb188f1698ea99ec2, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.343977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a948124-f69d-43e9-9ef3-88fdfaa05b15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:53.346374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:53.347898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:53.373209 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1511/3026] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:53.377864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.384137 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1516/3027] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:53 2022] PUT /identity/v3/projects/d258485a019d4cd7a4eb4478bd6a1a8e/users/16a5ce2c60f24e0bb188f1698ea99ec2/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:53.404350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.404627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.404900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.410309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc442d-fe0f-4e36-aa5b-16bc051e3fdd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.495899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] MFA Rules not processed for user `16a5ce2c60f24e0bb188f1698ea99ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:53.497125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:53.563454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.564355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.564628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.564896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.567024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:53.570251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.574198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:53.601446 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1512/3028] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:53.608260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.636092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475270be-d4ae-4ef0-8270-2956a3e2ea82 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.648619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.649348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.649695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.650060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.652920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.655017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:53.697131 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1517/3029] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:53.710306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.714189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:53.758445 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1513/3030] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:53 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:53.759811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.873460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:53.886027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5f95d-ae82-4f06-ad54-264a70394499 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.892661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.893612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.894036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.894494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.895235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.897288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:53.953160 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1514/3031] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:53 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:53.954525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:53.965089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e6414-d079-42c4-8b13-9382070de3ed None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.975710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baafcc4-4810-45b5-8f51-9eb50887feab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:53.990758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:53.991321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:53.991600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:53.991873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:53.992863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:53.994265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:54.022165 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1515/3032] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:54.023505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:54.047484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c23efa-9e80-4e2b-a553-17fd448e80e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:54.064046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:54.064686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.065216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.065511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.066767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:54.068566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:54.099460 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1516/3033] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:54.100592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:54.121688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057c90a-91ec-4314-8f8d-91f26a529abf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:54.125328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:54.126088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.126374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.126747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.134791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58694160-b51c-48c0-8c77-4e098548557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:54.135584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694160-b51c-48c0-8c77-4e098548557a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.135762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694160-b51c-48c0-8c77-4e098548557a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.136043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694160-b51c-48c0-8c77-4e098548557a admin admin] PATH_INFO: `/v3/projects/c42a8f60655a41fc92c01a45502975a9/users/cda4cbb54413425d8db164fd81a303a2/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.166887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:54.177668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58694160-b51c-48c0-8c77-4e098548557a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42a8f60655a41fc92c01a45502975a9, user_id=cda4cbb54413425d8db164fd81a303a2, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:54.183623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58694160-b51c-48c0-8c77-4e098548557a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:54.227688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1517/3034] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:54 2022] PUT /identity/v3/projects/c42a8f60655a41fc92c01a45502975a9/users/cda4cbb54413425d8db164fd81a303a2/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:54.230040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.230580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.230949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.279012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:54.280741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:54.298146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] MFA Rules not processed for user `cda4cbb54413425d8db164fd81a303a2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:54.309667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:54.326010 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1518/3035] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:54.427598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:54.441512 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1518/3036] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:54.445600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:54.445982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7268ae1-ba03-41d7-a4d5-78d7ac9482d9 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:54.613241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252b799-caad-41f9-b987-72601e9c3e8d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:54.623294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:54.624574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.625133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.626073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.626518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:54.628751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:54.635872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:54.636475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.636755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.637026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] PATH_INFO: `/v3/users/16a5ce2c60f24e0bb188f1698ea99ec2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.638210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a5ce2c60f24e0bb188f1698ea99ec2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:54.640231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:54.661472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:54.708978 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1519/3037] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:54 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:54:54.723703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:54.755006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a5ce2c60f24e0bb188f1698ea99ec2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:54.776251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a5ce2c60f24e0bb188f1698ea99ec2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:54.778592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a5ce2c60f24e0bb188f1698ea99ec2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:54.801722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a5ce2c60f24e0bb188f1698ea99ec2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:54.806984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b305804-5aff-4113-b04f-a6642ece560c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a5ce2c60f24e0bb188f1698ea99ec2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:54.854652 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1519/3038] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:54 2022] DELETE /identity/v3/users/16a5ce2c60f24e0bb188f1698ea99ec2 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:54.860585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:54.862421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:54.862874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:54.897257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da657cf6-cd76-46dc-b58d-00e29f149250 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:54.908504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:54.911544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:54.921279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:55.053990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.054658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.054889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.055165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.055806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.065255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.086477 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1520/3039] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:55.126225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.128360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:55.133274 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1520/3040] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:54 2022] POST /identity/v3/users => generated 291 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:55.135239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.139401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:55.165288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15aebab-731a-4a0b-af30-edee99d602de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.176836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.180028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.180573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.180864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.181547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.187207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.220550 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1521/3041] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:55.221530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.229154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86d32-3040-4f69-a3e1-c1e5ca74ab8b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.234381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.248494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.258003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba51f5-c0d3-4ac2-8a16-14e7a79e432e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.260248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.261708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.271302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.272026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.272719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.272719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] PATH_INFO: `/v3/projects/7ba1367e4f6549f08441f7c28079f7a8/users/4e1e8dbc5a584c3c89a0d471f0251445/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.293749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.295258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.313911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba1367e4f6549f08441f7c28079f7a8, user_id=4e1e8dbc5a584c3c89a0d471f0251445, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.318409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.321664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1521/3042] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:55.350982 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1522/3043] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:55 2022] PUT /identity/v3/projects/7ba1367e4f6549f08441f7c28079f7a8/users/4e1e8dbc5a584c3c89a0d471f0251445/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:55.352210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.368975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027431b8-7696-4ed6-9bc8-d24152aef99e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.422751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:55.495124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81179689-bcb5-499f-a735-e72ef5c23b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.496078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179689-bcb5-499f-a735-e72ef5c23b90 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.496362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179689-bcb5-499f-a735-e72ef5c23b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.496636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81179689-bcb5-499f-a735-e72ef5c23b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.497292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81179689-bcb5-499f-a735-e72ef5c23b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.501366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81179689-bcb5-499f-a735-e72ef5c23b90 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.533294 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1522/3044] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:54:55.537355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.567222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eb482-f5a1-4c16-be60-07886cbbf203 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.578891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.579582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.579862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.580764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] PATH_INFO: `/v3/projects/7ba1367e4f6549f08441f7c28079f7a8/users/4e1e8dbc5a584c3c89a0d471f0251445/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.590384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba1367e4f6549f08441f7c28079f7a8, user_id=4e1e8dbc5a584c3c89a0d471f0251445, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.593117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.626910 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1523/3045] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:55 2022] PUT /identity/v3/projects/7ba1367e4f6549f08441f7c28079f7a8/users/4e1e8dbc5a584c3c89a0d471f0251445/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:55.720131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.720468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.720756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.754684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] MFA Rules not processed for user `4e1e8dbc5a584c3c89a0d471f0251445`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:55.756517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:55.855585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.866031 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1523/3046] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:55.872761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1e8b2-479c-4a83-ad5a-13bda1e9c087 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.880133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:55.881529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:55.882046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:55.882538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:55.883649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:55.886139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:55.929317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.940534 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1524/3047] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 02:54:55 2022] POST /identity/v3/services => generated 241 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:55.946149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054fd9c-2fd6-45b6-b5e8-4519ad54d84b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:55.975588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:55.977510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:56.012577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.014400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.014620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.014939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/3bb5b3ba51784dccb69c7543c38a3833` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.015541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3bb5b3ba51784dccb69c7543c38a3833)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.026902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.096465 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1524/3048] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:55 2022] DELETE /identity/v3/services/3bb5b3ba51784dccb69c7543c38a3833 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:56.102315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.158923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c09a4e-41d8-4fb1-85dd-ad3514568d0c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.170678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.171724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.172271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.172861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.173710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.176355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.189458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d2812-1d6e-4d5d-ab00-ee86bcf1e7ce tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.208028 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1525/3049] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:56 2022] POST /identity/v3/services => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:56.212276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.224513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.225169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.225450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.225720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] PATH_INFO: `/v3/projects/d258485a019d4cd7a4eb4478bd6a1a8e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.228581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d258485a019d4cd7a4eb4478bd6a1a8e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.230641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.273228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132fc2a-e1b2-42e3-a33b-544dfd0c1505 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.298007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.298698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.298935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.299198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/6b7687bb2e7b4268ae15b34c56492f78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.299930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:update_service(service_id=6b7687bb2e7b4268ae15b34c56492f78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.300878 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:56.300878 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:56.300878 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:56.301760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.334390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:56.367297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1526/3050] 10.222.0.16 () {60 vars in 1252 bytes} [Sat Oct 29 02:54:56 2022] PATCH /identity/v3/services/6b7687bb2e7b4268ae15b34c56492f78 => generated 282 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:56.371675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.408411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd258485a019d4cd7a4eb4478bd6a1a8e', 'request_id': 'req-535a7653-ffa7-486c-8eba-ff1474453796'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:56.430750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd258485a019d4cd7a4eb4478bd6a1a8e', 'request_id': 'req-535a7653-ffa7-486c-8eba-ff1474453796'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:56.446054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd258485a019d4cd7a4eb4478bd6a1a8e', 'request_id': 'req-535a7653-ffa7-486c-8eba-ff1474453796'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:56.446924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0f16-c82a-441a-aee1-7757e9410581 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.484369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] The token cache is being invalidate because project d258485a019d4cd7a4eb4478bd6a1a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:54:56.484827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:56.487853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-535a7653-ffa7-486c-8eba-ff1474453796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:56.490582 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1525/3051] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:55 2022] DELETE /identity/v3/projects/d258485a019d4cd7a4eb4478bd6a1a8e => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:54:56.496340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654bd2f-cd72-4700-8f10-98bf5f00e7d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.496684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654bd2f-cd72-4700-8f10-98bf5f00e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.496937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654bd2f-cd72-4700-8f10-98bf5f00e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.512129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:56.552382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b654bd2f-cd72-4700-8f10-98bf5f00e7d6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:56.553656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b654bd2f-cd72-4700-8f10-98bf5f00e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:56.599563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.600805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.600805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.600805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/6b7687bb2e7b4268ae15b34c56492f78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.601333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:get_service(service_id=6b7687bb2e7b4268ae15b34c56492f78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.602401 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:56.602401 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:56.602401 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:56.603300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.621087 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1527/3052] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 02:54:56 2022] GET /identity/v3/services/6b7687bb2e7b4268ae15b34c56492f78 => generated 282 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:56.625561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.630051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:56.668411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f93352-b8e6-46b5-907a-c08ce47004aa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.689074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.689723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.690229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.690511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/6b7687bb2e7b4268ae15b34c56492f78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.691483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6b7687bb2e7b4268ae15b34c56492f78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.693399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.732057 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1526/3053] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:56.739537 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1528/3054] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:56 2022] DELETE /identity/v3/services/6b7687bb2e7b4268ae15b34c56492f78 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:56.743419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.745214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.746115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.749512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.786431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805d57-8c5e-4906-a99b-7efffb6ec9b3 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.816639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.817316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.817601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.817997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/6b7687bb2e7b4268ae15b34c56492f78` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.818619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:get_service(service_id=6b7687bb2e7b4268ae15b34c56492f78)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.820559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.824038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:56.825719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Could not find service: 6b7687bb2e7b4268ae15b34c56492f78.: keystone.exception.ServiceNotFound: Could not find service: 6b7687bb2e7b4268ae15b34c56492f78. Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6b7687bb2e7b4268ae15b34c56492f78. Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 02:54:56.836823 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 02:54:56.837984 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 6b7687bb2e7b4268ae15b34c56492f78. Oct 29 02:54:56.842913 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 02:54:56.847757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1529/3055] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 02:54:56 2022] GET /identity/v3/services/6b7687bb2e7b4268ae15b34c56492f78 => generated 113 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 02:54:56.848805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.872772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68e56c-bf84-45f5-952c-7a28311a5c7d tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.878036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1527/3056] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:56.882679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.893996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.894634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.894915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.895188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.895852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.896403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123d8b4-ce6d-4698-baa6-930409d55ea4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:56.897521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.901551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:56.902317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:56.902510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:56.903314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:56.904500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:56.904812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:56.910488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:56.937470 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1530/3057] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:56 2022] POST /identity/v3/services => generated 275 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:56.938048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.944744 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1528/3058] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:54:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:56.945679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:56.966385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df561eca-3356-49ba-a8ca-6744a763a542 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.002377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8132ba1-331d-4355-9756-8ff44a692eaa tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.019384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.021658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.022167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.023379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.025371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.026049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.026331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.026607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.026970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.027255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.028864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.034265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.088373 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1529/3059] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:56 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:57.095899 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1531/3060] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:56 2022] POST /identity/v3/services => generated 274 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:57.099636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.103434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.161486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e11d8-158f-41f8-aaf6-c3edb5a6e5f8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.211783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:57.243307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33b52-0d7b-4a6a-af4f-f24e8f2b0a3a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.277066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.278565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.279798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.280745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.280909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.281191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.281463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.281910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.282021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.282890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.283962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.285153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.310706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1532/3061] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:54:57 2022] POST /identity/v3/services => generated 275 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:57.317855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.331541 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1530/3062] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:54:57 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:54:57.337159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.355396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8392-ad80-4a9e-82a1-5d09c715c509 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.367753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d60ad2-4944-4ab2-a23e-33a1cf250d2b tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.391503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.392132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.392417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.392691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.393312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.394780 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 02:54:57.394780 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 02:54:57.394780 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 02:54:57.395694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.406516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.407139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.407419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.407689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.408342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.410002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.428890 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1533/3063] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/services => generated 2979 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:57.433615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.437079 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1531/3064] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:57.446330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.462975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc524f5-0044-452a-94d6-1e68663d95e8 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.477507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7946a61-6f87-4c7c-b3ce-546b78288164 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.481038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.481683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.482234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.482234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.482877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-2079863263) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:57.483200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.484867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.493151 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1534/3065] 10.222.0.16 () {58 vars in 1222 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-2079863263 => generated 418 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:57.495960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.496603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.496878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.497150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.497882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.499688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.502347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.517403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:57.524786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1946d69-8521-4ca9-b419-ed3f043520f2 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.530290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1532/3066] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:54:57.538224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.550297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.550935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.551224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.551493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.552135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-683526647) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:57.552456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.554099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.568230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1ee4f-c11c-43be-bb9f-bd184672fea4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.572351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1535/3067] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-683526647 => generated 416 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:57.579821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.590208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfb520-5d64-4fd0-bf5d-174e1241507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.591203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb520-5d64-4fd0-bf5d-174e1241507b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.591488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb520-5d64-4fd0-bf5d-174e1241507b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.591874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfb520-5d64-4fd0-bf5d-174e1241507b admin admin] PATH_INFO: `/v3/projects/431241db26d44c4ea915ded528edb4f8/users/487d794ccbf544809c8e422efe507716/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.607880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db1126-dce9-4492-8ab5-a1d4e295b47c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.627665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.630558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.631250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.631686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.632544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1435882990) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:54:57.634043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfb520-5d64-4fd0-bf5d-174e1241507b admin admin] RBAC: Authorizing `identity:create_grant(project_id=431241db26d44c4ea915ded528edb4f8, user_id=487d794ccbf544809c8e422efe507716, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.634723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.638481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.641655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfb520-5d64-4fd0-bf5d-174e1241507b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.658925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1536/3068] 10.222.0.16 () {58 vars in 1222 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1435882990 => generated 418 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:54:57.662547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.670687 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1533/3069] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:54:57 2022] PUT /identity/v3/projects/431241db26d44c4ea915ded528edb4f8/users/487d794ccbf544809c8e422efe507716/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:57.677902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef394-2381-433f-bea8-85cc104626bf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.678467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef394-2381-433f-bea8-85cc104626bf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.679018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef394-2381-433f-bea8-85cc104626bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.690230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836acb77-bd7e-48a1-882a-0c499cb40c09 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:57.719183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95aef394-2381-433f-bea8-85cc104626bf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:57.722918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95aef394-2381-433f-bea8-85cc104626bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:57.870229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:57.874098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:57.878760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:57.879469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/32eabea550294cf4896e0f7d35d45cb0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:57.880807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=32eabea550294cf4896e0f7d35d45cb0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:57.886203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:57.972430 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1534/3070] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:57 2022] POST /identity/v3/auth/tokens => generated 3742 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:54:57.984533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef394-2381-433f-bea8-85cc104626bf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:57.986697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95aef394-2381-433f-bea8-85cc104626bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:58.004084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1537/3071] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:57 2022] DELETE /identity/v3/services/32eabea550294cf4896e0f7d35d45cb0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:58.005539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:58.071359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bbbc3-b498-45a8-aea2-2f351ffebbf5 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:58.083636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:58.084304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:58.084659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:58.084845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/0dfd8a5201b341c088c686721f644319` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:58.085438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0dfd8a5201b341c088c686721f644319)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:58.087087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:58.181257 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1538/3072] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:58 2022] DELETE /identity/v3/services/0dfd8a5201b341c088c686721f644319 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:58.191129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:58.251065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef394-2381-433f-bea8-85cc104626bf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:58.280522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb19fe4-fc62-4ef7-8a1c-d08098d4a958 tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:58.303724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e1e8dbc5a584c3c89a0d471f0251445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ba1367e4f6549f08441f7c28079f7a8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:58.304865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:58.305905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:58.306374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] PATH_INFO: `/v3/services/78ada5cb502b4893a2b4d0d187a86819` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:58.307156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63771f-2f1f-42b7-814d-8fe26c5df7f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:58.307925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorizing `identity:delete_service(service_id=78ada5cb502b4893a2b4d0d187a86819)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:58.308695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63771f-2f1f-42b7-814d-8fe26c5df7f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:58.310591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:58.311025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63771f-2f1f-42b7-814d-8fe26c5df7f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:58.318896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63771f-2f1f-42b7-814d-8fe26c5df7f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:58.347518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63771f-2f1f-42b7-814d-8fe26c5df7f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:58.349142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63771f-2f1f-42b7-814d-8fe26c5df7f5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:58.353596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:58.377140 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1539/3073] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:54:58 2022] DELETE /identity/v3/services/78ada5cb502b4893a2b4d0d187a86819 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:58.382636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:58.390753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:58.450263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23b248-3ecd-4455-8fbe-635137db438c tempest-ServicesTestJSON-1051048293 tempest-ServicesTestJSON-1051048293-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:58.451738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1535/3074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:54:58.464321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:58.465389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:58.465912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:58.466497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] PATH_INFO: `/v3/users/cda4cbb54413425d8db164fd81a303a2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:58.468031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda4cbb54413425d8db164fd81a303a2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:58.474018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:58.677905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda4cbb54413425d8db164fd81a303a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:58.681497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=13 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:54:58.723023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda4cbb54413425d8db164fd81a303a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:58.726301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda4cbb54413425d8db164fd81a303a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:58.766729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda4cbb54413425d8db164fd81a303a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:58.770413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda4cbb54413425d8db164fd81a303a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:54:58.817365 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1540/3075] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:54:58 2022] DELETE /identity/v3/users/cda4cbb54413425d8db164fd81a303a2 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:54:58.821631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4d90e-f5e8-4745-ac84-076e75f33669 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:58.821945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4d90e-f5e8-4745-ac84-076e75f33669 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:58.822222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4d90e-f5e8-4745-ac84-076e75f33669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:58.884064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aea4d90e-f5e8-4745-ac84-076e75f33669 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:54:58.888098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aea4d90e-f5e8-4745-ac84-076e75f33669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:59.070991 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1536/3076] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:54:59.090333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:54:59.092205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:54:59.406911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7733a22-4aff-4f40-87e3-d27943c241d4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:54:59.421379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:54:59.422073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:54:59.422356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:54:59.422629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:54:59.450774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:54:59.452475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:54:59.482522 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1541/3077] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:01.304612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:01.306470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:01.307417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:01.329487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:01.331340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:01.359391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061be7-8818-4f00-80fd-3d8a00f66f45 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:01.369967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:01.373711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:01.377135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:01.378303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] PATH_INFO: `/v3/projects/c42a8f60655a41fc92c01a45502975a9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:01.381695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42a8f60655a41fc92c01a45502975a9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:01.389655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:01.407825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:01.409102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:01.509210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42a8f60655a41fc92c01a45502975a9', 'request_id': 'req-f72ba38a-56f0-4086-8983-a60b7def43eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:01.535143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42a8f60655a41fc92c01a45502975a9', 'request_id': 'req-f72ba38a-56f0-4086-8983-a60b7def43eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:01.561099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42a8f60655a41fc92c01a45502975a9', 'request_id': 'req-f72ba38a-56f0-4086-8983-a60b7def43eb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:01.612558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] The token cache is being invalidate because project c42a8f60655a41fc92c01a45502975a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:01.613089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:01.618513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f72ba38a-56f0-4086-8983-a60b7def43eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:01.622482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1537/3078] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:01.627484 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1542/3079] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:01 2022] DELETE /identity/v3/projects/c42a8f60655a41fc92c01a45502975a9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:01.628938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:01.634131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:01.635512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:01.637996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:01.661005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f47264-1a8c-474c-bc35-d6e952b26f80 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:01.685361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:01.686871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:01.851989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:01.862081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:01.862742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:01.863018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:01.863290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] PATH_INFO: `/v3/users/4e1e8dbc5a584c3c89a0d471f0251445` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:01.869652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e1e8dbc5a584c3c89a0d471f0251445)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:01.872798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:01.927537 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1543/3080] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:01.939334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:01.943299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:01.976985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:02.131697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e1e8dbc5a584c3c89a0d471f0251445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:02.157998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e1e8dbc5a584c3c89a0d471f0251445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:02.158614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e1e8dbc5a584c3c89a0d471f0251445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:02.192401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e1e8dbc5a584c3c89a0d471f0251445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:02.194793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e1e8dbc5a584c3c89a0d471f0251445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:02.287014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1538/3081] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:01 2022] DELETE /identity/v3/users/4e1e8dbc5a584c3c89a0d471f0251445 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:02.318772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0deba9-0823-4a3c-bc2c-83ef0d85c8cd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:02.578247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:02.579085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:02.581032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:02.585251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:02.592323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:02.788566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:02.791172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69ccb6-dbfc-48df-8e63-8b5b12344306 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:02.815796 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1544/3082] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 877 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:04.114646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:04.123490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:04.405060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388422e-f399-4642-8fef-d37c0f4683aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:04.439355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:04.442385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:04.451020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:04.451918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] PATH_INFO: `/v3/projects/7ba1367e4f6549f08441f7c28079f7a8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:04.455234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba1367e4f6549f08441f7c28079f7a8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:04.469121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:04.650875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba1367e4f6549f08441f7c28079f7a8', 'request_id': 'req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:04.668098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba1367e4f6549f08441f7c28079f7a8', 'request_id': 'req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:04.683196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba1367e4f6549f08441f7c28079f7a8', 'request_id': 'req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:04.712305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] The token cache is being invalidate because project 7ba1367e4f6549f08441f7c28079f7a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:04.713322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:04.729347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dfc6a56-2c9a-4471-9fa9-796a9e7eb1bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:04.744067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:04.744557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:04.744889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:04.750724 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1539/3083] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:04 2022] DELETE /identity/v3/projects/7ba1367e4f6549f08441f7c28079f7a8 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:04.824455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:04.832546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:04.892668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:05.054594 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1545/3084] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:05.063693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.064172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.064447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.160791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:05.162965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:05.195998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1540/3085] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:05.197356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:05.223913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d530d8-2ef5-4eed-835d-ef0c7791aa0d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:05.251639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:05.252639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.253018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.253747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.254310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:05.254643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:05.256551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:05.288816 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1546/3086] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:55:05.290638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:05.313866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f366a3-81a3-44eb-879f-0b608c0783e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:05.330967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:05.331949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.332364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.332770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.334523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:05.341038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:05.409574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:05.440069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:05.440971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1541/3087] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:05 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:05.457886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416845e1-066a-4dd8-a397-4fb20ad82c8d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:05.602589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:05.603401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.603997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.604166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.604967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:05.607300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:05.691893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1547/3088] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:05 2022] POST /identity/v3/users => generated 284 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:55:05.696362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:05.708707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd84b9-933a-4ff8-a55d-817643a3f0aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:05.732730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:05.733472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.733877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.734151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.734847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:05.736500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:05.780494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:05.791880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1542/3089] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:05.803072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f93ba-2efa-4a12-baa1-050cede71f3f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:05.823959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb456a65-048b-4f2e-9b79-919ce0a64d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:05.824598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456a65-048b-4f2e-9b79-919ce0a64d93 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.824872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456a65-048b-4f2e-9b79-919ce0a64d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.825140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb456a65-048b-4f2e-9b79-919ce0a64d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.825791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb456a65-048b-4f2e-9b79-919ce0a64d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:05.830648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb456a65-048b-4f2e-9b79-919ce0a64d93 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:05.873145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:05.887296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086acfbf-46dc-40a7-9dc4-d7e49e5368b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:05.891461 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1548/3090] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:05.906629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:05.911331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:05.911665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:05.914277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] PATH_INFO: `/v3/projects/dfc488d19331483cb72485b8382d59a5/users/0d18dd861a6f46f8a938adaa17dbd9da/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:05.970584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc488d19331483cb72485b8382d59a5, user_id=0d18dd861a6f46f8a938adaa17dbd9da, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:05.973426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:06.009783 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1543/3091] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:05 2022] PUT /identity/v3/projects/dfc488d19331483cb72485b8382d59a5/users/0d18dd861a6f46f8a938adaa17dbd9da/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:06.023088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:06.023411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:06.023817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:06.099645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] MFA Rules not processed for user `0d18dd861a6f46f8a938adaa17dbd9da`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:06.101184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:06.376786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:06.388496 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1549/3092] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:06.397757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5445a-cca8-4781-b57a-3387f57ba7b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:06.421443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca98ee5-eba5-433d-8e56-f3dca93bda88 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18dd861a6f46f8a938adaa17dbd9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfc488d19331483cb72485b8382d59a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:06.422482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca98ee5-eba5-433d-8e56-f3dca93bda88 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:06.422950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca98ee5-eba5-433d-8e56-f3dca93bda88 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:06.423401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca98ee5-eba5-433d-8e56-f3dca93bda88 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] PATH_INFO: `/v3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:06.430574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:06.437194 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1544/3093] 10.222.0.16 () {58 vars in 1104 bytes} [Sat Oct 29 02:55:06 2022] GET /identity/v3 => generated 255 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:55:06.442152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774838d-5462-4b56-a737-72871224b9b7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:06.471547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fb280-6ec1-444a-b4e5-6e078c81eaa9 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18dd861a6f46f8a938adaa17dbd9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfc488d19331483cb72485b8382d59a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:06.477781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb280-6ec1-444a-b4e5-6e078c81eaa9 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:06.478174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb280-6ec1-444a-b4e5-6e078c81eaa9 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:06.478436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fb280-6ec1-444a-b4e5-6e078c81eaa9 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] PATH_INFO: `/v3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:06.497200 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1550/3094] 10.222.0.16 () {58 vars in 1104 bytes} [Sat Oct 29 02:55:06 2022] GET /identity/v3 => generated 255 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:06.497733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca98ee5-eba5-433d-8e56-f3dca93bda88 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:06.525233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca98ee5-eba5-433d-8e56-f3dca93bda88 tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:06.544575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34b947-d5bd-4517-b996-0a5e8db11aac tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d18dd861a6f46f8a938adaa17dbd9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfc488d19331483cb72485b8382d59a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:06.545179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b947-d5bd-4517-b996-0a5e8db11aac tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:06.545465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b947-d5bd-4517-b996-0a5e8db11aac tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:06.545887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34b947-d5bd-4517-b996-0a5e8db11aac tempest-TestApiDiscovery-633797055 tempest-TestApiDiscovery-633797055-project] PATH_INFO: `/v3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:06.557649 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1545/3095] 10.222.0.16 () {58 vars in 1104 bytes} [Sat Oct 29 02:55:06 2022] GET /identity/v3 => generated 255 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:55:06.564435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdbca-b6d8-4a3f-b2ed-0da3b1c5d595 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:06.564772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdbca-b6d8-4a3f-b2ed-0da3b1c5d595 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:06.565109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fdbca-b6d8-4a3f-b2ed-0da3b1c5d595 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:06.567199 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1551/3096] 10.222.0.16 () {56 vars in 895 bytes} [Sat Oct 29 02:55:06 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:55:06.576650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d509df-3a09-4c9c-8ed4-aca6ad91bcf0 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:06.576965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d509df-3a09-4c9c-8ed4-aca6ad91bcf0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:06.577432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d509df-3a09-4c9c-8ed4-aca6ad91bcf0 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:06.591230 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1546/3097] 10.222.0.16 () {56 vars in 895 bytes} [Sat Oct 29 02:55:06 2022] GET /identity/ => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:55:06.595226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fdbca-b6d8-4a3f-b2ed-0da3b1c5d595 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:06.616632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:07.022391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fdbca-b6d8-4a3f-b2ed-0da3b1c5d595 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:07.037761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:07.038554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:07.038840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:07.039220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] PATH_INFO: `/v3/users/0d18dd861a6f46f8a938adaa17dbd9da` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:07.059681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d18dd861a6f46f8a938adaa17dbd9da)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:07.072898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:07.304065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d18dd861a6f46f8a938adaa17dbd9da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:07.412360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d18dd861a6f46f8a938adaa17dbd9da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:07.419144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d18dd861a6f46f8a938adaa17dbd9da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:07.458545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d18dd861a6f46f8a938adaa17dbd9da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:07.459474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d18dd861a6f46f8a938adaa17dbd9da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:07.536549 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1552/3098] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:06 2022] DELETE /identity/v3/users/0d18dd861a6f46f8a938adaa17dbd9da => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:07.538327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:07.539026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:07.539754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:07.621185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:07.626224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:07.849255 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1547/3099] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:07.882148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:07.884179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:08.188885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179bd8e6-2127-4276-ac68-44ca6e43cc92 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:08.215200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb2c79-f340-442f-9891-7b5b477ed005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:08.215862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2c79-f340-442f-9891-7b5b477ed005 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:08.216145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2c79-f340-442f-9891-7b5b477ed005 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:08.216419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb2c79-f340-442f-9891-7b5b477ed005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:08.256503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb2c79-f340-442f-9891-7b5b477ed005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:08.260680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb2c79-f340-442f-9891-7b5b477ed005 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:08.352296 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1553/3100] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:10.516925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:10.518508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:10.584737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d048d-b389-42f9-bf96-d6c587d2e5dc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:10.621087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:10.621753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:10.622066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:10.622338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] PATH_INFO: `/v3/projects/dfc488d19331483cb72485b8382d59a5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:10.624892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc488d19331483cb72485b8382d59a5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:10.628767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:10.762468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc488d19331483cb72485b8382d59a5', 'request_id': 'req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:10.776809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc488d19331483cb72485b8382d59a5', 'request_id': 'req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:10.795506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc488d19331483cb72485b8382d59a5', 'request_id': 'req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:10.820086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] The token cache is being invalidate because project dfc488d19331483cb72485b8382d59a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:10.820696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:10.822434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a958d69-2ca4-4e4e-b4cf-cb39d7268dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:10.824427 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1548/3101] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:10 2022] DELETE /identity/v3/projects/dfc488d19331483cb72485b8382d59a5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:10.829290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:10.830225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:10.830646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:10.888974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:10.890422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:10.950381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:11.054093 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1554/3102] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:11.063277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.063561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.064106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.113645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:11.114985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:11.139336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1549/3103] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:11.143853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:11.159243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8a921-ef56-46d3-9ad5-f8ed4707dc0d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:11.175068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:11.178683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.181004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.181445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.184237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:11.186520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:11.188326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:11.222164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1555/3104] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:11.223620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:11.236610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d2602-84ac-4338-b2db-61ea61565760 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:11.252410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:11.253211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.253641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.253945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.254636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:11.256628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:11.353895 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1550/3105] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:11 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:11.355122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:11.372508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0233f-daef-47e0-9cdd-fa29ff719d9e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:11.532934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:11.533655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.534096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.534465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.535116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:11.539675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:11.595917 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1556/3106] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:11 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:55:11.600326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:11.614446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c192-4d43-46fb-8990-bdaa8a46447a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:11.630690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:11.631347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.631632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.631906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.632568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:11.634408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:11.645784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:11.664249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:11.666625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1551/3107] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:11.677470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a15e62-22ff-449c-b05b-f247fcb7293e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:11.695315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e47d7c-b6d7-45c6-9e54-bc51f930f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:11.698812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47d7c-b6d7-45c6-9e54-bc51f930f0cf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.701738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47d7c-b6d7-45c6-9e54-bc51f930f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.702469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e47d7c-b6d7-45c6-9e54-bc51f930f0cf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.705056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e47d7c-b6d7-45c6-9e54-bc51f930f0cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:11.709452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e47d7c-b6d7-45c6-9e54-bc51f930f0cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:11.746562 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1557/3108] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:11.747819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:11.761466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3f017-e913-45e2-8228-ca762c829bcc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:11.775047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:11.776468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.777375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.778209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] PATH_INFO: `/v3/projects/e7fca130e6294697bb7bdc8041f04139/users/bcca317d105e4c588d4f4f43aeaf8e21/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.816272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fca130e6294697bb7bdc8041f04139, user_id=bcca317d105e4c588d4f4f43aeaf8e21, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:11.819598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:11.847852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1552/3109] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:11 2022] PUT /identity/v3/projects/e7fca130e6294697bb7bdc8041f04139/users/bcca317d105e4c588d4f4f43aeaf8e21/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:11.859086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75631045-08e4-471c-971a-735a159112f0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:11.859665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75631045-08e4-471c-971a-735a159112f0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:11.859908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75631045-08e4-471c-971a-735a159112f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:11.924614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-75631045-08e4-471c-971a-735a159112f0 None None] MFA Rules not processed for user `bcca317d105e4c588d4f4f43aeaf8e21`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:11.925963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-75631045-08e4-471c-971a-735a159112f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:12.186182 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1558/3110] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:12.192665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:12.213882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d388f20-437e-4948-9758-eb29c0ef8998 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:12.223175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d05bc8-3ccf-4fca-b228-84baaf3f77a6 tempest-IdentityCatalogTest-1910833032 tempest-IdentityCatalogTest-1910833032-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcca317d105e4c588d4f4f43aeaf8e21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7fca130e6294697bb7bdc8041f04139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:12.224071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d05bc8-3ccf-4fca-b228-84baaf3f77a6 tempest-IdentityCatalogTest-1910833032 tempest-IdentityCatalogTest-1910833032-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:12.224490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d05bc8-3ccf-4fca-b228-84baaf3f77a6 tempest-IdentityCatalogTest-1910833032 tempest-IdentityCatalogTest-1910833032-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:12.224766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d05bc8-3ccf-4fca-b228-84baaf3f77a6 tempest-IdentityCatalogTest-1910833032 tempest-IdentityCatalogTest-1910833032-project] PATH_INFO: `/v3/auth/catalog` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:12.225351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d05bc8-3ccf-4fca-b228-84baaf3f77a6 tempest-IdentityCatalogTest-1910833032 tempest-IdentityCatalogTest-1910833032-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:12.226455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d05bc8-3ccf-4fca-b228-84baaf3f77a6 tempest-IdentityCatalogTest-1910833032 tempest-IdentityCatalogTest-1910833032-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:12.234344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75631045-08e4-471c-971a-735a159112f0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:12.239476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1553/3111] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 02:55:12 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:12.378477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:12.481682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75631045-08e4-471c-971a-735a159112f0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:12.499141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:12.502907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:12.502907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:12.502907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] PATH_INFO: `/v3/users/bcca317d105e4c588d4f4f43aeaf8e21` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:12.504606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcca317d105e4c588d4f4f43aeaf8e21)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:12.508728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:12.624148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcca317d105e4c588d4f4f43aeaf8e21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:12.674088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcca317d105e4c588d4f4f43aeaf8e21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:12.675317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcca317d105e4c588d4f4f43aeaf8e21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:12.726728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcca317d105e4c588d4f4f43aeaf8e21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:12.727969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcca317d105e4c588d4f4f43aeaf8e21'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:12.775656 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1559/3112] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:12 2022] DELETE /identity/v3/users/bcca317d105e4c588d4f4f43aeaf8e21 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:12.781341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41ce70-9444-497b-8536-f379e05eb4a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:12.781831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41ce70-9444-497b-8536-f379e05eb4a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:12.782307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41ce70-9444-497b-8536-f379e05eb4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:12.839751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df41ce70-9444-497b-8536-f379e05eb4a4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:12.841069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df41ce70-9444-497b-8536-f379e05eb4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:13.013285 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1554/3113] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:13.064563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:13.066996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:13.200665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513febb-ae29-4952-b06c-810992686e18 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:13.211018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:13.211871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:13.212335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:13.212814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:13.232213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:13.234544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:13.259337 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1560/3114] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:13.838390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:13.838858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:13.838858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:13.902126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] MFA Rules not processed for user `487d794ccbf544809c8e422efe507716`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:13.903443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:14.121642 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1555/3115] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:13 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:14.129583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:14.131870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:14.197114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:14.198923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:14.225596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:14.231976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142e2d3-b9b1-400f-93a7-7b7d370150c2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:14.250272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:14.251206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:14.251920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:14.252344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] PATH_INFO: `/v3/projects/e7fca130e6294697bb7bdc8041f04139` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:14.254091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fca130e6294697bb7bdc8041f04139)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:14.257194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:14.275543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa04c79-b088-49aa-86c2-b0a3b197eefc service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:14.296887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69cc50-d088-4435-826b-630913363bb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:14.299312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69cc50-d088-4435-826b-630913363bb1 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:14.299605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69cc50-d088-4435-826b-630913363bb1 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:14.305987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69cc50-d088-4435-826b-630913363bb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:14.316205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69cc50-d088-4435-826b-630913363bb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:14.317943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69cc50-d088-4435-826b-630913363bb1 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:14.351953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1561/3116] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:14.386835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fca130e6294697bb7bdc8041f04139', 'request_id': 'req-328dbccf-5652-4e96-9b09-56d1e45e793f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:14.397154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fca130e6294697bb7bdc8041f04139', 'request_id': 'req-328dbccf-5652-4e96-9b09-56d1e45e793f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:14.404519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:14.410898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fca130e6294697bb7bdc8041f04139', 'request_id': 'req-328dbccf-5652-4e96-9b09-56d1e45e793f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:14.431705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] The token cache is being invalidate because project e7fca130e6294697bb7bdc8041f04139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:14.432168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:14.433190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-328dbccf-5652-4e96-9b09-56d1e45e793f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:14.440655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:14.441143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:14.441579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:14.449996 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1556/3117] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:14 2022] DELETE /identity/v3/projects/e7fca130e6294697bb7bdc8041f04139 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:14.471266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:14.472628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:14.604766 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1562/3118] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:14.606717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:14.607068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:14.607405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:14.629319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:14.630590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:14.639827 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1557/3119] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:14.644135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:14.678913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d17c44-8ddd-41b0-ab22-de96a44c3ae3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:14.687373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:14.690026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:14.690315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:14.690593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:14.691421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:14.692411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:14.694498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:14.733863 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1563/3120] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:55:14.736078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:14.747743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e04d6-f2fb-4ed2-96be-2aa457407083 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:14.757025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:14.757819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:14.758213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:14.758622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:14.759370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:14.762364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:14.821846 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1558/3121] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:14 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:14.824701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:14.837511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14819170-b0ba-4b76-8843-b462c56759a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:15.006025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:15.006797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.007578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.007689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.008992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:15.010454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:15.061575 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1564/3122] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:14 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:15.063804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:15.090607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a42486-8922-4ec7-81dd-46940f8c35cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:15.107580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:15.109503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.109991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.110503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.111459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:15.115645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:15.131811 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1559/3123] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:15.135943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:15.173100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48672956-0064-4ad3-86b3-48a67df83a7c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:15.184689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e26cf-d54d-4d2a-b9a8-cf7731ea7e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:15.185270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e26cf-d54d-4d2a-b9a8-cf7731ea7e3a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.185546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e26cf-d54d-4d2a-b9a8-cf7731ea7e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.185836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e26cf-d54d-4d2a-b9a8-cf7731ea7e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.187210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e26cf-d54d-4d2a-b9a8-cf7731ea7e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:15.189014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e26cf-d54d-4d2a-b9a8-cf7731ea7e3a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:15.225266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1565/3124] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:15.231239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:15.264826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d920af-6abb-4bd9-be18-7a071b04e368 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:15.279702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c0624-6b7c-404d-93e5-82dbef69b557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:15.280947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0624-6b7c-404d-93e5-82dbef69b557 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.282848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0624-6b7c-404d-93e5-82dbef69b557 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.283774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0624-6b7c-404d-93e5-82dbef69b557 admin admin] PATH_INFO: `/v3/projects/f178cc67ffd64aeab6bdf6e446accfeb/users/a1b3b05546164d0a880e8f7014840c6d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.332386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c0624-6b7c-404d-93e5-82dbef69b557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f178cc67ffd64aeab6bdf6e446accfeb, user_id=a1b3b05546164d0a880e8f7014840c6d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:15.335137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c0624-6b7c-404d-93e5-82dbef69b557 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:15.372651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.373241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.373673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.383852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1560/3125] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:15 2022] PUT /identity/v3/projects/f178cc67ffd64aeab6bdf6e446accfeb/users/a1b3b05546164d0a880e8f7014840c6d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:15.385390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.385752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.387461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.417567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:15.419377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:15.455591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] MFA Rules not processed for user `a1b3b05546164d0a880e8f7014840c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:15.456858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:15.554404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:15.630625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1566/3126] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:15.648086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:15.648279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1561/3127] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:15.650368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:15.689084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:15.692000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:15.814558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05557ef-8a18-4feb-863a-51f4e11caccc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:15.819950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef190e99-0315-4f15-b555-6e4c6398fd58 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:15.820188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1bb6f-278f-4631-89d3-5ceee2301812 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:15.820897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1bb6f-278f-4631-89d3-5ceee2301812 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.821270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1bb6f-278f-4631-89d3-5ceee2301812 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.821919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1bb6f-278f-4631-89d3-5ceee2301812 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.829971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:15.831783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:15.832253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:15.832957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:15.834091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1bb6f-278f-4631-89d3-5ceee2301812 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:15.835612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1bb6f-278f-4631-89d3-5ceee2301812 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:15.848651 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1562/3128] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:15.856374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:15.858256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:15.870805 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1567/3129] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:16.158837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08f97-2394-4960-90c7-3b23c022a72f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:16.159553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08f97-2394-4960-90c7-3b23c022a72f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:16.159553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08f97-2394-4960-90c7-3b23c022a72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:16.171662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:16.221647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-61a08f97-2394-4960-90c7-3b23c022a72f None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:16.225320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61a08f97-2394-4960-90c7-3b23c022a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:16.271805 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1563/3130] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:16.272529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:16.285936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666186a-0011-4cfa-92fe-b8ad6888c13a service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:16.301632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:16.302764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:16.303462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:16.303986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:16.317883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:16.323111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:16.339049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1568/3131] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 02:55:16.986159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad39997-e075-4f98-b837-a0d8c602d87d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:16.986857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad39997-e075-4f98-b837-a0d8c602d87d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:16.986857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad39997-e075-4f98-b837-a0d8c602d87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:17.057510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2ad39997-e075-4f98-b837-a0d8c602d87d None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:17.059624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ad39997-e075-4f98-b837-a0d8c602d87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:17.075479 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1564/3132] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 02:55:17.089498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:17.102104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040dc91-5e2c-48ef-aa69-97384644b748 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:17.130959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f997d-30b9-4536-8c37-95fed74d58b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:17.133062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f997d-30b9-4536-8c37-95fed74d58b3 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:17.133969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f997d-30b9-4536-8c37-95fed74d58b3 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:17.134447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f997d-30b9-4536-8c37-95fed74d58b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:17.157234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f997d-30b9-4536-8c37-95fed74d58b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:17.170823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f997d-30b9-4536-8c37-95fed74d58b3 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:17.205208 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1569/3133] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:17.726114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6d5ed-5195-4196-8879-dfb4bcec1ba1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:17.727211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6d5ed-5195-4196-8879-dfb4bcec1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:17.727657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6d5ed-5195-4196-8879-dfb4bcec1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:17.765886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:17.766524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:17.766524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:17.783865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1df6d5ed-5195-4196-8879-dfb4bcec1ba1 None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:17.797650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1df6d5ed-5195-4196-8879-dfb4bcec1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:17.817467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:17.819169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:17.857703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1570/3134] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:17.859568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:17.885561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdddff2-a703-4568-9356-06103c4dbf11 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:17.900570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:17.902376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:17.903408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:17.903782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:17.923576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:17.927065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:17.936541 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1565/3135] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:17.942088 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1571/3136] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:18.489504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba97bf-1b67-41b2-b125-f0b9c805e9a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:18.489791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba97bf-1b67-41b2-b125-f0b9c805e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:18.490262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba97bf-1b67-41b2-b125-f0b9c805e9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:18.537586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cbba97bf-1b67-41b2-b125-f0b9c805e9a4 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:18.539287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cbba97bf-1b67-41b2-b125-f0b9c805e9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:18.580492 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1566/3137] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:18.610719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:18.626899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34c1d7-c902-44f5-a17b-e0d08e9a87ab service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:18.638952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:18.640110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:18.640626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:18.641163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:18.660477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:18.662784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:18.690209 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1572/3138] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:19.111706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa084-833e-4d2b-868c-cdc86f8c0955 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:19.112235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa084-833e-4d2b-868c-cdc86f8c0955 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:19.112235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5afa084-833e-4d2b-868c-cdc86f8c0955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:19.145070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d5afa084-833e-4d2b-868c-cdc86f8c0955 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:19.149002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5afa084-833e-4d2b-868c-cdc86f8c0955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:19.169182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1567/3139] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:19.193458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:19.210804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1baa8-4b76-4ee4-8d6d-e7c249e9c1ca service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:19.219149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:19.221028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:19.223064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:19.224463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:19.243725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:19.247116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:19.261717 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1573/3140] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:19.796141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e94-a7e6-4bfa-b511-5444c5f82b71 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:19.796539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e94-a7e6-4bfa-b511-5444c5f82b71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:19.798027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b1e94-a7e6-4bfa-b511-5444c5f82b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:19.839024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c65b1e94-a7e6-4bfa-b511-5444c5f82b71 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:19.840287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c65b1e94-a7e6-4bfa-b511-5444c5f82b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:19.848080 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1568/3141] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:19.866234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:19.894666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5c2d3-f169-4525-b796-01c308d6cbbe service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:19.907592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:19.909308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:19.910581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:19.911082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:19.936563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:19.940018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:19.966467 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1574/3142] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:21.542229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f272b-61a1-4eca-a9f2-6f8c8929a38e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:21.543263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f272b-61a1-4eca-a9f2-6f8c8929a38e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:21.543756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f272b-61a1-4eca-a9f2-6f8c8929a38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:21.607987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bb7f272b-61a1-4eca-a9f2-6f8c8929a38e None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:21.613131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb7f272b-61a1-4eca-a9f2-6f8c8929a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:21.629755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1569/3143] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:21.644545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:21.668521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f73f62-dc8e-40b3-b15a-05233e919381 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:21.685437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:21.686920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:21.687487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:21.688048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:21.719765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:21.721543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:21.739574 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1575/3144] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:21.989645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0270a-7b3f-4bbe-9b9c-e5f0adbf7c15 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:21.990271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0270a-7b3f-4bbe-9b9c-e5f0adbf7c15 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:21.990552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0270a-7b3f-4bbe-9b9c-e5f0adbf7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:22.052754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-75d0270a-7b3f-4bbe-9b9c-e5f0adbf7c15 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:22.056555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75d0270a-7b3f-4bbe-9b9c-e5f0adbf7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:22.088638 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1570/3145] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:22.091242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:22.103977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873acacd-abb3-4dbc-b66c-36b7a7d45ac9 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:22.109933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:22.111019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:22.111500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:22.111974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:22.121925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:22.124122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:22.135622 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1576/3146] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:22.338225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb04b-fbfe-424d-9be1-172177dd156e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:22.338551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb04b-fbfe-424d-9be1-172177dd156e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:22.338843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7eb04b-fbfe-424d-9be1-172177dd156e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:22.408379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6a7eb04b-fbfe-424d-9be1-172177dd156e None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:22.411147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6a7eb04b-fbfe-424d-9be1-172177dd156e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:22.437178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1571/3147] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:22.466289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:22.474552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:22.490352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d7e38-c71e-48fd-a90e-ca9fffc37604 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:22.510381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:22.511371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:22.511786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:22.512205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:22.541539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:22.544501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:22.580634 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1577/3148] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:22.800224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aae613-60b8-4b09-8e33-624282362334 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:22.800224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aae613-60b8-4b09-8e33-624282362334 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:22.805737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aae613-60b8-4b09-8e33-624282362334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:22.856568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-41aae613-60b8-4b09-8e33-624282362334 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:22.859673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41aae613-60b8-4b09-8e33-624282362334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:22.895270 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1572/3149] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:22.904004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:22.930164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eaedf2-0099-42b8-8651-aab96da457af service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:22.952045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:22.952777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:22.953058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:22.953324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:22.970820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:22.973172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:23.001101 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1578/3150] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:23.241975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b82d-53e8-4183-8f46-3fb56f33dcf5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:23.242598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b82d-53e8-4183-8f46-3fb56f33dcf5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:23.243102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08b82d-53e8-4183-8f46-3fb56f33dcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:23.265400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a08b82d-53e8-4183-8f46-3fb56f33dcf5 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:23.267188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a08b82d-53e8-4183-8f46-3fb56f33dcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:23.291366 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1573/3151] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:23.292716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:23.308118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e61bb-9a9e-47ea-8b92-7d6e05e74908 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:23.316549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:23.317705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:23.318299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:23.318784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:23.329642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:23.332269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:23.357277 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1579/3152] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:23.639609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:23.640626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:23.641113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:23.677727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:23.679368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:23.693533 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1574/3153] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:55:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:23.709503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:23.721357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f310d7-88cb-4407-bb64-164dd1dc14ad service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:23.727497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17314b9a-dbb0-46f9-89e9-b3b9da9feffd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:23.728521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17314b9a-dbb0-46f9-89e9-b3b9da9feffd service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:23.729045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17314b9a-dbb0-46f9-89e9-b3b9da9feffd service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:23.729530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17314b9a-dbb0-46f9-89e9-b3b9da9feffd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:23.740789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17314b9a-dbb0-46f9-89e9-b3b9da9feffd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:23.742874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17314b9a-dbb0-46f9-89e9-b3b9da9feffd service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:23.778766 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1580/3154] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:23.972879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:24.097487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3534a-9308-4a27-b407-fa2a9a9fcb84 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:24.104960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:24.105985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:24.106437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:24.106849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] PATH_INFO: `/v3/users/a1b3b05546164d0a880e8f7014840c6d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:24.108297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b3b05546164d0a880e8f7014840c6d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:24.111494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:24.174941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:24.203989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b3b05546164d0a880e8f7014840c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:24.216969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b3b05546164d0a880e8f7014840c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:24.219016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b3b05546164d0a880e8f7014840c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:24.229990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b3b05546164d0a880e8f7014840c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:24.231041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b3b05546164d0a880e8f7014840c6d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:24.258169 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1575/3155] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:23 2022] DELETE /identity/v3/users/a1b3b05546164d0a880e8f7014840c6d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:24.262902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:24.263918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:24.264594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:24.323185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:24.323715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:24.543841 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1581/3156] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:24.560989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:24.567003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:24.698233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f40713d-5097-4424-ae79-c7ed70a35bc4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:24.709363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6f42e-88c9-4fbb-ac87-e4560469d470 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:24.710299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6f42e-88c9-4fbb-ac87-e4560469d470 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:24.710798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6f42e-88c9-4fbb-ac87-e4560469d470 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:24.711314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6f42e-88c9-4fbb-ac87-e4560469d470 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:24.734186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6f42e-88c9-4fbb-ac87-e4560469d470 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:24.735807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6f42e-88c9-4fbb-ac87-e4560469d470 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:24.759715 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1576/3157] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:25.855782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:25.857451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:25.880994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00fc4e-7a5e-4226-ac81-08c185abc982 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:25.892524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:25.893561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:25.894060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:25.894906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] PATH_INFO: `/v3/projects/f178cc67ffd64aeab6bdf6e446accfeb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:25.904612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f178cc67ffd64aeab6bdf6e446accfeb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:25.909005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:26.026071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f178cc67ffd64aeab6bdf6e446accfeb', 'request_id': 'req-a9235391-eb0a-4800-a655-068fa9a31476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:26.034267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f178cc67ffd64aeab6bdf6e446accfeb', 'request_id': 'req-a9235391-eb0a-4800-a655-068fa9a31476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:26.043618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f178cc67ffd64aeab6bdf6e446accfeb', 'request_id': 'req-a9235391-eb0a-4800-a655-068fa9a31476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:26.090186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] The token cache is being invalidate because project f178cc67ffd64aeab6bdf6e446accfeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:26.090614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:26.092321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9235391-eb0a-4800-a655-068fa9a31476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:26.099128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1582/3158] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:25 2022] DELETE /identity/v3/projects/f178cc67ffd64aeab6bdf6e446accfeb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:26.104438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.104947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.104947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.161325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:26.162801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:26.272460 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1577/3159] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:26.280145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.280624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.280974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.321385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:26.326573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:26.369569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1583/3160] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:26.374599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:26.390979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb78ee5-7db6-464d-a2d1-6e11ba12bea8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:26.414797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:26.416319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.416771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.417733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.417878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:26.418345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:26.420394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:26.449408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1578/3161] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:26.452735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:26.504131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc9bd-0027-417b-9f04-9253d3ebd742 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:26.514556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:26.516396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.516677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.518279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.521442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:26.526783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:26.590490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:26.613633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1584/3162] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:26 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:26.617490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:26.651126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1c7e0-3781-4ea6-9abb-c09918c5785d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:26.771598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:26.830044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:26.830785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.831066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.831409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.832068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:26.834141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:26.864550 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1579/3163] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:26 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:26.868630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:26.882328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec036a8c-f903-45d5-af0a-e5d4bd4958b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:26.888157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:26.889575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.890200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.890651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.893275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:26.895780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:26.911914 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1585/3164] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:55:26.915730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:26.931501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e04c8-7f3c-4b83-b8f6-076c0eb1caf5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:26.939092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48d02e-e09c-4a78-b533-6f321587d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:26.939371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d02e-e09c-4a78-b533-6f321587d03d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:26.940453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d02e-e09c-4a78-b533-6f321587d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:26.940762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48d02e-e09c-4a78-b533-6f321587d03d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:26.941440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d02e-e09c-4a78-b533-6f321587d03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:26.943160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48d02e-e09c-4a78-b533-6f321587d03d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:26.969390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:26.981262 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1580/3165] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:26.994598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ca1aa-df39-4fb5-8bb3-8151d4cf1285 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:27.015783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:27.017047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:27.017505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:27.018008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] PATH_INFO: `/v3/projects/fbcc7cd77eb0438c8f2f0560ea0c923a/users/9be1c7ffec4e427796b4f3563b99c319/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:27.077534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbcc7cd77eb0438c8f2f0560ea0c923a, user_id=9be1c7ffec4e427796b4f3563b99c319, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:27.081050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:27.121051 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1586/3166] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:26 2022] PUT /identity/v3/projects/fbcc7cd77eb0438c8f2f0560ea0c923a/users/9be1c7ffec4e427796b4f3563b99c319/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:27.126178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:27.126666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:27.130077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:27.197406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] MFA Rules not processed for user `9be1c7ffec4e427796b4f3563b99c319`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:27.200180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:27.364779 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1581/3167] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:27.370430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:27.517255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a15ab4-bf44-4107-b999-ea0849285468 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:27.524908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:27.525737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:27.526336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:27.526718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:27.527694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:27.530231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:27.586053 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1587/3168] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:27 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:27.589456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:27.609039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee806b-ceb5-4393-a032-0705502d7b04 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:27.754642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:27.755356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:27.755808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:27.756361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:27.757148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:27.759401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:27.819853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:27.832115 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1582/3169] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:27 2022] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:27.834620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358454-20b8-446a-bc75-3918bcf1f18c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:27.840477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:27.841319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:27.841600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:27.841933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:27.842818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:27.848382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:27.875062 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1588/3170] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:27.875698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:27.888188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523b9288-bf98-4dc8-b3df-c904565b64fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:27.895854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:27.896554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:27.897130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:27.897269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] PATH_INFO: `/v3/projects/2317cdee74d345e282f7b688324729c1/users/ff3e72f5d3f3474c9534d0c4e00c0852/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:27.923780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2317cdee74d345e282f7b688324729c1, user_id=ff3e72f5d3f3474c9534d0c4e00c0852, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:27.938829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:27.965437 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1583/3171] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:27 2022] PUT /identity/v3/projects/2317cdee74d345e282f7b688324729c1/users/ff3e72f5d3f3474c9534d0c4e00c0852/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:27.969482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:27.985426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5984de-4ddc-4736-8ab9-3d546ee37ded admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:28.138098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22500a00-7405-4cf1-91a8-d84756323a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:28.138401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22500a00-7405-4cf1-91a8-d84756323a0c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:28.138714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22500a00-7405-4cf1-91a8-d84756323a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:28.139081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22500a00-7405-4cf1-91a8-d84756323a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:28.139730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22500a00-7405-4cf1-91a8-d84756323a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:28.141428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22500a00-7405-4cf1-91a8-d84756323a0c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:28.161360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1589/3172] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:27 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:28.164701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:28.210096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d29b-8e43-49d4-a394-362bc11157e5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:28.216315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:28.217163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:28.217645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:28.218112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] PATH_INFO: `/v3/projects/2317cdee74d345e282f7b688324729c1/users/ff3e72f5d3f3474c9534d0c4e00c0852/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:28.220469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2317cdee74d345e282f7b688324729c1, user_id=ff3e72f5d3f3474c9534d0c4e00c0852, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:28.224959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:28.248920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:28.276944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:28.277781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:28.278334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:28.279410 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1584/3173] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:28 2022] PUT /identity/v3/projects/2317cdee74d345e282f7b688324729c1/users/ff3e72f5d3f3474c9534d0c4e00c0852/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:28.335860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] MFA Rules not processed for user `ff3e72f5d3f3474c9534d0c4e00c0852`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:28.337647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:28.364728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:28.476088 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1590/3174] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:28.490784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:28.494728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:28.589073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534ac02-6c5f-456a-b9f3-ddc7e789de92 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:28.595566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d00c9-ba39-4eb4-93c8-8d11458ca8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:28.596132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d00c9-ba39-4eb4-93c8-8d11458ca8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:28.596539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d00c9-ba39-4eb4-93c8-8d11458ca8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:28.597035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d00c9-ba39-4eb4-93c8-8d11458ca8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:28.611283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d00c9-ba39-4eb4-93c8-8d11458ca8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:28.613248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d00c9-ba39-4eb4-93c8-8d11458ca8e6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:28.625821 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1585/3175] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:29.652378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:29.654625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:29.682248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e22de-0698-495e-98cf-f50453a44ff7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:29.691257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:29.693870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:29.694176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:29.695769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:29.700680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:29.867851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:29.874760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dd5eb-edc6-4897-8587-738bc91525cd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:29.891833 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1591/3176] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:31.967345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d1dcd-87fe-4ad0-bcbc-ce95f0f1940a None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:31.968706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d1dcd-87fe-4ad0-bcbc-ce95f0f1940a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:31.969258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d1dcd-87fe-4ad0-bcbc-ce95f0f1940a None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:31.971080 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1586/3177] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:55:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:55:31.981293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:31.982306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:31.982842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:32.022953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:32.025887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:32.054394 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1592/3178] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:32.080387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d1dcd-87fe-4ad0-bcbc-ce95f0f1940a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:32.100229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d1dcd-87fe-4ad0-bcbc-ce95f0f1940a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:32.105526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc2821-0885-49eb-bf89-71235fd04938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:32.106882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc2821-0885-49eb-bf89-71235fd04938 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:32.107281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc2821-0885-49eb-bf89-71235fd04938 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:32.107682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc2821-0885-49eb-bf89-71235fd04938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:32.118862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc2821-0885-49eb-bf89-71235fd04938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:32.121193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc2821-0885-49eb-bf89-71235fd04938 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:32.146502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1587/3179] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:32.805102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:32.819124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176957-22e1-4648-bd49-5e066f54b415 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:32.825212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:32.826520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:32.827001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:32.827505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] PATH_INFO: `/v3/users/9be1c7ffec4e427796b4f3563b99c319` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:32.828918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be1c7ffec4e427796b4f3563b99c319)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:32.833220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:32.895924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be1c7ffec4e427796b4f3563b99c319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:32.914307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be1c7ffec4e427796b4f3563b99c319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:32.915180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be1c7ffec4e427796b4f3563b99c319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:32.923389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be1c7ffec4e427796b4f3563b99c319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:32.924093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be1c7ffec4e427796b4f3563b99c319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:32.939712 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1593/3180] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:32 2022] DELETE /identity/v3/users/9be1c7ffec4e427796b4f3563b99c319 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:32.945116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:32.945465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:32.946324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:32.970118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:32.972804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:33.057115 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1588/3181] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:33.068163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:33.070426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:33.104800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:33.126967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:33.132295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:33.163194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594d70-2266-4b5e-8fc3-5b37163087eb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:33.168692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:33.170690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:33.171003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:33.171895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] PATH_INFO: `/v3/users/2bccf42abb184f15ae36a855e0d8e68f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:33.174227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bccf42abb184f15ae36a855e0d8e68f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:33.178683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:33.211875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd39d59-cd05-4eff-ad66-7104f7aae681 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:33.216563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:33.217387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:33.217657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:33.218150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:33.247284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:33.252588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:33.266555 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1594/3182] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:33.274436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bccf42abb184f15ae36a855e0d8e68f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.289762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bccf42abb184f15ae36a855e0d8e68f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.291640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bccf42abb184f15ae36a855e0d8e68f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.303759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bccf42abb184f15ae36a855e0d8e68f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.305644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bccf42abb184f15ae36a855e0d8e68f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.354033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:33.368378 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1589/3183] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:33 2022] DELETE /identity/v3/users/2bccf42abb184f15ae36a855e0d8e68f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:33.721279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:33.723169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:33.745944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54535dbd-e44e-438d-af41-7870afd28edc service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:33.842947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:33.844059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:33.844475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:33.845821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] PATH_INFO: `/v3/projects/fbcc7cd77eb0438c8f2f0560ea0c923a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:33.848762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbcc7cd77eb0438c8f2f0560ea0c923a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:33.861474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:33.946116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbcc7cd77eb0438c8f2f0560ea0c923a', 'request_id': 'req-4a23f1b5-4722-42d8-8890-b0238a20d46c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.955548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbcc7cd77eb0438c8f2f0560ea0c923a', 'request_id': 'req-4a23f1b5-4722-42d8-8890-b0238a20d46c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.958640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:33.960445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:33.970323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbcc7cd77eb0438c8f2f0560ea0c923a', 'request_id': 'req-4a23f1b5-4722-42d8-8890-b0238a20d46c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.981985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fbc21-7f6e-4f80-a944-fc2a8febf38a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:33.992374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] The token cache is being invalidate because project fbcc7cd77eb0438c8f2f0560ea0c923a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:33.992812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.993481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:33.999521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1595/3184] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:33 2022] DELETE /identity/v3/projects/fbcc7cd77eb0438c8f2f0560ea0c923a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:34.000902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:34.003924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:34.123095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:34.127612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:34.128593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.129080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.129662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] PATH_INFO: `/v3/projects/87111b9e962d4606a29bc7ad37b8d484` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.131293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87111b9e962d4606a29bc7ad37b8d484)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:34.135455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:34.159188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f1b5-4722-42d8-8890-b0238a20d46c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:34.174082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:34.176763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.177221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.178119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] PATH_INFO: `/v3/users/ff3e72f5d3f3474c9534d0c4e00c0852` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.194803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3e72f5d3f3474c9534d0c4e00c0852)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:34.194803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:34.278588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87111b9e962d4606a29bc7ad37b8d484', 'request_id': 'req-6733ce07-1027-4abc-aa84-870a340156a7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.303507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87111b9e962d4606a29bc7ad37b8d484', 'request_id': 'req-6733ce07-1027-4abc-aa84-870a340156a7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.332001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3e72f5d3f3474c9534d0c4e00c0852'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.353367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87111b9e962d4606a29bc7ad37b8d484', 'request_id': 'req-6733ce07-1027-4abc-aa84-870a340156a7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.359001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3e72f5d3f3474c9534d0c4e00c0852'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.360445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3e72f5d3f3474c9534d0c4e00c0852'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.381180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3e72f5d3f3474c9534d0c4e00c0852'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.385429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3e72f5d3f3474c9534d0c4e00c0852'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.392814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] The token cache is being invalidate because project 87111b9e962d4606a29bc7ad37b8d484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:34.393092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.393926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6733ce07-1027-4abc-aa84-870a340156a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:34.399650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1590/3185] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:33 2022] DELETE /identity/v3/projects/87111b9e962d4606a29bc7ad37b8d484 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:34.401245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87740946-e73b-4d5b-921f-b2bc8052f8f5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.401578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87740946-e73b-4d5b-921f-b2bc8052f8f5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.401916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87740946-e73b-4d5b-921f-b2bc8052f8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.418566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1596/3186] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:33 2022] DELETE /identity/v3/users/ff3e72f5d3f3474c9534d0c4e00c0852 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:34.446586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-87740946-e73b-4d5b-921f-b2bc8052f8f5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:34.450833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-87740946-e73b-4d5b-921f-b2bc8052f8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:34.542481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:34.547955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:34.583660 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1591/3187] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:34.592640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.592640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.592640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.630876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:34.632501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:34.649900 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1592/3188] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:34.650861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:34.661224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e500cd8-de20-430e-86b1-74d7216b2ac4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:34.668468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:34.669164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.669445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.669713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.670582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:34.670963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:34.673650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:34.685980 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1593/3189] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:34.693612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:34.724313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549d8e-4007-460e-aace-e1930e882b52 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:34.727985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03574f1a-1a45-4505-9376-eb5f4d4c4f1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:34.730369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:34.730984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.731257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.731522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.731930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:34.732306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:34.732591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.732920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.733192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.736080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:34.744849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:34.774689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:34.826255 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1594/3190] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:34 2022] POST /identity/v3/projects => generated 395 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:34.827730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:34.883636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:34.885373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:34.904483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1597/3191] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:55:34.961601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cdb30-a212-4723-bffa-1dcda894c322 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:34.973583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:34.974289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:34.974576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:34.974851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:34.975497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:34.977432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:35.025192 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1595/3192] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:34 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:35.029230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:35.047381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f7ff0-8a4a-47e8-93c0-a0038d5f493f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:35.053737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:35.054314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.054740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.055101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.056484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:35.062337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:35.069381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:35.093996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:35.101726 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1598/3193] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:35.107100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42b65c-10c3-4889-9d7c-cbc5bec95d5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:35.121106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:35.121746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.122052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.122324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.122978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:35.124918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:35.155712 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1596/3194] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:55:35.157144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:35.194192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfad83-152d-4bde-bc7c-0a9a8136e12a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:35.214038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973710c7-9cd7-4aa8-a0ed-be2e2a7254d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:35.216161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973710c7-9cd7-4aa8-a0ed-be2e2a7254d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.216509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973710c7-9cd7-4aa8-a0ed-be2e2a7254d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.217734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973710c7-9cd7-4aa8-a0ed-be2e2a7254d8 admin admin] PATH_INFO: `/v3/projects/fc54ca946910499d877b803cd567d289/users/384db252fce5450eb3a2121da5d0fab2/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.262564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:35.265061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973710c7-9cd7-4aa8-a0ed-be2e2a7254d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc54ca946910499d877b803cd567d289, user_id=384db252fce5450eb3a2121da5d0fab2, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:35.266534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:35.271244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973710c7-9cd7-4aa8-a0ed-be2e2a7254d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:35.298102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a5a7d-7486-44e4-bbb7-aa854f30214a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:35.313085 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1599/3195] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:35 2022] PUT /identity/v3/projects/fc54ca946910499d877b803cd567d289/users/384db252fce5450eb3a2121da5d0fab2/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:35.324325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa53e4-63d8-4466-be12-b14131e84aa5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.324325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa53e4-63d8-4466-be12-b14131e84aa5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.324496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa53e4-63d8-4466-be12-b14131e84aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.400261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8aa53e4-63d8-4466-be12-b14131e84aa5 None None] MFA Rules not processed for user `384db252fce5450eb3a2121da5d0fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:35.404873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8aa53e4-63d8-4466-be12-b14131e84aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:35.510337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:35.511205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.511484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.511760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] PATH_INFO: `/v3/projects/2317cdee74d345e282f7b688324729c1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.518914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2317cdee74d345e282f7b688324729c1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:35.520998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:35.532412 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1600/3196] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:35.540617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a19a-7dc9-4b5a-8569-e36565af332c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.543196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a19a-7dc9-4b5a-8569-e36565af332c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.544076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42a19a-7dc9-4b5a-8569-e36565af332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.606761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e42a19a-7dc9-4b5a-8569-e36565af332c None None] MFA Rules not processed for user `384db252fce5450eb3a2121da5d0fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:35.608694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e42a19a-7dc9-4b5a-8569-e36565af332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:35.622189 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1601/3197] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:35.658778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2317cdee74d345e282f7b688324729c1', 'request_id': 'req-dc695261-8d62-4898-8432-f25369bedbff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:35.674265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2317cdee74d345e282f7b688324729c1', 'request_id': 'req-dc695261-8d62-4898-8432-f25369bedbff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:35.690129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2317cdee74d345e282f7b688324729c1', 'request_id': 'req-dc695261-8d62-4898-8432-f25369bedbff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:35.706515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:35.711872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] The token cache is being invalidate because project 2317cdee74d345e282f7b688324729c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:35.716608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:35.717686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dc695261-8d62-4898-8432-f25369bedbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:35.719947 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1597/3198] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:35 2022] DELETE /identity/v3/projects/2317cdee74d345e282f7b688324729c1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:35.724651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.725428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.725773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.770813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:35.772076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:35.883886 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1602/3199] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:35.885259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.885467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.886100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.913086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:35.914356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:35.922711 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1598/3200] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:35.927565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:35.940645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500183c-e129-41b2-9f12-65771bf151ef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:35.956442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:35.960742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:35.961677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:35.962180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:35.962644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:35.963679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:35.965239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:35.971662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:35.979060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.021347 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1603/3201] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:36.022858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:36.059647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080918-1290-496f-9abd-46c1bcbc1a39 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.073153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.073789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.074100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.074373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.077313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.079895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.108169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73708e-50f7-4a83-b481-36b0c7d66d70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.116685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.117790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.118345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.118837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.121449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.126095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1604/3202] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:36 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:36.130164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:36.169408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:36.246245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0cd60-7303-4891-b97b-6f1fdfed070f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.256073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.257702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a906bcc-4ec7-4718-9a2a-b7b306efe30d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.269163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.270070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.270559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.271034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.272557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.278904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.282768 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1599/3203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:35 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:36.305220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.306704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.307249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.329781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1605/3204] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:36 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:55:36.333679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:36.353963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7cc5-5da3-4dfa-936c-52599f002f1b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.369930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] MFA Rules not processed for user `384db252fce5450eb3a2121da5d0fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:36.372649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.373438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.373828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.374191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.374986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.376734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.376859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.411146 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1606/3205] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:36.412645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:36.424080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c526eb9-7d8b-4214-ba10-c042bb0d1b5d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.430145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.430781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.431064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.431335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.432044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.435068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.464298 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1607/3206] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:36.466127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:36.478579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.528435 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1600/3207] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:36.528435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:36.590929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263b3d2-d32c-45d8-ba8e-0f5c00c95954 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.601610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113260af-3cf3-459e-9875-2c81a4ad2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.602421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113260af-3cf3-459e-9875-2c81a4ad2e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.602722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113260af-3cf3-459e-9875-2c81a4ad2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.602954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113260af-3cf3-459e-9875-2c81a4ad2e02 admin admin] PATH_INFO: `/v3/projects/551af258ebf94b82ae9bb3e8c2de6874/users/857924adb79446128a890d798d6b07c9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.639153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113260af-3cf3-459e-9875-2c81a4ad2e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=551af258ebf94b82ae9bb3e8c2de6874, user_id=857924adb79446128a890d798d6b07c9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.642832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113260af-3cf3-459e-9875-2c81a4ad2e02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.651205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab40bec-9c38-47c8-ad09-4c3249b39715 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:36.658846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:36.659868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.660457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.661010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.664549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.670313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1601/3208] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:36 2022] PUT /identity/v3/projects/551af258ebf94b82ae9bb3e8c2de6874/users/857924adb79446128a890d798d6b07c9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:36.671669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc3f8-2e93-44e6-bfc4-02ec33ac1c13 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.671959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc3f8-2e93-44e6-bfc4-02ec33ac1c13 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.672233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bfc3f8-2e93-44e6-bfc4-02ec33ac1c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.697102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-79bfc3f8-2e93-44e6-bfc4-02ec33ac1c13 None None] MFA Rules not processed for user `384db252fce5450eb3a2121da5d0fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:36.713058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79bfc3f8-2e93-44e6-bfc4-02ec33ac1c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.719209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:36.794251 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1602/3209] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:36.796281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036e0c-a542-41ac-acb2-647a03a52682 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.797988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036e0c-a542-41ac-acb2-647a03a52682 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.798369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d036e0c-a542-41ac-acb2-647a03a52682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.804523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:36.806367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b708112-656a-4d80-ac11-20f46b9edaee service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:36.846664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1608/3210] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:36.848415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:36.854153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:36.854656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:36.882321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d036e0c-a542-41ac-acb2-647a03a52682 None None] MFA Rules not processed for user `857924adb79446128a890d798d6b07c9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:36.886209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d036e0c-a542-41ac-acb2-647a03a52682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.952857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] MFA Rules not processed for user `384db252fce5450eb3a2121da5d0fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:36.960412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:36.984829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1609/3211] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:37.025590 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1603/3212] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:37.068793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:37.071560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:37.109172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:37.177891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a6996-93f9-4ad5-a20d-dd8c715c7f34 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:37.182153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:37.183119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:37.183468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:37.183875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:37.203686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:37.208310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:37.232559 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1610/3213] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:37 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:37.329815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a6ab-1c2b-42c7-a80f-af2a6999cb70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:37.329815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a6ab-1c2b-42c7-a80f-af2a6999cb70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:37.329815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a6ab-1c2b-42c7-a80f-af2a6999cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:37.369215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4ae6a6ab-1c2b-42c7-a80f-af2a6999cb70 None None] MFA Rules not processed for user `384db252fce5450eb3a2121da5d0fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:37.378977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ae6a6ab-1c2b-42c7-a80f-af2a6999cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:37.406561 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1604/3214] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:37.586336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:37.591915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:37.846877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b03f7-3b68-493e-8a63-e0b3e0b83615 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:37.858679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:37.860124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:37.860534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:37.860931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] PATH_INFO: `/v3/users/384db252fce5450eb3a2121da5d0fab2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:37.862356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384db252fce5450eb3a2121da5d0fab2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:37.870814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:37.946258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384db252fce5450eb3a2121da5d0fab2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:37.962283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384db252fce5450eb3a2121da5d0fab2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:37.963037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384db252fce5450eb3a2121da5d0fab2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:37.972495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384db252fce5450eb3a2121da5d0fab2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:37.973420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384db252fce5450eb3a2121da5d0fab2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:38.019302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1611/3215] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:37 2022] DELETE /identity/v3/users/384db252fce5450eb3a2121da5d0fab2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:38.020548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2038f6-2d8e-4cf6-a0af-c305069f1015 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:38.020840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2038f6-2d8e-4cf6-a0af-c305069f1015 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:38.021119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2038f6-2d8e-4cf6-a0af-c305069f1015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:38.055927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf2038f6-2d8e-4cf6-a0af-c305069f1015 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:38.057340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf2038f6-2d8e-4cf6-a0af-c305069f1015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:38.195121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1605/3216] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:38.274097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:38.274097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:38.386737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:38.463162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709db33d-bae0-4b1d-baaa-504f855e3fa4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:38.476841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:38.477385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:38.477669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:38.477976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:38.496208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:38.497814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:38.513990 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1612/3217] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:38.779271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac561a0a-e861-4812-8aa8-f4983304f29f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:38.779784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac561a0a-e861-4812-8aa8-f4983304f29f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:38.779864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac561a0a-e861-4812-8aa8-f4983304f29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:38.825817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ac561a0a-e861-4812-8aa8-f4983304f29f None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:38.830749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac561a0a-e861-4812-8aa8-f4983304f29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:38.883416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:38.937977 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1606/3218] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:40.442232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:40.444902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:40.477952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e2f83-3408-48dc-b8dd-212a1f917f6f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:40.500001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:40.500683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:40.500965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:40.501241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] PATH_INFO: `/v3/projects/fc54ca946910499d877b803cd567d289` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:40.504684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc54ca946910499d877b803cd567d289)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:40.513247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:40.632501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc54ca946910499d877b803cd567d289', 'request_id': 'req-b9392f4b-4bb2-46b2-98c1-49013719f5c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:40.648483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc54ca946910499d877b803cd567d289', 'request_id': 'req-b9392f4b-4bb2-46b2-98c1-49013719f5c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:40.683269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc54ca946910499d877b803cd567d289', 'request_id': 'req-b9392f4b-4bb2-46b2-98c1-49013719f5c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:40.714400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] The token cache is being invalidate because project fc54ca946910499d877b803cd567d289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:40.715270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:40.716598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9392f4b-4bb2-46b2-98c1-49013719f5c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:40.719514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1613/3219] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:40 2022] DELETE /identity/v3/projects/fc54ca946910499d877b803cd567d289 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:40.724666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446ead-0584-4f00-b8de-292f0b336f88 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:40.725703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446ead-0584-4f00-b8de-292f0b336f88 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:40.726214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b446ead-0584-4f00-b8de-292f0b336f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:40.767229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:40.772033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:40.774075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:40.796619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2b446ead-0584-4f00-b8de-292f0b336f88 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:40.803595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b446ead-0584-4f00-b8de-292f0b336f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:41.011703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:41.012943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:41.018601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1607/3220] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:41.026878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.027390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.027705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.063257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:41.064662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:41.080200 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1608/3221] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:55:41.081697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.095913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf600d-9552-4882-afd2-1aa03402e3b3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.113837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.117031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.117031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.117200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.119599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:41.124758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.132600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.159486 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1609/3222] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:41.163885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.181486 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1614/3223] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:55:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:41.194789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.195725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06516f7-0e7f-4664-a9b2-0db10b05e95f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.196250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:41.207592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.208624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.208962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.209407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.210979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.216072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.278141 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1610/3224] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:41 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:41.282236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.352911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:41.443235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcdadd-5452-477e-b76c-5c4a5392aae6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.466401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464acf7f-caec-4888-aec3-6d6073482d3d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.478525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.479586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.480559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.480976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.482038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.498533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.563013 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1611/3225] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:41 2022] POST /identity/v3/users => generated 292 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:41.564061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.577725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22df3a-83a4-4714-a046-a4dc963f4b90 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.583922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.584555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.584829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.585096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.585738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.587512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.607017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1612/3226] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:41.610969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.627868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a52d2-54e8-4a80-967c-c0e8c7b4a66d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.633059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a52d2-54e8-4a80-967c-c0e8c7b4a66d service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.633552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a52d2-54e8-4a80-967c-c0e8c7b4a66d service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.633968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a52d2-54e8-4a80-967c-c0e8c7b4a66d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.637613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f5d98-e748-45a8-b1fc-55cd8ba76a8c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.654323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.655775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.655775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.656022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.656683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.660564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.686772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1613/3227] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:41.691107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:41.714853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f5f9d-881c-4823-8b6a-54d6275791c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:41.728122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:41.728810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.729642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.730088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] PATH_INFO: `/v3/projects/9f94d5560cbe4ad98fdb148e80c66ffc/users/3c307a82cd9d4c3f884e67c376757a6a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.752212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a52d2-54e8-4a80-967c-c0e8c7b4a66d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.754649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a52d2-54e8-4a80-967c-c0e8c7b4a66d service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.763259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:41.768295 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1615/3228] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:55:41.798665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f94d5560cbe4ad98fdb148e80c66ffc, user_id=3c307a82cd9d4c3f884e67c376757a6a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:41.838815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:41.876267 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1614/3229] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:41 2022] PUT /identity/v3/projects/9f94d5560cbe4ad98fdb148e80c66ffc/users/3c307a82cd9d4c3f884e67c376757a6a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:41.883926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:41.884414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:41.885536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:41.996571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:41.998151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:42.198073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1616/3230] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:42.369170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:42.371769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:42.647874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1838-6831-419e-802d-74d80f216e95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:42.664519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:42.666241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:42.668968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:42.669474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:42.708429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:42.711608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:42.762807 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1615/3231] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:44.202303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:44.205277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:44.229160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fefa3-e919-4938-9fa4-4f6246c734ae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:44.240139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:44.241037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:44.241427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:44.241789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:44.243800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:44.270512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:44.272183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:44.301078 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1617/3232] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:46.323409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:46.325278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:46.384448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bcdaf-1ebd-4934-984c-327f7a06d6b1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:46.404492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:46.405544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:46.406031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:46.406489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] PATH_INFO: `/v3/users/487d794ccbf544809c8e422efe507716` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:46.408425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487d794ccbf544809c8e422efe507716)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:46.410630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:46.561840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487d794ccbf544809c8e422efe507716'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:46.579732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487d794ccbf544809c8e422efe507716'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:46.580713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487d794ccbf544809c8e422efe507716'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:46.648582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487d794ccbf544809c8e422efe507716'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:46.652907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d04d310-f3cb-44e5-bb37-1a1179135f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487d794ccbf544809c8e422efe507716'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:46.714193 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1616/3233] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:46 2022] DELETE /identity/v3/users/487d794ccbf544809c8e422efe507716 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:47.790948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:47.798793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:47.809583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06417d-a8d6-408d-a867-7ab33cb0b0c9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:47.965343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:47.967937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:47.970793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:47.971629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] PATH_INFO: `/v3/projects/431241db26d44c4ea915ded528edb4f8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:47.974602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431241db26d44c4ea915ded528edb4f8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:47.994676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:48.142896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431241db26d44c4ea915ded528edb4f8', 'request_id': 'req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:48.157104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431241db26d44c4ea915ded528edb4f8', 'request_id': 'req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:48.180743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431241db26d44c4ea915ded528edb4f8', 'request_id': 'req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:48.206385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] The token cache is being invalidate because project 431241db26d44c4ea915ded528edb4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:48.206680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:48.208313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6ca4afde-0f3b-42e9-ae82-98cfdf8877c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:48.211372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1618/3234] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:47 2022] DELETE /identity/v3/projects/431241db26d44c4ea915ded528edb4f8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:48.217452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:48.217988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:48.218065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:48.266864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:48.270994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:48.470387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:48.509858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1617/3235] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:48.511291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:48.511599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:48.511873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:48.596040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:48.597788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:48.626404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:48.643362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1619/3236] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:48.649116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c90ad-0972-455a-8a1c-c79cf6061e6b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:48.654934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:48.656563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:48.657176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:48.657717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:48.658637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:48.659248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:48.662777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:48.681738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:48.700162 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1618/3237] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:48.701925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71ce01-7996-41bb-9652-3ab88eaffbb1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:48.711532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:48.712433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:48.712846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:48.713538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:48.714567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:48.717094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:48.809214 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1620/3238] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:48 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:48.812869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:48.836171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc275c-c528-431b-b9ae-2839e75bc75d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:48.970670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:48.974954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:48.975775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:48.976898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:48.977848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:48.981012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:49.054951 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1619/3239] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:48 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:49.061714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:49.090916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adbaf6-e3bf-4f0a-b09c-e658be588b91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:49.105335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:49.106907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:49.108334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:49.108849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:49.110991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:49.114992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:49.153897 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1621/3240] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:49.154426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:49.189133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9394533-ad61-4f7d-b938-68bca7f4ac4d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:49.215857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df86f0-a030-49d0-9f1b-e3b1fb5e2685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:49.217414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df86f0-a030-49d0-9f1b-e3b1fb5e2685 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:49.217700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df86f0-a030-49d0-9f1b-e3b1fb5e2685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:49.218289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df86f0-a030-49d0-9f1b-e3b1fb5e2685 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:49.218676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df86f0-a030-49d0-9f1b-e3b1fb5e2685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:49.220308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df86f0-a030-49d0-9f1b-e3b1fb5e2685 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:49.260032 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1620/3241] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:49.264417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:49.283050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266a088-3c28-4600-bca6-1f091a863bf7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:49.299585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:49.300359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:49.300842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:49.301188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] PATH_INFO: `/v3/projects/81d9071c47304d7ca128734f7bc8eeed/users/f909cc7113594047add07a2bbd14187a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:49.333471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d9071c47304d7ca128734f7bc8eeed, user_id=f909cc7113594047add07a2bbd14187a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:49.336799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:49.393193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:49.393709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:49.394221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:49.416542 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1622/3242] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:49 2022] PUT /identity/v3/projects/81d9071c47304d7ca128734f7bc8eeed/users/f909cc7113594047add07a2bbd14187a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:55:49.460197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:49.463224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:49.765425 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1621/3243] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:50.056549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:50.058567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:50.132762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:50.214988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfe66e-7248-47ca-bf9a-9d296b8cd656 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:50.229524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeaea4-dd59-4278-b126-861f6a054564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:50.230507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeaea4-dd59-4278-b126-861f6a054564 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:50.230976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeaea4-dd59-4278-b126-861f6a054564 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:50.231646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeaea4-dd59-4278-b126-861f6a054564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:50.269913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeaea4-dd59-4278-b126-861f6a054564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:50.271432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeaea4-dd59-4278-b126-861f6a054564 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:50.287386 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1623/3244] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:57.007922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:57.014696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:57.057168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30307aa9-56cb-4062-bcdc-a9dc1523500b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:57.082786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:57.083555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:57.083935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:57.084332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] PATH_INFO: `/v3/users/857924adb79446128a890d798d6b07c9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:57.088450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=857924adb79446128a890d798d6b07c9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:57.093115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:57.198253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857924adb79446128a890d798d6b07c9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:57.217638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857924adb79446128a890d798d6b07c9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:57.218439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857924adb79446128a890d798d6b07c9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:57.225620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:57.229078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857924adb79446128a890d798d6b07c9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:57.230159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857924adb79446128a890d798d6b07c9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:57.267013 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1622/3245] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:55:57 2022] DELETE /identity/v3/users/857924adb79446128a890d798d6b07c9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:57.271342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:57.272226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:57.272731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:57.315049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:57.316638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:57.465707 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1624/3246] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:57.535490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:57.537152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:57.668799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021a139-6c17-4044-8326-d6b16ebfa0b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:57.673516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341d0ab-c42d-421d-b6c6-9893ae1ee47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:57.674403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341d0ab-c42d-421d-b6c6-9893ae1ee47d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:57.674786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341d0ab-c42d-421d-b6c6-9893ae1ee47d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:57.675155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341d0ab-c42d-421d-b6c6-9893ae1ee47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:57.688572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341d0ab-c42d-421d-b6c6-9893ae1ee47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:57.690480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341d0ab-c42d-421d-b6c6-9893ae1ee47d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:57.703739 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1623/3247] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:55:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:55:58.683091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:58.684641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:58.712575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039d0ae-21ac-4a60-8333-cdd55065dce1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:58.728844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:58.729787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:58.730251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:58.730671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] PATH_INFO: `/v3/projects/551af258ebf94b82ae9bb3e8c2de6874` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:58.732090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] RBAC: Authorizing `identity:delete_project(project_id=551af258ebf94b82ae9bb3e8c2de6874)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:58.734556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:58.816905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '551af258ebf94b82ae9bb3e8c2de6874', 'request_id': 'req-70e9fa01-e562-4e3a-9be8-6a943d0eb979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:58.824926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '551af258ebf94b82ae9bb3e8c2de6874', 'request_id': 'req-70e9fa01-e562-4e3a-9be8-6a943d0eb979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:58.833320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '551af258ebf94b82ae9bb3e8c2de6874', 'request_id': 'req-70e9fa01-e562-4e3a-9be8-6a943d0eb979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:58.855846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] The token cache is being invalidate because project 551af258ebf94b82ae9bb3e8c2de6874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:55:58.856326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:58.871011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-70e9fa01-e562-4e3a-9be8-6a943d0eb979 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:55:58.873968 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1625/3248] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:55:58 2022] DELETE /identity/v3/projects/551af258ebf94b82ae9bb3e8c2de6874 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:58.878902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:58.879660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:58.880079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:58.909217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:58.911343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:59.055762 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1624/3249] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:59.062420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.062709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.063031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.110434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:59.110434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:55:59.130120 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1626/3250] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:55:59.134275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:59.144980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c434780-cd5a-4109-b699-067701b5f0d6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:59.162460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:59.163100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.163383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.163655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.164340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:55:59.164620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:59.166397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:59.197329 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1625/3251] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:55:59.201687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:59.211790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f14dd-cbfa-4d6b-bb23-7bddf8cdba6c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:59.231245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:59.232128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.232560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.232984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.233788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:59.236101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:59.297419 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1627/3252] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:55:59 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:55:59.301635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:59.315989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e66971-9221-4900-95dd-22c8e136002f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:59.477481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:59.478178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.478454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.484342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.485078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:59.499991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:59.540165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:59.558556 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1626/3253] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:55:59 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:55:59.559323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:59.595810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930e248-5ee0-4c9d-b8ef-722dd119ee7a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:59.601177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:59.601825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.602116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.602387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.603546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:59.605168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:59.618600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1628/3254] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:55:59.622995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:59.635534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fca3c-4da8-465c-83fa-0684739afa84 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:59.651078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693ab1b-70fe-4e90-b4be-7ef3e0a78e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:59.651716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ab1b-70fe-4e90-b4be-7ef3e0a78e9c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.651995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ab1b-70fe-4e90-b4be-7ef3e0a78e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.652261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693ab1b-70fe-4e90-b4be-7ef3e0a78e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.653696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693ab1b-70fe-4e90-b4be-7ef3e0a78e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:59.655511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693ab1b-70fe-4e90-b4be-7ef3e0a78e9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:59.688150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1627/3255] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:55:59.692573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:55:59.707232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4961f-20f9-459e-94e0-878228efb6fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:55:59.722643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:55:59.723414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.723785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.723973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] PATH_INFO: `/v3/projects/27aa3da3170a4ab5a57ef15f20483b4f/users/059a7b31cf2f45bda437a84510b29e56/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.750384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:55:59.754417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27aa3da3170a4ab5a57ef15f20483b4f, user_id=059a7b31cf2f45bda437a84510b29e56, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:55:59.758743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:55:59.796133 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1629/3256] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:55:59 2022] PUT /identity/v3/projects/27aa3da3170a4ab5a57ef15f20483b4f/users/059a7b31cf2f45bda437a84510b29e56/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:55:59.810285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:55:59.810285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:55:59.810285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:55:59.875756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] MFA Rules not processed for user `059a7b31cf2f45bda437a84510b29e56`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:55:59.876916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:00.063144 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1628/3257] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:55:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:00.102318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:00.104721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:00.260450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a8ac1-ea1d-4e9a-9446-b15b64478e7c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:00.273931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:00.274810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:00.275261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:00.275669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:00.291755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:00.294291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:00.309216 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1630/3258] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:00.325346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:00.327282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:00.434061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab582927-72e6-4687-8be4-85eedae5a11e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:00.442629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:00.443964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:00.444900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:00.445280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] PATH_INFO: `/v3/users/f0ea28d9bb3544bca1a3c90d983fe8e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:00.447186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ea28d9bb3544bca1a3c90d983fe8e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:00.453760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:00.544400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ea28d9bb3544bca1a3c90d983fe8e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:00.556610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ea28d9bb3544bca1a3c90d983fe8e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:00.557898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ea28d9bb3544bca1a3c90d983fe8e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:00.577856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ea28d9bb3544bca1a3c90d983fe8e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:00.578821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ea28d9bb3544bca1a3c90d983fe8e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:00.644452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:00.677611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1629/3259] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:00 2022] DELETE /identity/v3/users/f0ea28d9bb3544bca1a3c90d983fe8e4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:01.780478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:01.812861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1548d-a4fc-44ea-af37-cba3ad7c0aac service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:02.092876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:02.093595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:02.098227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:02.098666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] PATH_INFO: `/v3/projects/60896479fb0c4357ad5fb03016470283` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:02.103667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60896479fb0c4357ad5fb03016470283)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:02.106470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:02.269214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60896479fb0c4357ad5fb03016470283', 'request_id': 'req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.287340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60896479fb0c4357ad5fb03016470283', 'request_id': 'req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.318150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60896479fb0c4357ad5fb03016470283', 'request_id': 'req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.344301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] The token cache is being invalidate because project 60896479fb0c4357ad5fb03016470283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:02.344601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.348640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.363366 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1631/3260] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:01 2022] DELETE /identity/v3/projects/60896479fb0c4357ad5fb03016470283 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:02.364304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:02.365914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:02.411782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21577279-0965-4a1a-8be6-e2c8c3caa7f1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:02.618874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:02.619542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:02.620244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:02.620455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] PATH_INFO: `/v3/users/8174a907c0c5453eb52b6ca846a7f819` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:02.623540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8174a907c0c5453eb52b6ca846a7f819)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:02.626910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:02.758063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8174a907c0c5453eb52b6ca846a7f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.772462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8174a907c0c5453eb52b6ca846a7f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.773332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8174a907c0c5453eb52b6ca846a7f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.806882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8174a907c0c5453eb52b6ca846a7f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.814319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8174a907c0c5453eb52b6ca846a7f819'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:02.868136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1630/3261] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:02 2022] DELETE /identity/v3/users/8174a907c0c5453eb52b6ca846a7f819 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:03.835174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:03.838614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:03.882170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c2bb1-2430-4eb8-8a19-a5cb65c2f4b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:04.003651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:04.020055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:04.021595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:04.182714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:04.184242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:04.184522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:04.184834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] PATH_INFO: `/v3/projects/42308a54f9f341b9b8c232c0879961af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:04.186305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42308a54f9f341b9b8c232c0879961af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:04.188373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:04.302664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42308a54f9f341b9b8c232c0879961af', 'request_id': 'req-b845c75d-0f03-4cc0-8721-ab1384e96ac2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:04.320742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42308a54f9f341b9b8c232c0879961af', 'request_id': 'req-b845c75d-0f03-4cc0-8721-ab1384e96ac2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:04.351979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42308a54f9f341b9b8c232c0879961af', 'request_id': 'req-b845c75d-0f03-4cc0-8721-ab1384e96ac2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:04.416586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] The token cache is being invalidate because project 42308a54f9f341b9b8c232c0879961af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:04.417454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:04.418213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b845c75d-0f03-4cc0-8721-ab1384e96ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:04.428577 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1632/3262] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:03 2022] DELETE /identity/v3/projects/42308a54f9f341b9b8c232c0879961af => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:04.434487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f413-9021-4b5a-8639-6064c511a092 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:04.434831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f413-9021-4b5a-8639-6064c511a092 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:04.435104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731f413-9021-4b5a-8639-6064c511a092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:04.438704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b793b-09ec-406d-b14a-f9f7254afb2c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:04.469399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:04.499593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b731f413-9021-4b5a-8639-6064c511a092 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:04.502862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b731f413-9021-4b5a-8639-6064c511a092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:04.684454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:04.685159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:04.685520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:04.685718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:04.688557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:04.737162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:04.739090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:04.760379 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1633/3263] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:04.766211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:04.766532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:04.766844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:04.779380 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1631/3264] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 760 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:56:04.810061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:04.811669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:04.840079 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1634/3265] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:56:04.840868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:04.860764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a95334-fab1-403a-84f5-624de2d17058 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:04.887022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:04.887970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:04.888539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:04.888991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:04.889692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:04.890037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:04.891695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:04.938515 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1632/3266] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:04.943544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:04.956551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b2dc-7d71-48d8-b0f6-bd18e1b27d13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:04.963142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:04.963938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:04.964318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:04.964694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:04.965453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:04.974280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:05.098216 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1635/3267] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:04 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:05.098429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:05.115901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7403-88cc-4eb0-8cc3-753103eb3592 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:05.325619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:05.326602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:05.326874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:05.327149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:05.327798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:05.329761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:05.394035 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1633/3268] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:05 2022] POST /identity/v3/users => generated 286 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:05.398869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:05.419991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4802c0-7cb0-40ed-a162-131d9a4919b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:05.438014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:05.440147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:05.441088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:05.441521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:05.442379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:05.444367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:05.461420 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1636/3269] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:05.465416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:05.516377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b7d92-ecb6-4d89-91bd-6ffaf9c340d8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:05.566190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e083f-91f4-46a6-93d1-7996cb41ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:05.566589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e083f-91f4-46a6-93d1-7996cb41ac3e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:05.566858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e083f-91f4-46a6-93d1-7996cb41ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:05.567119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e083f-91f4-46a6-93d1-7996cb41ac3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:05.567785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e083f-91f4-46a6-93d1-7996cb41ac3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:05.579002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e083f-91f4-46a6-93d1-7996cb41ac3e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:05.608984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:05.645441 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1634/3270] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:05 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:05.647944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f1f6a-0271-415f-b3f6-3c44add4a18d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:05.680749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:05.681953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:05.682901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:05.683453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] PATH_INFO: `/v3/projects/bb4932874cc24e0799ad24fe4552df08/users/763da0ad486b45dfa9236753decbed13/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:05.725355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:05.738135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4932874cc24e0799ad24fe4552df08, user_id=763da0ad486b45dfa9236753decbed13, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:05.752474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:05.791788 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1637/3271] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:05 2022] PUT /identity/v3/projects/bb4932874cc24e0799ad24fe4552df08/users/763da0ad486b45dfa9236753decbed13/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:05.797532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:05.798044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:05.798436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:05.919148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] MFA Rules not processed for user `763da0ad486b45dfa9236753decbed13`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:05.928719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:06.094704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:06.120786 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1635/3272] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:06.125645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:06.323415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f901d-c927-4e91-993a-2d901364d426 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:06.343563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:06.344454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:06.344800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:06.345138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:06.345893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:06.364463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:06.452827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:06.452973 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1638/3273] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:06 2022] POST /identity/v3/projects => generated 373 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:06.484298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea013963-1d2d-42ce-84a3-ac2064800fc6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:06.648410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:06.649056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:06.649333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:06.649606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:06.650308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:06.656511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:06.710447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1636/3274] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:06 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:06.713415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:06.726126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072e100-feab-4636-856c-c6cddde5821f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:06.753872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:06.754496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:06.754775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:06.755049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:06.755715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:06.761861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:06.802273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:06.804206 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1639/3275] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:06.827590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f8dd9-115e-4d38-99eb-10e1547b65e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:06.839961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:06.842870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:06.843447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:06.845143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] PATH_INFO: `/v3/projects/be813bcf97bd4fb6be7cd7cac88f086f/users/f54c55feea754229b521717b83bd4bfb/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:06.894282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be813bcf97bd4fb6be7cd7cac88f086f, user_id=f54c55feea754229b521717b83bd4bfb, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:06.897760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:06.924298 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1637/3276] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:06 2022] PUT /identity/v3/projects/be813bcf97bd4fb6be7cd7cac88f086f/users/f54c55feea754229b521717b83bd4bfb/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:06.928333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:06.941068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c4464-6009-48d9-b2dd-77c3a334ca4c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:07.155678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4c505-36e5-4b52-916f-d95fbf6cbaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:07.157116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4c505-36e5-4b52-916f-d95fbf6cbaae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:07.157537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4c505-36e5-4b52-916f-d95fbf6cbaae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:07.157983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4c505-36e5-4b52-916f-d95fbf6cbaae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:07.158920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4c505-36e5-4b52-916f-d95fbf6cbaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:07.161180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4c505-36e5-4b52-916f-d95fbf6cbaae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:07.179255 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1640/3277] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:07.180256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:07.196597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba92-ceef-4c4c-ba1b-672486f474f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:07.227606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:07.228874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:07.234000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:07.234535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] PATH_INFO: `/v3/projects/be813bcf97bd4fb6be7cd7cac88f086f/users/f54c55feea754229b521717b83bd4bfb/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:07.239225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be813bcf97bd4fb6be7cd7cac88f086f, user_id=f54c55feea754229b521717b83bd4bfb, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:07.244709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:07.288635 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1638/3278] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:07 2022] PUT /identity/v3/projects/be813bcf97bd4fb6be7cd7cac88f086f/users/f54c55feea754229b521717b83bd4bfb/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:07.302416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:07.302700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:07.302983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:07.400242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] MFA Rules not processed for user `f54c55feea754229b521717b83bd4bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:07.401908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:07.549044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:07.646076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1641/3279] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:07.653983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:07.671956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626a8a6-b883-4825-ab3d-e40cbfe69619 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:07.687923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:07.691851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:07.692289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:07.692697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:07.694025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:07.694469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:07.696225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:07.749413 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1639/3280] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:07.756408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:07.775742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52e1b4-7a94-47d1-a153-e307e383b4e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:07.799877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:07.800675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:07.801236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:07.801630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:07.803618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:07.807015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:07.887512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1642/3281] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:07 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:07.891083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:07.907044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0439e8-5b3a-4aee-ac6a-64e4a73585bd tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:08.053195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:08.058011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:08.059459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:08.061314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:08.064063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:08.064360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:08.072996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccef37-bff9-438c-a6ea-fa7fa7fb9e98 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:08.141013 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1640/3282] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:08.144111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:08.146154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:08.424787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d52e6-2365-4770-9761-367ceab83b61 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:08.461018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:08.464860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:08.469239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:08.470278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:08.514107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:08.517508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:08.608128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1643/3283] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:08.645214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4bd88-db9e-4521-9e32-7c4cff20aea4 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:08.645717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4bd88-db9e-4521-9e32-7c4cff20aea4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:08.645795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4bd88-db9e-4521-9e32-7c4cff20aea4 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:08.647396 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1641/3284] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:56:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:56:08.661565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:56:08.683139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:08.708480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954c8481-4e85-4f44-ae71-efa3508b25ae service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:08.724068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5b086-1005-4cb5-8e2c-b82b44cc285c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:08.725146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b086-1005-4cb5-8e2c-b82b44cc285c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:08.725645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b086-1005-4cb5-8e2c-b82b44cc285c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:08.726176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5b086-1005-4cb5-8e2c-b82b44cc285c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:08.728179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5b086-1005-4cb5-8e2c-b82b44cc285c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc29332e0f5d4f199cdbecd7b351bd54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:08.744201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5b086-1005-4cb5-8e2c-b82b44cc285c tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:08.761481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed598dda-3509-47e1-a24a-1011d79cce74 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:08.762993 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1644/3285] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:56:08 2022] GET /identity/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54 => generated 371 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:08.763663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed598dda-3509-47e1-a24a-1011d79cce74 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:08.764101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed598dda-3509-47e1-a24a-1011d79cce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:08.865307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed598dda-3509-47e1-a24a-1011d79cce74 None None] MFA Rules not processed for user `3c307a82cd9d4c3f884e67c376757a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:08.866439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed598dda-3509-47e1-a24a-1011d79cce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:08.905417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:09.023882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ee7e-ecb5-4314-869d-5418ac04d5a8 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.024416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ee7e-ecb5-4314-869d-5418ac04d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.025034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439ee7e-ecb5-4314-869d-5418ac04d5a8 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.027744 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1645/3286] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:56:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:56:09.030493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1642/3287] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:09.040137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ee7e-ecb5-4314-869d-5418ac04d5a8 None None] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:56:09.053066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.053952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.054469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.100844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ee7e-ecb5-4314-869d-5418ac04d5a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:09.137872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] MFA Rules not processed for user `3c307a82cd9d4c3f884e67c376757a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:09.140883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439ee7e-ecb5-4314-869d-5418ac04d5a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:09.147468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:09.157596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:09.158232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.158874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.159160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.162227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc29332e0f5d4f199cdbecd7b351bd54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:09.164766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:09.180354 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1643/3288] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:09.184414 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1646/3289] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:56:09 2022] GET /identity/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54 => generated 371 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:09.279653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:09.281382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:09.310989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2baf3-55e5-482e-94df-a9781cf54147 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:09.328286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f70fb-023b-4b18-ba11-20fb603205da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:09.338257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:09.342655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.343190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.347373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.348422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:09.352262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:09.358398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:09.359575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:09.365734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.366588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.374695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.413834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:09.424609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:09.440709 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1647/3290] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:09.444389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:09.473551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faccfd7d-a6f7-4379-8c67-32b054b8d68e tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:09.480400 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1644/3291] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:09.506271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962695a9-cbcd-4c3b-b794-41110b64199f tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:09.507561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962695a9-cbcd-4c3b-b794-41110b64199f tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.510089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962695a9-cbcd-4c3b-b794-41110b64199f tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.511995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962695a9-cbcd-4c3b-b794-41110b64199f tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.512709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962695a9-cbcd-4c3b-b794-41110b64199f tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:09.528569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962695a9-cbcd-4c3b-b794-41110b64199f tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:09.598066 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1648/3292] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:09 2022] POST /identity/v3/users => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:09.602459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:09.627757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c0955-f5a9-4a6b-9ca9-1d98720da91c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:09.650041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:09.653012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.654859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.655257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.657423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:09.659280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:09.663545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:09.728741 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1645/3293] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:09.773392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650c687-ca6b-4b93-baae-c86a49405a3d None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.773682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650c687-ca6b-4b93-baae-c86a49405a3d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.773990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9650c687-ca6b-4b93-baae-c86a49405a3d None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.775361 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1649/3294] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:56:09.786579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:56:09.788383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:09.823388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:09.840871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8bcb8-11fa-4ffd-9bbf-ca1a1793a0c6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:09.852387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:09.853058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:09.853340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:09.853616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:09.866764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc29332e0f5d4f199cdbecd7b351bd54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:09.868883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:09.871037 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1646/3295] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:56:09 2022] GET /identity/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54 => generated 371 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:10.165740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668af5e-c943-4865-9c19-876ee17bffe5 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:10.166085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668af5e-c943-4865-9c19-876ee17bffe5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:10.166360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668af5e-c943-4865-9c19-876ee17bffe5 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:10.167981 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1650/3296] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 02:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 02:56:10.178854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 02:56:10.196661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:10.217747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac8ed2-27ed-4d92-a020-b723960d1c80 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:10.228309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:10.228970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:10.229254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:10.229531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:10.234028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:get_project(project_id=bc29332e0f5d4f199cdbecd7b351bd54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:10.236130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:10.245476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1647/3297] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 02:56:10 2022] GET /identity/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54 => generated 371 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:10.296886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668af5e-c943-4865-9c19-876ee17bffe5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:10.320425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668af5e-c943-4865-9c19-876ee17bffe5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:10.333088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:10.333756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:10.334066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:10.334343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/users/f12cc1ba4bec40029b31edf1e804e135` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:10.370572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f12cc1ba4bec40029b31edf1e804e135)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:10.372777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:10.459824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:10.462760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12cc1ba4bec40029b31edf1e804e135'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:10.510566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12cc1ba4bec40029b31edf1e804e135'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:10.511363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12cc1ba4bec40029b31edf1e804e135'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:10.538386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12cc1ba4bec40029b31edf1e804e135'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:10.539171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12cc1ba4bec40029b31edf1e804e135'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:10.575202 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1651/3298] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:10 2022] DELETE /identity/v3/users/f12cc1ba4bec40029b31edf1e804e135 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:10.579519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:10.581301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:10.613711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5807-dfe8-4b0a-b8a4-a6a5596308d6 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:10.842017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f54c55feea754229b521717b83bd4bfb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be813bcf97bd4fb6be7cd7cac88f086f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:10.842679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:10.842983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:10.843204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] PATH_INFO: `/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:10.850067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bc29332e0f5d4f199cdbecd7b351bd54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:10.852295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:10.997893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc29332e0f5d4f199cdbecd7b351bd54', 'request_id': 'req-054ee382-d6c7-460c-bc09-f95b8c661df9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.030690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc29332e0f5d4f199cdbecd7b351bd54', 'request_id': 'req-054ee382-d6c7-460c-bc09-f95b8c661df9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.059970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc29332e0f5d4f199cdbecd7b351bd54', 'request_id': 'req-054ee382-d6c7-460c-bc09-f95b8c661df9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.071216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:11.087037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] The token cache is being invalidate because project bc29332e0f5d4f199cdbecd7b351bd54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:11.087652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.090448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-054ee382-d6c7-460c-bc09-f95b8c661df9 tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.097558 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1648/3299] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:10 2022] DELETE /identity/v3/projects/bc29332e0f5d4f199cdbecd7b351bd54 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:11.099130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:11.100620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:11.290240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12aae02-9132-410a-b91a-c39dbebf556a tempest-QuotasAdminTestV236-530032589 tempest-QuotasAdminTestV236-530032589-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:11.441092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:11.442368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:11.442869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:11.443420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] PATH_INFO: `/v3/users/763da0ad486b45dfa9236753decbed13` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:11.446564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=763da0ad486b45dfa9236753decbed13)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:11.448717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:11.500825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:11.501090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:11.501435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:11.583929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763da0ad486b45dfa9236753decbed13'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.604666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763da0ad486b45dfa9236753decbed13'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.606158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763da0ad486b45dfa9236753decbed13'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.614194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] MFA Rules not processed for user `f909cc7113594047add07a2bbd14187a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:11.617564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:11.619107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:11.626385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763da0ad486b45dfa9236753decbed13'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.628300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-54ba16e0-ca01-4491-b2ec-4c79d8ddda6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763da0ad486b45dfa9236753decbed13'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:11.672921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1652/3300] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:11 2022] DELETE /identity/v3/users/763da0ad486b45dfa9236753decbed13 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:11.697326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:11.697673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:11.706796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:11.848736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:11.850052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:11.876718 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1649/3301] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:11.877627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:11.879056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:12.006393 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1653/3302] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:12.007557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:12.011717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:12.183879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22381e-a7ff-4517-abf7-b461acb5ccf1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:12.189053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9e84-2716-40b7-81c7-e56261c79444 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:12.207463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:12.208295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:12.209361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:12.209745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:12.391940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:12.392122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:12.392411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:12.392686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:12.400439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:12.407297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:12.409019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:12.440170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:12.447543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3e438-cad6-4d9d-9f37-6e6c959666f3 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:12.452756 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1654/3303] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:12.455423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:12.480874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:12.491057 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1650/3304] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:12.638165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:12.752504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5937cab-3c6f-4193-8462-eee1234ed85d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:12.769510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:12.778328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:12.780179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:12.780881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:12.823190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:12.840226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:12.902237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1655/3305] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:14.432902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a66e7-dbc8-4e5a-8d65-35a75ac82ca2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:14.433432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a66e7-dbc8-4e5a-8d65-35a75ac82ca2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:14.433432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a66e7-dbc8-4e5a-8d65-35a75ac82ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:14.507182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7c3a66e7-dbc8-4e5a-8d65-35a75ac82ca2 None None] MFA Rules not processed for user `f909cc7113594047add07a2bbd14187a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:14.512410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c3a66e7-dbc8-4e5a-8d65-35a75ac82ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:14.555275 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1651/3306] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:14.610023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:14.612073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:14.663238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111b9b5-44c6-4065-b84a-fd2e73a522b4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:14.686181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:14.687216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:14.709032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:14.716514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] PATH_INFO: `/v3/projects/bb4932874cc24e0799ad24fe4552df08` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:14.722841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4932874cc24e0799ad24fe4552df08)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:14.724415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:14.777180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:14.777451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:14.777672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:14.791299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:14.845040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:14.846564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:14.942573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4932874cc24e0799ad24fe4552df08', 'request_id': 'req-b5a98d2a-803d-4457-800c-770cc0393ec5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:14.956572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4932874cc24e0799ad24fe4552df08', 'request_id': 'req-b5a98d2a-803d-4457-800c-770cc0393ec5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:14.975761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4932874cc24e0799ad24fe4552df08', 'request_id': 'req-b5a98d2a-803d-4457-800c-770cc0393ec5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.010380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] The token cache is being invalidate because project bb4932874cc24e0799ad24fe4552df08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:15.010679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.012192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.026095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1656/3307] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:14 2022] DELETE /identity/v3/projects/bb4932874cc24e0799ad24fe4552df08 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:15.030372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:15.033222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:15.054901 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1652/3308] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:15.211522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a98d2a-803d-4457-800c-770cc0393ec5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:15.227012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:15.230091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:15.231581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:15.232182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] PATH_INFO: `/v3/users/f54c55feea754229b521717b83bd4bfb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:15.235078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54c55feea754229b521717b83bd4bfb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:15.239706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:15.381839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54c55feea754229b521717b83bd4bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.410062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:15.428979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54c55feea754229b521717b83bd4bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.432146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54c55feea754229b521717b83bd4bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.477387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54c55feea754229b521717b83bd4bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.478958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54c55feea754229b521717b83bd4bfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:15.501698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1657/3309] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:15 2022] DELETE /identity/v3/users/f54c55feea754229b521717b83bd4bfb => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:15.937436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:15.939074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:15.963117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257043c-d193-4878-a805-28a58e6eeb84 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:16.097038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:16.097703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:16.098013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:16.098292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:16.107222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:16.142005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:16.145336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:16.172279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1653/3310] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:17.486951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:17.488455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:17.525629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2dd3d-4d09-49bb-a91b-a10c098f5de9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:17.536819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:17.537938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:17.539909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:17.540743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:17.553966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:17.585173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:17.586979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:17.611296 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1658/3311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:18.802146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:18.820428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ec9da-1422-4b73-aafc-9c98d622cc52 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:18.837942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:18.838577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:18.842236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:18.844085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:18.855484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:19.089467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:19.091127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:19.158511 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1654/3312] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:19.259666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:19.261209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:19.543227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668560a1-74b7-404b-9c77-ea2d801dd1a1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:19.562619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:19.563583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:19.564915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:19.565750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:19.571456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:19.609987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:19.612452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:19.640728 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1659/3313] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:19.768982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:19.781881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6edac-0dce-4aa6-a1e3-0be3faa4c779 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:19.789790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:19.791614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:19.791881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:19.792160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:19.798685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:19.824620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:19.828031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bab63-f117-42dc-b153-0ad33006e86f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:19.851717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1655/3314] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:19.929404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:19.930332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:19.956995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24c8fe-226b-4c75-ae88-91d064c7ca20 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:19.974396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:19.975562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:19.975847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:19.976121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] PATH_INFO: `/v3/projects/be813bcf97bd4fb6be7cd7cac88f086f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:19.977740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be813bcf97bd4fb6be7cd7cac88f086f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:19.979863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:20.088594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be813bcf97bd4fb6be7cd7cac88f086f', 'request_id': 'req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:20.107039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be813bcf97bd4fb6be7cd7cac88f086f', 'request_id': 'req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:20.124540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be813bcf97bd4fb6be7cd7cac88f086f', 'request_id': 'req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:20.156477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] The token cache is being invalidate because project be813bcf97bd4fb6be7cd7cac88f086f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:20.156857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:20.157645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-494c89fe-6b5b-488e-b8ca-91c2dbdd3313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:20.166560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:20.167073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:20.167490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:20.173333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1660/3315] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:19 2022] DELETE /identity/v3/projects/be813bcf97bd4fb6be7cd7cac88f086f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:20.255792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:20.257322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:20.387741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:20.465850 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1656/3316] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:20.475121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:20.475661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:20.475661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:20.517428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:20.519017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:20.545253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1661/3317] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:20.545977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:20.570259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4db0c-1bb7-4b7e-96c8-3205bd3479cc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:20.583859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:20.585122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:20.585762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:20.586879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:20.587679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:20.588131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:20.590034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:20.613543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:20.620034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1657/3318] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:20.630467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582ed02-1ecb-4903-ae63-029ccda1ea88 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:20.644074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:20.644873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:20.645331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:20.645608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:20.646273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:20.651196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:20.712143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:20.739673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:20.755805 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1662/3319] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:20 2022] POST /identity/v3/projects => generated 407 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:20.763524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5f05c0-ca8c-407b-aea0-ae61769df863 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:20.941676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:20.942398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:20.942596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:20.942869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:20.943506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:20.956469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:21.029439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:21.035437 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1658/3320] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:20 2022] POST /identity/v3/users => generated 304 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:21.041148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d88fe8-10a3-4e6a-b95a-afc6e732fb88 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:21.052045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:21.053014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.053442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.053888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.054705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:21.057110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:21.076327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:21.093911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1663/3321] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:56:21.100526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af002197-e87b-4ab5-bd0e-b96c3a39d325 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:21.109772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87dd83-c305-4daf-a197-32bd5849d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:21.110572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87dd83-c305-4daf-a197-32bd5849d651 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.110874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87dd83-c305-4daf-a197-32bd5849d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.111323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87dd83-c305-4daf-a197-32bd5849d651 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.112513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87dd83-c305-4daf-a197-32bd5849d651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:21.114437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87dd83-c305-4daf-a197-32bd5849d651 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:21.151528 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1659/3322] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:21.153123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:21.171976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268adf0-9cde-4618-b485-566e67e175cd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:21.179387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:21.180221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.180549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.180823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] PATH_INFO: `/v3/projects/058fdc9449bf4951abdf80aa1442bf7b/users/77ebc821972b43bf860101d8e4bf4171/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.223852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=058fdc9449bf4951abdf80aa1442bf7b, user_id=77ebc821972b43bf860101d8e4bf4171, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:21.228888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:21.260109 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1664/3323] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:21 2022] PUT /identity/v3/projects/058fdc9449bf4951abdf80aa1442bf7b/users/77ebc821972b43bf860101d8e4bf4171/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:21.268311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.268833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.269261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.336940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] MFA Rules not processed for user `77ebc821972b43bf860101d8e4bf4171`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:21.339470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:21.499837 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1660/3324] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:21 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:21.504052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:21.646580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91f300-b440-4a90-af92-9d7da7e7d08b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:21.658461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061234c-e737-45c0-882c-cc0ba35cb287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:21.659102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061234c-e737-45c0-882c-cc0ba35cb287 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.659553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061234c-e737-45c0-882c-cc0ba35cb287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.660143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061234c-e737-45c0-882c-cc0ba35cb287 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.661273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061234c-e737-45c0-882c-cc0ba35cb287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:21.668120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061234c-e737-45c0-882c-cc0ba35cb287 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:21.732848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1665/3325] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:21 2022] POST /identity/v3/projects => generated 407 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:21.737069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:21.751320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f322e1-6ee9-4626-80f5-4e32836e330e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:21.771339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.771633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.771909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.819069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:21.820176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:21.821229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:21.898394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:21.899212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:21.899641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:21.900091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:21.900875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:21.903192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:21.962254 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1661/3326] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:21 2022] POST /identity/v3/users => generated 310 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:21.967515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:21.984924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d38463-74b1-489d-a72d-c39c4537d8bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:22.000741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:22.001379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.001742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.001999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.010208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:22.011866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:22.012662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1666/3327] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:56:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 02:56:22.020872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:22.022492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:22.039472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1662/3328] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:22.044577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:22.065410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ac65a-1810-4f48-82ad-6e2c3b9e8990 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:22.083878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:22.084596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.084874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.085148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] PATH_INFO: `/v3/projects/a06df23b71d748dab1678864f80c3c77/users/0181397987bc4412891afbdfd4474b09/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.159908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06df23b71d748dab1678864f80c3c77, user_id=0181397987bc4412891afbdfd4474b09, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:22.165526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:22.183654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:22.196884 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1663/3329] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:22 2022] PUT /identity/v3/projects/a06df23b71d748dab1678864f80c3c77/users/0181397987bc4412891afbdfd4474b09/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:22.219557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:22.247841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4c753-02a4-4397-a5ec-600d868528d5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:22.368091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece911d7-f574-4063-a731-712b9ffb1d8c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:22.374562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:22.375378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.375656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.375929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.376586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:22.378238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:22.406582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:22.407381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.407905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.408286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.419694 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1664/3330] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:22.421142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:22.423282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:22.575817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:22.579295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:22.619221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1667/3331] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 02:56:22.621070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:22.625418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028906a-72b0-453c-9392-747c722d92fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:22.634138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848949d6-f7d8-421a-9322-2e4e7ea84631 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:22.657474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837617e9-3d07-4aa1-99a8-85eac0442ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:22.658360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837617e9-3d07-4aa1-99a8-85eac0442ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.658861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837617e9-3d07-4aa1-99a8-85eac0442ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.659240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837617e9-3d07-4aa1-99a8-85eac0442ee9 admin admin] PATH_INFO: `/v3/projects/a06df23b71d748dab1678864f80c3c77/users/0181397987bc4412891afbdfd4474b09/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.662798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:22.663446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.663725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.663999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.672674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837617e9-3d07-4aa1-99a8-85eac0442ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06df23b71d748dab1678864f80c3c77, user_id=0181397987bc4412891afbdfd4474b09, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:22.685643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:22.694578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837617e9-3d07-4aa1-99a8-85eac0442ee9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:22.727250 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1668/3332] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:22 2022] PUT /identity/v3/projects/a06df23b71d748dab1678864f80c3c77/users/0181397987bc4412891afbdfd4474b09/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:22.742316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6727f-a585-42db-a335-43ec53141d46 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:22.742630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6727f-a585-42db-a335-43ec53141d46 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:22.743015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6727f-a585-42db-a335-43ec53141d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:22.774193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:22.783163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:22.840971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1665/3333] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:22.850070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-04d6727f-a585-42db-a335-43ec53141d46 None None] MFA Rules not processed for user `0181397987bc4412891afbdfd4474b09`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:22.853506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-04d6727f-a585-42db-a335-43ec53141d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:23.101610 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1669/3334] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:22 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:23.109499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:23.115444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:23.128110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bffeb-0ac2-4d19-804d-71afc2912ab2 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:23.352945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:23.355371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:23.356072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:23.356367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] PATH_INFO: `/v3/users/77ebc821972b43bf860101d8e4bf4171` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:23.360554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ebc821972b43bf860101d8e4bf4171)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:23.364620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:23.507737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ebc821972b43bf860101d8e4bf4171'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:23.530372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ebc821972b43bf860101d8e4bf4171'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:23.531659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ebc821972b43bf860101d8e4bf4171'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:23.563542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ebc821972b43bf860101d8e4bf4171'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:23.566205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ebc821972b43bf860101d8e4bf4171'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:23.636089 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1666/3335] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:23 2022] DELETE /identity/v3/users/77ebc821972b43bf860101d8e4bf4171 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:23.642591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:23.643144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:23.643257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:23.710785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:23.712043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:23.728711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:23.894323 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1670/3336] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:23.913211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:23.915645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:24.084042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6da92-7fd3-47bd-bbf5-dcdfda9892b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:24.096137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:24.097399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:24.098654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:24.100702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:24.143221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:24.144696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:24.178179 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1667/3337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:26.012110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:26.014677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:26.042590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f69facd-dfa0-4dd1-a550-1f11204519b3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:26.057010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:26.058181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:26.059073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:26.060160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] PATH_INFO: `/v3/projects/058fdc9449bf4951abdf80aa1442bf7b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:26.063775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=058fdc9449bf4951abdf80aa1442bf7b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:26.068737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:26.240693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '058fdc9449bf4951abdf80aa1442bf7b', 'request_id': 'req-38e5af46-1056-4239-8acb-343d9e18ad27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.250674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '058fdc9449bf4951abdf80aa1442bf7b', 'request_id': 'req-38e5af46-1056-4239-8acb-343d9e18ad27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.261197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '058fdc9449bf4951abdf80aa1442bf7b', 'request_id': 'req-38e5af46-1056-4239-8acb-343d9e18ad27'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.284833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] The token cache is being invalidate because project 058fdc9449bf4951abdf80aa1442bf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:26.285181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.286158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.296046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:26.297200 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1671/3338] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:26 2022] DELETE /identity/v3/projects/058fdc9449bf4951abdf80aa1442bf7b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:26.332892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdd34c-00d1-4d68-9874-70712e323146 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:26.366109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:26.494546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:26.499209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:26.499995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:26.501620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] PATH_INFO: `/v3/users/0181397987bc4412891afbdfd4474b09` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:26.508585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0181397987bc4412891afbdfd4474b09)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:26.511931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:26.656036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0181397987bc4412891afbdfd4474b09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.672012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0181397987bc4412891afbdfd4474b09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.674415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0181397987bc4412891afbdfd4474b09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.713314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0181397987bc4412891afbdfd4474b09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.716315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0181397987bc4412891afbdfd4474b09'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:26.803410 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1668/3339] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:26 2022] DELETE /identity/v3/users/0181397987bc4412891afbdfd4474b09 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:27.872113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:27.873668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:28.061835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5af46-1056-4239-8acb-343d9e18ad27 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:28.208028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:28.218487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:28.219443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:28.220210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:28.220767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:28.223633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:28.391316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:28.392810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e7813-0676-417a-a900-0449902bc51a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:28.415843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1672/3340] 10.222.0.16 () {60 vars in 1396 bytes} [Sat Oct 29 02:56:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:29.655003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:29.657024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:29.743519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707051-8c4a-485c-a04c-f20a7da5aa10 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:29.750864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:29.752049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:29.752049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:29.752313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] PATH_INFO: `/v3/projects/a06df23b71d748dab1678864f80c3c77` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:29.753539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a06df23b71d748dab1678864f80c3c77)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:29.756052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:29.816617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:29.820939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a06df23b71d748dab1678864f80c3c77', 'request_id': 'req-f2e0accc-3dad-4174-89ba-212ac6fc8808'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:29.831446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a06df23b71d748dab1678864f80c3c77', 'request_id': 'req-f2e0accc-3dad-4174-89ba-212ac6fc8808'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:29.841729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a06df23b71d748dab1678864f80c3c77', 'request_id': 'req-f2e0accc-3dad-4174-89ba-212ac6fc8808'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:29.859255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] The token cache is being invalidate because project a06df23b71d748dab1678864f80c3c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:29.859605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:29.860430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2e0accc-3dad-4174-89ba-212ac6fc8808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:29.862615 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1669/3341] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:29 2022] DELETE /identity/v3/projects/a06df23b71d748dab1678864f80c3c77 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:29.868997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:29.870347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:29.871049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:29.902755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:29.905411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:29.981633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1673/3342] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:29.990448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:29.990775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:29.990994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.012689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:30.013975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:30.028344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1670/3343] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:30.046704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:30.072380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c48153-8e77-4ce3-868a-b41978da89ed None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:30.085277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:30.086049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.086216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.086489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.087419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:30.087542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:30.089656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:30.102164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1674/3344] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:30.106381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:30.118343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8d04d-c3f4-487b-a769-9dc1267690e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:30.125444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:30.126131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.126503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.126778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.127550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:30.129669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:30.174346 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1671/3345] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:30 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:30.178317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:30.191845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8697805-227f-4392-a7a1-2449917939e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:30.332835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:30.334267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.334628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.334972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.335689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:30.339749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:30.376639 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1675/3346] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:30 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:30.377648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:30.397949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15724a65-cf81-4a63-bb95-3f15f930c73f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:30.408664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:30.410478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.410478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.410777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.412010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:30.414411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:30.449203 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1672/3347] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:56:30.457510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:30.471618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526eb5ec-3df4-470c-a9c1-b05d8d05fc12 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:30.482972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd884431-ea7c-4979-b248-c0b846dfc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:30.483611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884431-ea7c-4979-b248-c0b846dfc926 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.483896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884431-ea7c-4979-b248-c0b846dfc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.484168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd884431-ea7c-4979-b248-c0b846dfc926 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.484806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884431-ea7c-4979-b248-c0b846dfc926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:30.490820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd884431-ea7c-4979-b248-c0b846dfc926 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:30.556020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:30.567873 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1676/3348] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:30.574560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78011f90-0977-4370-95a0-d6e20567b925 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:30.587101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:30.589496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.591606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.592129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] PATH_INFO: `/v3/projects/c30f37c67c8447aa81e36881aea344e2/users/c20348dd3ba24c5880d7cb00f95ddb9f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.642793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30f37c67c8447aa81e36881aea344e2, user_id=c20348dd3ba24c5880d7cb00f95ddb9f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:30.645531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:30.680513 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1673/3349] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:30 2022] PUT /identity/v3/projects/c30f37c67c8447aa81e36881aea344e2/users/c20348dd3ba24c5880d7cb00f95ddb9f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:30.705379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:30.705735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:30.706903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:30.786893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:30.816800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] MFA Rules not processed for user `c20348dd3ba24c5880d7cb00f95ddb9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:30.818098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:30.956549 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1677/3350] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:30.961221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:31.113284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582dccc-8119-4a9b-8952-fa39d77631e6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:31.125832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:31.126548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.126830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.127103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.127915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:31.134329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:31.205851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1674/3351] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:30 2022] POST /identity/v3/projects => generated 391 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:31.208049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:31.221898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57471157-2c22-47af-88d1-2e001fc120b0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:31.354499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:31.356114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.356549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.356970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.357833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:31.360077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:31.416406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1678/3352] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:31 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:31.420657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:31.449331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa901dcc-fa90-4bad-a8ef-e8e8a886c579 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:31.464170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:31.465072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.465072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.465597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.467092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:31.468894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:31.518016 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1675/3353] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:56:31.522149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:31.543200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c85618-0acf-4585-9258-5b14ce22775d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:31.584539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:31.585347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.585633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.586198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] PATH_INFO: `/v3/projects/b22d6f7db6554d618d55ce37a81c7594/users/810a7b2c94f64ba69ff2d605e9335eb7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.642748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22d6f7db6554d618d55ce37a81c7594, user_id=810a7b2c94f64ba69ff2d605e9335eb7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:31.645570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:31.689164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1679/3354] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:31 2022] PUT /identity/v3/projects/b22d6f7db6554d618d55ce37a81c7594/users/810a7b2c94f64ba69ff2d605e9335eb7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:31.690345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:31.703993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c54bfd-0e63-48df-a9ef-b23ebaeee9b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:31.770207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:31.816547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2aa33-3562-497b-a0b6-34405addcb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:31.817737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2aa33-3562-497b-a0b6-34405addcb51 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.818393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2aa33-3562-497b-a0b6-34405addcb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.818821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2aa33-3562-497b-a0b6-34405addcb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.819795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2aa33-3562-497b-a0b6-34405addcb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:31.821600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2aa33-3562-497b-a0b6-34405addcb51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:31.835083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1676/3355] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:31.839462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:31.856878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be668842-210a-4543-a36e-60b606482e28 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:31.862433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:31.863493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.864860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.865317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] PATH_INFO: `/v3/projects/b22d6f7db6554d618d55ce37a81c7594/users/810a7b2c94f64ba69ff2d605e9335eb7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.867824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22d6f7db6554d618d55ce37a81c7594, user_id=810a7b2c94f64ba69ff2d605e9335eb7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:31.871862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:31.885787 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1680/3356] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:31 2022] PUT /identity/v3/projects/b22d6f7db6554d618d55ce37a81c7594/users/810a7b2c94f64ba69ff2d605e9335eb7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:31.896044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:31.896720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:31.897267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:31.954834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] MFA Rules not processed for user `810a7b2c94f64ba69ff2d605e9335eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:31.957851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:32.151259 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1677/3357] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:32.196440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:32.198943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:32.419789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:32.493283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1a28f-ab09-40cd-aa9c-c2000cd94b87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:32.504452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87104-2080-4776-a893-afa26e617757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:32.505299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87104-2080-4776-a893-afa26e617757 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:32.505739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87104-2080-4776-a893-afa26e617757 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:32.506306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e87104-2080-4776-a893-afa26e617757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:32.517859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e87104-2080-4776-a893-afa26e617757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:32.521931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e87104-2080-4776-a893-afa26e617757 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:32.538469 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1681/3358] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:33.294192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:33.296637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:33.337882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2584d1-0fbd-4cc4-98e3-aa0534457bd3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:33.358000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cf05a-4481-44df-a057-f9a6d8c17544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:33.359427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf05a-4481-44df-a057-f9a6d8c17544 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:33.360130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf05a-4481-44df-a057-f9a6d8c17544 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:33.360417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cf05a-4481-44df-a057-f9a6d8c17544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:33.486494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cf05a-4481-44df-a057-f9a6d8c17544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:33.488850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cf05a-4481-44df-a057-f9a6d8c17544 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:33.510187 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1678/3359] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:33.535318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87104-2080-4776-a893-afa26e617757 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:33.881121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e87104-2080-4776-a893-afa26e617757 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:33.894026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:33.895002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:33.895338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:33.895616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] PATH_INFO: `/v3/users/c20348dd3ba24c5880d7cb00f95ddb9f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:33.897603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20348dd3ba24c5880d7cb00f95ddb9f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:33.899813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:34.059979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20348dd3ba24c5880d7cb00f95ddb9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:34.079291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20348dd3ba24c5880d7cb00f95ddb9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:34.080147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20348dd3ba24c5880d7cb00f95ddb9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:34.091120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20348dd3ba24c5880d7cb00f95ddb9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:34.091912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20348dd3ba24c5880d7cb00f95ddb9f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:34.127069 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1682/3360] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:33 2022] DELETE /identity/v3/users/c20348dd3ba24c5880d7cb00f95ddb9f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:34.129000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:34.129762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:34.130301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:34.170361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:34.171963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:34.330802 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1679/3361] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:56:34.424016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:34.425991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:34.592081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208ece-61a2-4e59-9cf1-293777f7aeb5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:34.609359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:34.610838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:34.611112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:34.613420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:34.626274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:34.627864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:34.633763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:34.650945 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1683/3362] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:36.317046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:36.318824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:36.360634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:36.369225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec53ab-52a6-4815-b5c4-32c2c79852f7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:36.385716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:36.388439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:36.390084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:36.391099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] PATH_INFO: `/v3/projects/c30f37c67c8447aa81e36881aea344e2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:36.394284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30f37c67c8447aa81e36881aea344e2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:36.399045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:36.457060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30f37c67c8447aa81e36881aea344e2', 'request_id': 'req-55610a19-c4f1-461c-a890-2aadd146346a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.464655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30f37c67c8447aa81e36881aea344e2', 'request_id': 'req-55610a19-c4f1-461c-a890-2aadd146346a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.470989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30f37c67c8447aa81e36881aea344e2', 'request_id': 'req-55610a19-c4f1-461c-a890-2aadd146346a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.485693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] The token cache is being invalidate because project c30f37c67c8447aa81e36881aea344e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:36.486017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.486954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.488577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1680/3363] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:36 2022] DELETE /identity/v3/projects/c30f37c67c8447aa81e36881aea344e2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:36.492687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:36.504345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13beba-9506-4aee-8bdd-c633953c167a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:36.597133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:36.599486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:36.599877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:36.600215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] PATH_INFO: `/v3/users/810a7b2c94f64ba69ff2d605e9335eb7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:36.602966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=810a7b2c94f64ba69ff2d605e9335eb7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:36.608102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:36.671470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '810a7b2c94f64ba69ff2d605e9335eb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.694417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '810a7b2c94f64ba69ff2d605e9335eb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.695591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '810a7b2c94f64ba69ff2d605e9335eb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.703955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '810a7b2c94f64ba69ff2d605e9335eb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.704643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6d12bece-c0b4-4b85-ab29-27fc61d0cdb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '810a7b2c94f64ba69ff2d605e9335eb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:36.726237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1684/3364] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:36 2022] DELETE /identity/v3/users/810a7b2c94f64ba69ff2d605e9335eb7 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:38.748723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:38.750759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:38.789020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55610a19-c4f1-461c-a890-2aadd146346a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:38.993682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:38.994457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:38.996657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:38.997058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] PATH_INFO: `/v3/projects/b22d6f7db6554d618d55ce37a81c7594` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:39.001500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22d6f7db6554d618d55ce37a81c7594)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:39.004980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:39.224033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22d6f7db6554d618d55ce37a81c7594', 'request_id': 'req-f418e3e0-fa01-4b9c-930c-b5553a445bcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:39.239483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22d6f7db6554d618d55ce37a81c7594', 'request_id': 'req-f418e3e0-fa01-4b9c-930c-b5553a445bcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:39.274504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22d6f7db6554d618d55ce37a81c7594', 'request_id': 'req-f418e3e0-fa01-4b9c-930c-b5553a445bcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:39.349426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] The token cache is being invalidate because project b22d6f7db6554d618d55ce37a81c7594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:39.349861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:39.354678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f418e3e0-fa01-4b9c-930c-b5553a445bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:39.359452 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1681/3365] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:38 2022] DELETE /identity/v3/projects/b22d6f7db6554d618d55ce37a81c7594 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:39.366619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384493b0-3742-4292-832a-4666569e232b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:39.367509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384493b0-3742-4292-832a-4666569e232b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:39.368193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384493b0-3742-4292-832a-4666569e232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:39.432056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-384493b0-3742-4292-832a-4666569e232b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:39.433335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-384493b0-3742-4292-832a-4666569e232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:39.611118 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1685/3366] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:39.612663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36376-a466-499e-9522-a710324385aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:39.613049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36376-a466-499e-9522-a710324385aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:39.613422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d36376-a466-499e-9522-a710324385aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:39.637044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d5d36376-a466-499e-9522-a710324385aa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:39.638524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5d36376-a466-499e-9522-a710324385aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:39.650935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1682/3367] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:39.656881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384493b0-3742-4292-832a-4666569e232b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:39.672228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384493b0-3742-4292-832a-4666569e232b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:39.681094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:39.681739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:39.682053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:39.682326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:39.682989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:39.683289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:39.718420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:39.741167 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1686/3368] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:39.746462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36376-a466-499e-9522-a710324385aa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:39.758503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d36376-a466-499e-9522-a710324385aa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:39.774066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:39.774707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:39.774985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:39.775258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:39.776075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:39.778124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:39.821021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:39.859236 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1683/3369] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:39 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:56:39.863682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:39.873456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:39.880261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddcfe33-7f43-4882-9949-04bf556db225 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:40.045452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:40.046291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:40.046668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:40.047006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:40.047832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:40.049912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:40.095840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1687/3370] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:39 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:40.097850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:40.109031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b41dcc5-8beb-4fc9-996f-ce50e3faed1f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:40.119867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:40.122784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:40.123310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:40.123781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:40.124630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:40.126840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:40.148808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:40.150737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1684/3371] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:40.164423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c7530-489c-4d4a-8cdf-ad8b2e2c1d27 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:40.176217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b7b5f-64db-44a9-84a0-4e79b83b06cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:40.176791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7b5f-64db-44a9-84a0-4e79b83b06cc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:40.177118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7b5f-64db-44a9-84a0-4e79b83b06cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:40.177394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b7b5f-64db-44a9-84a0-4e79b83b06cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:40.178228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b7b5f-64db-44a9-84a0-4e79b83b06cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:40.181546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b7b5f-64db-44a9-84a0-4e79b83b06cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:40.209937 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1688/3372] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:56:40.212518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:40.225514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab26607-5875-477d-bc0f-1a9245ac7d25 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:40.232465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:40.234645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:40.235431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:40.235927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] PATH_INFO: `/v3/projects/4d79effa8abb45b09a4e38134edd8f46/users/8da7a286ae354ff18e919e5086dc9a04/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:40.288111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d79effa8abb45b09a4e38134edd8f46, user_id=8da7a286ae354ff18e919e5086dc9a04, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:40.295080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:40.350607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:40.350832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1685/3373] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:40 2022] PUT /identity/v3/projects/4d79effa8abb45b09a4e38134edd8f46/users/8da7a286ae354ff18e919e5086dc9a04/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:40.351065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:40.351167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:40.406883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] MFA Rules not processed for user `8da7a286ae354ff18e919e5086dc9a04`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:40.408158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:40.561313 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1689/3374] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 02:56:41.057770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:41.060832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:41.222929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8177b9e-1e32-4bc7-b305-2cc9317718b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:41.242679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f5f7b-d512-4a06-b1f0-3f32d993213d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:41.242866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f5f7b-d512-4a06-b1f0-3f32d993213d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:41.243191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f5f7b-d512-4a06-b1f0-3f32d993213d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:41.243567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f5f7b-d512-4a06-b1f0-3f32d993213d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:41.263765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f5f7b-d512-4a06-b1f0-3f32d993213d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:41.267804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f5f7b-d512-4a06-b1f0-3f32d993213d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:41.312392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1686/3375] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:41.608250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:41.775711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef8370-df89-4d41-9b33-77f218444342 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:41.787693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:41.788470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:41.788847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:41.789212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] PATH_INFO: `/v3/users/8da7a286ae354ff18e919e5086dc9a04` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:41.792001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da7a286ae354ff18e919e5086dc9a04)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:41.799703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:41.837957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:41.920110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da7a286ae354ff18e919e5086dc9a04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:41.950883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da7a286ae354ff18e919e5086dc9a04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:41.953748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da7a286ae354ff18e919e5086dc9a04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:41.971529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da7a286ae354ff18e919e5086dc9a04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:41.973427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da7a286ae354ff18e919e5086dc9a04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:42.001993 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1690/3376] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:41 2022] DELETE /identity/v3/users/8da7a286ae354ff18e919e5086dc9a04 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:42.006501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:42.007107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:42.007559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:42.038896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:42.040949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:42.145372 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1687/3377] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:42.204005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:42.206415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:42.390041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df6408-a34a-4aa4-a1d9-4262ae7f9b2a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:42.410188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810afe26-f875-4f27-9a9e-93a69e9647b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:42.411952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810afe26-f875-4f27-9a9e-93a69e9647b3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:42.412237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810afe26-f875-4f27-9a9e-93a69e9647b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:42.412513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810afe26-f875-4f27-9a9e-93a69e9647b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:42.478027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810afe26-f875-4f27-9a9e-93a69e9647b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:42.484019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810afe26-f875-4f27-9a9e-93a69e9647b3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:42.511075 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1691/3378] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:44.303824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:44.305867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:44.333740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a785d5-a8f8-4967-9883-4bda69cc3c70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:44.338914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:44.339943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:44.340673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:44.341520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] PATH_INFO: `/v3/projects/4d79effa8abb45b09a4e38134edd8f46` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:44.344579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d79effa8abb45b09a4e38134edd8f46)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:44.347559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:44.433371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:44.453331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d79effa8abb45b09a4e38134edd8f46', 'request_id': 'req-8616222f-9a23-455c-9296-a838111c9f36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.468389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d79effa8abb45b09a4e38134edd8f46', 'request_id': 'req-8616222f-9a23-455c-9296-a838111c9f36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.481511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d79effa8abb45b09a4e38134edd8f46', 'request_id': 'req-8616222f-9a23-455c-9296-a838111c9f36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.517395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] The token cache is being invalidate because project 4d79effa8abb45b09a4e38134edd8f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:44.517695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.518703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8616222f-9a23-455c-9296-a838111c9f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.522485 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1688/3379] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:44 2022] DELETE /identity/v3/projects/4d79effa8abb45b09a4e38134edd8f46 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:44.527576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:44.528686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:44.529119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:44.608348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:44.608499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:44.768702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1692/3380] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:44.778863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:44.779245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:44.779442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:44.810357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:44.812341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:44.823805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:44.823805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:44.839496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ee2a-82a7-4d43-b955-2f8405340df0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:44.842106 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1689/3381] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:44.846641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:44.858787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6247e8-9658-4688-a2a8-4ff130a2fdac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:44.859530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:44.860236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:44.860510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:44.860777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] PATH_INFO: `/v3/users/6c2aa25bffe3421e8a75d88388dd5441` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:44.862081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2aa25bffe3421e8a75d88388dd5441)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:44.864546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:44.872788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:44.874078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:44.874384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:44.874628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:44.875290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:44.885893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:44.890684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:44.908196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1690/3382] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:56:44.913340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:44.923869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:44.928336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879b696-baac-4afe-8082-2e3568c8af6e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:44.934087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:44.934879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:44.935259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:44.935812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:44.936830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:44.939205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:44.943900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2aa25bffe3421e8a75d88388dd5441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.965184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2aa25bffe3421e8a75d88388dd5441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.966205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2aa25bffe3421e8a75d88388dd5441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.975395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2aa25bffe3421e8a75d88388dd5441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.976106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2aa25bffe3421e8a75d88388dd5441'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:44.981434 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1691/3383] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:44 2022] POST /identity/v3/projects => generated 359 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:44.990127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:44.993777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:45.011272 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1693/3384] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:44 2022] DELETE /identity/v3/users/6c2aa25bffe3421e8a75d88388dd5441 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:45.099094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643f8bb-1557-4d44-9769-bfb62a46849b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.204370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.205258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.205694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.206589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.207403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.209531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.240333 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1692/3385] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:44 2022] POST /identity/v3/users => generated 280 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:45.244777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.261042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576e98a-f014-4222-8612-0093ed622ba9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.268074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.269536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.269874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.270191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.270861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.272597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.291069 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1694/3386] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:45.292358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.312043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239953e-b677-4901-84d4-63e8ed707544 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.320504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.321435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.322104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.322585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.323465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.326653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.347375 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1693/3387] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:45.351649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.367796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bbf85-f191-4673-8007-93e8a1cc7469 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.390556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2f5328-a955-4bc6-804c-e8bbfc0d9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.391607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f5328-a955-4bc6-804c-e8bbfc0d9731 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.392162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f5328-a955-4bc6-804c-e8bbfc0d9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.392904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2f5328-a955-4bc6-804c-e8bbfc0d9731 admin admin] PATH_INFO: `/v3/projects/e5a6ab203ca4450babf81fe1f2d4496c/users/77721d9953bd42e99b5efa643dfd4635/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.419354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.422716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:45.429336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f5328-a955-4bc6-804c-e8bbfc0d9731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a6ab203ca4450babf81fe1f2d4496c, user_id=77721d9953bd42e99b5efa643dfd4635, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.432702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2f5328-a955-4bc6-804c-e8bbfc0d9731 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.464121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1695/3388] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:45 2022] PUT /identity/v3/projects/e5a6ab203ca4450babf81fe1f2d4496c/users/77721d9953bd42e99b5efa643dfd4635/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:45.466246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.466659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.467211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.468077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc921a9-eb93-4828-8ed2-2d709d355312 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.473185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:45.505562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] MFA Rules not processed for user `77721d9953bd42e99b5efa643dfd4635`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:45.506974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:45.592787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.593535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.594016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.594293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] PATH_INFO: `/v3/projects/a1287e36822b48f9a9020375bd0da2ab` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.595484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1287e36822b48f9a9020375bd0da2ab)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.597901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.602174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1696/3389] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:45.613175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.616132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:45.664449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1287e36822b48f9a9020375bd0da2ab', 'request_id': 'req-b843e78d-f4b5-48b1-a14a-38999f3c7461'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.673339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1287e36822b48f9a9020375bd0da2ab', 'request_id': 'req-b843e78d-f4b5-48b1-a14a-38999f3c7461'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.682545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1287e36822b48f9a9020375bd0da2ab', 'request_id': 'req-b843e78d-f4b5-48b1-a14a-38999f3c7461'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.699062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:45.703639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] The token cache is being invalidate because project a1287e36822b48f9a9020375bd0da2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:45.703944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.705250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.709837 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1694/3390] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:45 2022] DELETE /identity/v3/projects/a1287e36822b48f9a9020375bd0da2ab => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:45.712063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.715068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:45.720070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71175ff7-54cc-4bc1-97d4-afd22437008e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.809144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.809457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843e78d-f4b5-48b1-a14a-38999f3c7461 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:45.810791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.810989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.811329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.813541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:45.814912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:45.815765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:45.816265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:45.816745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] PATH_INFO: `/v3/users/1605b259e8e54f4491e692b7073b3dc4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:45.818323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1605b259e8e54f4491e692b7073b3dc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.823334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.876951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:45.885776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1605b259e8e54f4491e692b7073b3dc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.892861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:45.894532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:45.899502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1605b259e8e54f4491e692b7073b3dc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.900225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1605b259e8e54f4491e692b7073b3dc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.910304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1605b259e8e54f4491e692b7073b3dc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.911166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f003adcb-f96e-40e1-973a-89a6d6dbcbb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1605b259e8e54f4491e692b7073b3dc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:45.933598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1697/3391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:56:45.967142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1695/3392] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:45 2022] DELETE /identity/v3/users/1605b259e8e54f4491e692b7073b3dc4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:45.975122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:45.976846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:46.001697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dae34-1a23-47aa-93f8-61876c1d4bb6 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:46.192069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:46.194756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:46.195208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:46.195733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] PATH_INFO: `/v3/users/77721d9953bd42e99b5efa643dfd4635` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:46.199625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=77721d9953bd42e99b5efa643dfd4635)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:46.203478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:46.325646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:46.345321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77721d9953bd42e99b5efa643dfd4635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:46.378228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77721d9953bd42e99b5efa643dfd4635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:46.379187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77721d9953bd42e99b5efa643dfd4635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:46.392577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77721d9953bd42e99b5efa643dfd4635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:46.393666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77721d9953bd42e99b5efa643dfd4635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:46.419618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1698/3393] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:45 2022] DELETE /identity/v3/users/77721d9953bd42e99b5efa643dfd4635 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:46.420442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:46.420975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:46.420975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:46.458730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:46.461231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:46.567244 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1696/3394] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:46.580455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:46.582024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:46.673417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c80f2-3855-4099-9700-f9aee81732ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:46.677584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:46.678327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:46.678600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:46.678951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:46.694192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:46.695752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:46.716870 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1699/3395] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:46.968166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:46.970071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:46.994254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3826559-0181-4080-92ab-8833218b1b95 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:47.042471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:47.044961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.046099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.046451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] PATH_INFO: `/v3/projects/eeceedb4ed084d7a876c03f27463bcf6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.049534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeceedb4ed084d7a876c03f27463bcf6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:47.055292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:47.156491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeceedb4ed084d7a876c03f27463bcf6', 'request_id': 'req-c85328d8-8afb-443c-b04b-7c072b7c1427'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.171508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeceedb4ed084d7a876c03f27463bcf6', 'request_id': 'req-c85328d8-8afb-443c-b04b-7c072b7c1427'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.189419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeceedb4ed084d7a876c03f27463bcf6', 'request_id': 'req-c85328d8-8afb-443c-b04b-7c072b7c1427'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.204831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:47.206497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:47.211139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] The token cache is being invalidate because project eeceedb4ed084d7a876c03f27463bcf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:47.211547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.212293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c85328d8-8afb-443c-b04b-7c072b7c1427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.216129 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1697/3396] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:46 2022] DELETE /identity/v3/projects/eeceedb4ed084d7a876c03f27463bcf6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:47.232201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037824-2bd2-4782-819b-294b2ef298fd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.232759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037824-2bd2-4782-819b-294b2ef298fd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.233116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037824-2bd2-4782-819b-294b2ef298fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.238012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd842a-c860-41fb-ac92-50e6167554fd service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:47.297584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66037824-2bd2-4782-819b-294b2ef298fd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:47.301022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66037824-2bd2-4782-819b-294b2ef298fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:47.358091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:47.358774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.364400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.364515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] PATH_INFO: `/v3/projects/e5a6ab203ca4450babf81fe1f2d4496c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.366805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a6ab203ca4450babf81fe1f2d4496c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:47.368681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:47.379309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:47.438916 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1698/3397] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:47.441272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.442310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.442763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.469386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a6ab203ca4450babf81fe1f2d4496c', 'request_id': 'req-c3be4520-9b3e-4c29-a99f-b155db23a718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.471292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:47.472990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:47.482308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a6ab203ca4450babf81fe1f2d4496c', 'request_id': 'req-c3be4520-9b3e-4c29-a99f-b155db23a718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.499105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:47.503067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a6ab203ca4450babf81fe1f2d4496c', 'request_id': 'req-c3be4520-9b3e-4c29-a99f-b155db23a718'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.529775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] The token cache is being invalidate because project e5a6ab203ca4450babf81fe1f2d4496c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:47.530245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.531705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3be4520-9b3e-4c29-a99f-b155db23a718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:47.537561 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1700/3398] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:47 2022] DELETE /identity/v3/projects/e5a6ab203ca4450babf81fe1f2d4496c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:47.539544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e046-045c-4438-b9df-5239533b7488 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.540031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e046-045c-4438-b9df-5239533b7488 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.540443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191e046-045c-4438-b9df-5239533b7488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.587306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c191e046-045c-4438-b9df-5239533b7488 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:47.589335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c191e046-045c-4438-b9df-5239533b7488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:47.629083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1699/3399] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:47.636213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:47.658390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4dcbe-fc53-42fa-a6e9-128f281aa066 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:47.677633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:47.678287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.678564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.678830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.679482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:47.679784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:47.681392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:47.707757 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1700/3400] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:47.714076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:47.729762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cf3e-9a56-4c99-803e-5fb6ec2aecb0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:47.747686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16aa8a9-72d1-4826-8baa-221af1d21359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:47.748670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aa8a9-72d1-4826-8baa-221af1d21359 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.748953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aa8a9-72d1-4826-8baa-221af1d21359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.749325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16aa8a9-72d1-4826-8baa-221af1d21359 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.750013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16aa8a9-72d1-4826-8baa-221af1d21359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:47.752052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16aa8a9-72d1-4826-8baa-221af1d21359 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:47.758640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1701/3401] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:47.760526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.760813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.761085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.786279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:47.787617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:47.789294 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1701/3402] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:56:47.791004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.791564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.791989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.834734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:47.836584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:47.901141 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1702/3403] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:47.901141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:47.937649 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1702/3404] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:47.938907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:47.952075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89af12a-3674-40ac-8846-16ffcca9864c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:47.971776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:47.972833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:47.973308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:47.973786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:47.975756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:47.976284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:47.979243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.005981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1703/3405] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:48.007261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.019186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7743682-0449-434d-b8dc-2b3997c5fa76 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.029772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.030563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.030941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.031316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.032235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.038821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.039968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dc4467-4a2f-4eca-a5fe-2d0c46312dd5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.056969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.057641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.057924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.058202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.059130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.068212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.096433 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1704/3406] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:48 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:48.097513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.107498 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1703/3407] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:47 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:48.108934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.113668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:48.127911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f6e03-7e42-483c-8a61-05bb55297b5f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.162692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:48.216246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36431572-3898-4ffd-bf4b-20ca5492baeb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.223318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.223945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.224565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.224565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.225094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.227790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.252269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.253573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.254395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.254870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.256233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.258640 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1705/3408] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:48 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:48.259133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.262691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.273694 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1704/3409] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:48.277413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.286373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c97f-18aa-4534-880c-ad6224bb08ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.292107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ab0d-4abf-4422-b561-4d763d811061 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.299653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.300746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.301119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.301474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.302262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.304073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.305132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.305967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.306426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.307125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.308082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.310619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.322964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1705/3410] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:56:48.324305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.329148 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1706/3411] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:48.330835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.340254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dfde5-26bb-48a4-9678-2e48af56272a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.347049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d327b-0828-4350-85bb-20b4e1b00a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.347950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d327b-0828-4350-85bb-20b4e1b00a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.348380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d327b-0828-4350-85bb-20b4e1b00a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.348685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5592082-1cee-49f8-bb63-46c821f294a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.348971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d327b-0828-4350-85bb-20b4e1b00a51 admin admin] PATH_INFO: `/v3/projects/c84dd12e6a2c4a67b8d2a00188663316/users/4014a93c9f3c4604b8e1de913ee5891e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.356232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.357164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.357513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.358103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.358828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.360870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.369228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d327b-0828-4350-85bb-20b4e1b00a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84dd12e6a2c4a67b8d2a00188663316, user_id=4014a93c9f3c4604b8e1de913ee5891e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.372841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d327b-0828-4350-85bb-20b4e1b00a51 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.381646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1707/3412] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:48.385944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.401090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e451c-4761-435a-974b-585ca75a23a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.403051 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1706/3413] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:48 2022] PUT /identity/v3/projects/c84dd12e6a2c4a67b8d2a00188663316/users/4014a93c9f3c4604b8e1de913ee5891e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:48.406950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.409062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.410105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.446996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] MFA Rules not processed for user `4014a93c9f3c4604b8e1de913ee5891e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:48.448310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:48.540230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30c2c1-1b91-4359-ad83-715fa363a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.547180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c2c1-1b91-4359-ad83-715fa363a9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.547180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c2c1-1b91-4359-ad83-715fa363a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.547180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30c2c1-1b91-4359-ad83-715fa363a9d6 admin admin] PATH_INFO: `/v3/projects/fa9a72e5d3ea460ebdb09420824ba04b/users/eaaa0b3debf041098f1f188124050dad/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.577057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30c2c1-1b91-4359-ad83-715fa363a9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa9a72e5d3ea460ebdb09420824ba04b, user_id=eaaa0b3debf041098f1f188124050dad, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.580367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30c2c1-1b91-4359-ad83-715fa363a9d6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.587617 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1707/3414] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:48.589018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.605405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d6771-f206-4214-a195-a3bdf1151de0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.623832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1708/3415] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:48 2022] PUT /identity/v3/projects/fa9a72e5d3ea460ebdb09420824ba04b/users/eaaa0b3debf041098f1f188124050dad/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:48.629029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d649-57c5-4745-914c-6245d5644544 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.629461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d649-57c5-4745-914c-6245d5644544 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.629827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349d649-57c5-4745-914c-6245d5644544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.662631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1349d649-57c5-4745-914c-6245d5644544 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:48.663876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1349d649-57c5-4745-914c-6245d5644544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:48.771916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.772550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.772836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.773094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.774121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:48.775662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:48.786161 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1709/3416] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:48.791745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d649-57c5-4745-914c-6245d5644544 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.796905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1349d649-57c5-4745-914c-6245d5644544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:48.803976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:48.823153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:48.831083 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1708/3417] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:48 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:48.835598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:48.913293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1349d649-57c5-4745-914c-6245d5644544 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.976710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b7b280-8335-47c8-84ca-213ac06d0f28 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:48.990771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:48.992686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:48.993180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:48.995074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:48.998749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.001029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.034039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:49.034904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.035192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.035508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.057732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.066917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.093216 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1710/3418] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:49.105986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:49.107267 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1709/3419] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:48 2022] POST /identity/v3/users => generated 300 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:56:49.118857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10160940-c286-409b-bb23-13c9ccb78ed4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:49.124422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:49.125069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.125348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.125606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.126305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.128091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.141706 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1711/3420] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:49.145566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:49.156490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126675c-9a05-419c-aac2-0c4a1868a848 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:49.182359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:49.183060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.183349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.183677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] PATH_INFO: `/v3/projects/9dadbd37488c485a9a6114a18c23a00a/users/b648f0754cd84a118bc4aef124700d40/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.241736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:49.248548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dadbd37488c485a9a6114a18c23a00a, user_id=b648f0754cd84a118bc4aef124700d40, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.248706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:49.251317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.301722 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1710/3421] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:49 2022] PUT /identity/v3/projects/9dadbd37488c485a9a6114a18c23a00a/users/b648f0754cd84a118bc4aef124700d40/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:49.303414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:49.425420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d536e1-b07a-4164-a569-9a57b64313b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:49.477553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c8fe1-b4a1-49fa-8b71-38c7e358944b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:49.486846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:49.488930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.489520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.490169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.491490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.494863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.523044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1711/3422] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:49 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:49.526889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:49.530785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:49.549617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:49.550279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.550554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.550800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65338eed-6c40-48d0-b71c-3c814585d877 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:49.550945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.557745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2558e1-8bd1-4f30-9725-744b64d0d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:49.558633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2558e1-8bd1-4f30-9725-744b64d0d519 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.559157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2558e1-8bd1-4f30-9725-744b64d0d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.559788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2558e1-8bd1-4f30-9725-744b64d0d519 admin admin] PATH_INFO: `/v3/projects/9dadbd37488c485a9a6114a18c23a00a/users/b648f0754cd84a118bc4aef124700d40/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.562608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:49.581380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2558e1-8bd1-4f30-9725-744b64d0d519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dadbd37488c485a9a6114a18c23a00a, user_id=b648f0754cd84a118bc4aef124700d40, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.588268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2558e1-8bd1-4f30-9725-744b64d0d519 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.598979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:49.600909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eecedd5-4888-48c1-bfa9-9d13108da691 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:49.624571 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1712/3423] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:49.650309 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1712/3424] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:49 2022] PUT /identity/v3/projects/9dadbd37488c485a9a6114a18c23a00a/users/b648f0754cd84a118bc4aef124700d40/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:49.652197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.652527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.652795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.714780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] MFA Rules not processed for user `b648f0754cd84a118bc4aef124700d40`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:49.718452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:49.736881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:49.737235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:49.737501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:49.795073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:49.796349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:49.863184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1713/3425] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:49.875585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:49.879794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:49.891002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:49.910180 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1713/3426] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:50.004242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a145499-78ea-4b59-a17e-6bb2b677606d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:50.024987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9d7d6-1893-4836-8bb9-170109c5bc12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:50.026068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9d7d6-1893-4836-8bb9-170109c5bc12 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:50.026894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9d7d6-1893-4836-8bb9-170109c5bc12 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:50.027219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9d7d6-1893-4836-8bb9-170109c5bc12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:50.043558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9d7d6-1893-4836-8bb9-170109c5bc12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:50.048012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9d7d6-1893-4836-8bb9-170109c5bc12 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:50.064135 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1714/3427] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:56:50.755434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:50.884368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba255c5-a9a1-42bb-8dd6-380abb5131f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:50.895203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:50.896285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:50.897948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:50.899005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] PATH_INFO: `/v3/users/4014a93c9f3c4604b8e1de913ee5891e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:50.903198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4014a93c9f3c4604b8e1de913ee5891e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:50.909023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:51.032660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4014a93c9f3c4604b8e1de913ee5891e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:51.064020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4014a93c9f3c4604b8e1de913ee5891e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:51.065202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4014a93c9f3c4604b8e1de913ee5891e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:51.077186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4014a93c9f3c4604b8e1de913ee5891e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:51.078880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4014a93c9f3c4604b8e1de913ee5891e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:51.114764 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1714/3428] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:50 2022] DELETE /identity/v3/users/4014a93c9f3c4604b8e1de913ee5891e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:51.121314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d56be-8ec3-4287-9662-68f1a4df0090 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:51.122201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d56be-8ec3-4287-9662-68f1a4df0090 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:51.122633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d56be-8ec3-4287-9662-68f1a4df0090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:51.160736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-475d56be-8ec3-4287-9662-68f1a4df0090 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:51.163594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-475d56be-8ec3-4287-9662-68f1a4df0090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:51.233097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:51.264167 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1715/3429] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:56:51.300108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:51.301706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:51.515349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015865a3-1f5c-4168-a39a-6aca55f7ee9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:51.529212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:51.529212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:51.529212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:51.529212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:51.572426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:51.573912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:51.592552 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1715/3430] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:52.984594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:52.985423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:52.986582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:53.036746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:53.038448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:53.104336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:53.106197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:53.140108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd6df8-80ef-463b-ac84-daccf27e2f54 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:53.150414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:53.151055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:53.151512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:53.151935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] PATH_INFO: `/v3/projects/c84dd12e6a2c4a67b8d2a00188663316` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:53.154017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84dd12e6a2c4a67b8d2a00188663316)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:53.158040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:53.184556 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1716/3431] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:56:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:53.192451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:53.216240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:53.217729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:53.264312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84dd12e6a2c4a67b8d2a00188663316', 'request_id': 'req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.273598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84dd12e6a2c4a67b8d2a00188663316', 'request_id': 'req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.280102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84dd12e6a2c4a67b8d2a00188663316', 'request_id': 'req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.311889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] The token cache is being invalidate because project c84dd12e6a2c4a67b8d2a00188663316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:53.317189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.322702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.326826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1716/3432] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:53 2022] DELETE /identity/v3/projects/c84dd12e6a2c4a67b8d2a00188663316 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:53.333480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:53.337019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:53.363758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbe427-7730-4a68-b1cb-6e7f11f808ab None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:53.493223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6aa16-c0f1-4ab7-980a-80c9f3da2f3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:53.495627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:53.497037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:53.497622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:53.498200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:53.501932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:53.502676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:53.503041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:53.504248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:53.504618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] PATH_INFO: `/v3/users/b648f0754cd84a118bc4aef124700d40` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:53.506359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b648f0754cd84a118bc4aef124700d40)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:53.509156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:53.595653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b648f0754cd84a118bc4aef124700d40'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.608379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:53.628185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b648f0754cd84a118bc4aef124700d40'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.629699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b648f0754cd84a118bc4aef124700d40'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.643573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b648f0754cd84a118bc4aef124700d40'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.645748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b648f0754cd84a118bc4aef124700d40'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:53.659697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:53.661301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:53.672073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1717/3433] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:53 2022] DELETE /identity/v3/users/b648f0754cd84a118bc4aef124700d40 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:53.672073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:53.677680 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1717/3434] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 02:56:53.688660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:53.737027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:53.855041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ed86-c8e6-45e0-b10b-e618a47d7f88 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:53.867781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:53.871143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:53.873005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:53.873441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] PATH_INFO: `/v3/users/3c307a82cd9d4c3f884e67c376757a6a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:53.876816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c307a82cd9d4c3f884e67c376757a6a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:53.883071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:53.982251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c307a82cd9d4c3f884e67c376757a6a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.023885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c307a82cd9d4c3f884e67c376757a6a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.024656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c307a82cd9d4c3f884e67c376757a6a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.048472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c307a82cd9d4c3f884e67c376757a6a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.049263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c307a82cd9d4c3f884e67c376757a6a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.080390 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1718/3435] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:56:53 2022] DELETE /identity/v3/users/3c307a82cd9d4c3f884e67c376757a6a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:54.237794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:54.251992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e939c61-3960-4917-b8ab-23e2e72bfbb2 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:54.391036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:54.391703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.392031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.392304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] PATH_INFO: `/v3/projects/9dadbd37488c485a9a6114a18c23a00a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.394052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:54.395559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:54.401255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dadbd37488c485a9a6114a18c23a00a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:54.403232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:54.435306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae3e5b-5c22-46a6-8b3e-6d0867b48404 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:54.449344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:54.452656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.453313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.454337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] PATH_INFO: `/v3/projects/9f94d5560cbe4ad98fdb148e80c66ffc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.457164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f94d5560cbe4ad98fdb148e80c66ffc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:54.465996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:54.497455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dadbd37488c485a9a6114a18c23a00a', 'request_id': 'req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.516175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dadbd37488c485a9a6114a18c23a00a', 'request_id': 'req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.536029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dadbd37488c485a9a6114a18c23a00a', 'request_id': 'req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.545029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f94d5560cbe4ad98fdb148e80c66ffc', 'request_id': 'req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.552318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f94d5560cbe4ad98fdb148e80c66ffc', 'request_id': 'req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.560126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f94d5560cbe4ad98fdb148e80c66ffc', 'request_id': 'req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.568705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] The token cache is being invalidate because project 9dadbd37488c485a9a6114a18c23a00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:54.569345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.570419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f81b86c4-c675-483e-b98a-a56d8ccf1e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.574779 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1718/3436] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:54 2022] DELETE /identity/v3/projects/9dadbd37488c485a9a6114a18c23a00a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:54.578228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211def0-bc63-4a5a-840f-f76019badbd1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.578848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211def0-bc63-4a5a-840f-f76019badbd1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.579225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211def0-bc63-4a5a-840f-f76019badbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.584867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] The token cache is being invalidate because project 9f94d5560cbe4ad98fdb148e80c66ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:56:54.585161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.585927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bb394c5c-75dd-40b9-becc-9fa9d86d3a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:56:54.588541 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1719/3437] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:56:54 2022] DELETE /identity/v3/projects/9f94d5560cbe4ad98fdb148e80c66ffc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:54.594010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab39a08-7f6e-4bf1-aba5-6c8f1723bb80 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.594415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab39a08-7f6e-4bf1-aba5-6c8f1723bb80 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.594757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab39a08-7f6e-4bf1-aba5-6c8f1723bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.606546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b211def0-bc63-4a5a-840f-f76019badbd1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:54.607868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b211def0-bc63-4a5a-840f-f76019badbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:54.622035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1ab39a08-7f6e-4bf1-aba5-6c8f1723bb80 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:54.623546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1ab39a08-7f6e-4bf1-aba5-6c8f1723bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:54.649498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:54.736260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1720/3438] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:54.736503 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1719/3439] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:54.747122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.747510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.747855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.754233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a992-aa97-4c31-b9fa-2fe7538e2e42 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.754909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a992-aa97-4c31-b9fa-2fe7538e2e42 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.755371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2a992-aa97-4c31-b9fa-2fe7538e2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.809877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] MFA Rules not processed for user `0868f50723074f2b98f7b1096743f3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:54.811144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:54.823093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fce2a992-aa97-4c31-b9fa-2fe7538e2e42 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:54.824397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fce2a992-aa97-4c31-b9fa-2fe7538e2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:54.856854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1720/3440] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:56:54.858337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.858611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.858877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.894944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:54.908579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:54.913221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:54.934501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1721/3441] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:54.935381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:54.954589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cea35-048c-4258-9226-e7b6dcff13aa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:54.970010 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1721/3442] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:54.975005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:54.985994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:54.986851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:54.987449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:54.987868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:54.988706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:54.989159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.001374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.001578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d844d-a7ca-4fd2-b937-4fc2981aa733 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.015473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.018744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.019751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.020039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.020714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:56:55.021022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.028580 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1722/3443] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:55.035223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.040465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.055130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55780ff-624c-4a55-9f8d-3f450b4c3b4f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.068452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.069167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.069505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.069876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.070740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.087980 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1722/3444] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:56:55.092453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.093734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.107907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb62585-43d1-4f72-9292-43dd6690c868 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.115204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.116655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.116780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.117364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.117725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.120295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.162402 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1723/3445] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:55.166676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.168638 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1723/3446] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/projects => generated 395 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:55.172981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.266947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac959893-22cc-42b5-bec1-a378e4e89142 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.290033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.293655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.294242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.294807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.295676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.298367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.310265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d4c3b-b1ec-48cb-bcc6-94d3d5828481 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.317886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.318963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.319668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.320263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.321133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.326359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.340745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1724/3447] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:55.344796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.371645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b4698-74b4-48d3-ba98-5f183e16baa8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.380326 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1724/3448] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/users => generated 288 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:56:55.383505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.385045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.387951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.389557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.390081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.392080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.397583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.412832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7b7d-1977-40bb-bd4a-859bc8abf98d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.426733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.428155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1725/3449] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:55.428852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.429308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.429755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.432007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.433409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.438347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.460223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da339a6-25ff-496a-9055-206c7248a4ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.471426 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1725/3450] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:55.472643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.473129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.473634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.474106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.474508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.475304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.477053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.479819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:55.494177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0564750-94a1-4db4-bbc7-136844d19734 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.495428 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1726/3451] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:55.496548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.501519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.502557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.502934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.503455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.504885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.507440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.510231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1946a-2448-4722-824c-34f10967d724 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.516243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee18a7-2ce6-4dbd-b67d-98592483989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.517297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee18a7-2ce6-4dbd-b67d-98592483989f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.517941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee18a7-2ce6-4dbd-b67d-98592483989f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.518400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee18a7-2ce6-4dbd-b67d-98592483989f admin admin] PATH_INFO: `/v3/projects/523c0a96752940ca9416402d8180b1bd/users/be3a530b7ca34f6b9e84e3e7ece9fcff/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.539946 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1726/3452] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:55.541341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.544220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee18a7-2ce6-4dbd-b67d-98592483989f admin admin] RBAC: Authorizing `identity:create_grant(project_id=523c0a96752940ca9416402d8180b1bd, user_id=be3a530b7ca34f6b9e84e3e7ece9fcff, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.547747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee18a7-2ce6-4dbd-b67d-98592483989f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.568017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710902cb-a545-4275-940a-32dee23e634e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.575513 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1727/3453] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:55 2022] PUT /identity/v3/projects/523c0a96752940ca9416402d8180b1bd/users/be3a530b7ca34f6b9e84e3e7ece9fcff/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:55.579137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.579434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.579704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.617897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:55.619210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:55.647920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72962492-c008-42ab-994a-bdd644a9c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.649188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962492-c008-42ab-994a-bdd644a9c6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.649648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962492-c008-42ab-994a-bdd644a9c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.650276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962492-c008-42ab-994a-bdd644a9c6f3 admin admin] PATH_INFO: `/v3/projects/fc4a5146b4134f11af39e82d9ae9f03b/users/eeff83f3646947109a6a670d0711398f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.680942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72962492-c008-42ab-994a-bdd644a9c6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4a5146b4134f11af39e82d9ae9f03b, user_id=eeff83f3646947109a6a670d0711398f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:55.684456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72962492-c008-42ab-994a-bdd644a9c6f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:55.714815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1728/3455] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:55.715295 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1727/3455] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:55 2022] PUT /identity/v3/projects/fc4a5146b4134f11af39e82d9ae9f03b/users/eeff83f3646947109a6a670d0711398f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:55.716964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.718137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.718137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:55.740466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.747704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:55.754489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] MFA Rules not processed for user `eeff83f3646947109a6a670d0711398f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:55.756185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:55.760396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:55.835589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575366f0-241d-454e-bf1e-e87238684f5a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:55.907343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1728/3456] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:55.911270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:55.953651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:55.957360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:55.957765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:55.958195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.035373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a099fb23-308c-4bd6-a87e-d82c1657dab3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:56.043019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:56.044399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.044693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.045028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.045688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.047985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.084171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:56.122194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.125621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.147257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1729/3457] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:56:55 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:56.148525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:56.157445 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1729/3458] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:56:56.337152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693e8ee4-3124-4d98-864f-f5f6576cd432 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:56.355737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:56.358689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.359970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.360323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.361069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.368012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.428931 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1730/3459] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:56:56 2022] POST /identity/v3/users => generated 295 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:56:56.429416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:56.447383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da60f-628f-4b93-a116-b5ef069480c4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:56.456121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:56.457777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.459000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.459465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.460281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.463108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.517910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1730/3460] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:56.518856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:56.538458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8be771a-0600-45f0-aad8-b6e41bb4c4be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:56.551279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:56.553265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.554675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.554953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] PATH_INFO: `/v3/projects/d00b18d27eb643cfacec3f332d76cb9e/users/7fbbacb94711468e977c6eba0935f41e/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.592317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00b18d27eb643cfacec3f332d76cb9e, user_id=7fbbacb94711468e977c6eba0935f41e, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.595174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.606124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:56.627535 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1731/3461] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:56 2022] PUT /identity/v3/projects/d00b18d27eb643cfacec3f332d76cb9e/users/7fbbacb94711468e977c6eba0935f41e/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:56:56.630020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:56.645264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe0dd-8462-4033-a6b3-682bf51e8c9d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:56.763373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc7080-3471-4aa6-88f1-eb42c3a11640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:56.774346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc7080-3471-4aa6-88f1-eb42c3a11640 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.774718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc7080-3471-4aa6-88f1-eb42c3a11640 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.774897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc7080-3471-4aa6-88f1-eb42c3a11640 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.775767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc7080-3471-4aa6-88f1-eb42c3a11640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.779171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc7080-3471-4aa6-88f1-eb42c3a11640 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.807640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1731/3462] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:56:56.813974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:56.826029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567324-ae8a-4c7a-ac85-7f9ea8f96c26 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:56.847027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f15ccb-68ac-4d96-b909-e3b1024f5df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:56.847863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f15ccb-68ac-4d96-b909-e3b1024f5df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.848080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f15ccb-68ac-4d96-b909-e3b1024f5df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.848429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f15ccb-68ac-4d96-b909-e3b1024f5df5 admin admin] PATH_INFO: `/v3/projects/d00b18d27eb643cfacec3f332d76cb9e/users/7fbbacb94711468e977c6eba0935f41e/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.859880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f15ccb-68ac-4d96-b909-e3b1024f5df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00b18d27eb643cfacec3f332d76cb9e, user_id=7fbbacb94711468e977c6eba0935f41e, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:56.870682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f15ccb-68ac-4d96-b909-e3b1024f5df5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:56.906751 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1732/3463] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:56:56 2022] PUT /identity/v3/projects/d00b18d27eb643cfacec3f332d76cb9e/users/7fbbacb94711468e977c6eba0935f41e/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:56:56.918239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:56.918492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:56.918729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:56.979255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] MFA Rules not processed for user `7fbbacb94711468e977c6eba0935f41e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:56.980545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:57.136887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1732/3464] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:57.146481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea830-dbea-45f9-9335-eb9915b8d4eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:57.147774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea830-dbea-45f9-9335-eb9915b8d4eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:57.147774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ea830-dbea-45f9-9335-eb9915b8d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:57.193505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8c9ea830-dbea-45f9-9335-eb9915b8d4eb None None] MFA Rules not processed for user `eeff83f3646947109a6a670d0711398f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:57.197402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c9ea830-dbea-45f9-9335-eb9915b8d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:57.379050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1733/3465] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:56:57.390594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:56:57.392198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:57.556573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:56:57.662193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c93bd-3594-4598-9b01-a29ed4b8fd6a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:56:57.703735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:56:57.707238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:57.708152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:57.708431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:57.745662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:56:57.747624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:56:57.832273 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1733/3466] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:56:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:56:59.517179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd4e4c-5296-469d-84bb-0d7ee2650920 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:56:59.517760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd4e4c-5296-469d-84bb-0d7ee2650920 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:56:59.518907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd4e4c-5296-469d-84bb-0d7ee2650920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:56:59.583112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f2dd4e4c-5296-469d-84bb-0d7ee2650920 None None] MFA Rules not processed for user `eeff83f3646947109a6a670d0711398f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:56:59.584516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f2dd4e4c-5296-469d-84bb-0d7ee2650920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:56:59.603805 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1734/3467] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:56:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:01.707208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:01.708681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:01.870076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e70e6-258c-431e-b1b2-f2565080b33e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:01.897475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:01.898170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:01.899840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:01.900112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] PATH_INFO: `/v3/users/059a7b31cf2f45bda437a84510b29e56` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:01.908193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059a7b31cf2f45bda437a84510b29e56)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:01.919549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:02.072171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059a7b31cf2f45bda437a84510b29e56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:02.106151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059a7b31cf2f45bda437a84510b29e56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:02.106933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059a7b31cf2f45bda437a84510b29e56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:02.166805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059a7b31cf2f45bda437a84510b29e56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:02.167846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059a7b31cf2f45bda437a84510b29e56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:02.200727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1734/3468] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:01 2022] DELETE /identity/v3/users/059a7b31cf2f45bda437a84510b29e56 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:02.205467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:02.206052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:02.206275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:02.251205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:02.257318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:02.435107 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1735/3469] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:02.649593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:02.651592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:02.834659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b7204-b8d7-4189-bad4-382e4814ffb0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:02.843134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ace86a-fdae-4826-8cf1-4632e5650b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:02.844595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace86a-fdae-4826-8cf1-4632e5650b63 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:02.844815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace86a-fdae-4826-8cf1-4632e5650b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:02.845096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ace86a-fdae-4826-8cf1-4632e5650b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:02.920398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace86a-fdae-4826-8cf1-4632e5650b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:02.927851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ace86a-fdae-4826-8cf1-4632e5650b63 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:02.950870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:02.986663 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1735/3470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:05.378179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:05.380317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:05.397311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e8382-f3ab-490a-ba1c-ecefb2526fc5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:05.404378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:05.418171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:05.418171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:05.418171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] PATH_INFO: `/v3/projects/27aa3da3170a4ab5a57ef15f20483b4f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:05.418171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27aa3da3170a4ab5a57ef15f20483b4f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:05.418171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:05.508499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27aa3da3170a4ab5a57ef15f20483b4f', 'request_id': 'req-177fa2a5-6d07-433d-98cb-a064b774f064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:05.517144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27aa3da3170a4ab5a57ef15f20483b4f', 'request_id': 'req-177fa2a5-6d07-433d-98cb-a064b774f064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:05.525728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27aa3da3170a4ab5a57ef15f20483b4f', 'request_id': 'req-177fa2a5-6d07-433d-98cb-a064b774f064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:05.549410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] The token cache is being invalidate because project 27aa3da3170a4ab5a57ef15f20483b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:05.550112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:05.551544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-177fa2a5-6d07-433d-98cb-a064b774f064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:05.558478 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1736/3471] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:05 2022] DELETE /identity/v3/projects/27aa3da3170a4ab5a57ef15f20483b4f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:05.558929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:05.559453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:05.559453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:05.587500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:05.588774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:05.686057 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1736/3472] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:05.688174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:05.688174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:05.688174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:05.707764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:05.729257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:05.731949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:05.784913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1737/3473] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:05.789602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:05.801224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bffd9-473d-46ce-b4a3-a36be7e9ce57 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:05.808436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:05.810042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:05.810636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:05.811545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:05.813167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:57:05.813714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:05.818968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:05.840753 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1737/3474] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:57:05.843755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:05.855251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6fa6da-264d-4708-9ba5-e7126c4f69d4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:05.862162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:05.863243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:05.863676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:05.864088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:05.866294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:05.869345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:05.915909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:05.923372 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1738/3475] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:05 2022] POST /identity/v3/projects => generated 353 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:05.929948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5a642-0852-4cec-80bc-3c5fe64d2559 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:06.009082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:06.010265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:06.010855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:06.011304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:06.013007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:06.015294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:06.063466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:06.072677 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1738/3476] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:05 2022] POST /identity/v3/users => generated 277 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:06.080880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101bd28-3fe7-4c89-927f-4555403e1734 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:06.102638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:06.104950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:06.105771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:06.106594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:06.109921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:06.116199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:06.153164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:06.166167 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1739/3477] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:06.172482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb1dc8-023b-4ce3-9ea3-3fcaac8aad90 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:06.180008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf87bc7-00d1-4410-a67f-5a94d5b3c82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:06.180966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87bc7-00d1-4410-a67f-5a94d5b3c82c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:06.181444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87bc7-00d1-4410-a67f-5a94d5b3c82c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:06.181980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf87bc7-00d1-4410-a67f-5a94d5b3c82c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:06.182780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf87bc7-00d1-4410-a67f-5a94d5b3c82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:06.185428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf87bc7-00d1-4410-a67f-5a94d5b3c82c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:06.210783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:06.221123 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1739/3478] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:06.226866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96e62e-1b5a-4379-9017-08c8cf7a11b8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:06.238894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:06.239991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:06.241533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:06.242165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] PATH_INFO: `/v3/projects/4a4c598c229b4739a9205236e95ac65a/users/24cab6e93b4b428e95463d4922091b94/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:06.270845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4c598c229b4739a9205236e95ac65a, user_id=24cab6e93b4b428e95463d4922091b94, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:06.294498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:06.319008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1740/3479] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:06 2022] PUT /identity/v3/projects/4a4c598c229b4739a9205236e95ac65a/users/24cab6e93b4b428e95463d4922091b94/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:06.335160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150d10-86e4-4f3e-9002-712d2720ef3f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:06.335616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150d10-86e4-4f3e-9002-712d2720ef3f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:06.335738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b150d10-86e4-4f3e-9002-712d2720ef3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:06.400899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4b150d10-86e4-4f3e-9002-712d2720ef3f None None] MFA Rules not processed for user `24cab6e93b4b428e95463d4922091b94`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:06.402405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b150d10-86e4-4f3e-9002-712d2720ef3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:06.510827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:06.539141 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1740/3480] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:06.608657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:06.611438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:06.702917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf059c-50bf-47a6-afb7-c2e1cb0812ef admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:06.707805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:06.709038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:06.709323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:06.709600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:06.740525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:06.742145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:06.757196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1741/3481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:09.541501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf62c8-4785-4ed8-8f6a-a6cfc81b8c83 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:09.546085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf62c8-4785-4ed8-8f6a-a6cfc81b8c83 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:09.546694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf62c8-4785-4ed8-8f6a-a6cfc81b8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:09.631059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0bbf62c8-4785-4ed8-8f6a-a6cfc81b8c83 None None] MFA Rules not processed for user `eaaa0b3debf041098f1f188124050dad`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:09.632795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0bbf62c8-4785-4ed8-8f6a-a6cfc81b8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:09.753505 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1741/3482] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:09.865112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:09.867244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:09.993516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e54d8-7293-4056-9094-747766998343 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:10.001058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e1fc-0ecb-4251-90a1-d319b21ea5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:10.001699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e1fc-0ecb-4251-90a1-d319b21ea5f9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:10.002015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e1fc-0ecb-4251-90a1-d319b21ea5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:10.002292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e1fc-0ecb-4251-90a1-d319b21ea5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:10.015140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e1fc-0ecb-4251-90a1-d319b21ea5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:10.016777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e1fc-0ecb-4251-90a1-d319b21ea5f9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:10.037584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1742/3483] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:11.285788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636962d-215c-49b7-bf1f-a8ccfd5313c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:11.290973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636962d-215c-49b7-bf1f-a8ccfd5313c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:11.291503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636962d-215c-49b7-bf1f-a8ccfd5313c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:11.374936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2636962d-215c-49b7-bf1f-a8ccfd5313c8 None None] MFA Rules not processed for user `f909cc7113594047add07a2bbd14187a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:11.380603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2636962d-215c-49b7-bf1f-a8ccfd5313c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:11.547395 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1742/3484] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:11.978427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f72ce-b830-4acf-9428-d639159f931a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:11.978949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f72ce-b830-4acf-9428-d639159f931a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:11.978949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f72ce-b830-4acf-9428-d639159f931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:12.044370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-329f72ce-b830-4acf-9428-d639159f931a None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:12.045654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-329f72ce-b830-4acf-9428-d639159f931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:12.081421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:12.185172 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1743/3485] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:12.197281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:12.197620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:12.197872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:12.233167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:12.242017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:12.250704 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1743/3486] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:12.672602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f72ce-b830-4acf-9428-d639159f931a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:12.692567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f72ce-b830-4acf-9428-d639159f931a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:12.709185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e74cb8-14f1-4a71-843d-21ad030edf7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:12.709843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74cb8-14f1-4a71-843d-21ad030edf7b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:12.710130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74cb8-14f1-4a71-843d-21ad030edf7b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:12.710409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e74cb8-14f1-4a71-843d-21ad030edf7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:12.735001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e74cb8-14f1-4a71-843d-21ad030edf7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:12.737076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e74cb8-14f1-4a71-843d-21ad030edf7b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:12.765532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1744/3487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:12 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:13.131221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:13.288514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213ccfc-e71c-4219-96b6-271c905c11f8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:13.299320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:13.300223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:13.301768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:13.302300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] PATH_INFO: `/v3/users/24cab6e93b4b428e95463d4922091b94` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:13.304076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24cab6e93b4b428e95463d4922091b94)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:13.307970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:13.356063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:13.434696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24cab6e93b4b428e95463d4922091b94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:13.461314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24cab6e93b4b428e95463d4922091b94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:13.463006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24cab6e93b4b428e95463d4922091b94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:13.486171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24cab6e93b4b428e95463d4922091b94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:13.490167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24cab6e93b4b428e95463d4922091b94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:13.523895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1744/3488] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:13 2022] DELETE /identity/v3/users/24cab6e93b4b428e95463d4922091b94 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:13.528726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:13.529255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:13.529426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:13.579664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:13.581758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:13.735239 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1745/3489] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:13.751040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:13.752696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:13.846658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94c3a1-727d-483b-9550-8c32580e14a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:13.851937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e53382-7e0c-4f37-9da1-d9c144a127ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:13.852887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53382-7e0c-4f37-9da1-d9c144a127ec service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:13.854242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53382-7e0c-4f37-9da1-d9c144a127ec service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:13.855346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e53382-7e0c-4f37-9da1-d9c144a127ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:13.869281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e53382-7e0c-4f37-9da1-d9c144a127ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:13.871608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e53382-7e0c-4f37-9da1-d9c144a127ec service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:13.897224 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1745/3490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:14.606059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:14.607773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:14.634573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc6c24-d70d-41de-bcca-85e6aa5bb8a3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:14.658824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:14.659492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:14.659774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:14.660043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] PATH_INFO: `/v3/projects/4a4c598c229b4739a9205236e95ac65a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:14.662600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4c598c229b4739a9205236e95ac65a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:14.664526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:14.786733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4c598c229b4739a9205236e95ac65a', 'request_id': 'req-87b01ba9-fe7d-4d19-90be-40751c5765e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:14.803582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4c598c229b4739a9205236e95ac65a', 'request_id': 'req-87b01ba9-fe7d-4d19-90be-40751c5765e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:14.819194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4c598c229b4739a9205236e95ac65a', 'request_id': 'req-87b01ba9-fe7d-4d19-90be-40751c5765e0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:14.844020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] The token cache is being invalidate because project 4a4c598c229b4739a9205236e95ac65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:14.844317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:14.845166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87b01ba9-fe7d-4d19-90be-40751c5765e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:14.847547 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1746/3491] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:14 2022] DELETE /identity/v3/projects/4a4c598c229b4739a9205236e95ac65a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:14.852397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:14.853324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:14.853955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:14.892358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:14.893426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:15.017613 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1746/3492] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:15.025245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.025524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.026008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.064293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:15.066275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:15.095391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:15.096030 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1747/3493] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:15.108474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e17d0-13cf-44dd-833b-7b5bc95bb125 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:15.122066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:15.123848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.124133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.126574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.127462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:57:15.127784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:15.131082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:15.165770 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1747/3494] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:57:15.169797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:15.184724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefdfc8-b0ce-4969-9516-2284b7a9f1c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:15.200009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:15.200675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.201556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.202193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.202855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:15.204776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:15.274918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:15.286863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:15.294999 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1748/3495] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:15 2022] POST /identity/v3/projects => generated 403 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:15.301546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb8465-06c2-49fa-97d2-c2da545b378b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:15.341545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:15.433212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:15.434129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.434367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.434646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.435969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:15.438428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:15.479160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:15.479944 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1748/3496] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:15 2022] POST /identity/v3/users => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:57:15.496349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c0a0d-975d-4344-9ca8-787716b86f65 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:15.512611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:15.514613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.515306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.515587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.518965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:15.520795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:15.566178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1749/3497] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:57:15.570740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:15.583656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a8997-d94d-4b0e-8568-4e10d316ba93 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:15.589771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad74aa-8d33-4536-b6d6-b0ad2b47a698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:15.590514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad74aa-8d33-4536-b6d6-b0ad2b47a698 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.590797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad74aa-8d33-4536-b6d6-b0ad2b47a698 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.591073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad74aa-8d33-4536-b6d6-b0ad2b47a698 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.591725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad74aa-8d33-4536-b6d6-b0ad2b47a698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:15.593930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad74aa-8d33-4536-b6d6-b0ad2b47a698 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:15.617244 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1749/3498] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:15.617660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:15.640200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db8a7e-8f01-48c9-9092-14b727ca42f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:15.651881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97e660-31d8-4280-bf93-170b64155265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:15.652578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e660-31d8-4280-bf93-170b64155265 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.652869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e660-31d8-4280-bf93-170b64155265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.653126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97e660-31d8-4280-bf93-170b64155265 admin admin] PATH_INFO: `/v3/projects/695c44ed3ff445df8d19817f0a27fc85/users/15c89f1a0be748188ceeeccf1711f72c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.691908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97e660-31d8-4280-bf93-170b64155265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695c44ed3ff445df8d19817f0a27fc85, user_id=15c89f1a0be748188ceeeccf1711f72c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:15.697096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.697456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.698101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97e660-31d8-4280-bf93-170b64155265 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:15.698217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.724339 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1750/3499] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:15 2022] PUT /identity/v3/projects/695c44ed3ff445df8d19817f0a27fc85/users/15c89f1a0be748188ceeeccf1711f72c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:15.726251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] MFA Rules not processed for user `eaaa0b3debf041098f1f188124050dad`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:15.727510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:15.736928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:15.737469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:15.737744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:15.785681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] MFA Rules not processed for user `15c89f1a0be748188ceeeccf1711f72c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:15.787097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:15.821351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1750/3500] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:15.949048 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1751/3501] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:15.954857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:16.109832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac98010-7193-4ea8-b5c4-790558b39b35 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:16.121993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:16.123136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.130229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.131636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.133290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:16.137685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:16.199333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1751/3502] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:15 2022] POST /identity/v3/projects => generated 405 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:16.199871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:16.215149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78437ee3-8503-43a7-b1e5-ede60ad1a0f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:16.348483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:16.349609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.350205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.350711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.351610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:16.354898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:16.384044 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1752/3503] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:16 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:57:16.388332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:16.406075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9c99-e3fe-44a4-b9ac-6f70f4a48f3e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:16.414066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:16.426815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.430018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.430529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.431393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:16.436764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:16.486507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1752/3504] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:16.486641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:16.499971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c35c9-a20e-4cbb-8b04-6320bf800d2c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:16.509392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:16.510303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.510632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.511076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] PATH_INFO: `/v3/projects/834c9c3726954f66912b6d563bc698db/users/8b65816c71ed4f2ebd4403b610f42bef/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.558607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834c9c3726954f66912b6d563bc698db, user_id=8b65816c71ed4f2ebd4403b610f42bef, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:16.561311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:16.595165 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1753/3505] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:16 2022] PUT /identity/v3/projects/834c9c3726954f66912b6d563bc698db/users/8b65816c71ed4f2ebd4403b610f42bef/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:57:16.599655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:16.613746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aa111-83db-471e-9dc5-860d819ded7e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:16.662582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:16.742239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefd27d-f7bd-486a-b2ef-7b4f8f214389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:16.742888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefd27d-f7bd-486a-b2ef-7b4f8f214389 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.743168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefd27d-f7bd-486a-b2ef-7b4f8f214389 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.743442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefd27d-f7bd-486a-b2ef-7b4f8f214389 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.744246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefd27d-f7bd-486a-b2ef-7b4f8f214389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:16.746499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefd27d-f7bd-486a-b2ef-7b4f8f214389 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:16.772487 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1753/3506] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:16.779664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:16.801568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3a912-f741-42ab-a91c-18c9a6e00ea4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:16.818263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:16.819817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.822491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.823777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] PATH_INFO: `/v3/projects/834c9c3726954f66912b6d563bc698db/users/8b65816c71ed4f2ebd4403b610f42bef/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.832325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834c9c3726954f66912b6d563bc698db, user_id=8b65816c71ed4f2ebd4403b610f42bef, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:16.841299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:16.870593 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1754/3507] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:16 2022] PUT /identity/v3/projects/834c9c3726954f66912b6d563bc698db/users/8b65816c71ed4f2ebd4403b610f42bef/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:57:16.881781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:16.881781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:16.881781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:16.942822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] MFA Rules not processed for user `8b65816c71ed4f2ebd4403b610f42bef`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:16.944069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:17.139905 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1754/3508] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:17.152578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:17.154784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:17.174271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:17.331958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad5f42-00f0-4a1d-9215-b0a132731c57 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:17.340214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b2748-41cf-409e-8573-6cfec592d5b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:17.342072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2748-41cf-409e-8573-6cfec592d5b0 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:17.343231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2748-41cf-409e-8573-6cfec592d5b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:17.344359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b2748-41cf-409e-8573-6cfec592d5b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:17.366098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b2748-41cf-409e-8573-6cfec592d5b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:17.368777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b2748-41cf-409e-8573-6cfec592d5b0 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:17.389236 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1755/3509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:17 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:17.682501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:17.885405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be1723-9276-45f3-99ec-fe062f3215e0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:17.897308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:17.898304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:17.898778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:17.899201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] PATH_INFO: `/v3/users/15c89f1a0be748188ceeeccf1711f72c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:17.903204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15c89f1a0be748188ceeeccf1711f72c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:17.905363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:18.003406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15c89f1a0be748188ceeeccf1711f72c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:18.010908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:18.024471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15c89f1a0be748188ceeeccf1711f72c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:18.025964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15c89f1a0be748188ceeeccf1711f72c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:18.037393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15c89f1a0be748188ceeeccf1711f72c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:18.038609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15c89f1a0be748188ceeeccf1711f72c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:18.058391 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1755/3510] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:17 2022] DELETE /identity/v3/users/15c89f1a0be748188ceeeccf1711f72c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:18.062454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:18.062932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:18.063012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:18.098747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:18.106900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:18.276803 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1756/3511] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:18.301569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:18.303295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:18.453596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e00e9-e0e9-4e22-b96f-a9a967679cb2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:18.462104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:18.465946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:18.466473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:18.466983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:18.479926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:18.482002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:18.495655 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1756/3512] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:19.709011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:19.711543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:19.736392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db107f3-19be-478b-abe7-e7db162f5629 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:19.751384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:19.752454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:19.752966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:19.753450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] PATH_INFO: `/v3/projects/695c44ed3ff445df8d19817f0a27fc85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:19.754891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=695c44ed3ff445df8d19817f0a27fc85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:19.757045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:19.851647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695c44ed3ff445df8d19817f0a27fc85', 'request_id': 'req-0548f2d6-9202-4454-bd0d-9a1bc19097ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:19.866597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695c44ed3ff445df8d19817f0a27fc85', 'request_id': 'req-0548f2d6-9202-4454-bd0d-9a1bc19097ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:19.884899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695c44ed3ff445df8d19817f0a27fc85', 'request_id': 'req-0548f2d6-9202-4454-bd0d-9a1bc19097ed'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:19.909873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] The token cache is being invalidate because project 695c44ed3ff445df8d19817f0a27fc85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:19.910219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:19.911040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:19.917662 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1757/3513] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:19 2022] DELETE /identity/v3/projects/695c44ed3ff445df8d19817f0a27fc85 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:19.919529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:19.937432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c396b32-95b2-43d1-b236-f8aac4f5685d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:20.086925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:20.091938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:20.092225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:20.093490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] PATH_INFO: `/v3/users/8b65816c71ed4f2ebd4403b610f42bef` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:20.095441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b65816c71ed4f2ebd4403b610f42bef)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:20.099488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:20.233288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b65816c71ed4f2ebd4403b610f42bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:20.265188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b65816c71ed4f2ebd4403b610f42bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:20.266053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b65816c71ed4f2ebd4403b610f42bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:20.288909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b65816c71ed4f2ebd4403b610f42bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:20.290989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-67cfacde-cca5-4e09-a1c2-bcf0a9abeff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b65816c71ed4f2ebd4403b610f42bef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:20.295476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:20.325204 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1757/3514] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:19 2022] DELETE /identity/v3/users/8b65816c71ed4f2ebd4403b610f42bef => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:57:21.411388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:21.414617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:21.433109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0548f2d6-9202-4454-bd0d-9a1bc19097ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:21.494865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:21.581741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:21.582431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:21.583177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:21.583774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] PATH_INFO: `/v3/projects/834c9c3726954f66912b6d563bc698db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:21.585231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=834c9c3726954f66912b6d563bc698db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:21.590699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:21.709110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834c9c3726954f66912b6d563bc698db', 'request_id': 'req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:21.740390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834c9c3726954f66912b6d563bc698db', 'request_id': 'req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:21.750152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834c9c3726954f66912b6d563bc698db', 'request_id': 'req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:21.772641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] The token cache is being invalidate because project 834c9c3726954f66912b6d563bc698db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:21.772937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:21.773849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4b364bc5-b073-45cc-8a8f-18e8d5f78f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:21.776343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1758/3515] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:21 2022] DELETE /identity/v3/projects/834c9c3726954f66912b6d563bc698db => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:21.781446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:21.781979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:21.781979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:21.830042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:21.831818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:21.981109 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1758/3516] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:21.988678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:21.989383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:21.989981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.016451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:22.017971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:22.037140 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1759/3517] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:22.040543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.053970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8a113-d1c6-4171-8f06-2b8fabfa61c9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.065672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.066631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.066977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.067392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.068494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:57:22.068904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.070636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.099963 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1759/3518] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:57:22.102150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.119631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610821eb-0e28-42c2-8b89-49e6620d2731 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.125433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.127432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.127807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.128929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.129991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.133383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.190478 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1760/3519] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:22 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:22.192975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.203416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bfb69-e12c-44ad-b9d8-dc06bcda9383 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.326465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.327165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.327447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.327721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.328881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.331838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.371474 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1760/3520] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:22 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:57:22.375685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.390754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3195da-926e-4057-bec1-b79e35f7615d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.395488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.396117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.396464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.396735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.397384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.399071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.412942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1761/3521] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:22.416741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.428054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c097028-06d6-4653-894a-e9c9fb0fd27c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.434962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a6422-b9bb-40c5-9ac7-6ea272989b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.435722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6422-b9bb-40c5-9ac7-6ea272989b98 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.436183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6422-b9bb-40c5-9ac7-6ea272989b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.442345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a6422-b9bb-40c5-9ac7-6ea272989b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.443112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a6422-b9bb-40c5-9ac7-6ea272989b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.444668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a6422-b9bb-40c5-9ac7-6ea272989b98 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.459670 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1761/3522] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:57:22.465634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.477839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521488c4-df8c-4370-9f1f-e9cfd6e51593 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.482964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.483674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.483955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.484241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] PATH_INFO: `/v3/projects/db3085e8c043439aa0f26b6fb87657c2/users/6b7a7c46b65d4d3880aa60766ed9a1e1/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.504249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3085e8c043439aa0f26b6fb87657c2, user_id=6b7a7c46b65d4d3880aa60766ed9a1e1, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.507015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.523312 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1762/3523] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:22 2022] PUT /identity/v3/projects/db3085e8c043439aa0f26b6fb87657c2/users/6b7a7c46b65d4d3880aa60766ed9a1e1/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:22.535280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.535562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.535833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.571939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] MFA Rules not processed for user `6b7a7c46b65d4d3880aa60766ed9a1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:22.573423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:22.646537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:22.673957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1762/3524] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:22.676777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.753269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:22.766650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e1d48-1449-4ea6-94eb-648a68e48440 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.774059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.774701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.774980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.775310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.775953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.778191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.812911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1763/3525] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:22 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:57:22.816966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.829073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f919-3702-4d2e-a91c-0c81a5443e44 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.899894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.900543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.900817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.901082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.901779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.903908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.933977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1763/3526] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:22 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:22.935162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.946154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ad01c-3b3e-49cd-86a9-2bff11b4a9ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.951279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.952080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.952517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.952793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:22.953586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:22.955396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:22.967007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1764/3527] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:22.971253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:22.982041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d789460-9490-4a45-a7ad-3c532529189d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:22.987030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:22.987700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:22.987985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:22.988267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] PATH_INFO: `/v3/projects/e08334ff11f9406291e092de6376cf02/users/fb3b1d7b72c54adfb53105c86ad74d9b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.005920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08334ff11f9406291e092de6376cf02, user_id=fb3b1d7b72c54adfb53105c86ad74d9b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:23.008615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:23.023477 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1764/3528] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:22 2022] PUT /identity/v3/projects/e08334ff11f9406291e092de6376cf02/users/fb3b1d7b72c54adfb53105c86ad74d9b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:57:23.027766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:23.038612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffda45-8bc9-4d05-81fb-11132864384f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:23.099191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544b5e3-d7ac-455e-ba71-6d585d53629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:23.099836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b5e3-d7ac-455e-ba71-6d585d53629b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:23.100121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b5e3-d7ac-455e-ba71-6d585d53629b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:23.100390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544b5e3-d7ac-455e-ba71-6d585d53629b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.101038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544b5e3-d7ac-455e-ba71-6d585d53629b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:23.102811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0544b5e3-d7ac-455e-ba71-6d585d53629b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:23.120235 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1765/3529] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:57:23.121483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:23.135563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b049990-dbcb-447d-938a-0e51df9d6b39 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:23.140717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:23.141385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:23.141671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:23.141982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] PATH_INFO: `/v3/projects/e08334ff11f9406291e092de6376cf02/users/fb3b1d7b72c54adfb53105c86ad74d9b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.144121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08334ff11f9406291e092de6376cf02, user_id=fb3b1d7b72c54adfb53105c86ad74d9b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:23.146810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:23.161868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1765/3530] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:23 2022] PUT /identity/v3/projects/e08334ff11f9406291e092de6376cf02/users/fb3b1d7b72c54adfb53105c86ad74d9b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:23.172650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566028-7377-411e-9a9d-85cb887663a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:23.172977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566028-7377-411e-9a9d-85cb887663a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:23.173212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566028-7377-411e-9a9d-85cb887663a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.211399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03566028-7377-411e-9a9d-85cb887663a6 None None] MFA Rules not processed for user `fb3b1d7b72c54adfb53105c86ad74d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:23.213744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03566028-7377-411e-9a9d-85cb887663a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:23.357893 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1766/3531] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:23.367097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:23.380262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:23.519837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02d32a-b6a4-4aba-96b6-c2aabd507301 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:23.530160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f491c-be0c-4b0b-95e1-457eef529cbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:23.532560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f491c-be0c-4b0b-95e1-457eef529cbe service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:23.532560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f491c-be0c-4b0b-95e1-457eef529cbe service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:23.532560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f491c-be0c-4b0b-95e1-457eef529cbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.555917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f491c-be0c-4b0b-95e1-457eef529cbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:23.557566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f491c-be0c-4b0b-95e1-457eef529cbe service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:23.581410 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1766/3532] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:23.677041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:23.677608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:23.677608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.721661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] MFA Rules not processed for user `eeff83f3646947109a6a670d0711398f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:23.723017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:23.792655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db74aff-45f4-4266-b59c-296e5af9790e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:23.792655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db74aff-45f4-4266-b59c-296e5af9790e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:23.792655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db74aff-45f4-4266-b59c-296e5af9790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:23.802173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:23.829322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0db74aff-45f4-4266-b59c-296e5af9790e None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:23.832097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0db74aff-45f4-4266-b59c-296e5af9790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:23.845468 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1767/3533] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:23.941474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:23.986044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1767/3534] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:24.417777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:24.500849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07950796-3b84-4233-bed9-764bde0aa679 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:24.506623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:24.507610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:24.508154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:24.509987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] PATH_INFO: `/v3/users/6b7a7c46b65d4d3880aa60766ed9a1e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:24.511994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b7a7c46b65d4d3880aa60766ed9a1e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:24.514164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:24.591435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b7a7c46b65d4d3880aa60766ed9a1e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:24.600979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b7a7c46b65d4d3880aa60766ed9a1e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:24.601817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b7a7c46b65d4d3880aa60766ed9a1e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:24.634985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b7a7c46b65d4d3880aa60766ed9a1e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:24.639985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b7a7c46b65d4d3880aa60766ed9a1e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:24.678409 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1768/3535] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:24 2022] DELETE /identity/v3/users/6b7a7c46b65d4d3880aa60766ed9a1e1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:24.679715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:24.679999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:24.680270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:24.718991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:24.720784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:24.821857 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1768/3536] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:24.861586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:24.863429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:25.022740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6200763-e67e-4d59-856b-4da2ef920e16 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:25.035276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:25.036195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:25.036580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:25.036953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:25.059992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:25.065445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:25.091279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1769/3537] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:25.925714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:25.928392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:25.951036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0b67a-7de7-4933-bb8c-214854de8f43 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:25.973718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:25.975078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:25.975362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:25.975636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] PATH_INFO: `/v3/projects/db3085e8c043439aa0f26b6fb87657c2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:25.976878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3085e8c043439aa0f26b6fb87657c2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:25.980512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:26.083552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3085e8c043439aa0f26b6fb87657c2', 'request_id': 'req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.096471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3085e8c043439aa0f26b6fb87657c2', 'request_id': 'req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.108241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3085e8c043439aa0f26b6fb87657c2', 'request_id': 'req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.129484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] The token cache is being invalidate because project db3085e8c043439aa0f26b6fb87657c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:26.129963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.130936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.133312 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1769/3538] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:25 2022] DELETE /identity/v3/projects/db3085e8c043439aa0f26b6fb87657c2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:26.138335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:26.153592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bf391-5a00-4030-b8a1-a9e265a8da15 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:26.176753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:26.313931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:26.315427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:26.318621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:26.319849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] PATH_INFO: `/v3/users/fb3b1d7b72c54adfb53105c86ad74d9b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:26.324671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3b1d7b72c54adfb53105c86ad74d9b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:26.327271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:26.487379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3b1d7b72c54adfb53105c86ad74d9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.510228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3b1d7b72c54adfb53105c86ad74d9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.515317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3b1d7b72c54adfb53105c86ad74d9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.533450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3b1d7b72c54adfb53105c86ad74d9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.534853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c01e501-252e-4fde-8d11-d39f40dbd0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3b1d7b72c54adfb53105c86ad74d9b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:26.602359 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1770/3539] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:26 2022] DELETE /identity/v3/users/fb3b1d7b72c54adfb53105c86ad74d9b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:57:27.139437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:27.140958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:27.161937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6a7e7-91ce-40ed-93b2-afbc2ce9549d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:27.304748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:27.307606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:27.308125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:27.308757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] PATH_INFO: `/v3/projects/e08334ff11f9406291e092de6376cf02` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:27.310470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08334ff11f9406291e092de6376cf02)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:27.312919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:27.327849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:27.381857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08334ff11f9406291e092de6376cf02', 'request_id': 'req-f741827e-50be-45fc-a0a3-241461abd258'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:27.393069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08334ff11f9406291e092de6376cf02', 'request_id': 'req-f741827e-50be-45fc-a0a3-241461abd258'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:27.403820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08334ff11f9406291e092de6376cf02', 'request_id': 'req-f741827e-50be-45fc-a0a3-241461abd258'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:27.452631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] The token cache is being invalidate because project e08334ff11f9406291e092de6376cf02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:27.455172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:27.457841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f741827e-50be-45fc-a0a3-241461abd258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:27.460798 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1770/3540] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:27 2022] DELETE /identity/v3/projects/e08334ff11f9406291e092de6376cf02 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:27.465755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:27.466331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:27.466331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:27.496838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:27.498127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:27.648306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:27.648635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:27.648973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:27.660792 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1771/3541] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:27.685021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:27.688294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:27.714637 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1771/3542] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:27.718897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:27.730375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8c38b-ba02-4414-9743-114700e0104c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:27.736808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:27.737450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:27.739425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:27.739425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:27.739611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:57:27.739826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:27.741729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:27.767849 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1772/3543] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:57:27.772242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:27.788677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee09a5a-a5a6-451f-bcd0-05111d49ca38 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:27.800157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:27.801368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:27.801647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:27.801947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:27.803676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:27.808304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:27.888417 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1772/3544] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:27 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:27.893449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:27.932466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b76c9f-b6eb-4a61-918d-e25aa03ce417 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:27.976606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:28.141732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:28.143824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:28.144842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:28.146884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:28.148209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:28.154876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:28.220092 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1773/3545] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:27 2022] POST /identity/v3/users => generated 282 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:28.224095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:28.240244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7b3c2-d5d8-463a-a64e-e0aef11a53f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:28.248820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:28.249923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:28.250359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:28.250810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:28.251624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:28.253437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:28.269148 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1773/3546] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:28.273028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:28.290675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba71bf-e4ac-4fd4-a0ee-b1a16df5104e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:28.298636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a505387-08e3-4290-bdf5-3586ccb7c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:28.299264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505387-08e3-4290-bdf5-3586ccb7c3bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:28.299543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505387-08e3-4290-bdf5-3586ccb7c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:28.299810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a505387-08e3-4290-bdf5-3586ccb7c3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:28.300451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505387-08e3-4290-bdf5-3586ccb7c3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:28.302655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a505387-08e3-4290-bdf5-3586ccb7c3bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:28.323969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:28.350408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1774/3547] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:28.371611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20540998-991f-44ec-87d1-011af30bfdd5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:28.378346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:28.379036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:28.380599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:28.380914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] PATH_INFO: `/v3/projects/3944475abf4c47b2817066f570a038ac/users/135f108c73ad463a860e6881df42e5ae/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:28.405550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3944475abf4c47b2817066f570a038ac, user_id=135f108c73ad463a860e6881df42e5ae, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:28.408323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:28.430935 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1774/3548] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:28 2022] PUT /identity/v3/projects/3944475abf4c47b2817066f570a038ac/users/135f108c73ad463a860e6881df42e5ae/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:28.446103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:28.447033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:28.447807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:28.499872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] MFA Rules not processed for user `135f108c73ad463a860e6881df42e5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:28.503030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:28.762481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:28.763370 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1775/3549] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:28.883988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce19062-4eec-434b-aa46-212effad01b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:28.898187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:28.905173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:28.905173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:28.905173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:28.905173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:28.905173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.007202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:29.021831 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1775/3550] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:28 2022] POST /identity/v3/projects => generated 363 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:57:29.024872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9097f2-7026-4f43-83c1-efdaf4290471 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:29.191494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:29.192139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.192421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.192697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.193345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:29.203607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.268320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1776/3551] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:29 2022] POST /identity/v3/users => generated 288 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:29.273073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:29.288968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c7d0e-7e97-4145-b5b8-6cbd16f47c37 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:29.307298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:29.314255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.314564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.316496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.318168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:29.320740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.347428 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1776/3552] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:29.351973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:29.363454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53501e03-0167-4281-9aba-6e71bd5fb923 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:29.373170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:29.374194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.374631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.375198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] PATH_INFO: `/v3/projects/96d1b19db6094cc9a964b077f6673e47/users/57b5f26b76c4460693ea50ea55c09688/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.418185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d1b19db6094cc9a964b077f6673e47, user_id=57b5f26b76c4460693ea50ea55c09688, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:29.421068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.424061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:29.445161 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1777/3553] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:29 2022] PUT /identity/v3/projects/96d1b19db6094cc9a964b077f6673e47/users/57b5f26b76c4460693ea50ea55c09688/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:29.451270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:29.469534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16172f55-e328-4072-9b62-1e2f66bcbe50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:29.479891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:29.584260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b542248-c6ae-466c-9c5f-d4a0afcded64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:29.585498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542248-c6ae-466c-9c5f-d4a0afcded64 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.586030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542248-c6ae-466c-9c5f-d4a0afcded64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.586492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b542248-c6ae-466c-9c5f-d4a0afcded64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.587901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b542248-c6ae-466c-9c5f-d4a0afcded64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:29.590564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b542248-c6ae-466c-9c5f-d4a0afcded64 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.610221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1777/3554] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:29.614688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:29.628019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c32645-81ae-4406-9120-a3fddb2d6dcc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:29.634552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:29.635645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.636197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.636738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] PATH_INFO: `/v3/projects/96d1b19db6094cc9a964b077f6673e47/users/57b5f26b76c4460693ea50ea55c09688/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.638953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d1b19db6094cc9a964b077f6673e47, user_id=57b5f26b76c4460693ea50ea55c09688, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:29.642168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.667006 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1778/3555] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:29 2022] PUT /identity/v3/projects/96d1b19db6094cc9a964b077f6673e47/users/57b5f26b76c4460693ea50ea55c09688/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:29.668457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.668749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.669087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.711837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] MFA Rules not processed for user `57b5f26b76c4460693ea50ea55c09688`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:29.716423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:29.875713 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1778/3556] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:29.887896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:29.890547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:29.962579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867573b2-66e1-4518-b515-a5301b151aeb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:29.968713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f290fe-86c0-47f7-9172-6765e3cbe886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:29.970203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f290fe-86c0-47f7-9172-6765e3cbe886 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:29.970728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f290fe-86c0-47f7-9172-6765e3cbe886 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:29.971006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f290fe-86c0-47f7-9172-6765e3cbe886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:29.982594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f290fe-86c0-47f7-9172-6765e3cbe886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:29.984242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f290fe-86c0-47f7-9172-6765e3cbe886 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:29.996911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1779/3557] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:30.086922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:30.099747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6218ff-ca57-4051-902a-2c8e31a7c3e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:30.104323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d29520-9fab-4653-a370-0dd6ae42e1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:30.104876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d29520-9fab-4653-a370-0dd6ae42e1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:30.105167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d29520-9fab-4653-a370-0dd6ae42e1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:30.105433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d29520-9fab-4653-a370-0dd6ae42e1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:30.197999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d29520-9fab-4653-a370-0dd6ae42e1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:30.200126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d29520-9fab-4653-a370-0dd6ae42e1c5 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:30.216118 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1779/3558] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:31.935911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa339a-a40a-4007-acad-8cdb5202f57c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:31.936867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa339a-a40a-4007-acad-8cdb5202f57c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:31.937315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa339a-a40a-4007-acad-8cdb5202f57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:31.975840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ebaa339a-a40a-4007-acad-8cdb5202f57c None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:31.977509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ebaa339a-a40a-4007-acad-8cdb5202f57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:32.054010 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1780/3559] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:31 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:32.371455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033717e5-9ad5-4592-9fc9-67a5813783e0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:32.371455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033717e5-9ad5-4592-9fc9-67a5813783e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:32.371455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033717e5-9ad5-4592-9fc9-67a5813783e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:32.395041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-033717e5-9ad5-4592-9fc9-67a5813783e0 None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:32.396696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-033717e5-9ad5-4592-9fc9-67a5813783e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:32.416253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1780/3560] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:32.503163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cff3-92e2-454a-969b-999d58cacdcc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:32.503451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cff3-92e2-454a-969b-999d58cacdcc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:32.503718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4654cff3-92e2-454a-969b-999d58cacdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:32.528599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4654cff3-92e2-454a-969b-999d58cacdcc None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:32.535246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4654cff3-92e2-454a-969b-999d58cacdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:32.563628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1781/3561] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:32.905890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:32.906132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:32.906406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:32.941529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:32.942808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:32.966178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1781/3562] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:32.997124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:32.997690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:32.997908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:33.028097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] MFA Rules not processed for user `be3a530b7ca34f6b9e84e3e7ece9fcff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:33.029325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:33.051362 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1782/3563] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:34.658230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:34.664480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:34.672013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:34.674065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:34.693033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:34.769136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4ca46-2d78-428a-a17e-56e1ba732ac0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:34.773691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:34.774364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:34.774643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:34.774917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:34.775491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa78740-4369-4e1d-8f9c-d5fe03f0f240 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:34.777541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:34.781630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:34.782479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:34.782930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:34.783367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:34.785264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:34.817331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:34.867396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:34.868298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:34.870909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:34.871050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:34.884406 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1783/3564] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:57:34.898192 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1782/3565] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:43.457413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:43.483505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2579e12-f353-4a9b-9ba9-14454fdea5b7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:43.508317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:43.508930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:43.509176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:43.509458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:43.511645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:43.639474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:43.641058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:43.653469 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1784/3566] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:44.582707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:44.605591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:44.666539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf64cb0-be30-412b-9d4e-6b06fa2dea9f service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:44.690313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:44.696082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:44.698122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:44.700212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] PATH_INFO: `/v3/users/0868f50723074f2b98f7b1096743f3cc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:44.705428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0868f50723074f2b98f7b1096743f3cc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:44.713336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:44.919196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0868f50723074f2b98f7b1096743f3cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:44.955903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0868f50723074f2b98f7b1096743f3cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:44.956984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0868f50723074f2b98f7b1096743f3cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:44.990026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0868f50723074f2b98f7b1096743f3cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:44.992419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1b7b3fd-b55b-44b2-b71a-b2157e6c9f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0868f50723074f2b98f7b1096743f3cc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:45.030203 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1783/3567] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:44 2022] DELETE /identity/v3/users/0868f50723074f2b98f7b1096743f3cc => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:45.632149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:45.655585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a8cb8-a571-41fb-8112-2da0b8545329 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:45.800454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:45.805036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:45.805036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:45.807175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] PATH_INFO: `/v3/projects/09d1a1bd5d9d434a8a5e8f94d564515f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:45.807175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d1a1bd5d9d434a8a5e8f94d564515f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:45.813345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:46.002992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d1a1bd5d9d434a8a5e8f94d564515f', 'request_id': 'req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:46.024833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d1a1bd5d9d434a8a5e8f94d564515f', 'request_id': 'req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:46.044485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:46.047509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d1a1bd5d9d434a8a5e8f94d564515f', 'request_id': 'req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:46.088296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] The token cache is being invalidate because project 09d1a1bd5d9d434a8a5e8f94d564515f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:46.090884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:46.094039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-57b3720d-ac91-49f9-aaac-43a8e11ffb4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:46.097478 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1785/3568] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:45 2022] DELETE /identity/v3/projects/09d1a1bd5d9d434a8a5e8f94d564515f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:46.114820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:46.115679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:46.116097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:46.170070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:46.178868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:46.223767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:46.503229 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1784/3569] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:46.511392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:46.511817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:46.512128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:46.605617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:46.607967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:46.642118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1786/3570] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:46.646519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:46.661736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4ec8d-f84f-40f0-82ae-e5d976afa6bc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:46.675996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:46.676644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:46.676927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:46.677201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:46.677996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:57:46.678206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:46.679824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:46.712481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1785/3571] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:57:46.717029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:46.748978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532a08-dde4-4c78-b819-2dfe6215f962 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:46.765794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:46.766667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:46.769643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:46.770195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:46.771442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:46.773525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:46.834092 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1787/3572] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:46 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:46.838386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:46.849517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3651f6-ba6d-4e87-9743-8a87e5ebf084 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:47.022845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:47.025262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:47.026401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:47.026855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:47.030271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:47.035246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:47.089056 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1786/3573] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:46 2022] POST /identity/v3/users => generated 290 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:47.093230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:47.107398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8c0d7-9c83-437c-8f38-7e1114c8ac9b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:47.124895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:47.125653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:47.127354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:47.127354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:47.127354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:47.129254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:47.161411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:47.168702 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1788/3574] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:47.173280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b90c20-00f6-4e4f-a1fc-cf33d8045657 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:47.189237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda74de3-d019-462d-ae41-607300b9106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:47.190096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74de3-d019-462d-ae41-607300b9106a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:47.190676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74de3-d019-462d-ae41-607300b9106a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:47.190676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda74de3-d019-462d-ae41-607300b9106a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:47.191094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda74de3-d019-462d-ae41-607300b9106a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:47.192849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda74de3-d019-462d-ae41-607300b9106a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:47.217175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1787/3575] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:47.221463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:47.250092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0dee7-7e5a-4f6e-a06f-7c8d549bb418 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:47.262622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:47.263506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:47.263870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:47.265156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] PATH_INFO: `/v3/projects/2541b0313460463f87257f0cc735f973/users/7518ee5c6e334b768c9881ebb6e30559/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:47.339104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2541b0313460463f87257f0cc735f973, user_id=7518ee5c6e334b768c9881ebb6e30559, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:47.342549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:47.366851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1789/3576] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:47 2022] PUT /identity/v3/projects/2541b0313460463f87257f0cc735f973/users/7518ee5c6e334b768c9881ebb6e30559/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:47.372142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:47.372880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:47.373317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:47.407135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:47.408652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:47.735012 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1788/3577] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:47.758172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:47.760355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:47.888680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560f256-6b84-4c8e-92fd-e8f992c6c9d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:47.898736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:47.899387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:47.899669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:47.899934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:47.923234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:47.924695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:47.950185 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1790/3578] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:57:52.956514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:52.962853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:52.993846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e4d5-4d75-437d-9db7-4465c8aa1dc1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:53.030183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:53.031048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:53.031465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:53.032052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] PATH_INFO: `/v3/users/be3a530b7ca34f6b9e84e3e7ece9fcff` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:53.035134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be3a530b7ca34f6b9e84e3e7ece9fcff)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:53.043800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:53.123512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:53.187868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be3a530b7ca34f6b9e84e3e7ece9fcff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:53.202755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be3a530b7ca34f6b9e84e3e7ece9fcff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:53.203618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be3a530b7ca34f6b9e84e3e7ece9fcff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:53.231790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be3a530b7ca34f6b9e84e3e7ece9fcff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:53.232537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-699c8df5-8dcf-430d-a78d-25f3e3f07772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be3a530b7ca34f6b9e84e3e7ece9fcff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:53.279157 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1789/3579] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:57:52 2022] DELETE /identity/v3/users/be3a530b7ca34f6b9e84e3e7ece9fcff => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:54.284028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:54.299595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24975cd5-61ad-4d46-8f9a-9858f302b398 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:54.463879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:54.465460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:54.466194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:54.466559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] PATH_INFO: `/v3/projects/523c0a96752940ca9416402d8180b1bd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:54.474186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] RBAC: Authorizing `identity:delete_project(project_id=523c0a96752940ca9416402d8180b1bd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:54.483111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:54.571846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:54.623524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523c0a96752940ca9416402d8180b1bd', 'request_id': 'req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:54.638534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523c0a96752940ca9416402d8180b1bd', 'request_id': 'req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:54.650796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523c0a96752940ca9416402d8180b1bd', 'request_id': 'req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:54.678097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] The token cache is being invalidate because project 523c0a96752940ca9416402d8180b1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:57:54.678685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:54.679589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a21b8fe6-c36c-41ce-a38b-b1e70f11525f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:57:54.682050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1791/3580] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:57:54 2022] DELETE /identity/v3/projects/523c0a96752940ca9416402d8180b1bd => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:54.688202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:54.689062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:54.689494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:54.718269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:54.719413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:54.879500 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1790/3581] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:54.881178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:54.881466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:54.881766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:54.920585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:54.921932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:54.934278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1792/3582] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:57:54.937687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:54.959203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c5fa3-22ac-44a9-be5e-05d4775f36df None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:54.985852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:54.986876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:54.987572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:54.988077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:54.988920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:57:54.989538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:54.991190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:55.024076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1791/3583] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:57:55.028490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:55.047102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e591a-c177-4488-bc50-db68cd7216f3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:55.062959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:55.063163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.063515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.064041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.064634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:55.069403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:55.163309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1793/3584] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:57:55 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:55.168474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:55.188622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b0c1b-b3cd-482a-8ec2-69dc0e74b8a0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:55.347767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:55.348507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.348953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.349325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.350354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:55.354036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:55.387741 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1792/3585] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:57:55 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:57:55.391393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:55.409379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba741dcb-868b-4d8c-adef-edeec448b39c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:55.431915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:55.432844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.433984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.435878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.436709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:55.438535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:55.469036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:55.469882 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1794/3586] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:57:55.486405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1aafc7-b2b9-4bf4-9ad4-3f2946c4c8e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:55.501298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6abdf-5c84-4d42-b4fb-656ca55354a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:55.502287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6abdf-5c84-4d42-b4fb-656ca55354a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.502668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6abdf-5c84-4d42-b4fb-656ca55354a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.503267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6abdf-5c84-4d42-b4fb-656ca55354a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.504270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6abdf-5c84-4d42-b4fb-656ca55354a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:55.506454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6abdf-5c84-4d42-b4fb-656ca55354a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:55.533852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1793/3587] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:57:55.535310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:55.547918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca60d7-2649-4ed1-84c6-3b9d0be91a5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:55.571762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30db90-d05d-46d1-9416-ecb97f7133c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:55.572494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30db90-d05d-46d1-9416-ecb97f7133c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.572766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30db90-d05d-46d1-9416-ecb97f7133c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.573286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30db90-d05d-46d1-9416-ecb97f7133c6 admin admin] PATH_INFO: `/v3/projects/34130dd0aa5d43c9846cf1a7fdb8d27d/users/a1c2e0d8efb54a128b52722a2dcb3d7b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.612508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30db90-d05d-46d1-9416-ecb97f7133c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34130dd0aa5d43c9846cf1a7fdb8d27d, user_id=a1c2e0d8efb54a128b52722a2dcb3d7b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:55.615219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30db90-d05d-46d1-9416-ecb97f7133c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:55.641964 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1795/3588] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:57:55 2022] PUT /identity/v3/projects/34130dd0aa5d43c9846cf1a7fdb8d27d/users/a1c2e0d8efb54a128b52722a2dcb3d7b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:57:55.653779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.654246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.654603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.666313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:57:55.709460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] MFA Rules not processed for user `a1c2e0d8efb54a128b52722a2dcb3d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:55.710935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:55.871828 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1794/3589] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:55.876143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cee76-d4e2-4540-9f7c-c2a473c066e1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:55.876463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cee76-d4e2-4540-9f7c-c2a473c066e1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:55.876770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46cee76-d4e2-4540-9f7c-c2a473c066e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:55.926231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d46cee76-d4e2-4540-9f7c-c2a473c066e1 None None] MFA Rules not processed for user `a1c2e0d8efb54a128b52722a2dcb3d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:55.927495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d46cee76-d4e2-4540-9f7c-c2a473c066e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:55.941009 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1796/3590] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:57:55.993860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:57:55.999334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:56.191366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538be2b4-9b1e-4249-bae1-153c3989e27c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:57:56.203222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2054462-c252-49a0-bd61-dde33efe0590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:57:56.203860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2054462-c252-49a0-bd61-dde33efe0590 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:56.204135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2054462-c252-49a0-bd61-dde33efe0590 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:56.204403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2054462-c252-49a0-bd61-dde33efe0590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:56.214604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2054462-c252-49a0-bd61-dde33efe0590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:57:56.216581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2054462-c252-49a0-bd61-dde33efe0590 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:57:56.243633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1795/3591] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:57:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:57:56.866368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cda55-287b-4046-9154-7ac94bff183f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:57:56.866872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cda55-287b-4046-9154-7ac94bff183f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:57:56.866978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90cda55-287b-4046-9154-7ac94bff183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:57:56.902583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d90cda55-287b-4046-9154-7ac94bff183f None None] MFA Rules not processed for user `a1c2e0d8efb54a128b52722a2dcb3d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:57:56.903824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d90cda55-287b-4046-9154-7ac94bff183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:57:56.949121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1797/3592] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:02.783003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:02.783504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:02.784284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:02.887741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] MFA Rules not processed for user `7518ee5c6e334b768c9881ebb6e30559`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:02.891840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:03.166375 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1796/3593] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:03.168377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:03.168852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:03.168948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:03.210207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] MFA Rules not processed for user `7518ee5c6e334b768c9881ebb6e30559`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:03.213016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:03.235029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1798/3594] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:03.675864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:03.695275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc707663-1b6f-4702-b987-b0a4d5d1ec81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:03.710574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f943608a-0f09-43cf-ab73-626e9841631d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:03.715087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943608a-0f09-43cf-ab73-626e9841631d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:03.715368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943608a-0f09-43cf-ab73-626e9841631d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:03.715640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943608a-0f09-43cf-ab73-626e9841631d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:03.744655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:03.754681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943608a-0f09-43cf-ab73-626e9841631d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:03.758164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f943608a-0f09-43cf-ab73-626e9841631d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:03.778573 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1797/3595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:05.702417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:05.704247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:05.820566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e9094-1c49-424e-ac78-08ae83dcd986 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:05.826176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:05.827268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:05.828171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:05.828835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] PATH_INFO: `/v3/users/135f108c73ad463a860e6881df42e5ae` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:05.831136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135f108c73ad463a860e6881df42e5ae)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:05.833453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:05.999203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:06.036080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135f108c73ad463a860e6881df42e5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:06.064261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135f108c73ad463a860e6881df42e5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:06.065666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135f108c73ad463a860e6881df42e5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:06.087226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135f108c73ad463a860e6881df42e5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:06.095481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135f108c73ad463a860e6881df42e5ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:06.118148 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1799/3596] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:05 2022] DELETE /identity/v3/users/135f108c73ad463a860e6881df42e5ae => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:06.122990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:06.125335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:06.125896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:06.178144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:06.181505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:06.342739 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1798/3597] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:06.380577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:06.382497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:06.507754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b971d-05c3-4b16-8ac5-3f72c567e180 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:06.514977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:06.525819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:06.526161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:06.528585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:06.551526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:06.553562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:06.584731 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1800/3598] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:07.679734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:07.681568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:07.702831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb2c1f-ab2a-4504-9a12-4eb61b0bd6a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:07.714225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:07.714819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:07.715098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:07.715370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] PATH_INFO: `/v3/projects/3944475abf4c47b2817066f570a038ac` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:07.719853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3944475abf4c47b2817066f570a038ac)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:07.727691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:07.839144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3944475abf4c47b2817066f570a038ac', 'request_id': 'req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:07.847373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3944475abf4c47b2817066f570a038ac', 'request_id': 'req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:07.859770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3944475abf4c47b2817066f570a038ac', 'request_id': 'req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:07.893741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] The token cache is being invalidate because project 3944475abf4c47b2817066f570a038ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:07.895391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:07.896090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:07.900903 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1799/3599] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:07 2022] DELETE /identity/v3/projects/3944475abf4c47b2817066f570a038ac => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:07.902135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:07.913304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f6280-2c81-4cd3-89a2-2efd49349606 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:08.042970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:08.043710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:08.051365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:08.051811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] PATH_INFO: `/v3/users/57b5f26b76c4460693ea50ea55c09688` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:08.053267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b5f26b76c4460693ea50ea55c09688)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:08.055454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:08.182699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b5f26b76c4460693ea50ea55c09688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:08.195666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b5f26b76c4460693ea50ea55c09688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:08.196546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b5f26b76c4460693ea50ea55c09688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:08.212088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:08.217257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b5f26b76c4460693ea50ea55c09688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:08.221928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4e97e79-71fa-4c72-8386-1e316b8fde59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b5f26b76c4460693ea50ea55c09688'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:08.277955 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1801/3600] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:07 2022] DELETE /identity/v3/users/57b5f26b76c4460693ea50ea55c09688 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:09.005183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.006806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:09.028467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f7732-eb66-4b1b-80f1-a20ebb84366e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.131878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.133154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.133918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.134502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] PATH_INFO: `/v3/projects/96d1b19db6094cc9a964b077f6673e47` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.136181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d1b19db6094cc9a964b077f6673e47)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:09.138623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:09.226330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:09.277456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d1b19db6094cc9a964b077f6673e47', 'request_id': 'req-5cd3e031-336f-4f0a-96a8-1ec3715512a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:09.289372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d1b19db6094cc9a964b077f6673e47', 'request_id': 'req-5cd3e031-336f-4f0a-96a8-1ec3715512a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:09.303464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d1b19db6094cc9a964b077f6673e47', 'request_id': 'req-5cd3e031-336f-4f0a-96a8-1ec3715512a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:09.329729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] The token cache is being invalidate because project 96d1b19db6094cc9a964b077f6673e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:09.330106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:09.332449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cd3e031-336f-4f0a-96a8-1ec3715512a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:09.337848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1800/3601] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:09 2022] DELETE /identity/v3/projects/96d1b19db6094cc9a964b077f6673e47 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:09.342726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.343266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.343266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.377395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:09.378822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:09.488140 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1802/3602] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:09.496919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.497550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.498005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.538278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:09.539749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:09.557725 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1801/3603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:09.562148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.604968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd926936-3fed-4dff-9f1c-aa91c903d9b1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.614538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.615171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.615452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.615727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.616383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:09.616687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:09.618337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:09.655154 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1803/3604] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:09.660489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.675775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839afa3-5db1-4a57-a888-a29f5208143a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.686757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.687495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.687842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.688187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.689433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:09.690923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:09.736194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1802/3605] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:09 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:09.740279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.751241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452530a-1fa1-4397-8166-a383c1576d53 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.829329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.830318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.830563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.830834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.832140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:09.834327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:09.863119 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1804/3606] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:09 2022] POST /identity/v3/users => generated 285 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:09.867750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.880682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16bfee-d283-4eff-95d0-1b2101e8552c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.887535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.888470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.889135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.890295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.891342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:09.893334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:09.907925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1803/3607] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:09.911314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.929710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66776-d086-4649-92e9-77924da30991 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.936682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44477f-ef07-4436-886b-f88c30464f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.937417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44477f-ef07-4436-886b-f88c30464f3d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.937763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44477f-ef07-4436-886b-f88c30464f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.938606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44477f-ef07-4436-886b-f88c30464f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:09.940871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44477f-ef07-4436-886b-f88c30464f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:09.942401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44477f-ef07-4436-886b-f88c30464f3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:09.954138 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1805/3608] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:09.958520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:09.976618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1aa2a4-9769-4550-856b-0ae4cdb7e1e5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:09.983119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:09.983943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:09.984318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:09.984685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] PATH_INFO: `/v3/projects/199669af8fb24effa8978e5ec0843d1f/users/8250d8dccbec42b39ea9b4906e4cfe48/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.050572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=199669af8fb24effa8978e5ec0843d1f, user_id=8250d8dccbec42b39ea9b4906e4cfe48, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:10.053265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:10.079057 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1804/3609] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:09 2022] PUT /identity/v3/projects/199669af8fb24effa8978e5ec0843d1f/users/8250d8dccbec42b39ea9b4906e4cfe48/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:10.080801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:10.081091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:10.081369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.128344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] MFA Rules not processed for user `8250d8dccbec42b39ea9b4906e4cfe48`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:10.130873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:10.195146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:10.250901 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1806/3610] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:10.252966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:10.356515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a19d1-3007-441e-9754-26b01d970846 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:10.375919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:10.377229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:10.377792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:10.378284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.379170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:10.381962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:10.433656 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1805/3611] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:10 2022] POST /identity/v3/projects => generated 369 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:10.436519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:10.454589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756044ce-35cf-4b7d-aaaa-6a8caf51d85c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:10.599017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:10.599643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:10.599917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:10.600453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.601090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:10.603381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:10.658325 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1807/3612] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:10 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:10.662781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:10.684680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760fd0f-6602-4ffb-98aa-d89eea9987fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:10.706578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:10.707220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:10.707500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:10.707775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.708428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:10.710048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:10.748484 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1806/3613] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:10.751671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:10.762599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5ff16-c678-4d29-b4b9-7f09e1a3248c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:10.768594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:10.769326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:10.769670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:10.770024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] PATH_INFO: `/v3/projects/bbf5164c0720409087aba03ba568a57c/users/843db0ebeb7c40508e122df5ddef8b89/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.801105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf5164c0720409087aba03ba568a57c, user_id=843db0ebeb7c40508e122df5ddef8b89, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:10.822767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:10.840873 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1808/3614] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:10 2022] PUT /identity/v3/projects/bbf5164c0720409087aba03ba568a57c/users/843db0ebeb7c40508e122df5ddef8b89/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:10.842100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:10.857356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6bdb1-ea6d-4dd6-ae00-9bb7d7586fb1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:10.877034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:10.976554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e72c2-e255-4e42-9344-0ce33f7c3fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:10.977618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e72c2-e255-4e42-9344-0ce33f7c3fad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:10.978457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e72c2-e255-4e42-9344-0ce33f7c3fad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:10.978822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e72c2-e255-4e42-9344-0ce33f7c3fad admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:10.979749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e72c2-e255-4e42-9344-0ce33f7c3fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:10.981588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495e72c2-e255-4e42-9344-0ce33f7c3fad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:11.005056 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1807/3615] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:11.006410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:11.019450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874e487-d1df-4651-b259-66fdb97724ae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:11.026235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:11.026892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:11.027179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:11.027454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] PATH_INFO: `/v3/projects/bbf5164c0720409087aba03ba568a57c/users/843db0ebeb7c40508e122df5ddef8b89/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:11.029978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf5164c0720409087aba03ba568a57c, user_id=843db0ebeb7c40508e122df5ddef8b89, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:11.032965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:11.049477 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1809/3616] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:11 2022] PUT /identity/v3/projects/bbf5164c0720409087aba03ba568a57c/users/843db0ebeb7c40508e122df5ddef8b89/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:11.061884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:11.062460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:11.062946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:11.131984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] MFA Rules not processed for user `843db0ebeb7c40508e122df5ddef8b89`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:11.133255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:11.249896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1808/3617] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:11.292130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:11.293884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:11.368015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554cf28-624b-49c7-8c27-1d88118169ca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:11.372092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:11.372711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:11.372987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:11.373258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:11.383213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:11.384970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:11.408260 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1810/3618] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:11.464149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:11.478970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21a9b8-3337-44a4-aa8c-08f8d157cdf4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:11.484407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cdee1-91ec-410b-b878-1b616f40426f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:11.485459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cdee1-91ec-410b-b878-1b616f40426f service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:11.485869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cdee1-91ec-410b-b878-1b616f40426f service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:11.486239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cdee1-91ec-410b-b878-1b616f40426f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:11.554414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cdee1-91ec-410b-b878-1b616f40426f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:11.555990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397cdee1-91ec-410b-b878-1b616f40426f service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:11.577786 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1809/3619] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:15.422807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:15.500170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:15.578458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e0d90-5357-4e1a-9f52-d6343ec4a9a3 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:15.588860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:15.589939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:15.590388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:15.590818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] PATH_INFO: `/v3/users/8250d8dccbec42b39ea9b4906e4cfe48` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:15.592455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8250d8dccbec42b39ea9b4906e4cfe48)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:15.594774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:15.684010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8250d8dccbec42b39ea9b4906e4cfe48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:15.702489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8250d8dccbec42b39ea9b4906e4cfe48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:15.704204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8250d8dccbec42b39ea9b4906e4cfe48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:15.719035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8250d8dccbec42b39ea9b4906e4cfe48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:15.722929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8250d8dccbec42b39ea9b4906e4cfe48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:15.763052 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1811/3620] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:15 2022] DELETE /identity/v3/users/8250d8dccbec42b39ea9b4906e4cfe48 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:15.767235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:15.767747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:15.767830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:15.795128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:15.796897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:15.857604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:15.888609 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1810/3621] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:15.903208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:15.905065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:16.038078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e29b4-41c6-44d3-9be4-47ace318e5a4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:16.043579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:16.044211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:16.044486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:16.044756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:16.064600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:16.066073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:16.091920 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1812/3622] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:16.662816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:16.665099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:16.720883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff1789-cd00-4413-b2ce-44f2d144cc11 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:16.766578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:16.770598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:16.771891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:16.772352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] PATH_INFO: `/v3/projects/199669af8fb24effa8978e5ec0843d1f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:16.775498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199669af8fb24effa8978e5ec0843d1f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:16.778104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:16.930611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199669af8fb24effa8978e5ec0843d1f', 'request_id': 'req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:16.956186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199669af8fb24effa8978e5ec0843d1f', 'request_id': 'req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:16.977173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199669af8fb24effa8978e5ec0843d1f', 'request_id': 'req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.014132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] The token cache is being invalidate because project 199669af8fb24effa8978e5ec0843d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:17.014571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.017584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.021789 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1811/3623] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:16 2022] DELETE /identity/v3/projects/199669af8fb24effa8978e5ec0843d1f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:17.026329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:17.045792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3009bc8-ef3c-440e-821b-f7c66b9a3b05 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:17.227874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:17.256233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:17.256961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:17.257244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:17.257522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] PATH_INFO: `/v3/users/843db0ebeb7c40508e122df5ddef8b89` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:17.258789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843db0ebeb7c40508e122df5ddef8b89)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:17.260939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:17.409651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843db0ebeb7c40508e122df5ddef8b89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.427271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843db0ebeb7c40508e122df5ddef8b89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.427901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843db0ebeb7c40508e122df5ddef8b89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.439158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843db0ebeb7c40508e122df5ddef8b89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.440756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf1a2565-753e-4443-8ea7-99419b680c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843db0ebeb7c40508e122df5ddef8b89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:17.488994 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1813/3624] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:17 2022] DELETE /identity/v3/users/843db0ebeb7c40508e122df5ddef8b89 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:18.100747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:18.102334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:18.154478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c5ee9-8e9a-4fa3-8df2-aa435b243d56 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:18.283088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:18.283738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:18.284018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:18.284292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] PATH_INFO: `/v3/projects/bbf5164c0720409087aba03ba568a57c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:18.285488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf5164c0720409087aba03ba568a57c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:18.287531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:18.377647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf5164c0720409087aba03ba568a57c', 'request_id': 'req-4d054b38-b1ff-4965-af57-47c5caf453a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:18.392503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf5164c0720409087aba03ba568a57c', 'request_id': 'req-4d054b38-b1ff-4965-af57-47c5caf453a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:18.408826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf5164c0720409087aba03ba568a57c', 'request_id': 'req-4d054b38-b1ff-4965-af57-47c5caf453a5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:18.412046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:18.431178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] The token cache is being invalidate because project bbf5164c0720409087aba03ba568a57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:18.431605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:18.432384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d054b38-b1ff-4965-af57-47c5caf453a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:18.439449 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1812/3625] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:18 2022] DELETE /identity/v3/projects/bbf5164c0720409087aba03ba568a57c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:18.441302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:18.441770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:18.441906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:18.505671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:18.507007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:18.661832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1814/3626] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:18.670979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:18.671540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:18.672410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:18.757515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:18.758805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:18.773759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:18.774379 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1813/3627] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:18.792628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9106478-cd31-4ec2-8b12-715cb49fa266 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:18.809309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:18.815702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:18.818223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:18.818596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:18.821159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:18.821620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:18.827554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:18.902945 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1815/3628] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:18.907818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:18.921485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224680-8cb7-46df-8b13-5af971ceef14 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:18.961009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:18.962615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:18.963012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:18.963392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:18.964155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:18.968075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:19.051599 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1814/3629] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:19.055388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:19.067070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062537-ce2f-4fd1-98bd-f50f772c64ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:19.153532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:19.180465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:19.181234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.181596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.181996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.182669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:19.184642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:19.222614 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1816/3630] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:19 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:19.226381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:19.239524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d2c9c-f521-414a-9ccd-873835f447b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:19.245484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:19.246414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.246885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.247337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.248184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:19.250106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:19.284361 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1815/3631] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:58:19.285628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:19.305498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d170d-fd3f-4402-99cb-381958637ce2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:19.311856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b20b-d1c0-4878-bef6-bc6288d8a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:19.312532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b20b-d1c0-4878-bef6-bc6288d8a930 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.312815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b20b-d1c0-4878-bef6-bc6288d8a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.313089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b20b-d1c0-4878-bef6-bc6288d8a930 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.313788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b20b-d1c0-4878-bef6-bc6288d8a930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:19.315759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b20b-d1c0-4878-bef6-bc6288d8a930 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:19.329159 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1817/3632] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:19.332986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:19.345409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b36cd4-8c8e-43a3-9c02-76acc948d150 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:19.350437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:19.351223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.351573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.351922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] PATH_INFO: `/v3/projects/0fa9eb06f10944fca1042fba102b4618/users/83fe1680371447ec8f8b66077099abcc/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.368038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa9eb06f10944fca1042fba102b4618, user_id=83fe1680371447ec8f8b66077099abcc, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:19.373255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:19.397573 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1816/3633] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:19 2022] PUT /identity/v3/projects/0fa9eb06f10944fca1042fba102b4618/users/83fe1680371447ec8f8b66077099abcc/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:19.399353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.399717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.400023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.475605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] MFA Rules not processed for user `83fe1680371447ec8f8b66077099abcc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:19.476906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:19.597336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:19.598050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1818/3634] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:19.680770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcf949-454e-458c-bee6-bebef7a17c13 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:19.700038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:19.714040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.714040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.714040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.714040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:19.714040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:19.780839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1817/3635] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:19.785671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:19.804776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb1475-20e3-465f-9cc1-f10cb0a6de20 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:19.952679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:19.953496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:19.953838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:19.954287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:19.955495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:19.957833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.005358 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1819/3636] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:19 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:20.009606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.025309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58480dd-120b-4cef-ac15-3212e1c89a86 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.037576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:20.038269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.038546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.038813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.050219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.061463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:20.063079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:20.068167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.100519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1818/3637] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:58:20.101542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.110116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:20.152869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c29c-5005-4a87-ab26-57fecd258d85 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.167337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:20.179830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:20.180521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.181104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.181420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] PATH_INFO: `/v3/users/f909cc7113594047add07a2bbd14187a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.182736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f909cc7113594047add07a2bbd14187a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:20.184773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.210490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa253fb5-63ae-4532-9d7b-449b5a7538a3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.225362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:20.226429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.226912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.227440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.231677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:20.252528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:20.259565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.277749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1820/3638] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:20.280658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.288214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f909cc7113594047add07a2bbd14187a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:20.302693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ad897-a189-483a-977b-4dc82e990e5d service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.307110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:DELETE=9,keystone:SELECT=87 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:20.316822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f909cc7113594047add07a2bbd14187a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:20.318245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f909cc7113594047add07a2bbd14187a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:20.338318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:20.339435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.339654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.339883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] PATH_INFO: `/v3/projects/028f071b62544eabacbb88e0f04698a4/users/4fd5f3366280452c84a467d6dd419c72/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.344455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f909cc7113594047add07a2bbd14187a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:20.345745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f909cc7113594047add07a2bbd14187a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:20.372408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028f071b62544eabacbb88e0f04698a4, user_id=4fd5f3366280452c84a467d6dd419c72, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:20.372408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.379784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1819/3639] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:20 2022] DELETE /identity/v3/users/f909cc7113594047add07a2bbd14187a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:20.393985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1821/3640] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:20 2022] PUT /identity/v3/projects/028f071b62544eabacbb88e0f04698a4/users/4fd5f3366280452c84a467d6dd419c72/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:20.396646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.398726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:20.544666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547cae3-1fb5-4968-9802-178b2b2db635 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.676708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:20.677550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.678022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.678572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.679626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:20.681590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.695038 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1820/3641] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:20.699473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.712279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337f615-30bf-4c46-a9ef-37bec25ff1a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.729893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab17300-0011-4398-89b0-da5dfa9d54e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:20.729893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab17300-0011-4398-89b0-da5dfa9d54e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.729893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab17300-0011-4398-89b0-da5dfa9d54e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.729893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab17300-0011-4398-89b0-da5dfa9d54e7 admin admin] PATH_INFO: `/v3/projects/028f071b62544eabacbb88e0f04698a4/users/4fd5f3366280452c84a467d6dd419c72/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.737349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab17300-0011-4398-89b0-da5dfa9d54e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028f071b62544eabacbb88e0f04698a4, user_id=4fd5f3366280452c84a467d6dd419c72, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:20.737349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab17300-0011-4398-89b0-da5dfa9d54e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:20.750378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:20.752558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:20.754233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1822/3642] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:20 2022] PUT /identity/v3/projects/028f071b62544eabacbb88e0f04698a4/users/4fd5f3366280452c84a467d6dd419c72/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:20.787641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304aca2-bde7-4b04-b709-3a68d74ac162 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:20.879538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8484af-3842-4528-b787-d8b242b21366 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:20.879907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8484af-3842-4528-b787-d8b242b21366 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:20.880190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8484af-3842-4528-b787-d8b242b21366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:20.979728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df8484af-3842-4528-b787-d8b242b21366 None None] MFA Rules not processed for user `4fd5f3366280452c84a467d6dd419c72`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:20.986438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df8484af-3842-4528-b787-d8b242b21366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.041359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:21.042437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.042905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.043373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] PATH_INFO: `/v3/projects/81d9071c47304d7ca128734f7bc8eeed` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.045159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d9071c47304d7ca128734f7bc8eeed)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:21.048621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:21.127901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:21.178762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d9071c47304d7ca128734f7bc8eeed', 'request_id': 'req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:21.197355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d9071c47304d7ca128734f7bc8eeed', 'request_id': 'req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:21.213601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d9071c47304d7ca128734f7bc8eeed', 'request_id': 'req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:21.226956 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1823/3643] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:58:21.229142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceab9b-81b2-4eaa-8de3-214321199f4c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.229930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceab9b-81b2-4eaa-8de3-214321199f4c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.229930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ceab9b-81b2-4eaa-8de3-214321199f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.249525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] The token cache is being invalidate because project 81d9071c47304d7ca128734f7bc8eeed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:21.250770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:21.253016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:21.257872 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1821/3644] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:20 2022] DELETE /identity/v3/projects/81d9071c47304d7ca128734f7bc8eeed => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:21.260206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:21.264495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.283625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-60ceab9b-81b2-4eaa-8de3-214321199f4c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:21.286591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60ceab9b-81b2-4eaa-8de3-214321199f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.424452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8991ad3-ec0e-4a03-8bed-4e77f38c2ffa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:21.429268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:21.429918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.430196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.430466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.432945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.488060 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1824/3645] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 02:58:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:21.509362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850fe0-52fa-4c9c-935b-44e7730b4ae6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.509532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850fe0-52fa-4c9c-935b-44e7730b4ae6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.509674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95850fe0-52fa-4c9c-935b-44e7730b4ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.564420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95850fe0-52fa-4c9c-935b-44e7730b4ae6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:21.565992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95850fe0-52fa-4c9c-935b-44e7730b4ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.618126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:21.647061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:21.648873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:21.676200 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1822/3646] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:21 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:21.690028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:21.692529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.702257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1825/3647] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:21.708341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.708637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.708912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.766687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:21.767817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:21.778164 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1826/3648] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:21.782523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:21.795132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa31c2-d8fd-478a-8bcc-03d987de311e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:21.816548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:21.817327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.817690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.818059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.820126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:21.821276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:21.825228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:21.855089 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1827/3649] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:21.858990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:21.886699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136c19-0bc4-4c8a-b9f9-11a6aefc17a7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:21.891417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:21.906089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:21.906655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.906939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.907225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.908026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:21.910112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:21.923206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4f5ab-3d4a-482b-9ea3-5755b7f96060 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:21.938764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:21.940478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:21.941016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:21.941649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:21.967452 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1828/3650] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:21 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:21.973599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:21.976261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:21.981793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:21.997374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1823/3651] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:58:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:21.999423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:22.002610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:22.021174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcec601-e264-40f8-8395-3f6d9921eadd service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:22.142250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446a931-d121-479b-96ec-e6663b755d5f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:22.170026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:22.170849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.171223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.171582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.172376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:22.181497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:22.190640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:22.192020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.192620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.193517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] PATH_INFO: `/v3/users/83fe1680371447ec8f8b66077099abcc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.195476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fe1680371447ec8f8b66077099abcc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:22.201313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:22.231245 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1829/3652] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:21 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:58:22.232324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:22.272594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f10b72-d28e-4bd7-9135-022008b93d32 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:22.284890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:22.285527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.285814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.286105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.287111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:22.288385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:22.312603 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1830/3653] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:22.313609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:22.344160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3394-a8c2-4926-9586-3ddaf1647a31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:22.358522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fe1680371447ec8f8b66077099abcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:22.361146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:22.361900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.362251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.362587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.363348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:22.365983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:22.390311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1831/3654] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:22.391536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:22.395229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fe1680371447ec8f8b66077099abcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:22.399600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fe1680371447ec8f8b66077099abcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:22.402795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655ad73-c507-48f2-9a6f-3e9bacaab1dc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:22.414813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45f582-f52d-4941-ab31-609f19f6ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:22.416299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f582-f52d-4941-ab31-609f19f6ad7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.417420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fe1680371447ec8f8b66077099abcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:22.418006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f582-f52d-4941-ab31-609f19f6ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.419379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45f582-f52d-4941-ab31-609f19f6ad7f admin admin] PATH_INFO: `/v3/projects/7eb1bb96119d42f3900af93321db08bf/users/baa5908625524366a62c614bd2113894/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.419807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a1d3bfef-88c0-417a-a7d7-6ebc3bf46712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fe1680371447ec8f8b66077099abcc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:22.461161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1824/3655] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:21 2022] DELETE /identity/v3/users/83fe1680371447ec8f8b66077099abcc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:22.466531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.468487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.468487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.470209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f582-f52d-4941-ab31-609f19f6ad7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb1bb96119d42f3900af93321db08bf, user_id=baa5908625524366a62c614bd2113894, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:22.473236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45f582-f52d-4941-ab31-609f19f6ad7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:22.505153 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1832/3656] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:22 2022] PUT /identity/v3/projects/7eb1bb96119d42f3900af93321db08bf/users/baa5908625524366a62c614bd2113894/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:22.511697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:22.512098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:22.515477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:22.553392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:22.555193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:22.610498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:22.611763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:22.757101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:22.784595 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1825/3657] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:22.819082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:22.821070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:22.846542 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1833/3658] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:22.847248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:22.933214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:22.934894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:23.008034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c328fc-ed46-420a-881c-7b4d94418595 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:23.024771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:23.027522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:23.031004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:23.032352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:23.064311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:23.064594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b2a722-2c8d-4aef-869d-6296b29b0e65 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:23.069290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:23.071693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:23.072336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:23.072727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:23.073011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:23.100242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:23.101876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:23.104456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1826/3659] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:58:23.125603 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1834/3660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:24.520434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:24.522380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:24.552441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1000-6f7a-4cc8-b057-349d90d734e3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:24.575469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:24.576174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:24.576452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:24.576726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] PATH_INFO: `/v3/projects/0fa9eb06f10944fca1042fba102b4618` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:24.584519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa9eb06f10944fca1042fba102b4618)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:24.586534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:24.703746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa9eb06f10944fca1042fba102b4618', 'request_id': 'req-d5d4867c-3e6e-4c92-861c-a6495640557c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:24.711546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa9eb06f10944fca1042fba102b4618', 'request_id': 'req-d5d4867c-3e6e-4c92-861c-a6495640557c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:24.720042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa9eb06f10944fca1042fba102b4618', 'request_id': 'req-d5d4867c-3e6e-4c92-861c-a6495640557c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:24.750677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] The token cache is being invalidate because project 0fa9eb06f10944fca1042fba102b4618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:24.750967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:24.752200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:24.754633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1827/3661] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:24 2022] DELETE /identity/v3/projects/0fa9eb06f10944fca1042fba102b4618 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:24.758403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:24.774507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6150884-89ff-4b9e-8c14-6659d70a6f6e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:24.935594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:24.936591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:24.937041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:24.937368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] PATH_INFO: `/v3/users/4fd5f3366280452c84a467d6dd419c72` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:24.940134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd5f3366280452c84a467d6dd419c72)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:24.942278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:25.066418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd5f3366280452c84a467d6dd419c72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:25.082394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd5f3366280452c84a467d6dd419c72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:25.084243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd5f3366280452c84a467d6dd419c72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:25.104727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd5f3366280452c84a467d6dd419c72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:25.105780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-915b59f2-6708-49ce-9ad1-e9bb7af4cce3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd5f3366280452c84a467d6dd419c72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:25.151720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1835/3662] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:24 2022] DELETE /identity/v3/users/4fd5f3366280452c84a467d6dd419c72 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:25.152269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:26.202032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:26.203554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:26.228623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4867c-3e6e-4c92-861c-a6495640557c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:26.390214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:26.391311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:26.391984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:26.392412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] PATH_INFO: `/v3/projects/028f071b62544eabacbb88e0f04698a4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:26.393841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=028f071b62544eabacbb88e0f04698a4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:26.395925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:26.466248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:26.490358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028f071b62544eabacbb88e0f04698a4', 'request_id': 'req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:26.503354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028f071b62544eabacbb88e0f04698a4', 'request_id': 'req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:26.522169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028f071b62544eabacbb88e0f04698a4', 'request_id': 'req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:26.547257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] The token cache is being invalidate because project 028f071b62544eabacbb88e0f04698a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:26.547555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:26.549904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46fe81c6-9fa5-4e53-81e3-ecef1203a4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:26.554924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1828/3663] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:26 2022] DELETE /identity/v3/projects/028f071b62544eabacbb88e0f04698a4 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:26.560251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:26.560777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:26.560777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:26.635699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:26.636936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:26.789474 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1836/3664] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:26.799193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:26.799193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:26.799193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:26.845590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:26.848421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:26.888567 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1829/3665] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:26.893265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:26.912214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de3955-939c-4562-810d-29edd8e5f7be None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:26.921586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:26.922244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:26.922516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:26.922782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:26.923489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:26.923731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:26.925348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:26.968159 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1837/3666] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:26.969719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:26.980047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7b207-9f8c-40c9-b147-9722519c8b67 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:27.006682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:27.007331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:27.007612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:27.007875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:27.008516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:27.010670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:27.084922 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1830/3667] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:26 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:27.086639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:27.100801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c316818-f2a4-4243-8643-d8ed01c1f547 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:27.243655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:27.250381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:27.250381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:27.251088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:27.251792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:27.253913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:27.303125 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1838/3668] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:27 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:27.305717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:27.321743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5c38b-c9c6-4c64-ba90-5339256d85cf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:27.339407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:27.341565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:27.342117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:27.342593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:27.343482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:27.346117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:27.373464 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1831/3669] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:27.375319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:27.387543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056052ba-c8da-4234-a1c7-095b85736b10 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:27.393090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2ab7a-a682-432e-8541-ae5e32845d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:27.394031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2ab7a-a682-432e-8541-ae5e32845d2e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:27.394545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2ab7a-a682-432e-8541-ae5e32845d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:27.395173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2ab7a-a682-432e-8541-ae5e32845d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:27.396648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2ab7a-a682-432e-8541-ae5e32845d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:27.398539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2ab7a-a682-432e-8541-ae5e32845d2e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:27.416824 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1839/3670] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:27.421025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:27.438694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff00d5-a3c0-4d38-82a8-f6cae4bf2b3b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:27.449474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:27.451355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:27.451846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:27.452366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] PATH_INFO: `/v3/projects/e0fcecd250c94e0a8e6da1361bc1215a/users/94232038944e4365af0e3084d6e0e3eb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:27.489150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0fcecd250c94e0a8e6da1361bc1215a, user_id=94232038944e4365af0e3084d6e0e3eb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:27.492642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:27.552976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:27.555082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:27.559905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:27.569042 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1832/3671] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:27 2022] PUT /identity/v3/projects/e0fcecd250c94e0a8e6da1361bc1215a/users/94232038944e4365af0e3084d6e0e3eb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:27.669882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] MFA Rules not processed for user `94232038944e4365af0e3084d6e0e3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:27.673241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:27.811910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:27.844014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1840/3672] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:58:27.846808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:28.005610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a79cc-a880-4eb1-b308-e78722ae96fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:28.013315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:28.014668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:28.015081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:28.015368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:28.016690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:28.019412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:28.096596 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1833/3673] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:27 2022] POST /identity/v3/projects => generated 389 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:28.098299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:28.124682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c1cc72-3943-426c-b7bd-0a07cc68673d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:28.407736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:28.408453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:28.412034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:28.413197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:28.413988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:28.417795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:28.496828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1841/3674] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:28 2022] POST /identity/v3/users => generated 301 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:28.502092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:28.522281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b3016-19ae-4cc7-ad6d-15bfc5507f36 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:28.539650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:28.540444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:28.540722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:28.541610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:28.542139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:28.550361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:28.589920 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1834/3675] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:28.595060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:28.614029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fdd41-fd02-46a8-9b00-d12b17359a95 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:28.635613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:28.636930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:28.637080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:28.637290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] PATH_INFO: `/v3/projects/aaf723f8b9464781bd3d06fe695fabc5/users/569fa3215b064efebc324b1a803d91dc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:28.693411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf723f8b9464781bd3d06fe695fabc5, user_id=569fa3215b064efebc324b1a803d91dc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:28.696168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:28.734309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1842/3676] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:28 2022] PUT /identity/v3/projects/aaf723f8b9464781bd3d06fe695fabc5/users/569fa3215b064efebc324b1a803d91dc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:28.739627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:28.758894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6e2b0-b0eb-4a9a-9d55-839adb7b3b1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:28.895815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:28.985563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3e871-4c37-460b-aa54-5681feada8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:28.986410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e871-4c37-460b-aa54-5681feada8dd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:28.986797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e871-4c37-460b-aa54-5681feada8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:28.987159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e871-4c37-460b-aa54-5681feada8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:28.987906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3e871-4c37-460b-aa54-5681feada8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:28.989814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3e871-4c37-460b-aa54-5681feada8dd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:29.020340 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1835/3677] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:58:29.023060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:29.089612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ef64e-b892-4c95-9f4c-4419995e7680 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:29.102324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:29.103976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:29.104401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:29.104535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] PATH_INFO: `/v3/projects/aaf723f8b9464781bd3d06fe695fabc5/users/569fa3215b064efebc324b1a803d91dc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:29.107409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaf723f8b9464781bd3d06fe695fabc5, user_id=569fa3215b064efebc324b1a803d91dc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:29.111451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:29.155900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:29.156329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:29.156746 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1843/3678] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:29 2022] PUT /identity/v3/projects/aaf723f8b9464781bd3d06fe695fabc5/users/569fa3215b064efebc324b1a803d91dc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:29.156964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:29.225500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] MFA Rules not processed for user `569fa3215b064efebc324b1a803d91dc`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:29.227070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:29.446904 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1836/3679] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:58:29.456715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:29.459130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:29.628168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:29.640695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:29.641893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b352a9-5180-429b-bb59-bb04aaed70f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:29.663781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:29.666192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:29.666496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:29.666767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:29.705102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:29.706954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:29.743350 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1844/3680] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:29.863485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aa388-3402-425b-bf85-a1428cc53747 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:29.897128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:29.898209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:29.898657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:29.899088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:29.901750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:29.926112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:29.928748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019eeb-ff89-4c9a-af9d-646a1ee1024b service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:29.987936 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1837/3681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:30.092337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:30.303415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:30.331360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df5ee1-d018-4047-821f-603f62016243 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:30.348258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:30.349391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:30.350329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:30.350930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] PATH_INFO: `/v3/users/94232038944e4365af0e3084d6e0e3eb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:30.353945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94232038944e4365af0e3084d6e0e3eb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:30.356213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:30.480302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94232038944e4365af0e3084d6e0e3eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:30.498039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94232038944e4365af0e3084d6e0e3eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:30.498747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94232038944e4365af0e3084d6e0e3eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:30.521149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94232038944e4365af0e3084d6e0e3eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:30.522736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94232038944e4365af0e3084d6e0e3eb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:30.574634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1845/3682] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:30 2022] DELETE /identity/v3/users/94232038944e4365af0e3084d6e0e3eb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:30.585369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:30.585988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:30.586469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:30.662319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:30.664373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:30.792281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:30.792281 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1838/3683] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:30.839082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:30.842736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:31.004599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387f3cd-1fc0-4d54-bbf4-422653c2f2b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:31.015134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:31.015785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:31.016821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:31.017115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:31.053163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:31.057440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:31.098746 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1846/3684] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:32.035450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:32.037527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:32.060443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e776de0-7aa2-47c2-a913-aa93a3630fe9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:32.069672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:32.070369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:32.070650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:32.070920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] PATH_INFO: `/v3/projects/e0fcecd250c94e0a8e6da1361bc1215a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:32.074750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0fcecd250c94e0a8e6da1361bc1215a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:32.076808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:32.193573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0fcecd250c94e0a8e6da1361bc1215a', 'request_id': 'req-76da49fc-3baa-4d1c-9f8f-8700db235387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.210418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0fcecd250c94e0a8e6da1361bc1215a', 'request_id': 'req-76da49fc-3baa-4d1c-9f8f-8700db235387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.218302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0fcecd250c94e0a8e6da1361bc1215a', 'request_id': 'req-76da49fc-3baa-4d1c-9f8f-8700db235387'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.234984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] The token cache is being invalidate because project e0fcecd250c94e0a8e6da1361bc1215a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:32.235437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.236748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.242029 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1839/3685] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:32 2022] DELETE /identity/v3/projects/e0fcecd250c94e0a8e6da1361bc1215a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:32.243715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:32.278835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2602d08-67a6-4240-b0de-3b884de98252 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:32.390586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:32.391688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:32.392284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:32.392728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] PATH_INFO: `/v3/users/569fa3215b064efebc324b1a803d91dc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:32.394026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569fa3215b064efebc324b1a803d91dc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:32.397298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:32.418948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:32.544280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569fa3215b064efebc324b1a803d91dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.567541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569fa3215b064efebc324b1a803d91dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.568608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569fa3215b064efebc324b1a803d91dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.598507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569fa3215b064efebc324b1a803d91dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.599282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3b13437e-6f2b-44c5-8342-24b3afe866a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569fa3215b064efebc324b1a803d91dc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:32.663886 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1847/3686] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:32 2022] DELETE /identity/v3/users/569fa3215b064efebc324b1a803d91dc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:33.580147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:33.581643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:33.598502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da49fc-3baa-4d1c-9f8f-8700db235387 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:33.705518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:33.706864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:33.707576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:33.708814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] PATH_INFO: `/v3/projects/aaf723f8b9464781bd3d06fe695fabc5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:33.710285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaf723f8b9464781bd3d06fe695fabc5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:33.713413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:33.813341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaf723f8b9464781bd3d06fe695fabc5', 'request_id': 'req-734e20dd-d356-4012-b8b7-127f1cdad3fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:33.823684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaf723f8b9464781bd3d06fe695fabc5', 'request_id': 'req-734e20dd-d356-4012-b8b7-127f1cdad3fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:33.878220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaf723f8b9464781bd3d06fe695fabc5', 'request_id': 'req-734e20dd-d356-4012-b8b7-127f1cdad3fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:33.904324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:33.929429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] The token cache is being invalidate because project aaf723f8b9464781bd3d06fe695fabc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:33.931602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:33.932636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-734e20dd-d356-4012-b8b7-127f1cdad3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:33.941514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1840/3687] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:33 2022] DELETE /identity/v3/projects/aaf723f8b9464781bd3d06fe695fabc5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:33.942704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:33.943272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:33.943468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.000822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:34.004983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:34.215277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1848/3688] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:34.224304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.224603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.224878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.270672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:34.271776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:34.311578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.311803 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1841/3689] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:34.331416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df000dba-f0d2-43ce-835b-30645dadad12 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:34.345901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:34.346831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.347280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.347719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.348537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:34.349086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:34.350755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:34.403814 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1849/3690] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:34.412312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.426626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eceb66-bed8-4c8b-89ed-158333ddc62f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:34.432598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:34.433989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.434338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.434675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.435456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:34.438095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:34.478736 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1842/3691] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:34 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:34.482589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.501511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547457ca-4711-490d-ac2e-3b4e01eec91f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:34.619878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:34.621510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.624203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.624912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.625794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:34.630733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:34.672311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1850/3692] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:34 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:34.676388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.692450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d7bb7-044e-49fe-b595-fbee588559e8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:34.708741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:34.709459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.709879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.710284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.711073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:34.715121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:34.742163 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1843/3693] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:34.743142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.754673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c9cf9-aef7-4fa0-a0a1-0676c476b3d3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:34.781864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:34.787029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.792324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.796532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.797344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:34.806738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:34.817046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:34.843926 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1851/3694] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:58:34.848161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.864561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:34.866560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:34.869460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886cf79d-ed81-4db5-9d95-2d5a7845e487 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:34.887137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1012408-fc6e-4093-82f2-e5b76eb1e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:34.887834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1012408-fc6e-4093-82f2-e5b76eb1e45c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.888117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1012408-fc6e-4093-82f2-e5b76eb1e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.888392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1012408-fc6e-4093-82f2-e5b76eb1e45c admin admin] PATH_INFO: `/v3/projects/4b641d60f76d48318792fe3da6f594b6/users/c00d5870bc60456b93e17b97d9407ccd/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:34.932603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1012408-fc6e-4093-82f2-e5b76eb1e45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b641d60f76d48318792fe3da6f594b6, user_id=c00d5870bc60456b93e17b97d9407ccd, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:34.938175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1012408-fc6e-4093-82f2-e5b76eb1e45c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:34.982299 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1844/3695] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:34 2022] PUT /identity/v3/projects/4b641d60f76d48318792fe3da6f594b6/users/c00d5870bc60456b93e17b97d9407ccd/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:34.987418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:34.989002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:34.989284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:35.037870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4bcfc6-47a0-4b38-8ba6-3e4350d08e9d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:35.064866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] MFA Rules not processed for user `c00d5870bc60456b93e17b97d9407ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:35.068868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:35.204234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:35.204881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:35.205162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:35.205440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:35.215290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:35.247581 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1845/3696] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:35.279372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:35.285770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:35.301253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:35.309315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bff8c-6fc5-46e6-a06d-8e80b912ba62 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:35.351382 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1852/3697] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:58:35.574867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425a2db-239b-46db-9c37-4e41e5476698 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:35.597158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:35.597835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:35.598191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:35.602388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:35.650703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:35.655498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:35.696353 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1846/3698] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:40.370976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:40.371375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:40.371780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:40.454767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] MFA Rules not processed for user `baa5908625524366a62c614bd2113894`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:40.456241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:40.597278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1853/3699] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:40.604995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:40.607075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:40.664288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:40.807228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bbd9f4-8b07-4b89-9ab9-e48ce687d158 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:40.829725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:40.832424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:40.834201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:40.835690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:40.857713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:40.866652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:40.890067 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1847/3700] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:40.963000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:40.965569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:41.049107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:41.235189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc665c69-42b6-4880-a4d6-ec03f647389b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:41.255424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:41.256999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:41.258234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:41.260060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] PATH_INFO: `/v3/users/7518ee5c6e334b768c9881ebb6e30559` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:41.263152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7518ee5c6e334b768c9881ebb6e30559)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:41.266072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:41.381782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7518ee5c6e334b768c9881ebb6e30559'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:41.401950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7518ee5c6e334b768c9881ebb6e30559'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:41.402783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7518ee5c6e334b768c9881ebb6e30559'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:41.420906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7518ee5c6e334b768c9881ebb6e30559'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:41.423280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a2d5f68-898a-411d-bc3c-7ad21ba97bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7518ee5c6e334b768c9881ebb6e30559'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:41.472865 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1854/3701] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:40 2022] DELETE /identity/v3/users/7518ee5c6e334b768c9881ebb6e30559 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:42.085470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:42.128669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b089d-307d-40a1-a9ad-58fcec04ed28 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:42.349223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:42.349953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:42.350233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:42.350504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] PATH_INFO: `/v3/projects/2541b0313460463f87257f0cc735f973` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:42.351811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2541b0313460463f87257f0cc735f973)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:42.354630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:42.554960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2541b0313460463f87257f0cc735f973', 'request_id': 'req-031c333b-fa0c-49b0-b035-9bdbd6e89975'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:42.575581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2541b0313460463f87257f0cc735f973', 'request_id': 'req-031c333b-fa0c-49b0-b035-9bdbd6e89975'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:42.601479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2541b0313460463f87257f0cc735f973', 'request_id': 'req-031c333b-fa0c-49b0-b035-9bdbd6e89975'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:42.634722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] The token cache is being invalidate because project 2541b0313460463f87257f0cc735f973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:42.635093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:42.641933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-031c333b-fa0c-49b0-b035-9bdbd6e89975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:42.651001 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1848/3702] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:42 2022] DELETE /identity/v3/projects/2541b0313460463f87257f0cc735f973 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:42.653747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:42.654279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:42.654402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:42.704581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:42.716701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:42.950586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:42.951173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:42.951528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:42.953358 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1855/3703] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:43.004614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:43.007040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:43.029726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:43.041875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1849/3704] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:43.042684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23ef5d-51b3-449f-a869-a68013d59d8a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:43.060044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:43.060902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.061493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.061948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.062887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:43.063394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:43.065221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:43.109622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:43.115879 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1856/3705] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:43.122984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006fcb95-73ab-4812-8418-289c6f4ee46a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:43.139113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:43.139849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.140195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.140517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.141379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:43.146756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:43.196295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:43.202621 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1850/3706] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:43 2022] POST /identity/v3/projects => generated 383 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:58:43.211884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c59cb-02fd-4ecb-8a39-c33939abd594 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:43.264549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:43.360628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:43.361447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.361885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.362456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.363516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:43.365569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:43.457398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:43.463578 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1857/3707] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:43 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:43.483240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37a854-8311-428b-afea-f5fe22aa345d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:43.509971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:43.510617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.510884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.511995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.513668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:43.520683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:43.567215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:43.578068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1851/3708] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:43.594591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed5f8d-e830-4342-b8fd-0d072a00f224 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:43.607718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46d4bf-16c4-4346-abf9-e252a73170f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:43.608358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46d4bf-16c4-4346-abf9-e252a73170f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.612741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46d4bf-16c4-4346-abf9-e252a73170f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.613119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46d4bf-16c4-4346-abf9-e252a73170f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.613777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46d4bf-16c4-4346-abf9-e252a73170f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:43.620485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46d4bf-16c4-4346-abf9-e252a73170f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:43.656850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:43.659474 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1858/3709] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:43.668537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:43.687438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b1caa-1554-4a6d-939e-edaba7de97c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:43.697883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:43.699065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.699545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.700028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] PATH_INFO: `/v3/projects/c7a3da1a632d443aba8f5cf3b741714b/users/adb51369444c42c190b1b7bf5e23ddb9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.765317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a3da1a632d443aba8f5cf3b741714b, user_id=adb51369444c42c190b1b7bf5e23ddb9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:43.778462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:43.856196 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1852/3710] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:43 2022] PUT /identity/v3/projects/c7a3da1a632d443aba8f5cf3b741714b/users/adb51369444c42c190b1b7bf5e23ddb9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:43.856372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00944-d06c-4be9-9e3b-90b5ef47aae5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:43.856549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00944-d06c-4be9-9e3b-90b5ef47aae5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:43.856830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00944-d06c-4be9-9e3b-90b5ef47aae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:43.902517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-77f00944-d06c-4be9-9e3b-90b5ef47aae5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:43.903792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77f00944-d06c-4be9-9e3b-90b5ef47aae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:44.083688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1859/3711] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:58:44.135565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:44.137984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:44.314177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489df2bb-dfbd-48c6-902c-898becbb2859 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:44.328201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:44.329560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:44.330108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:44.330594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:44.345777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:44.348164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:44.362895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1853/3712] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:45.734877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054501a-cd04-461e-a662-162b36f245ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:45.735995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054501a-cd04-461e-a662-162b36f245ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:45.736665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054501a-cd04-461e-a662-162b36f245ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:45.784116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2054501a-cd04-461e-a662-162b36f245ba None None] MFA Rules not processed for user `baa5908625524366a62c614bd2113894`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:45.787441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2054501a-cd04-461e-a662-162b36f245ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:45.930323 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1860/3713] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:53.956604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:53.958193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:53.994293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74e280-7588-4368-a5f6-0b2af8886611 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:54.015221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:54.015923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:54.016201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:54.018664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] PATH_INFO: `/v3/users/a1c2e0d8efb54a128b52722a2dcb3d7b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:54.021849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1c2e0d8efb54a128b52722a2dcb3d7b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:54.045923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:54.191572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1c2e0d8efb54a128b52722a2dcb3d7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:54.215991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1c2e0d8efb54a128b52722a2dcb3d7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:54.217101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1c2e0d8efb54a128b52722a2dcb3d7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:54.227101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1c2e0d8efb54a128b52722a2dcb3d7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:54.228855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1c2e0d8efb54a128b52722a2dcb3d7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:54.251965 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1854/3714] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:53 2022] DELETE /identity/v3/users/a1c2e0d8efb54a128b52722a2dcb3d7b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:54.256611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:54.257215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:54.257215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:54.303352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:54.304551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:54.411907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:54.441604 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1861/3715] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:54.465592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:54.467322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:54.743183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874f9e9-427e-4fd5-8de3-17f33cc67e67 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:54.757920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86e85-b1cd-4657-a2b8-c8a4e42a3f2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:54.759368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86e85-b1cd-4657-a2b8-c8a4e42a3f2e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:54.759750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86e85-b1cd-4657-a2b8-c8a4e42a3f2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:54.760123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86e85-b1cd-4657-a2b8-c8a4e42a3f2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:54.778414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:54.783554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86e85-b1cd-4657-a2b8-c8a4e42a3f2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:54.787224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86e85-b1cd-4657-a2b8-c8a4e42a3f2e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:54.812424 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1855/3716] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:56.007846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:56.013140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:56.053847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b296b-961a-402f-9a70-e9049f1e1e4d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:56.093758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:56.094592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.094764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.095028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] PATH_INFO: `/v3/projects/34130dd0aa5d43c9846cf1a7fdb8d27d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.106246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=34130dd0aa5d43c9846cf1a7fdb8d27d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:56.110072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:56.221706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'request_id': 'req-65cd03c7-514b-4265-9571-b5e36d794ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.233789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'request_id': 'req-65cd03c7-514b-4265-9571-b5e36d794ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.252112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34130dd0aa5d43c9846cf1a7fdb8d27d', 'request_id': 'req-65cd03c7-514b-4265-9571-b5e36d794ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.296624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] The token cache is being invalidate because project 34130dd0aa5d43c9846cf1a7fdb8d27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:56.297054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.298436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.301259 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1862/3717] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:56 2022] DELETE /identity/v3/projects/34130dd0aa5d43c9846cf1a7fdb8d27d => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:56.307913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd935d8-f200-4a20-a622-01b44b812e7c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.308480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd935d8-f200-4a20-a622-01b44b812e7c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.308695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd935d8-f200-4a20-a622-01b44b812e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.364003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:56.366391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:56.377031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9fd935d8-f200-4a20-a622-01b44b812e7c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:56.381903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fd935d8-f200-4a20-a622-01b44b812e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:56.566143 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1856/3718] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:56.570252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd03c7-514b-4265-9571-b5e36d794ccd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:56.580613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.580897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.581170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.592960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:56.595324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.595626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.595884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] PATH_INFO: `/v3/users/c00d5870bc60456b93e17b97d9407ccd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.604233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00d5870bc60456b93e17b97d9407ccd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:56.608564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:56.638223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:56.639591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:56.693940 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1857/3719] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:56.697907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:56.715761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e7aa2-f86e-4135-9003-2905960fe9e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:56.721691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:56.726548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.727266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.727851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.728414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:58:56.728726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:56.730608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:56.765180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00d5870bc60456b93e17b97d9407ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.772729 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1858/3720] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:58:56.778334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00d5870bc60456b93e17b97d9407ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.779274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00d5870bc60456b93e17b97d9407ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.781445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:56.785356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:56.797600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00d5870bc60456b93e17b97d9407ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.798736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a58b4ad-a312-4493-b66d-3202740bf67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00d5870bc60456b93e17b97d9407ccd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:56.817783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3103e09-c7cb-42ac-be37-57de0fb01e1f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:56.824097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:56.829318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:56.831305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.832131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.832943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.833749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:56.837601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:56.846186 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1863/3721] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:58:56 2022] DELETE /identity/v3/users/c00d5870bc60456b93e17b97d9407ccd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:58:56.855491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:56.859360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:56.860055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:56.934491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:56.936312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:56.939289 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1859/3722] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:58:56 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:56.946271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:57.195142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1864/3723] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:57.211659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f2989-22d2-4e28-abe9-358fd7831161 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:57.230211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:57.231322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:57.234640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:57.237751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:57.240919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:57.248018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:57.263662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:57.265298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:57.305555 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1860/3724] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:58:56 2022] POST /identity/v3/users => generated 294 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:58:57.307651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:57.342658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cbbcc-59bd-489b-989e-dae096ba4d81 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:57.354449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:57.356602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:57.357006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:57.357631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:57.359634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:57.362673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:57.401774 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1861/3725] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:58:57.408046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:57.439241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ab4dc-4315-480f-b971-369d5f3f4f56 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:57.472186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:57.473953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:57.477015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdede1-482d-4a5a-a62c-7325a29d7d97 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:57.477689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:57.479791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:57.480696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:57.483577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:57.492341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0ce20-d4f5-46e3-ae9d-c9ae8468b85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:57.497045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0ce20-d4f5-46e3-ae9d-c9ae8468b85e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:57.498014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0ce20-d4f5-46e3-ae9d-c9ae8468b85e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:57.500265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0ce20-d4f5-46e3-ae9d-c9ae8468b85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:57.543520 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1862/3726] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:58:57.544571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:57.557400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0ce20-d4f5-46e3-ae9d-c9ae8468b85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:57.567672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0ce20-d4f5-46e3-ae9d-c9ae8468b85e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:57.635495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584474e4-188a-45db-816d-2b9284e99042 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:57.646709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:57.649583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:57.649583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:57.649583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] PATH_INFO: `/v3/projects/3ef09834b750437e9fa350df7b4bb0f3/users/801730a89d33490d8d6f425f20ce5b1d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:57.667714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef09834b750437e9fa350df7b4bb0f3, user_id=801730a89d33490d8d6f425f20ce5b1d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:57.670853 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1865/3727] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:58:57.671348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:57.684397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:57.707627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1863/3728] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:58:57 2022] PUT /identity/v3/projects/3ef09834b750437e9fa350df7b4bb0f3/users/801730a89d33490d8d6f425f20ce5b1d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:57.714177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce032de-a1be-45f0-83ec-5dd9b702c26d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:57.714462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce032de-a1be-45f0-83ec-5dd9b702c26d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:57.714723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce032de-a1be-45f0-83ec-5dd9b702c26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:57.752029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cce032de-a1be-45f0-83ec-5dd9b702c26d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:57.754456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cce032de-a1be-45f0-83ec-5dd9b702c26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:57.926127 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1866/3729] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:57.949434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:57.952086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:58.116535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5e195-df7a-4dfc-873e-64f95d8bd8a4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:58.129996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9655b9-89ad-4a79-a38c-9c3284e9f806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:58.138985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9655b9-89ad-4a79-a38c-9c3284e9f806 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:58.140148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9655b9-89ad-4a79-a38c-9c3284e9f806 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:58.141073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9655b9-89ad-4a79-a38c-9c3284e9f806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:58.174871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9655b9-89ad-4a79-a38c-9c3284e9f806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:58.178018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9655b9-89ad-4a79-a38c-9c3284e9f806 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:58.214791 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1864/3730] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:58:59.046038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc507-2d88-40a6-8af0-d7f884c3d709 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:59.046596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc507-2d88-40a6-8af0-d7f884c3d709 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:59.047095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00adc507-2d88-40a6-8af0-d7f884c3d709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:59.168766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-00adc507-2d88-40a6-8af0-d7f884c3d709 None None] MFA Rules not processed for user `adb51369444c42c190b1b7bf5e23ddb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:59.175325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00adc507-2d88-40a6-8af0-d7f884c3d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:59.217584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:58:59.258372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:59.258942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:59.259343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:59.282273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1867/3731] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:59.294382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:59.294382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:59.294644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:59.312245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:59.314588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:59.389630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] MFA Rules not processed for user `adb51369444c42c190b1b7bf5e23ddb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:59.396809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:59.424663 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1868/3732] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:58:59.432004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:59.435829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1865/3733] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 02:58:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:58:59.444506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:59.450402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:58:59.451811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:59.488049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f85370-8374-461b-b80b-bd8c9df64b1a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:59.518095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:59.518095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:59.518095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:59.518095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] PATH_INFO: `/v3/projects/4b641d60f76d48318792fe3da6f594b6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:59.518553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b641d60f76d48318792fe3da6f594b6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:59.518553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:59.613640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6c73f-4ab2-4cbd-8c77-afac460883e4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:58:59.634342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192198b2-f39b-4dd1-824f-cfb4b1cb9f63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:58:59.635884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192198b2-f39b-4dd1-824f-cfb4b1cb9f63 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:59.636940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192198b2-f39b-4dd1-824f-cfb4b1cb9f63 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:59.638393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192198b2-f39b-4dd1-824f-cfb4b1cb9f63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:59.660173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b641d60f76d48318792fe3da6f594b6', 'request_id': 'req-f12fcf33-5557-4e62-92af-7501c26fe287'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:59.660525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192198b2-f39b-4dd1-824f-cfb4b1cb9f63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:58:59.664691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192198b2-f39b-4dd1-824f-cfb4b1cb9f63 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:58:59.679005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b641d60f76d48318792fe3da6f594b6', 'request_id': 'req-f12fcf33-5557-4e62-92af-7501c26fe287'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:59.690427 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1866/3734] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:58:59.693334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b641d60f76d48318792fe3da6f594b6', 'request_id': 'req-f12fcf33-5557-4e62-92af-7501c26fe287'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:59.734357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] The token cache is being invalidate because project 4b641d60f76d48318792fe3da6f594b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:58:59.734705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:59.735546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f12fcf33-5557-4e62-92af-7501c26fe287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:58:59.737814 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1869/3735] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:58:59 2022] DELETE /identity/v3/projects/4b641d60f76d48318792fe3da6f594b6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:58:59.743090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:58:59.743616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:58:59.744561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:58:59.785566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:58:59.788236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:58:59.929617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:00.014821 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1867/3736] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:00.017137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.017417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.017686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.058479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:00.062279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:00.081878 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1870/3737] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:59:00.085919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.106342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7269f57-d315-478f-8e2b-fc93ca4558e1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.119033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.119889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.120193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.120469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.121192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:59:00.121614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.123457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.158801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.162360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1868/3738] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:59:00.176219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb4d42-3f50-4752-baad-eca42fc16cc1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.193787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.197024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.198911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.199595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.201090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.204558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.262148 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1871/3739] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:00 2022] POST /identity/v3/projects => generated 361 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:00.264114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.266099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:00.266959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.434430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de2515-83bf-4a51-957a-b609592f04aa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.502369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5690d54-6696-4390-9eb5-da7ff8039405 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.510645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.511511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.511921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.512674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.513569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.516703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.569554 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1872/3740] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:00 2022] POST /identity/v3/users => generated 281 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:00.571169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.582315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:00.592515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdcc49-8733-4b96-b51f-ceb8da0e7c6b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.597703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.602756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.606282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.606612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.606892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.607098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.607535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.607924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.609767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.612634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.615831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:00.633862 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1873/3741] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:00.637421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.653683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747501ff-ca49-4254-acc7-55adf4aa1c70 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.661110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.662580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.664392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.664965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.666274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.669159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.686797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1874/3742] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:00.690752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:00.710805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c1442c-4e1c-4a98-ba4c-eb16a894a3d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:00.728275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd6f0-ce8f-4056-ada9-fcb8950f515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:00.730737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd6f0-ce8f-4056-ada9-fcb8950f515a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.733262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd6f0-ce8f-4056-ada9-fcb8950f515a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.734300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd6f0-ce8f-4056-ada9-fcb8950f515a admin admin] PATH_INFO: `/v3/projects/19ecb3ff3b514a64bac30c29312f15c0/users/b388150928974bc3a6c7e4c3605a0109/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.795975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd6f0-ce8f-4056-ada9-fcb8950f515a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19ecb3ff3b514a64bac30c29312f15c0, user_id=b388150928974bc3a6c7e4c3605a0109, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.807646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd6f0-ce8f-4056-ada9-fcb8950f515a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.860498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:00.872288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:00.881867 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1875/3743] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:00 2022] PUT /identity/v3/projects/19ecb3ff3b514a64bac30c29312f15c0/users/b388150928974bc3a6c7e4c3605a0109/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:00.882508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:00.890478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:00.891089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:00.891513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:00.906046 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1869/3744] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:01.002412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] MFA Rules not processed for user `b388150928974bc3a6c7e4c3605a0109`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:01.004312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:01.168176 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1876/3745] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:59:01.215659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:01.217448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:01.378467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb1c346-8bd2-4eca-bd4e-699d6b95f467 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:01.498462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:01.499106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:01.502584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:01.502920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:01.525695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:01.528912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:01.554705 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1870/3746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:01.572647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:01.747500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81682b-5a74-4101-99bb-4e472f16aad9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:01.760235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:01.761276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:01.761276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:01.761864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] PATH_INFO: `/v3/users/b388150928974bc3a6c7e4c3605a0109` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:01.764632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b388150928974bc3a6c7e4c3605a0109)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:01.766685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:01.888132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b388150928974bc3a6c7e4c3605a0109'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:01.892102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:01.902594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b388150928974bc3a6c7e4c3605a0109'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:01.903453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b388150928974bc3a6c7e4c3605a0109'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:01.921578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b388150928974bc3a6c7e4c3605a0109'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:01.922420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-79011994-8504-4245-bd57-a2d9c848816b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b388150928974bc3a6c7e4c3605a0109'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:01.942240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:01.944248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:01.977108 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1877/3747] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:59:01 2022] DELETE /identity/v3/users/b388150928974bc3a6c7e4c3605a0109 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:01.980872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:01.981313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:01.981430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:02.077361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:02.078663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:02.193353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d802b38-db85-47cd-afe4-ca28718c73d5 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:02.224755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1878/3748] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:02.237868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:02.239614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:02.320551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:02.355813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:02.356504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:02.356709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:02.356984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:02.361844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:02.388396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d281004-fc8c-4add-bdc5-460971c113a9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:02.390138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:02.392716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:02.401180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a7241-b0ed-4a3b-873d-bea66fc41027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:02.401824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7241-b0ed-4a3b-873d-bea66fc41027 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:02.402100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7241-b0ed-4a3b-873d-bea66fc41027 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:02.402369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a7241-b0ed-4a3b-873d-bea66fc41027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:02.414637 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1871/3749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 02:59:02.444879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7241-b0ed-4a3b-873d-bea66fc41027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:02.446647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a7241-b0ed-4a3b-873d-bea66fc41027 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:02.470775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1879/3750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:03.373786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:03.375345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:03.392783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e856f-6998-4004-8144-53e2c713348c service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:03.400419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:03.401787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:03.404791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:03.408043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] PATH_INFO: `/v3/projects/19ecb3ff3b514a64bac30c29312f15c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:03.410269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=19ecb3ff3b514a64bac30c29312f15c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:03.413256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:03.459508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5bd90-513e-4ca7-aaa4-c7383838f754 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:03.459996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5bd90-513e-4ca7-aaa4-c7383838f754 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:03.460096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5bd90-513e-4ca7-aaa4-c7383838f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:03.516160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ece5bd90-513e-4ca7-aaa4-c7383838f754 None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:03.522888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ece5bd90-513e-4ca7-aaa4-c7383838f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:03.533445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ecb3ff3b514a64bac30c29312f15c0', 'request_id': 'req-708300d9-b4a1-4cc4-b482-6bdd072c96fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:03.543410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ecb3ff3b514a64bac30c29312f15c0', 'request_id': 'req-708300d9-b4a1-4cc4-b482-6bdd072c96fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:03.552199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ecb3ff3b514a64bac30c29312f15c0', 'request_id': 'req-708300d9-b4a1-4cc4-b482-6bdd072c96fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:03.573589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] The token cache is being invalidate because project 19ecb3ff3b514a64bac30c29312f15c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:59:03.574169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:03.575085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-708300d9-b4a1-4cc4-b482-6bdd072c96fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:03.577984 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1872/3751] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:03 2022] DELETE /identity/v3/projects/19ecb3ff3b514a64bac30c29312f15c0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:03.584864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:03.586756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:03.591281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:03.651791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:03.659462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:03.768911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1880/3752] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:03.880936 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1873/3753] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:03.889246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:03.889598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:03.889702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:03.933066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:03.937631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:03.989969 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1881/3754] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:03.993326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:04.016504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4b792-c723-4082-8e40-4044f9468e1b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:04.046669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:04.048687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.048975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.049358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.052478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:59:04.055627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:04.060384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:04.091821 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1874/3755] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:59:04.093651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:04.105619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98f2b8-ebc4-45ed-8097-b3e462c2d239 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:04.121023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:04.121958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.122382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.122814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.125582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:04.128836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:04.142867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:04.204019 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1882/3756] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:04 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:04.207899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:04.232737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18304d7-0605-4380-adbe-9396ef19e340 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:04.422647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:04.423288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.423773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.425591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.426633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:04.431275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:04.453634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:04.486983 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1875/3757] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:04 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:04.491157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:04.542098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94847b-a2c9-47a7-955f-35ed6c729c4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:04.556681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:04.557497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.557923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.558888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.560852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:04.562629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:04.598252 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1883/3758] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:04.602692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:04.620656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f5e5c3-353b-4b80-85b7-c881bfccb2b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:04.653889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da327d90-7359-442f-8cc7-e824573cc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:04.654537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327d90-7359-442f-8cc7-e824573cc79e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.654815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327d90-7359-442f-8cc7-e824573cc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.655088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da327d90-7359-442f-8cc7-e824573cc79e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.655738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327d90-7359-442f-8cc7-e824573cc79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:04.657370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da327d90-7359-442f-8cc7-e824573cc79e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:04.709064 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1876/3759] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:04.711089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:04.727436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c860c74-f806-41b9-b95d-f6cab7fa597d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:04.746029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:04.746705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.747037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.747862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] PATH_INFO: `/v3/projects/b273ff8ff99d49a9998600216bb595a3/users/33dc7a3043e54782acad777785b32200/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.795071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b273ff8ff99d49a9998600216bb595a3, user_id=33dc7a3043e54782acad777785b32200, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:04.811631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:04.884516 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1884/3760] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:04 2022] PUT /identity/v3/projects/b273ff8ff99d49a9998600216bb595a3/users/33dc7a3043e54782acad777785b32200/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:59:04.895506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:04.896030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:04.896461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:04.963098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] MFA Rules not processed for user `33dc7a3043e54782acad777785b32200`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:04.964422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:05.114255 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1877/3761] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:05.128110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:05.129951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:05.295403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca4bdb-0f8f-4383-93ca-31cadc9e79a8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:05.299892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79a638a-5fc0-4b47-a991-a03022557236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:05.300690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a638a-5fc0-4b47-a991-a03022557236 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:05.301126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a638a-5fc0-4b47-a991-a03022557236 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:05.301674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79a638a-5fc0-4b47-a991-a03022557236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:05.326927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a638a-5fc0-4b47-a991-a03022557236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:05.329766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79a638a-5fc0-4b47-a991-a03022557236 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:05.362499 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1885/3762] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:06.390507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:06.392751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:06.595801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73eb351-4361-440e-ace5-18c0e0e986cb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:06.624077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:06.624784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:06.625066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:06.625344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:06.629608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:06.846799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:06.848506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:06.898919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1878/3763] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:15.338219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:16.873622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=89 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:17.454262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619abd41-f6f9-4f93-8668-a8ddeb0c06d6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:17.454835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619abd41-f6f9-4f93-8668-a8ddeb0c06d6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:17.455121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619abd41-f6f9-4f93-8668-a8ddeb0c06d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:17.536783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-619abd41-f6f9-4f93-8668-a8ddeb0c06d6 None None] MFA Rules not processed for user `801730a89d33490d8d6f425f20ce5b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:17.538046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-619abd41-f6f9-4f93-8668-a8ddeb0c06d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:17.694570 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1886/3764] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:18.148632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:18.150794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:18.244900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63700f4-dec9-46f8-ab34-7a274a79447c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:18.251239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:18.251894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:18.252182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:18.252502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:18.273851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:18.275527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:18.313285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1879/3765] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:20.985697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:20.986199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:20.986299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:21.031619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] MFA Rules not processed for user `801730a89d33490d8d6f425f20ce5b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:21.035159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:21.057142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1887/3766] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:21.414077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:21.416385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:21.566661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78952405-e17d-46d8-a90e-5831bd2ff098 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:21.575790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:21.576601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:21.577497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:21.577497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:21.589226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:21.591850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:21.603736 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1880/3767] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 02:59:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 02:59:29.059911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:29.062541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:29.089165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a73492-c69d-4253-a9cb-f2d7dfdbb9f3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:29.094156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:29.094817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:29.095203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:29.095328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] PATH_INFO: `/v3/users/3b95983a06784c0092841b61efd66ba4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:29.110822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b95983a06784c0092841b61efd66ba4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:29.112826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:29.209021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b95983a06784c0092841b61efd66ba4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:29.221672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b95983a06784c0092841b61efd66ba4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:29.222851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b95983a06784c0092841b61efd66ba4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:29.241016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b95983a06784c0092841b61efd66ba4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:29.242515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b95983a06784c0092841b61efd66ba4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:29.267957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1888/3768] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:59:29 2022] DELETE /identity/v3/users/3b95983a06784c0092841b61efd66ba4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:59:30.426115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:30.438573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec4699-3a44-4fa0-9ddc-bfa0b98d8a76 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:30.577611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:30.578550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:30.579008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:30.579440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] PATH_INFO: `/v3/projects/c813a6b4d51c4c268e9871a292ac33b8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:30.580923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c813a6b4d51c4c268e9871a292ac33b8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:30.583340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:30.615818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:30.667155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c813a6b4d51c4c268e9871a292ac33b8', 'request_id': 'req-f3050df3-049e-4525-9724-7cf4fad0fad9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:30.677219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c813a6b4d51c4c268e9871a292ac33b8', 'request_id': 'req-f3050df3-049e-4525-9724-7cf4fad0fad9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:30.684985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c813a6b4d51c4c268e9871a292ac33b8', 'request_id': 'req-f3050df3-049e-4525-9724-7cf4fad0fad9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:30.706472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] The token cache is being invalidate because project c813a6b4d51c4c268e9871a292ac33b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:59:30.706882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:30.707648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:30.710361 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1881/3769] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:30 2022] DELETE /identity/v3/projects/c813a6b4d51c4c268e9871a292ac33b8 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:30.714871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:30.716664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:30.735085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bcd33-0b56-4e2c-b384-1cb42bfb53ca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:30.869543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:30.885230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:30.885834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:30.886122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:30.886393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] PATH_INFO: `/v3/users/973ed3157fe940c480abca5709116618` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:30.887712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] RBAC: Authorizing `identity:delete_user(user_id=973ed3157fe940c480abca5709116618)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:30.893565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:31.050291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973ed3157fe940c480abca5709116618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.082539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973ed3157fe940c480abca5709116618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.083198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973ed3157fe940c480abca5709116618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.112599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973ed3157fe940c480abca5709116618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.113350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973ed3157fe940c480abca5709116618'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.151774 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1889/3770] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:59:30 2022] DELETE /identity/v3/users/973ed3157fe940c480abca5709116618 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:31.528624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:31.530479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:31.590699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3050df3-049e-4525-9724-7cf4fad0fad9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:31.770059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:31.771075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:31.771537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:31.771822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] PATH_INFO: `/v3/projects/9ce758c03ffc42cebbf4f710f2b75a7a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:31.773399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce758c03ffc42cebbf4f710f2b75a7a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:31.775379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:31.861001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce758c03ffc42cebbf4f710f2b75a7a', 'request_id': 'req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.870444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce758c03ffc42cebbf4f710f2b75a7a', 'request_id': 'req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.887896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce758c03ffc42cebbf4f710f2b75a7a', 'request_id': 'req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.903240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:31.904693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:31.909525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] The token cache is being invalidate because project 9ce758c03ffc42cebbf4f710f2b75a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:59:31.909835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.910569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2323ec0-c60d-4b02-91c5-81cfa25e75a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:31.915891 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1882/3771] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:31 2022] DELETE /identity/v3/projects/9ce758c03ffc42cebbf4f710f2b75a7a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:31.918179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9519-128c-40dc-855c-a1b52867e0fc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:31.918674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9519-128c-40dc-855c-a1b52867e0fc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:31.919123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9519-128c-40dc-855c-a1b52867e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:31.929752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ecf0a-e94c-413d-bd89-838a6c14384c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:31.950667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b35b9519-128c-40dc-855c-a1b52867e0fc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:31.955260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b35b9519-128c-40dc-855c-a1b52867e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:32.020564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:32.021306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.021658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.022050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] PATH_INFO: `/v3/users/eeff83f3646947109a6a670d0711398f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.023196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:32.023583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeff83f3646947109a6a670d0711398f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:32.026922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:32.106142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1883/3772] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:32.109883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.109883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.109883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.139655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeff83f3646947109a6a670d0711398f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:32.166480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeff83f3646947109a6a670d0711398f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:32.167382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeff83f3646947109a6a670d0711398f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:32.174331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:32.179173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:32.183107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeff83f3646947109a6a670d0711398f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:32.184576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d5ec18c-3bf6-41de-9f1d-070b9409ff7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeff83f3646947109a6a670d0711398f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:32.198652 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1884/3773] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:32.203683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:32.232148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:32.248736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e55417d-c902-4b46-99e6-18415471ea5e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:32.254330 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1890/3774] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:59:31 2022] DELETE /identity/v3/users/eeff83f3646947109a6a670d0711398f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:59:32.267484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.270135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.270795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:32.271390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.271678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.271953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.272686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:59:32.273043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.273158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:32.274904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:32.313237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1885/3775] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:59:32.315080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:32.337132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d51c4-2da4-4bf9-bdd3-c0c1c92b88ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:32.341749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:32.345896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:32.476964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:32.477597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.477905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.478282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.480507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:32.482882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:32.488223 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1891/3776] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:32.501956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:32.507176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:32.565123 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1886/3777] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:32 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:59:32.566645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:32.618560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fc96c-561b-45c5-9c94-f8cd322583c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:32.712641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:32.713536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.714077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.714810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.801293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e73c6b-d280-4132-bce9-c979021e89a9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:32.816353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:32.817133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.817455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.817725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.818698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:32.837247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:32.849132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:32.851924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:32.859340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:32.884898 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1892/3778] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:32.889226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:32.889582 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1887/3779] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:32 2022] POST /identity/v3/users => generated 294 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 02:59:32.912660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22ca89-20a4-4f24-9631-939b00109e8c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:32.924106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:32.924734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:32.925010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:32.925283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:32.926030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:32.927569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:32.969278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1893/3780] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:59:32.973298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:32.987192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587661f-d9bd-4efa-943d-8018c784dec0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:33.000399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91336ea-d616-4ea1-8d43-647159921e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:33.001038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91336ea-d616-4ea1-8d43-647159921e08 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:33.001320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91336ea-d616-4ea1-8d43-647159921e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:33.001593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91336ea-d616-4ea1-8d43-647159921e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:33.002268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91336ea-d616-4ea1-8d43-647159921e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:33.004912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91336ea-d616-4ea1-8d43-647159921e08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:33.037723 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1888/3781] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:33.042204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:33.060661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e44af-b7a9-42cb-86cc-4aaefa708417 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:33.077959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:33.078660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:33.078958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:33.079204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] PATH_INFO: `/v3/projects/bf7809d4281c4efa9330464b86c1ee27/users/0bb215bc0435419eb2659aceb19ea58a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:33.125229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7809d4281c4efa9330464b86c1ee27, user_id=0bb215bc0435419eb2659aceb19ea58a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:33.127968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:33.155395 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1894/3782] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:33 2022] PUT /identity/v3/projects/bf7809d4281c4efa9330464b86c1ee27/users/0bb215bc0435419eb2659aceb19ea58a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:33.160817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:33.161079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:33.161351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:33.178192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:33.184974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:33.197012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:33.197012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:33.240594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:33.304806 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1889/3783] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:33.314523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:33.317161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24fb7c-24d4-4fd1-9855-7e6d58d37aeb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:33.322675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:33.323400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:33.323745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:33.324089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] PATH_INFO: `/v3/projects/fc4a5146b4134f11af39e82d9ae9f03b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:33.325914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4a5146b4134f11af39e82d9ae9f03b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:33.328202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:33.401779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4a5146b4134f11af39e82d9ae9f03b', 'request_id': 'req-e86c5c46-9b02-4732-9610-3506be2614f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.412174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4a5146b4134f11af39e82d9ae9f03b', 'request_id': 'req-e86c5c46-9b02-4732-9610-3506be2614f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.422499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4a5146b4134f11af39e82d9ae9f03b', 'request_id': 'req-e86c5c46-9b02-4732-9610-3506be2614f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.441320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23b6a1-c4ff-4efe-ae7a-86c15885fdfb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:33.447898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] The token cache is being invalidate because project fc4a5146b4134f11af39e82d9ae9f03b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:59:33.448275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.449418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.452047 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1895/3784] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:33 2022] DELETE /identity/v3/projects/fc4a5146b4134f11af39e82d9ae9f03b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:33.456094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:33.458711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:33.551991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:33.558062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c5c46-9b02-4732-9610-3506be2614f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:33.565729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:33.567556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:33.567960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:33.568356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] PATH_INFO: `/v3/users/7fbbacb94711468e977c6eba0935f41e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:33.573344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:33.574123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:33.574303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbbacb94711468e977c6eba0935f41e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:33.574449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:33.574722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:33.578068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:33.582444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:33.593158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:33.595106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:33.607315 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1890/3785] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:33.680740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbbacb94711468e977c6eba0935f41e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.691900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbbacb94711468e977c6eba0935f41e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.693998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbbacb94711468e977c6eba0935f41e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.707922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbbacb94711468e977c6eba0935f41e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.708852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a39b78c5-5e18-4a87-b5f2-a8c4492e5ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbbacb94711468e977c6eba0935f41e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:33.740965 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1896/3786] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:59:33 2022] DELETE /identity/v3/users/7fbbacb94711468e977c6eba0935f41e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:59:34.117485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:34.131610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d641f-1879-4142-b450-306ca1b944bd service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:34.255915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:34.257778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:34.258136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:34.258372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] PATH_INFO: `/v3/projects/d00b18d27eb643cfacec3f332d76cb9e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:34.260805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00b18d27eb643cfacec3f332d76cb9e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:34.262948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:34.324158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:34.378000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00b18d27eb643cfacec3f332d76cb9e', 'request_id': 'req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:34.391462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00b18d27eb643cfacec3f332d76cb9e', 'request_id': 'req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:34.418962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00b18d27eb643cfacec3f332d76cb9e', 'request_id': 'req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:34.448793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] The token cache is being invalidate because project d00b18d27eb643cfacec3f332d76cb9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:59:34.451471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:34.452219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2dbd66cc-9092-4c00-93c1-7856cc7ea0b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:34.461732 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1891/3787] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:34 2022] DELETE /identity/v3/projects/d00b18d27eb643cfacec3f332d76cb9e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:34.463660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:34.464155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:34.467751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:34.528869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:34.530376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:34.644082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1897/3788] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:34.652631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:34.653451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:34.653937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:34.681959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:34.683559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:34.698679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:34.710372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1892/3789] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:34.712513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7bfc9-d905-4562-9e1f-9b3b7a803932 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:34.719076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:34.720001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:34.720426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:34.721004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:34.721535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:59:34.722014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:34.724603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:34.741730 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1898/3790] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 02:59:34.746618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:34.760227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0698413-5cc0-4129-9210-2d1a4eaf22f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:34.771874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:34.772979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:34.774003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:34.774384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:34.776706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:34.779576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:34.820784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1893/3791] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:34 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:34.825089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:34.850053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb922e45-8ae9-47ba-bd2b-4ba126fe197b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.072421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.073954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.074603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.075117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.076365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.080858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.097851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:35.126287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.137914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1899/3792] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:34 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:35.143614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ec67a-6ef8-48a9-9bce-c9ae2f082ece admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.150419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.152174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.152716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.153259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.154278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.160344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.183785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.195863 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1894/3793] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 02:59:35.202264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf7e21-b82b-4d53-b4f0-2d8fd68c0be7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.208710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dffb101-b72c-47de-af90-aebe5e09fdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.209848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffb101-b72c-47de-af90-aebe5e09fdaf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.210451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffb101-b72c-47de-af90-aebe5e09fdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.210939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dffb101-b72c-47de-af90-aebe5e09fdaf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.212316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffb101-b72c-47de-af90-aebe5e09fdaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.214938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dffb101-b72c-47de-af90-aebe5e09fdaf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.239056 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1900/3794] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:35.239433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.272633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d75a0-8123-4533-bed1-dcd6bb3befb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.280220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.281380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.281859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.282281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] PATH_INFO: `/v3/projects/5d85e030cdfd49bfa36d55f2aa1a074c/users/a3151f4e39a646e1a3ba3585bc00b2ab/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.305044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d85e030cdfd49bfa36d55f2aa1a074c, user_id=a3151f4e39a646e1a3ba3585bc00b2ab, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.308663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.342426 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1895/3795] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:35 2022] PUT /identity/v3/projects/5d85e030cdfd49bfa36d55f2aa1a074c/users/a3151f4e39a646e1a3ba3585bc00b2ab/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:35.354618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.355371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.355789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.401506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] MFA Rules not processed for user `a3151f4e39a646e1a3ba3585bc00b2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:35.403161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:35.496697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1901/3796] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:59:35.500919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.590201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16516ff-c9a1-46f8-9f89-103ccac2c498 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.596063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.596651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.596928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.597190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.597901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.600049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.661561 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1896/3797] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:35 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:35.666545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.685741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402cf28-83e0-4792-a04a-ecccae4ca127 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.821099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.821836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.822202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.822533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.823235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.825416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.857257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1902/3798] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:35 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:35.861174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.878894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47700-dbb5-4fc1-b818-4e91df83feef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.886463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.889602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.891668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.891872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:35.892948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:35.897280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:35.927469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:35.928092 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1897/3799] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:35.945757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee91d49-a3d3-49d2-867c-89bc70024e41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:35.970517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:35.973127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:35.973488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:35.973778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] PATH_INFO: `/v3/projects/97cd5cd1287c4e5182d6485358b33d24/users/985a3b7f43be4a66b55b1375fcc47b94/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:36.036725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cd5cd1287c4e5182d6485358b33d24, user_id=985a3b7f43be4a66b55b1375fcc47b94, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:36.040274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:36.070713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1903/3800] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:35 2022] PUT /identity/v3/projects/97cd5cd1287c4e5182d6485358b33d24/users/985a3b7f43be4a66b55b1375fcc47b94/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:59:36.075138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:36.090001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd038a93-71e1-43ae-87f0-11c03548fcd8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:36.130700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:36.208161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b1535-f909-43fb-9859-12daf3976727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:36.209577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b1535-f909-43fb-9859-12daf3976727 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:36.209895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b1535-f909-43fb-9859-12daf3976727 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:36.210342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b1535-f909-43fb-9859-12daf3976727 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:36.211384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b1535-f909-43fb-9859-12daf3976727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:36.214670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b1535-f909-43fb-9859-12daf3976727 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:36.240459 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1898/3801] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:36.245029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:36.256493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd92adf-5f36-49dc-b4db-d9dfa0b36f4a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:36.270316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdd455-a681-4b11-b0cf-a60618ebbc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:36.271245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdd455-a681-4b11-b0cf-a60618ebbc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:36.271651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdd455-a681-4b11-b0cf-a60618ebbc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:36.272020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdd455-a681-4b11-b0cf-a60618ebbc01 admin admin] PATH_INFO: `/v3/projects/97cd5cd1287c4e5182d6485358b33d24/users/985a3b7f43be4a66b55b1375fcc47b94/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:36.275460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdd455-a681-4b11-b0cf-a60618ebbc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97cd5cd1287c4e5182d6485358b33d24, user_id=985a3b7f43be4a66b55b1375fcc47b94, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:36.278926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbdd455-a681-4b11-b0cf-a60618ebbc01 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:36.292628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1904/3802] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:36 2022] PUT /identity/v3/projects/97cd5cd1287c4e5182d6485358b33d24/users/985a3b7f43be4a66b55b1375fcc47b94/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:36.303630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:36.304256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:36.304803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:36.383834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] MFA Rules not processed for user `985a3b7f43be4a66b55b1375fcc47b94`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:36.385115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:36.578460 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1899/3803] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:36.591066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:36.592349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:36.593029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:36.629340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] MFA Rules not processed for user `a3151f4e39a646e1a3ba3585bc00b2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:36.634898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:36.675307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:36.773317 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1905/3804] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:36.812280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:36.813733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:36.948979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b8415-a5d9-4e2c-b517-e2b2d93a99f8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:36.966332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:36.967344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:36.967809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:36.968461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:36.987620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:36.992461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:37.018459 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1900/3805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:45.870188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:45.871574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:45.891457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:45.893025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:45.970304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:46.025621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e847c9d-419e-4d9a-8764-1bf176252a71 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:46.033346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:46.039947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.040535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.040780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.043548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:46.061867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:46.063315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465cbc8-232f-4a3c-9693-ebbeb194df54 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:46.063452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:46.072541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:46.073206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.073485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.073753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] PATH_INFO: `/v3/users/eaaa0b3debf041098f1f188124050dad` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.079020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaaa0b3debf041098f1f188124050dad)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:46.082728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:46.090771 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1906/3806] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:46.186547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaaa0b3debf041098f1f188124050dad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.213190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaaa0b3debf041098f1f188124050dad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.214020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaaa0b3debf041098f1f188124050dad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.224144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaaa0b3debf041098f1f188124050dad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.224951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ced113e8-efcb-4685-a3db-a42f94e68a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaaa0b3debf041098f1f188124050dad'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.244792 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1901/3807] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 02:59:45 2022] DELETE /identity/v3/users/eaaa0b3debf041098f1f188124050dad => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 02:59:46.457977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:46.477344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101490-17c1-440e-aada-25709fe0ff45 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:46.567333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:46.568800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.596378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.596766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] PATH_INFO: `/v3/projects/fa9a72e5d3ea460ebdb09420824ba04b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.598892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa9a72e5d3ea460ebdb09420824ba04b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:46.624370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:46.690082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa9a72e5d3ea460ebdb09420824ba04b', 'request_id': 'req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.697536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa9a72e5d3ea460ebdb09420824ba04b', 'request_id': 'req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.702653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:46.705309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa9a72e5d3ea460ebdb09420824ba04b', 'request_id': 'req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.722252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] The token cache is being invalidate because project fa9a72e5d3ea460ebdb09420824ba04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 02:59:46.723239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.724286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b03b8c6-bdd4-46f3-98aa-e07fac455f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 02:59:46.727269 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1907/3808] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 02:59:46 2022] DELETE /identity/v3/projects/fa9a72e5d3ea460ebdb09420824ba04b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:46.734090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.734090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.734733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.764199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:46.765833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:46.857450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1902/3809] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:46.858673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.858957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.859235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.882488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:46.883825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:46.918237 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1908/3810] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 02:59:46.919675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:46.931318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9eb07-0590-4d26-8802-6479a216c9f0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:46.937409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:46.938064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.938391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.938664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.939317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 02:59:46.939622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:46.941215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:46.954550 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1903/3811] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 02:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 02:59:46.959824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:46.972975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9bc6d-44c8-4f77-b156-db27e136a24f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:46.977921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:46.978695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:46.978976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:46.979248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:46.979880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:46.981820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:47.036637 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1909/3812] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:46 2022] POST /identity/v3/projects => generated 365 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:47.040972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:47.053904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64833f33-9175-41d9-aef7-aa1b45def2d4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:47.091182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:47.133974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:47.134608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.134731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.134997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.135617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:47.137740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:47.185685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1904/3813] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:47 2022] POST /identity/v3/users => generated 283 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:47.187447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:47.199025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279152a-0f2e-471c-9d29-36517ea55cd9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:47.207370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:47.208139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.208426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.208699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.209509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:47.211888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:47.229917 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1910/3814] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:47.234012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:47.246039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e9f1f-9ee4-43a4-b5d2-c97e99e7fe97 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:47.250712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1855ae-a19f-4bab-a610-e118e986dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:47.251321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1855ae-a19f-4bab-a610-e118e986dea0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.251600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1855ae-a19f-4bab-a610-e118e986dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.251868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1855ae-a19f-4bab-a610-e118e986dea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.252531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1855ae-a19f-4bab-a610-e118e986dea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:47.254166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1855ae-a19f-4bab-a610-e118e986dea0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:47.265690 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1905/3815] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:47.270299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:47.281305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce0790-b4f0-4f1d-95d1-0e3c9eb52b0d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:47.286702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:47.289105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.289105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.289105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] PATH_INFO: `/v3/projects/548a0a34ffec4fe8959e88faab0fb154/users/a878e1202c3d442fb55052e841589eb7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.314382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=548a0a34ffec4fe8959e88faab0fb154, user_id=a878e1202c3d442fb55052e841589eb7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:47.317378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:47.333839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1911/3816] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:47 2022] PUT /identity/v3/projects/548a0a34ffec4fe8959e88faab0fb154/users/a878e1202c3d442fb55052e841589eb7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:47.339485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c117067-8f6f-4902-bcfe-fe6233440dfb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.339905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c117067-8f6f-4902-bcfe-fe6233440dfb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.340045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c117067-8f6f-4902-bcfe-fe6233440dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.363576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6c117067-8f6f-4902-bcfe-fe6233440dfb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:47.364807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c117067-8f6f-4902-bcfe-fe6233440dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:47.431089 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1906/3817] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:47.440775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:47.442506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:47.511597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d0677-e77c-4f84-9b98-390306b9c8f7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:47.515707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:47.516015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.516302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.516578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.527465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:47.527465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:47.541833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1912/3818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 02:59:47.830881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:47.831339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:47.832693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:47.908136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] MFA Rules not processed for user `0bb215bc0435419eb2659aceb19ea58a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:47.909359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:48.121069 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1907/3819] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:48.126842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:48.132353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:48.172886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b8505-9619-4548-b73a-e4ed0b287ab5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:48.193121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:48.194217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:48.196703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:48.198004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:48.201330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:48.210516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:48.303165 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1913/3820] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 02:59:48 2022] POST /identity/v3/projects => generated 389 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:48.304550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:48.318501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4a1d-ed88-437a-aad8-894ca830fe21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:48.407715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:48.459971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:48.460598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:48.460875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:48.461145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:48.461789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:48.463966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:48.501824 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1908/3821] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 02:59:48 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 02:59:48.506984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:48.527635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68733ab9-24a1-4a09-8a95-4f61e33f0dd2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:48.544832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:48.547370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:48.549196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:48.549707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:48.552154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:48.559355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:48.582560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1914/3822] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:48.587215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:48.605693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13d378-6d8d-4b17-826e-6f29d294088d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:48.611208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:48.611900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:48.612177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:48.612446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] PATH_INFO: `/v3/projects/0270f9d8b3c54ac8b5539ad17f363faa/users/9a75f856a9ef4d479257a73a9b4c118d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:48.653042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0270f9d8b3c54ac8b5539ad17f363faa, user_id=9a75f856a9ef4d479257a73a9b4c118d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:48.656076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:48.700366 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1909/3823] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:48 2022] PUT /identity/v3/projects/0270f9d8b3c54ac8b5539ad17f363faa/users/9a75f856a9ef4d479257a73a9b4c118d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:48.710661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:48.724050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f91e5-8633-4aae-a68e-b9a638c4b2af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:48.842210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:48.865832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f22f5-38cc-4d0d-a194-56596ac2310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:48.866540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f22f5-38cc-4d0d-a194-56596ac2310d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:48.867033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f22f5-38cc-4d0d-a194-56596ac2310d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:48.867134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f22f5-38cc-4d0d-a194-56596ac2310d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:48.868230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f22f5-38cc-4d0d-a194-56596ac2310d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:48.870693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f22f5-38cc-4d0d-a194-56596ac2310d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:48.901709 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1915/3824] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 02:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 02:59:48.905851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:48.923246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71db79d1-97da-4795-a12f-b47f4cdcae5e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:48.943719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:48.944493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:48.944766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:48.945035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] PATH_INFO: `/v3/projects/0270f9d8b3c54ac8b5539ad17f363faa/users/9a75f856a9ef4d479257a73a9b4c118d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:48.955040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0270f9d8b3c54ac8b5539ad17f363faa, user_id=9a75f856a9ef4d479257a73a9b4c118d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:48.957763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 02:59:48.983868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1910/3825] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 02:59:48 2022] PUT /identity/v3/projects/0270f9d8b3c54ac8b5539ad17f363faa/users/9a75f856a9ef4d479257a73a9b4c118d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 02:59:58.887871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:58.979432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 02:59:59.123520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3710e-9eb8-4e99-8295-417bcc07fef9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:59.123802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3710e-9eb8-4e99-8295-417bcc07fef9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:59.124072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3710e-9eb8-4e99-8295-417bcc07fef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:59.213989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5eb3710e-9eb8-4e99-8295-417bcc07fef9 None None] MFA Rules not processed for user `a878e1202c3d442fb55052e841589eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:59.216803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5eb3710e-9eb8-4e99-8295-417bcc07fef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:59.440591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1916/3826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 02:59:59.776121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 02:59:59.778742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:59.835792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:59.842135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:59.842548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:59.911937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a1193-e204-4960-bbd0-ecfe3601cac8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 02:59:59.941298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b6e15-9337-4756-b3d7-c42192e2c972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 02:59:59.942042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b6e15-9337-4756-b3d7-c42192e2c972 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 02:59:59.942521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b6e15-9337-4756-b3d7-c42192e2c972 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 02:59:59.942863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b6e15-9337-4756-b3d7-c42192e2c972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 02:59:59.949625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] MFA Rules not processed for user `9a75f856a9ef4d479257a73a9b4c118d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 02:59:59.951249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 02:59:59.965009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b6e15-9337-4756-b3d7-c42192e2c972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 02:59:59.968295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b6e15-9337-4756-b3d7-c42192e2c972 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:00.012389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1911/3827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 02:59:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:00.159426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:00.160578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:00.161699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:00.177639 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1917/3828] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 02:59:59 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:00.189984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:00.191588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:00.202403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] MFA Rules not processed for user `adb51369444c42c190b1b7bf5e23ddb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:00.203859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:00.317313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaeb32-4757-45ee-b356-3c83deafc566 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:00.324330 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1912/3829] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:00.335934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e619c-d36e-435b-a56d-669e20232d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:00.336581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e619c-d36e-435b-a56d-669e20232d7e service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:00.336854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e619c-d36e-435b-a56d-669e20232d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:00.337119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e619c-d36e-435b-a56d-669e20232d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:00.418051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:00.486801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e619c-d36e-435b-a56d-669e20232d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:00.491250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e619c-d36e-435b-a56d-669e20232d7e service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:00.516360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1918/3830] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:02.506047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:02.522866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973ad03-ebfd-4b69-9c6b-6abd812144cd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:02.533926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:02.535009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:02.535520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:02.536017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:02.541367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:02.713570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:02.715499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:02.729115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1913/3831] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:02.779401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932798a9-6788-4658-86b4-ccb51b588595 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:02.782706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932798a9-6788-4658-86b4-ccb51b588595 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:02.783185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932798a9-6788-4658-86b4-ccb51b588595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:02.816091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-932798a9-6788-4658-86b4-ccb51b588595 None None] MFA Rules not processed for user `a3151f4e39a646e1a3ba3585bc00b2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:02.818273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-932798a9-6788-4658-86b4-ccb51b588595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:03.070870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1919/3832] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:03.376902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:03.379666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:03.411759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe81f1f-ee24-4742-b801-0ec3f9e8ba5e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:03.449975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:03.450591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:03.451055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:03.451759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:03.454335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:03.567369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:03.690259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:03.692464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623457c3-977c-4851-9918-1fd9759bd6d0 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:03.738695 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1914/3833] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:06.434422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:06.435590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:06.435863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:06.465451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] MFA Rules not processed for user `a878e1202c3d442fb55052e841589eb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:06.471218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:06.493050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1920/3834] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:13.703376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=17 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:16.457740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=42 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:18.557602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:18.558105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:18.558192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:18.600516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] MFA Rules not processed for user `fceb096cc5414b3a9d7300fefeb90dff`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:18.602178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:18.617860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1915/3835] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:21.491426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:21.494758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:21.644041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b3419-26e4-4aca-bfdc-d0a5e04960b4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:21.652763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:21.653697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:21.654424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:21.654863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] PATH_INFO: `/v3/users/baa5908625524366a62c614bd2113894` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:21.657346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa5908625524366a62c614bd2113894)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:21.660023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:21.886741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa5908625524366a62c614bd2113894'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:21.947019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa5908625524366a62c614bd2113894'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:21.948007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa5908625524366a62c614bd2113894'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:21.960443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa5908625524366a62c614bd2113894'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:21.961281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a55d5aee-e626-428d-a35e-6da92ec398df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa5908625524366a62c614bd2113894'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:22.026723 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1921/3836] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:00:21 2022] DELETE /identity/v3/users/baa5908625524366a62c614bd2113894 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:22.686838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:22.711551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5b5f5-7899-428a-9c9a-23d93f0368e5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:22.976249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:22.984348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:22.984643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:22.984917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] PATH_INFO: `/v3/projects/7eb1bb96119d42f3900af93321db08bf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:22.992532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb1bb96119d42f3900af93321db08bf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:23.002842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:23.154409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb1bb96119d42f3900af93321db08bf', 'request_id': 'req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:23.172630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb1bb96119d42f3900af93321db08bf', 'request_id': 'req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:23.186816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb1bb96119d42f3900af93321db08bf', 'request_id': 'req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:23.207596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] The token cache is being invalidate because project 7eb1bb96119d42f3900af93321db08bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:00:23.208100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:23.209870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f58cd2ad-9ce6-4f78-afb3-e23d6a4356a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:23.212405 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1916/3837] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:22 2022] DELETE /identity/v3/projects/7eb1bb96119d42f3900af93321db08bf => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:23.218372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:23.218834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:23.219267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:23.281866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:23.290759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:23.443365 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1922/3838] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:23.445564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:23.446056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:23.447397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:23.550752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:23.561426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:23.602121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1917/3839] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:23.603434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:23.634053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48b167-759e-4759-bad1-d9242a693ad9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:23.653135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:23.656588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:23.656876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:23.657156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:23.667106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:00:23.670716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:23.672306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:23.709455 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1923/3840] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:00:23.710296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:23.734785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98d19-9c6b-40c8-ab31-21f681cec268 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:23.771765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:23.772740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:23.773186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:23.773601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:23.774974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:23.777109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:23.857494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1918/3841] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:00:23 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:23.862582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:23.879844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612042d-3b51-49b7-bdcf-a005cd1bce65 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:23.892748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:24.061826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:24.061826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.061826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.061826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:24.063133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:24.081219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:24.124296 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1924/3842] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:00:23 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:00:24.125620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:24.142055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0bd747-b129-4d1b-bd8e-a2b25d7fbebe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:24.154871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:24.155507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.155789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.156054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:24.157702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:24.159396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:24.191026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1919/3843] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:24.192785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:24.207921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111eceb-a340-4181-986e-ef035e21bb4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:24.225484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a7d7-a380-4926-a712-d9e919eab335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:24.227738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a7d7-a380-4926-a712-d9e919eab335 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.229089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a7d7-a380-4926-a712-d9e919eab335 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.229627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a7d7-a380-4926-a712-d9e919eab335 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:24.232347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a7d7-a380-4926-a712-d9e919eab335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:24.248661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606a7d7-a380-4926-a712-d9e919eab335 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:24.287868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:24.288140 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1925/3844] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:24.307000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09ae87-436a-4817-8fc6-01a128518482 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:24.322661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a0222d-85bb-4b8f-bc3e-1f4aa4521eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:24.323473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0222d-85bb-4b8f-bc3e-1f4aa4521eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.323819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0222d-85bb-4b8f-bc3e-1f4aa4521eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.324115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0222d-85bb-4b8f-bc3e-1f4aa4521eb7 admin admin] PATH_INFO: `/v3/projects/870f44bf140f4b62828ffe0ce571f77f/users/8ae01397259c42adbdf5dc6aa8ee1871/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:24.367529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0222d-85bb-4b8f-bc3e-1f4aa4521eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=870f44bf140f4b62828ffe0ce571f77f, user_id=8ae01397259c42adbdf5dc6aa8ee1871, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:24.377886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a0222d-85bb-4b8f-bc3e-1f4aa4521eb7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:24.420326 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1920/3845] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:24 2022] PUT /identity/v3/projects/870f44bf140f4b62828ffe0ce571f77f/users/8ae01397259c42adbdf5dc6aa8ee1871/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:24.427693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.427976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.428246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:24.478779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] MFA Rules not processed for user `8ae01397259c42adbdf5dc6aa8ee1871`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:24.480494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:24.586726 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1926/3846] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:24.598400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.598680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.599143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:24.625679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] MFA Rules not processed for user `8ae01397259c42adbdf5dc6aa8ee1871`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:24.627290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:24.637386 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1921/3847] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:24.855292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:24.858610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:24.980164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fac7c0-1b1b-41e6-b236-cf44777eccf6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:24.987499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65536d9-1c5f-4e8a-a379-35183484188f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:24.988561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65536d9-1c5f-4e8a-a379-35183484188f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:24.989030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65536d9-1c5f-4e8a-a379-35183484188f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:24.989465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65536d9-1c5f-4e8a-a379-35183484188f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:25.017393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65536d9-1c5f-4e8a-a379-35183484188f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:25.019059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65536d9-1c5f-4e8a-a379-35183484188f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:25.024737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:25.043132 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1927/3848] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:29.905051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:29.907004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:29.951777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:30.101420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f3885-08ae-459c-ac61-ce864ab7c44e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:30.107420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:30.108037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:30.108360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:30.108632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] PATH_INFO: `/v3/users/33dc7a3043e54782acad777785b32200` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:30.109790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33dc7a3043e54782acad777785b32200)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:30.112051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:30.216605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33dc7a3043e54782acad777785b32200'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:30.247558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33dc7a3043e54782acad777785b32200'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:30.249129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33dc7a3043e54782acad777785b32200'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:30.288273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33dc7a3043e54782acad777785b32200'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:30.291024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33dc7a3043e54782acad777785b32200'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:30.315996 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1922/3849] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:00:29 2022] DELETE /identity/v3/users/33dc7a3043e54782acad777785b32200 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:30.320823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:30.321495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:30.321495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:30.365953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:30.367655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:30.572874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1928/3850] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:00:30.590388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:30.592860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:30.835549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e0aa6-53c2-4a5b-a3a2-c5cd0d463e99 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:30.841130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c02b23d-585b-4de4-82c9-86bbebd98ab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:30.841870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b23d-585b-4de4-82c9-86bbebd98ab1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:30.842160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b23d-585b-4de4-82c9-86bbebd98ab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:30.842435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02b23d-585b-4de4-82c9-86bbebd98ab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:30.858743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02b23d-585b-4de4-82c9-86bbebd98ab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:30.862013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c02b23d-585b-4de4-82c9-86bbebd98ab1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:30.913070 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1923/3851] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:32.088181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:32.091429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:32.132443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee941684-2859-4705-85e9-e4975208cf7b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:32.137953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:32.138273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.138365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.138623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] PATH_INFO: `/v3/projects/b273ff8ff99d49a9998600216bb595a3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.140078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b273ff8ff99d49a9998600216bb595a3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:32.146569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:32.242943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b273ff8ff99d49a9998600216bb595a3', 'request_id': 'req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:32.259735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b273ff8ff99d49a9998600216bb595a3', 'request_id': 'req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:32.277111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b273ff8ff99d49a9998600216bb595a3', 'request_id': 'req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:32.299627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] The token cache is being invalidate because project b273ff8ff99d49a9998600216bb595a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:00:32.299927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:32.302022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c7759d8-5aa9-47bc-be9e-6251c6f01d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:32.303979 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1929/3852] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:32 2022] DELETE /identity/v3/projects/b273ff8ff99d49a9998600216bb595a3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:32.312691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.313277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.315861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.351339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:32.352845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:32.400984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:32.471413 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1924/3853] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:32.479683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.479971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.480250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.524150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:32.525941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:32.538494 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1930/3854] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:32.543122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:32.559488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae39a69-c2da-4169-9af5-e8afaaf75668 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:32.572920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:32.573547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.573861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.574129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.574783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:00:32.575341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:32.578044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:32.596370 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1925/3855] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:00:32.597643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:32.608925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ad40d5-b59e-4b05-81a7-eac1e98d111f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:32.616552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:32.617311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.617695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.618101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.619145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:32.621856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:32.688667 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1931/3856] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:00:32 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:32.692794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:32.705325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98b692-ad19-4448-bbb2-3eba6c2c4832 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:32.782013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:32.782973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.783309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.783623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.784466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:32.787112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:32.828978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1926/3857] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:00:32 2022] POST /identity/v3/users => generated 291 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:00:32.830203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:32.844550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97aaa-771a-4d8e-b98d-fcbeb9136e70 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:32.850012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:32.850755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.851185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.851675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.852489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:32.854780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:32.877723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:32.878158 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1932/3858] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:00:32.914743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a74a-01f5-44ef-93df-d0f57afa9dfb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:32.962322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560813ee-c0c3-4a26-910c-1993d641c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:32.963344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560813ee-c0c3-4a26-910c-1993d641c892 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:32.963841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560813ee-c0c3-4a26-910c-1993d641c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:32.964373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560813ee-c0c3-4a26-910c-1993d641c892 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:32.965409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560813ee-c0c3-4a26-910c-1993d641c892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:32.967229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560813ee-c0c3-4a26-910c-1993d641c892 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:33.000628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1927/3859] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:00:33.005143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:33.021550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04c06-816a-450d-a60b-76239910bd00 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:33.038266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:33.040951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:33.041434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:33.042417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] PATH_INFO: `/v3/projects/bca8699491d9463884206d4a6dfcf794/users/ca33200afe954e1fa93584cec297c946/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:33.093968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca8699491d9463884206d4a6dfcf794, user_id=ca33200afe954e1fa93584cec297c946, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:33.096998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:33.125571 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1933/3860] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:33 2022] PUT /identity/v3/projects/bca8699491d9463884206d4a6dfcf794/users/ca33200afe954e1fa93584cec297c946/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:00:33.130701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:33.131639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:33.131639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:33.161535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:33.162857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:33.314837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1928/3861] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:33.340578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:33.342688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:33.392227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:33.438593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3964f-2cd7-453b-8154-b20e95ea5eb1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:33.442853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:33.443641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:33.444106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:33.444473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:33.454789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:33.456611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:33.479144 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1934/3862] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:34.632967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:34.661369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d034e-82e1-4985-a00d-7ada56d2c267 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:34.669228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:34.669981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:34.670271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:34.670714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:34.673222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:34.727979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:34.769128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:34.770720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:34.804688 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1929/3863] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:37.048171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:37.062620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:37.080803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca7d0-8cce-4c5f-b305-560927aaf984 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:37.089090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:37.089886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:37.090241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:37.090612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:37.092636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:37.108259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:37.109845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0895bd7-8bce-4cea-8191-68a3f61b7d02 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:37.132026 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1935/3864] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:38.158722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:38.160578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:38.193181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a199ce-7a0b-4398-bba4-185d973097f5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:38.199419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:38.200526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:38.201053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:38.201894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] PATH_INFO: `/v3/users/8ae01397259c42adbdf5dc6aa8ee1871` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:38.203567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae01397259c42adbdf5dc6aa8ee1871)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:38.207256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:38.304798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae01397259c42adbdf5dc6aa8ee1871'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:38.323191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae01397259c42adbdf5dc6aa8ee1871'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:38.324248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae01397259c42adbdf5dc6aa8ee1871'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:38.336987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae01397259c42adbdf5dc6aa8ee1871'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:38.338320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae01397259c42adbdf5dc6aa8ee1871'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:38.361146 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1930/3865] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:00:38 2022] DELETE /identity/v3/users/8ae01397259c42adbdf5dc6aa8ee1871 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:38.362912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:38.363436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:38.363436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:38.418168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:38.424702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:38.562168 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1936/3866] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:38.584947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:38.587283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:38.718005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb24b8-5d8b-4ef8-bfb5-fcd1cc76d493 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:38.730466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f96a8c-1335-4605-b104-ffa5b60783fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:38.732978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96a8c-1335-4605-b104-ffa5b60783fc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:38.733894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96a8c-1335-4605-b104-ffa5b60783fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:38.734309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f96a8c-1335-4605-b104-ffa5b60783fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:38.766930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96a8c-1335-4605-b104-ffa5b60783fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:38.768401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f96a8c-1335-4605-b104-ffa5b60783fc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:38.785102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1931/3867] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:00:39.771031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:39.778319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:39.820147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c471645-bc39-425f-ab71-d86420dbece2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:39.831087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:39.833925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:39.834663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:39.835180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] PATH_INFO: `/v3/projects/870f44bf140f4b62828ffe0ce571f77f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:39.839219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=870f44bf140f4b62828ffe0ce571f77f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:39.841531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:40.003545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '870f44bf140f4b62828ffe0ce571f77f', 'request_id': 'req-69d2f58c-d89b-465b-b18f-6c1a74058814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:40.012653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:40.013264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:40.013264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:40.049445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '870f44bf140f4b62828ffe0ce571f77f', 'request_id': 'req-69d2f58c-d89b-465b-b18f-6c1a74058814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:40.091315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '870f44bf140f4b62828ffe0ce571f77f', 'request_id': 'req-69d2f58c-d89b-465b-b18f-6c1a74058814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:40.126734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] The token cache is being invalidate because project 870f44bf140f4b62828ffe0ce571f77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:00:40.127023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:40.127737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69d2f58c-d89b-465b-b18f-6c1a74058814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:40.128361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:40.132957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1937/3868] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:39 2022] DELETE /identity/v3/projects/870f44bf140f4b62828ffe0ce571f77f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:40.138238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dad7b-55df-456f-8807-b4fc6b873837 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:40.138534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dad7b-55df-456f-8807-b4fc6b873837 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:40.138807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6dad7b-55df-456f-8807-b4fc6b873837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:40.144930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:40.198796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4f6dad7b-55df-456f-8807-b4fc6b873837 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:40.200059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f6dad7b-55df-456f-8807-b4fc6b873837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:40.262656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:40.287671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:40.337991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1932/3869] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:40.430663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:40.432178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:40.502174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1938/3870] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:00:40.504169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:40.509193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:40.509763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:40.594576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:40.596705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:40.624263 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1939/3871] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:40.628416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:40.655556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce692bb2-2398-44a2-92cd-c8989778525d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:40.663924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:40.664834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:40.665331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:40.665851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:40.666958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:00:40.668821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:40.671756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:40.677240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1e2f4-2503-4b3e-88ad-34c34ba27b0d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:40.694026 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1940/3872] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:00:40.704245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:40.704913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:40.705404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:40.705889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:40.710122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:40.721655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:40.723598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:40.734075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b19352-e679-4bda-8445-dd6a188636a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:40.749568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:40.750886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:40.751318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:40.751757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:40.753207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:40.755731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:40.763016 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1933/3873] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:00:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:00:40.875754 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1941/3874] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:00:40 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:40.880172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:40.907415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ceb8a-2ce5-4ab1-848f-7df41c58f96d service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:41.193105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:41.198819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:41.199504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:41.199964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:41.200923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:41.207280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:41.326400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1934/3875] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:00:40 2022] POST /identity/v3/users => generated 288 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:41.327387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:41.352020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678269b-094e-4976-94bf-7208b7ad239f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:41.364750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:41.366334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:41.366926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:41.367862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:41.369338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:41.376287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:41.417157 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1942/3876] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:00:41.420197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:41.445241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317766e-ba9c-408a-88ff-25bb4706a261 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:41.466605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81db380-bf24-4cd5-ac60-65f7d7f720da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:41.467115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db380-bf24-4cd5-ac60-65f7d7f720da admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:41.467364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db380-bf24-4cd5-ac60-65f7d7f720da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:41.467639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81db380-bf24-4cd5-ac60-65f7d7f720da admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:41.498578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81db380-bf24-4cd5-ac60-65f7d7f720da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:41.498578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81db380-bf24-4cd5-ac60-65f7d7f720da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:41.550281 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1935/3877] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:41.554991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:41.580469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92074a38-6bc9-4bc5-a332-20d8f09ef4cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:41.590019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:41.591134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:41.591669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:41.592308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] PATH_INFO: `/v3/projects/189356634b6049a3a44bb701d8529d13/users/541c48e9a20d4b04a33018145c1fce9f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:41.629162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] RBAC: Authorizing `identity:create_grant(project_id=189356634b6049a3a44bb701d8529d13, user_id=541c48e9a20d4b04a33018145c1fce9f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:41.633230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:41.656669 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1943/3878] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:41 2022] PUT /identity/v3/projects/189356634b6049a3a44bb701d8529d13/users/541c48e9a20d4b04a33018145c1fce9f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:41.661984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27c2fc-e85a-4b3e-8e7f-81fa68f397b6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:41.662724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27c2fc-e85a-4b3e-8e7f-81fa68f397b6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:41.663258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27c2fc-e85a-4b3e-8e7f-81fa68f397b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:41.701775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9f27c2fc-e85a-4b3e-8e7f-81fa68f397b6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:41.703221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f27c2fc-e85a-4b3e-8e7f-81fa68f397b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:41.813836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:41.845152 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1936/3879] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:41.913634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:41.916446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:42.091601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60634ab-b70d-487d-959f-482afae2a18b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:42.101205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:42.102300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:42.102842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:42.103355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:42.124017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:42.126172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:42.151107 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1944/3880] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:44.353295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:44.354150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:44.354150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:44.419782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] MFA Rules not processed for user `ca33200afe954e1fa93584cec297c946`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:44.421584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:44.633112 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1937/3881] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:44.638067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:44.639477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:44.667207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4957ad-b7c0-4ac9-a56f-29f44ba7c44a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:44.694210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:44.698332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:44.701385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:44.703157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:44.705301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:44.713398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:44.801469 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1945/3882] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:00:44 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:44.805259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:44.821374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48cda-2dc2-4138-a04e-84d75bda848f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:45.043245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:45.044105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.044573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.045061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.047608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:45.053948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:45.146686 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1938/3883] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:00:44 2022] POST /identity/v3/users => generated 295 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:45.151125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:45.175190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e6f66-4ffd-4e52-a027-14c23b455592 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:45.191753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:45.203849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.204143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.204419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.205287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:45.217673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:45.251344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1946/3884] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:45.257179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:45.274129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c263-1bf3-4e85-bc47-0a53f828dca1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:45.286750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:45.288270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.288958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.289397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] PATH_INFO: `/v3/projects/ac4de8b88140448ea3213f9506bde8bf/users/3591b1f560f645f2a9ed684c09d8d22b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.315323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:45.317471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:45.345410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e76ca-2243-4ffc-a183-754e93978c4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:45.361298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:45.362540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.363928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.364971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4de8b88140448ea3213f9506bde8bf, user_id=3591b1f560f645f2a9ed684c09d8d22b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:45.365450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] PATH_INFO: `/v3/users/a3151f4e39a646e1a3ba3585bc00b2ab` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.368598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3151f4e39a646e1a3ba3585bc00b2ab)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:45.369217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:45.375192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:45.401455 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1939/3885] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:45 2022] PUT /identity/v3/projects/ac4de8b88140448ea3213f9506bde8bf/users/3591b1f560f645f2a9ed684c09d8d22b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:45.403096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:45.482403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:45.618124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3151f4e39a646e1a3ba3585bc00b2ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:45.621463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:45.633619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3151f4e39a646e1a3ba3585bc00b2ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:45.634563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3151f4e39a646e1a3ba3585bc00b2ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:45.655974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cfd614-237f-4d16-abdb-2e9793d9f195 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:45.665406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3151f4e39a646e1a3ba3585bc00b2ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:45.667082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf43254e-31e6-463b-8406-b6596df3e732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3151f4e39a646e1a3ba3585bc00b2ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:45.680664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:45.684707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.684982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.686514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.689731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:45.695722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:45.724399 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1947/3886] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:00:45 2022] DELETE /identity/v3/users/a3151f4e39a646e1a3ba3585bc00b2ab => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:45.724399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.724399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.724399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.725713 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1940/3887] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:00:45.726891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:45.731595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:45.764655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118efbc-edf0-42c5-9cc9-0228012e5534 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:45.767415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:45.770072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:45.920264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:45.924362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:45.924797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:45.925092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] PATH_INFO: `/v3/projects/ac4de8b88140448ea3213f9506bde8bf/users/3591b1f560f645f2a9ed684c09d8d22b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:45.933526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4de8b88140448ea3213f9506bde8bf, user_id=3591b1f560f645f2a9ed684c09d8d22b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:45.946427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:45.952803 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1948/3888] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:45.960813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:45.964165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:46.004848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1941/3889] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:45 2022] PUT /identity/v3/projects/ac4de8b88140448ea3213f9506bde8bf/users/3591b1f560f645f2a9ed684c09d8d22b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:46.119625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80485f71-78d3-4416-9a88-bc826eea2891 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:46.395414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:46.401048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:46.401368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:46.401970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:46.426290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:46.597749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:46.599899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:46.629309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1949/3890] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:48.000825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:48.003631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:48.046278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682e59-d2d8-4177-8dad-abbdefbc6fd6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:48.052577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:48.053523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:48.054033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:48.054549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] PATH_INFO: `/v3/projects/5d85e030cdfd49bfa36d55f2aa1a074c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:48.056943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d85e030cdfd49bfa36d55f2aa1a074c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:48.060288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:48.190659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d85e030cdfd49bfa36d55f2aa1a074c', 'request_id': 'req-e78056fe-f881-4dec-972a-d6eec48d534f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.213729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d85e030cdfd49bfa36d55f2aa1a074c', 'request_id': 'req-e78056fe-f881-4dec-972a-d6eec48d534f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.252279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d85e030cdfd49bfa36d55f2aa1a074c', 'request_id': 'req-e78056fe-f881-4dec-972a-d6eec48d534f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.321291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] The token cache is being invalidate because project 5d85e030cdfd49bfa36d55f2aa1a074c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:00:48.323013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.328853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.332967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1942/3891] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:47 2022] DELETE /identity/v3/projects/5d85e030cdfd49bfa36d55f2aa1a074c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:00:48.337649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:48.383058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90881656-d8b1-4c0d-bcda-d4b24b9829a2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:48.645506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:48.649656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:48.652376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:48.656696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] PATH_INFO: `/v3/users/985a3b7f43be4a66b55b1375fcc47b94` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:48.661004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985a3b7f43be4a66b55b1375fcc47b94)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:48.667326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:48.852733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985a3b7f43be4a66b55b1375fcc47b94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.878046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985a3b7f43be4a66b55b1375fcc47b94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.878665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985a3b7f43be4a66b55b1375fcc47b94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.898698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985a3b7f43be4a66b55b1375fcc47b94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.900409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7d509862-9050-4d1c-b119-5c76e11cc820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985a3b7f43be4a66b55b1375fcc47b94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:48.990337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1950/3892] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:00:48 2022] DELETE /identity/v3/users/985a3b7f43be4a66b55b1375fcc47b94 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:50.351151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:50.354064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:50.379291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78056fe-f881-4dec-972a-d6eec48d534f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:50.500607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:50.501279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:50.501556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:50.501854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] PATH_INFO: `/v3/projects/97cd5cd1287c4e5182d6485358b33d24` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:50.503248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97cd5cd1287c4e5182d6485358b33d24)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:50.505236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:50.530837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:50.633563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97cd5cd1287c4e5182d6485358b33d24', 'request_id': 'req-6e84fffa-a414-4e21-80df-bc0d044fb062'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:50.647501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97cd5cd1287c4e5182d6485358b33d24', 'request_id': 'req-6e84fffa-a414-4e21-80df-bc0d044fb062'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:50.662425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97cd5cd1287c4e5182d6485358b33d24', 'request_id': 'req-6e84fffa-a414-4e21-80df-bc0d044fb062'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:50.788819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] The token cache is being invalidate because project 97cd5cd1287c4e5182d6485358b33d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:00:50.789568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:50.793846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e84fffa-a414-4e21-80df-bc0d044fb062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:50.797004 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1943/3893] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:00:50 2022] DELETE /identity/v3/projects/97cd5cd1287c4e5182d6485358b33d24 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:50.803638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:50.804152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:50.804270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:50.886263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:50.889987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:50.972691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:51.139769 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1951/3894] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:51.146805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.147097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.147375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.188110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:51.189372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:51.207608 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1944/3895] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:51.213137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:51.241126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d7b4d-bd82-4941-96af-78509044c3ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:51.261188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:51.267408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.267408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.267408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.271382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:00:51.271382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:51.276384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:51.340844 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1952/3896] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:00:51.341858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:51.354730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebeb972-57ab-4e2f-8dd9-01409367624c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:51.366565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:51.367497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.367847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.369268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.370931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:51.376934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:51.434325 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1945/3897] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:00:51 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:51.438812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:51.458066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8821500-a9b3-4564-9aac-96f32eb002a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:51.631736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:51.633437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.634030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.634546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.635581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:51.638975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:51.689818 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1953/3898] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:00:51 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:00:51.694341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:51.705579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eee49-e18d-468d-afa2-ece2b5045577 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:51.729540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:51.733312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.735317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.735648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.737648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:51.739450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:51.783379 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1946/3899] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:51.784887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:51.799431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350b105-7878-40b9-85a3-effcd6de7e9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:51.811011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893fcdb-d65d-422a-9b48-a560da1e032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:51.813371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893fcdb-d65d-422a-9b48-a560da1e032f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.815989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893fcdb-d65d-422a-9b48-a560da1e032f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.816763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893fcdb-d65d-422a-9b48-a560da1e032f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.818810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893fcdb-d65d-422a-9b48-a560da1e032f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:51.823391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893fcdb-d65d-422a-9b48-a560da1e032f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:51.869856 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1954/3900] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:51.872965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:51.886009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffc0bb-72e7-4ca2-b940-8f575cbed6c5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:51.914672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:51.915371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:51.915671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:51.915929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] PATH_INFO: `/v3/projects/40b39d3645764c74ab59a8e0e1f11cdb/users/caa0257cf6a6466a8ec5e5dd98da6289/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:51.968118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b39d3645764c74ab59a8e0e1f11cdb, user_id=caa0257cf6a6466a8ec5e5dd98da6289, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:51.971187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:52.029839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1947/3901] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:51 2022] PUT /identity/v3/projects/40b39d3645764c74ab59a8e0e1f11cdb/users/caa0257cf6a6466a8ec5e5dd98da6289/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:52.036672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:52.037342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:52.037879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:52.088483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] MFA Rules not processed for user `caa0257cf6a6466a8ec5e5dd98da6289`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:52.090541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:52.363274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:52.365532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1955/3902] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:52.605717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79944f1-7d01-49eb-a7d5-aeafe37525a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:52.618833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:52.621011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:52.622041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:52.622557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:52.624057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:52.631231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:52.730660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1948/3903] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:00:52 2022] POST /identity/v3/projects => generated 395 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:52.746350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:52.778315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1103b44-8a3c-410b-a281-ec978731e527 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:52.844943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:52.945758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:52.948969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:52.949262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:52.949584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:52.950550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:52.953210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:52.994360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1956/3904] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:00:52 2022] POST /identity/v3/users => generated 304 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:00:52.998279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:53.018690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb645471-67c8-4eef-a0a1-ae50e45e135e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:53.032482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:53.033330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:53.036401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:53.036401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:53.039346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:53.043113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:53.134645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:53.138703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1949/3905] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:00:53.158700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6bacc-b8e1-472e-b409-9ff653637e69 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:53.208890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:53.209596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:53.209901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:53.210170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] PATH_INFO: `/v3/projects/c5ccbcc6d55c4b0eba64bd7b54b574f0/users/3b00bb934de841b1aa415844cda304ba/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:53.280970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ccbcc6d55c4b0eba64bd7b54b574f0, user_id=3b00bb934de841b1aa415844cda304ba, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:53.283816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:53.326189 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1957/3906] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:53 2022] PUT /identity/v3/projects/c5ccbcc6d55c4b0eba64bd7b54b574f0/users/3b00bb934de841b1aa415844cda304ba/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:53.330232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:53.342978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:53.355757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66cb66-d8c4-4e40-89e1-e0ef436f6bae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:53.566136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a1c9d-afb5-406f-8a65-86155c0c4f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:53.569883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1c9d-afb5-406f-8a65-86155c0c4f57 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:53.570259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1c9d-afb5-406f-8a65-86155c0c4f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:53.571135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1c9d-afb5-406f-8a65-86155c0c4f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:53.574538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a1c9d-afb5-406f-8a65-86155c0c4f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:53.578896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a1c9d-afb5-406f-8a65-86155c0c4f57 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:53.617952 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1950/3907] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:00:53 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:00:53.622282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:53.636617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff025c-e3b3-4ad0-9523-3c8ec1a9e511 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:53.651285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:53.652052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:53.652363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:53.652663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] PATH_INFO: `/v3/projects/c5ccbcc6d55c4b0eba64bd7b54b574f0/users/3b00bb934de841b1aa415844cda304ba/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:53.659394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ccbcc6d55c4b0eba64bd7b54b574f0, user_id=3b00bb934de841b1aa415844cda304ba, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:53.667839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:53.702810 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1958/3908] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:00:53 2022] PUT /identity/v3/projects/c5ccbcc6d55c4b0eba64bd7b54b574f0/users/3b00bb934de841b1aa415844cda304ba/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:53.711021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:53.711456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:53.711841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:53.804206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] MFA Rules not processed for user `3b00bb934de841b1aa415844cda304ba`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:53.805124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:54.077159 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1951/3909] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:54.209993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:54.213148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:54.431183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb2c0-0c41-4a44-9755-9ade15732cfd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:54.457136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:54.458315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:54.458839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:54.459380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:54.476019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:54.479603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:54.533527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1959/3910] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:54 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:56.483580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:56.485520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:56.651931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b4a96-4c69-4796-9979-e226188bb763 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:56.656388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:56.657070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:56.657348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:56.657618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:56.659558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:56.741095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:56.743060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:56.763944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:56.777683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13cbd9-9132-4dc0-852c-a7bad42448e5 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:56.798596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c772046-a943-4b26-9924-91f5e5f77d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:56.799768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c772046-a943-4b26-9924-91f5e5f77d83 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:56.801262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c772046-a943-4b26-9924-91f5e5f77d83 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:56.802830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c772046-a943-4b26-9924-91f5e5f77d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:56.826632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:56.829461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:56.857181 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1952/3911] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:56.990754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:00:57.004761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c772046-a943-4b26-9924-91f5e5f77d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:57.006824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c772046-a943-4b26-9924-91f5e5f77d83 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:57.032570 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1960/3912] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:56 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:00:57.077694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:57.093838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef3dd4-6c43-4c68-9cf1-46fecb48db7c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:57.122378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:57.123046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:57.123326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:57.123599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] PATH_INFO: `/v3/users/caa0257cf6a6466a8ec5e5dd98da6289` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:57.132493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa0257cf6a6466a8ec5e5dd98da6289)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:57.134515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:57.315158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa0257cf6a6466a8ec5e5dd98da6289'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:57.375638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa0257cf6a6466a8ec5e5dd98da6289'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:57.378264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa0257cf6a6466a8ec5e5dd98da6289'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:57.394631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa0257cf6a6466a8ec5e5dd98da6289'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:57.400221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa0257cf6a6466a8ec5e5dd98da6289'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:00:57.440450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1953/3913] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:00:57 2022] DELETE /identity/v3/users/caa0257cf6a6466a8ec5e5dd98da6289 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:00:57.445060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe048f-e1cd-468d-a141-0d09e73cce26 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:57.445704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe048f-e1cd-468d-a141-0d09e73cce26 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:57.446110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe048f-e1cd-468d-a141-0d09e73cce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:57.499135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a9fe048f-e1cd-468d-a141-0d09e73cce26 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:00:57.502877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9fe048f-e1cd-468d-a141-0d09e73cce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:57.727501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1961/3914] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:00:57.928623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:00:57.932560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:00:58.141729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f096fe-3b7b-45b5-91ba-d52d0ae9e130 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:00:58.147150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adb84c-fa97-4e5b-8cba-13ecd402f8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:00:58.148216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adb84c-fa97-4e5b-8cba-13ecd402f8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:00:58.148523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adb84c-fa97-4e5b-8cba-13ecd402f8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:00:58.149038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adb84c-fa97-4e5b-8cba-13ecd402f8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:00:58.179351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adb84c-fa97-4e5b-8cba-13ecd402f8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:00:58.181641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adb84c-fa97-4e5b-8cba-13ecd402f8b9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:00:58.203450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1954/3915] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:00.324581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:00.325066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:00.325399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:00.359343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] MFA Rules not processed for user `0bb215bc0435419eb2659aceb19ea58a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:00.360799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:00.407309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26bab2-7ca5-42a8-b1ea-a5281216be63 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:00.407734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26bab2-7ca5-42a8-b1ea-a5281216be63 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:00.407839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26bab2-7ca5-42a8-b1ea-a5281216be63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:00.494744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4a26bab2-7ca5-42a8-b1ea-a5281216be63 None None] MFA Rules not processed for user `541c48e9a20d4b04a33018145c1fce9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:00.496035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a26bab2-7ca5-42a8-b1ea-a5281216be63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:00.562393 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1962/3916] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:00.572150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:00.574839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:00.626695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ac5de-2a20-4870-a559-6305b06f965a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:00.638435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:00.639184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:00.639574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:00.640317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] PATH_INFO: `/v3/projects/40b39d3645764c74ab59a8e0e1f11cdb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:00.641448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b39d3645764c74ab59a8e0e1f11cdb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:00.643686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:00.650664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:00.753135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1955/3917] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:00.754592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:00.754911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:00.755192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:00.763221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b39d3645764c74ab59a8e0e1f11cdb', 'request_id': 'req-b6899146-fd31-46b5-97ab-735a8dcda857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:00.771504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b39d3645764c74ab59a8e0e1f11cdb', 'request_id': 'req-b6899146-fd31-46b5-97ab-735a8dcda857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:00.786321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b39d3645764c74ab59a8e0e1f11cdb', 'request_id': 'req-b6899146-fd31-46b5-97ab-735a8dcda857'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:00.795705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] MFA Rules not processed for user `0bb215bc0435419eb2659aceb19ea58a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:00.796938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:00.804528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] The token cache is being invalidate because project 40b39d3645764c74ab59a8e0e1f11cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:01:00.804819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:00.807939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b6899146-fd31-46b5-97ab-735a8dcda857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:00.811116 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1963/3918] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:00 2022] DELETE /identity/v3/projects/40b39d3645764c74ab59a8e0e1f11cdb => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:00.814061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:00.817249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:00.817881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:00.864312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] MFA Rules not processed for user `541c48e9a20d4b04a33018145c1fce9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:00.867803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:00.917225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:00.940603 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1956/3919] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:00.944758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:00.971048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:01.078846 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1964/3920] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:01.095085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:01.097970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:01.274777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115af7b-a7c9-407d-b236-1429beb509aa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:01.288697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:01.289831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:01.290375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:01.290870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] PATH_INFO: `/v3/users/3b00bb934de841b1aa415844cda304ba` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:01.292317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b00bb934de841b1aa415844cda304ba)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:01.295199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:01.342583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a798dc4-b633-4d42-955a-2253feee8323 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:01.354894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:01.356931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:01.358057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:01.358365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:01.364633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:01.400215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:01.404847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:01.428221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1965/3921] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:01.459991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b00bb934de841b1aa415844cda304ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:01.511939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b00bb934de841b1aa415844cda304ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:01.528121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b00bb934de841b1aa415844cda304ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:01.554867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b00bb934de841b1aa415844cda304ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:01.558415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eac4c027-0d0a-463f-825a-ea2baeb1e764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b00bb934de841b1aa415844cda304ba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:01.598286 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1957/3922] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:01:00 2022] DELETE /identity/v3/users/3b00bb934de841b1aa415844cda304ba => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:02.862690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:02.876381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6985fc-de81-45cc-940f-90fb0c1dd181 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:02.995481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:02.996681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:02.997180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:02.997664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] PATH_INFO: `/v3/projects/c5ccbcc6d55c4b0eba64bd7b54b574f0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:02.999756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ccbcc6d55c4b0eba64bd7b54b574f0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:03.003146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:03.194278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ccbcc6d55c4b0eba64bd7b54b574f0', 'request_id': 'req-cdad7fab-af5a-46b1-aacb-48eca3591632'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:03.206958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ccbcc6d55c4b0eba64bd7b54b574f0', 'request_id': 'req-cdad7fab-af5a-46b1-aacb-48eca3591632'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:03.209594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:03.224163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ccbcc6d55c4b0eba64bd7b54b574f0', 'request_id': 'req-cdad7fab-af5a-46b1-aacb-48eca3591632'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:03.260444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] The token cache is being invalidate because project c5ccbcc6d55c4b0eba64bd7b54b574f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:01:03.262928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:03.264497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cdad7fab-af5a-46b1-aacb-48eca3591632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:03.271075 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1966/3923] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:02 2022] DELETE /identity/v3/projects/c5ccbcc6d55c4b0eba64bd7b54b574f0 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:03.272610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:03.273095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:03.273189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:03.285788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:03.329181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:03.330488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:03.614206 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1958/3924] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:03.617626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:03.618654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:03.619565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:03.675973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:03.679077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:03.706945 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1967/3925] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:03.707972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:03.742383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8a49-d960-4618-8909-961f2febfd77 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:03.764450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:03.774031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:03.774410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:03.775286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:03.776032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:01:03.776344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:03.778110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:03.814335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:03.815017 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1959/3926] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:01:03.824847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964235b2-df7d-453e-a52a-ffc80d94635d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:03.842680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:03.844845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:03.844845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:03.844845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:03.847489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:03.850670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:03.929288 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1968/3927] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:01:03 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:01:03.931770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:03.953686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490495-23a8-402b-9371-e9c797aaf5d7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:04.098596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:04.098821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.098963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.099530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:04.100248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:04.102496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:04.164328 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1960/3928] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:01:03 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:04.168488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:04.191733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398db83c-3a5d-4ad8-8acd-a4c39c97c218 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:04.221435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:04.226246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.226805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.228557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:04.230580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:04.235140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:04.267301 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1969/3929] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:04.268495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:04.284568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127ee4b-c73f-4af9-823c-6fab7d01ca6f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:04.309064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc9796-6237-48eb-85e4-c7a326c3744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:04.314521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc9796-6237-48eb-85e4-c7a326c3744d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.315101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc9796-6237-48eb-85e4-c7a326c3744d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.318562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc9796-6237-48eb-85e4-c7a326c3744d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:04.319443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc9796-6237-48eb-85e4-c7a326c3744d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:04.326892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc9796-6237-48eb-85e4-c7a326c3744d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:04.409436 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1961/3930] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:04.410892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:04.421583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731fa65-263c-41e9-8098-0066ded3dc7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:04.436341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f404c451-5e49-4d2c-86db-35353043ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:04.437493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c451-5e49-4d2c-86db-35353043ec55 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.438074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c451-5e49-4d2c-86db-35353043ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.438593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f404c451-5e49-4d2c-86db-35353043ec55 admin admin] PATH_INFO: `/v3/projects/6f701d727812417a860406464cf0f757/users/aa0f9eced1ff41e281ed82bb0465a58b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:04.477772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c451-5e49-4d2c-86db-35353043ec55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f701d727812417a860406464cf0f757, user_id=aa0f9eced1ff41e281ed82bb0465a58b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:04.480604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f404c451-5e49-4d2c-86db-35353043ec55 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:04.497914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1970/3931] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:01:04 2022] PUT /identity/v3/projects/6f701d727812417a860406464cf0f757/users/aa0f9eced1ff41e281ed82bb0465a58b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:04.511480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.511763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.512029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:04.562740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:04.563514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:04.667487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.667775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.668177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:04.749775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] MFA Rules not processed for user `3591b1f560f645f2a9ed684c09d8d22b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:04.751653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:04.782998 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1962/3932] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:04.790508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:04.792253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:04.846303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:04.919152 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1971/3933] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:04.966783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7612-0043-475a-8075-bea3eb1a85a3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:04.975918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:04.978800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:04.979214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:04.981776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:05.003936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:05.006433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:05.053044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1963/3934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:05.382936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:05.385737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:05.660879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:05.681392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750d376-1cae-4d3f-92dd-1ccbb43df685 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:05.699271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:05.701371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:05.701857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:05.703130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:05.730333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:05.735979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:05.779383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1972/3935] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:08.184329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:08.186272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:08.212519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40591b-b601-431e-a806-f3f42d35d077 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:08.235300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:08.235985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:08.236265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:08.236598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:08.252244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:08.312669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:08.314214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:08.332604 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1964/3936] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:10.609745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:10.627580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c2e10-affc-4085-8535-dafc4fa9fefd service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:10.634737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:10.635317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:10.635598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:10.635992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:10.637641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:10.665180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:10.666602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00318fe3-89bd-422a-bcc8-95dfc89d18e5 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:10.682824 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1973/3937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:13.066546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:13.069290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:13.090265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfd853-3ff6-4a68-9066-6e4a587e84fb service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:13.096525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:13.097626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:13.098268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:13.098783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] PATH_INFO: `/v3/users/fceb096cc5414b3a9d7300fefeb90dff` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:13.100229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fceb096cc5414b3a9d7300fefeb90dff)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:13.103138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:13.219893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fceb096cc5414b3a9d7300fefeb90dff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:13.237593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fceb096cc5414b3a9d7300fefeb90dff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:13.241269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fceb096cc5414b3a9d7300fefeb90dff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:13.251075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fceb096cc5414b3a9d7300fefeb90dff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:13.252085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33461dd8-fad0-4cb9-82ac-fa93ca8c99f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fceb096cc5414b3a9d7300fefeb90dff'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:13.279937 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1965/3938] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:01:13 2022] DELETE /identity/v3/users/fceb096cc5414b3a9d7300fefeb90dff => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:13.882719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6ea3-2642-4f09-a5d9-65a5fa121d22 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:13.884028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6ea3-2642-4f09-a5d9-65a5fa121d22 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:13.884507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b6ea3-2642-4f09-a5d9-65a5fa121d22 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:13.890406 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1974/3939] 10.222.0.16 () {54 vars in 921 bytes} [Sat Oct 29 03:01:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:01:13.907203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:13.907872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:13.913436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:13.976776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b6ea3-2642-4f09-a5d9-65a5fa121d22 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:13.978737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-922b6ea3-2642-4f09-a5d9-65a5fa121d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:13.998215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:14.008188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:14.119352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:14.170968 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1966/3940] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:01:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:14.178763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b6ea3-2642-4f09-a5d9-65a5fa121d22 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:14.184287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:14.185286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.185613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.185997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] PATH_INFO: `/v3/projects/616962eaa7c0469bb81953b54e70afad` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.188116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=616962eaa7c0469bb81953b54e70afad)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:14.191270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:14.204394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:14.210457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:14.354570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616962eaa7c0469bb81953b54e70afad', 'request_id': 'req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:14.364793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616962eaa7c0469bb81953b54e70afad', 'request_id': 'req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:14.374170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616962eaa7c0469bb81953b54e70afad', 'request_id': 'req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:14.385218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d949e0-aeaf-4acc-8eb5-f0d1aae9266e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:14.401359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] The token cache is being invalidate because project 616962eaa7c0469bb81953b54e70afad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:01:14.402127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:14.404151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4fe22228-ddd6-49e7-8d26-c56bbe6a6b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:14.410612 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1975/3941] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:13 2022] DELETE /identity/v3/projects/616962eaa7c0469bb81953b54e70afad => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:14.412767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027fb3-1f21-4d63-9e45-7b1510a3d896 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.413385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027fb3-1f21-4d63-9e45-7b1510a3d896 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.414367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3027fb3-1f21-4d63-9e45-7b1510a3d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.441184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d3027fb3-1f21-4d63-9e45-7b1510a3d896 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:14.443309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d3027fb3-1f21-4d63-9e45-7b1510a3d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:14.503006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:14.504223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.505259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.505941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.510349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:14.638912 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1976/3942] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:14.647485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.647901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.648038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.672284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:14.674493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:14.690843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1967/3943] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:14.691231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:14.693866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:14.707407 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1977/3944] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:14.713175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:14.740921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3404094-4033-4822-bc48-261dd969df3a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:14.747367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:14.748423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.748905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.750697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.751696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:01:14.752198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:14.754047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:14.772879 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1968/3945] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:01:14.778301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:14.783366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:14.791465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1029b1-3004-4ef4-b833-b91dae4a3459 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:14.807558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:14.808314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.808703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.809041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.809770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:14.813789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:14.863930 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1978/3946] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:01:14 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:14.869442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:14.886863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fffccb-89ea-4a2e-8e57-2dad90ad38a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:14.943555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:14.947021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:14.949372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:14.979068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:14.979847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:14.980286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:14.980652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:14.981787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:14.983644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:15.025282 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1969/3947] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:01:14 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:15.032453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:15.063660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8de3a-7819-48da-9c82-7890e82f1259 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:15.077237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:15.078340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.079351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.080954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.081919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:15.085616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:15.113920 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1970/3948] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:15.115986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:15.146968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a527262-7da4-4339-b6f5-0bf33f5a6181 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:15.163936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:15.172249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4441b-fb05-475b-a844-ba415ebf1618 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:15.173101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.177792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.178545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.179221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:15.184344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:15.188943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:15.189590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.189900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.190408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.195018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:15.207188 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1971/3949] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:15.211955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:15.223721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:15.225554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8168ab3-8c0e-463f-9650-7b1556a18ba5 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:15.230735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca56276-f445-4ce8-8ff2-8e9c6fc49de7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:15.238446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:15.239867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.240335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.240788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] PATH_INFO: `/v3/projects/d4193e4464b7488b9b3bb4064afb0288/users/dc4e17d222e0426698d1ef9a17921d64/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.252290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1979/3950] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:01:15.272858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4193e4464b7488b9b3bb4064afb0288, user_id=dc4e17d222e0426698d1ef9a17921d64, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:15.280820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:15.317507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1972/3951] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:01:15 2022] PUT /identity/v3/projects/d4193e4464b7488b9b3bb4064afb0288/users/dc4e17d222e0426698d1ef9a17921d64/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:15.319086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683b4e-908f-4eaf-9d0e-689de194408d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.319448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683b4e-908f-4eaf-9d0e-689de194408d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.319793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683b4e-908f-4eaf-9d0e-689de194408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.356929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5e683b4e-908f-4eaf-9d0e-689de194408d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:15.358413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5e683b4e-908f-4eaf-9d0e-689de194408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:15.510181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1980/3952] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:15.530401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:15.532498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:15.656951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.657968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.658243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.675931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453384b-1eae-4ac8-95f6-25c02f3b3694 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:15.681080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:15.682013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:15.682639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:15.683077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:15.697323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:15.699260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:15.700275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] MFA Rules not processed for user `adb51369444c42c190b1b7bf5e23ddb9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:15.706427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:15.725531 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1973/3953] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:15.857105 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1981/3954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:18.503437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:18.503437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:18.523629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6fd5c-e0d4-4eab-a2da-c894b9d121a0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:18.564659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:18.566624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:18.567959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:18.574902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:18.586031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:18.631853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:18.639572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:18.680653 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1974/3955] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:19.981143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:20.006037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401b95d-5f1a-443c-8bb0-a181c8ebd0fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:20.028969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:20.029621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:20.029928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:20.030204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:20.039718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:20.063739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:20.065212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:20.084647 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1982/3956] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:21.791293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:21.793835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:22.050644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2b1d6-71c0-4363-9acd-2da82724a418 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:22.074046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:22.075165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:22.075702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:22.076200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:22.083008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:22.106936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:22.116791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:22.119068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:22.146362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1975/3957] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:01:22.417496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:22.419568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:22.424594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:22.563247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c491ba1-7c8c-48b8-987b-d6a59cb56a0f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:22.568779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:22.569663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:22.570203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:22.570683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:22.572756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:22.602785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:22.604444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68008ee0-e372-41d7-9f1c-d55220438991 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:22.636423 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1983/3958] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:23.034090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:23.051768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba354929-36b3-47a2-bf3a-85d4b6fc8ab3 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:23.056529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:23.057173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:23.057451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:23.057719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:23.070178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:23.087087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:23.088952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:23.114324 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1976/3959] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:26.407477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:26.408061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:26.408061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:26.493621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] MFA Rules not processed for user `aa0f9eced1ff41e281ed82bb0465a58b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:26.495260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:26.726563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:26.729207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:26.740182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1984/3960] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:26.754201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8339777-f477-4f3f-862f-c00e069482d0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:26.773367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:26.774456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:26.776059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:26.776847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:26.777726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:26.786406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:26.855130 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1977/3961] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:01:26 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:26.859456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:26.882597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bd7c2-c28d-47c7-9171-6e57f24d117d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:27.174442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:27.175288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:27.175612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:27.176138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:27.176804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:27.188244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:27.248015 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1985/3962] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:01:26 2022] POST /identity/v3/users => generated 298 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:27.249326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:27.268726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371e9f2-b194-443e-86b2-d5450053f6b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:27.290232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:27.290977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:27.291258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:27.291534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:27.292192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:27.293889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:27.332642 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1978/3963] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:27.336992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:27.355299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2e96d-8181-424f-b32d-623710f52f4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:27.379936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:27.380654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:27.390122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:27.390422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] PATH_INFO: `/v3/projects/0215f0cfe2da4db7aa63ee37b50b090c/users/69929b60d43a48e39c99989d804c61d1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:27.455721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0215f0cfe2da4db7aa63ee37b50b090c, user_id=69929b60d43a48e39c99989d804c61d1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:27.467056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:27.489045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:27.499174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1986/3964] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:01:27 2022] PUT /identity/v3/projects/0215f0cfe2da4db7aa63ee37b50b090c/users/69929b60d43a48e39c99989d804c61d1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:27.503315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:27.522753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfd646-7625-467c-bcdf-5008938692d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:27.673533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:27.674227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:27.674502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:27.674770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:27.675415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:27.677204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:27.720874 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1979/3965] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:27.724330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:27.746553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b64ac8-ca63-42ad-a7e8-0ceb5276578f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:27.762468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88213500-f6ba-4e91-979c-5bfe1138a342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:27.763248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213500-f6ba-4e91-979c-5bfe1138a342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:27.763422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213500-f6ba-4e91-979c-5bfe1138a342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:27.763695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88213500-f6ba-4e91-979c-5bfe1138a342 admin admin] PATH_INFO: `/v3/projects/0215f0cfe2da4db7aa63ee37b50b090c/users/69929b60d43a48e39c99989d804c61d1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:27.773847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213500-f6ba-4e91-979c-5bfe1138a342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0215f0cfe2da4db7aa63ee37b50b090c, user_id=69929b60d43a48e39c99989d804c61d1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:27.778807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88213500-f6ba-4e91-979c-5bfe1138a342 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:27.805461 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1987/3966] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:01:27 2022] PUT /identity/v3/projects/0215f0cfe2da4db7aa63ee37b50b090c/users/69929b60d43a48e39c99989d804c61d1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:29.001314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:29.204832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf96f65-bd05-4376-a47e-25c8de0257e5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:29.323842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:29.398810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:29.399637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:29.400024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:29.400327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:29.406894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:29.459698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:29.463443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:29.501538 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1980/3967] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:37.799132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:38.497666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:38.497986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:38.498264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:38.626707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] MFA Rules not processed for user `dc4e17d222e0426698d1ef9a17921d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:38.627958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:38.842951 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1988/3968] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:39.190911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:39.214149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba618-358a-4ab4-bd13-8ca1b7632a17 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:39.228210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:39.228861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:39.229394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:39.229728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:39.250459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:39.254964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:39.269180 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1981/3969] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:41.857586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:41.862734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:42.061448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65855f2b-e107-4476-9f4d-27fe8be58a23 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:42.075928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:42.076852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:42.077298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:42.077773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] PATH_INFO: `/v3/users/a878e1202c3d442fb55052e841589eb7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:42.079158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a878e1202c3d442fb55052e841589eb7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:42.081163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:42.210049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a878e1202c3d442fb55052e841589eb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:42.225347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a878e1202c3d442fb55052e841589eb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:42.226320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a878e1202c3d442fb55052e841589eb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:42.258560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a878e1202c3d442fb55052e841589eb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:42.259573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-02bf7842-3f5f-4030-86db-aca310e30eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a878e1202c3d442fb55052e841589eb7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:42.289444 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1989/3970] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:01:41 2022] DELETE /identity/v3/users/a878e1202c3d442fb55052e841589eb7 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:45.951970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:45.971756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369e305-b731-4d02-9f42-bd16070262e4 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:46.203920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:46.204745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:46.205125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:46.205505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] PATH_INFO: `/v3/projects/548a0a34ffec4fe8959e88faab0fb154` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:46.208286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=548a0a34ffec4fe8959e88faab0fb154)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:46.215026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:46.327164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '548a0a34ffec4fe8959e88faab0fb154', 'request_id': 'req-62a3b3b0-6739-4d7a-b629-a813b72e0d30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:46.346233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '548a0a34ffec4fe8959e88faab0fb154', 'request_id': 'req-62a3b3b0-6739-4d7a-b629-a813b72e0d30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:46.369365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '548a0a34ffec4fe8959e88faab0fb154', 'request_id': 'req-62a3b3b0-6739-4d7a-b629-a813b72e0d30'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:46.390086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] The token cache is being invalidate because project 548a0a34ffec4fe8959e88faab0fb154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:01:46.391301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:46.393070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-62a3b3b0-6739-4d7a-b629-a813b72e0d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:46.400178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1982/3971] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:01:45 2022] DELETE /identity/v3/projects/548a0a34ffec4fe8959e88faab0fb154 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:46.402614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:46.403080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:46.404202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:46.436000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:46.437795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:46.446194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:46.553491 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1990/3972] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:46.563505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:46.564089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:46.564565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:46.608499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:46.609989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:46.626831 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1983/3973] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:46.639025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:46.659024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52135177-0d41-455f-b0a0-32d767b668ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:46.670385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:46.671345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:46.674246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:46.674771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:46.677482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:01:46.678091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:46.681551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:46.717057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:46.731224 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1991/3974] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:01:46.731454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c22c74-c3cf-404a-9303-0a6d0ee85144 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:46.744366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:46.746486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:46.746844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:46.747772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:46.748500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:46.753126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:46.828776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:46.838962 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1984/3975] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:01:46 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:46.844014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748a2b1-31d0-41d7-b4f7-fa415e8ed669 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:46.975170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:46.977069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:46.977647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:46.978068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:46.978817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:46.982015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:47.017903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1992/3976] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:01:46 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:01:47.019497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:47.033502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9985-aed0-4f1a-8c32-e78303546115 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:47.040189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:47.041182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.041727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.042596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.043468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:47.052378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:47.070977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1985/3977] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:01:47.073408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:47.090003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93e507-92ce-4c73-badb-fadeb1db4dd8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:47.096462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b5a8c-5cb2-4ae4-9ed2-6dfc8a34a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:47.098491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5a8c-5cb2-4ae4-9ed2-6dfc8a34a0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.099417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5a8c-5cb2-4ae4-9ed2-6dfc8a34a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.099417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b5a8c-5cb2-4ae4-9ed2-6dfc8a34a0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.100058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5a8c-5cb2-4ae4-9ed2-6dfc8a34a0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:47.102618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b5a8c-5cb2-4ae4-9ed2-6dfc8a34a0e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:47.122102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:47.132028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:47.132653 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1993/3978] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:01:47.137962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15c512-3d1b-4cdc-8ed0-b61018761fb5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:47.144481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:47.145682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.146416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.147349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] PATH_INFO: `/v3/projects/ff2d630709a746e386bbb39de2d56cfa/users/8c62bd2c7acf4c5ea9f7a9edae332de0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.167626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2d630709a746e386bbb39de2d56cfa, user_id=8c62bd2c7acf4c5ea9f7a9edae332de0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:47.170839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:47.197094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1986/3979] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:01:47 2022] PUT /identity/v3/projects/ff2d630709a746e386bbb39de2d56cfa/users/8c62bd2c7acf4c5ea9f7a9edae332de0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:01:47.200385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa497eb-f1d3-40cc-b67a-a92f71e4bc6a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.201071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa497eb-f1d3-40cc-b67a-a92f71e4bc6a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.201449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa497eb-f1d3-40cc-b67a-a92f71e4bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.225246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7fa497eb-f1d3-40cc-b67a-a92f71e4bc6a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:47.226743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fa497eb-f1d3-40cc-b67a-a92f71e4bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:47.305900 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1994/3980] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:47.331053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:47.334817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:47.469561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2f95a-a4a4-4988-89f1-194997944423 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:47.481065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:47.483853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.484146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.484428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.514019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:47.519685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:47.549102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8cbb-1705-466d-bf1a-7bc79d77fabf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.550119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8cbb-1705-466d-bf1a-7bc79d77fabf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.550604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8cbb-1705-466d-bf1a-7bc79d77fabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.551928 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1987/3981] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:47.634332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-963f8cbb-1705-466d-bf1a-7bc79d77fabf None None] MFA Rules not processed for user `69929b60d43a48e39c99989d804c61d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:47.636095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-963f8cbb-1705-466d-bf1a-7bc79d77fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:47.647964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:47.785559 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1995/3982] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:47.807710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:47.808988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:47.884752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.885369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.885903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:47.922755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] MFA Rules not processed for user `dc4e17d222e0426698d1ef9a17921d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:47.924107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:47.962659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca0d31-fe7c-478d-8a0b-26449dd4d27b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:47.984423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe8494-9dc3-4fee-827c-feb99e849ab6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:47.987613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe8494-9dc3-4fee-827c-feb99e849ab6 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:47.999116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe8494-9dc3-4fee-827c-feb99e849ab6 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:47.999688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe8494-9dc3-4fee-827c-feb99e849ab6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:48.021712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe8494-9dc3-4fee-827c-feb99e849ab6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:48.023955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fe8494-9dc3-4fee-827c-feb99e849ab6 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:48.077356 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1988/3983] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:47 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:48.094894 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1996/3984] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:48.727566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510a417-1056-433b-9caa-673afda0872e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:48.728255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510a417-1056-433b-9caa-673afda0872e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:48.728733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510a417-1056-433b-9caa-673afda0872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:48.816111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5510a417-1056-433b-9caa-673afda0872e None None] MFA Rules not processed for user `541c48e9a20d4b04a33018145c1fce9f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:48.818654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5510a417-1056-433b-9caa-673afda0872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:49.116580 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1989/3985] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:01:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:50.776472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:50.799233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03970ad7-6405-4873-b8e8-611e9298c1dc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:50.812997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:50.814170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:50.814764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:50.815910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:50.820936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:50.857841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:50.863593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:50.902473 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1997/3986] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:01:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:01:52.498521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:52.499503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:52.499961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:52.584521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:01:52.588350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:52.671822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:01:52.737027 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1990/3987] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:01:52.887080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:52.888678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:53.151717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69d9c-bb7a-45e5-b766-51b98687af14 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:53.172842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5894ce64-3ea7-4d62-828f-127c75ed1ddd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:53.174747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ce64-3ea7-4d62-828f-127c75ed1ddd service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:53.176677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ce64-3ea7-4d62-828f-127c75ed1ddd service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:53.178882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5894ce64-3ea7-4d62-828f-127c75ed1ddd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:53.208512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894ce64-3ea7-4d62-828f-127c75ed1ddd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:53.212160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5894ce64-3ea7-4d62-828f-127c75ed1ddd service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:53.250424 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1998/3988] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:01:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:01:58.156897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:01:58.162678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:01:58.201835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1356b-1d6d-48fe-abc2-5abd4a811937 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:01:58.231846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:01:58.232876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:01:58.234208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:01:58.234674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] PATH_INFO: `/v3/users/ca33200afe954e1fa93584cec297c946` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:01:58.248100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca33200afe954e1fa93584cec297c946)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:01:58.251759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:01:58.480013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca33200afe954e1fa93584cec297c946'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:58.587027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca33200afe954e1fa93584cec297c946'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:58.588196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca33200afe954e1fa93584cec297c946'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:58.630950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca33200afe954e1fa93584cec297c946'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:58.632912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca33200afe954e1fa93584cec297c946'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:01:58.706922 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1991/3989] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:01:58 2022] DELETE /identity/v3/users/ca33200afe954e1fa93584cec297c946 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:01.004612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:01.005186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:01.005186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:01.083177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:01.084823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:01.126943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:01.207081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 1999/3990] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:02:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:01.256251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:01.258812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:01.509037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97134cd2-c065-423a-abac-20a73295a882 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:01.518221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:01.519450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:01.519957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:01.520410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:01.542728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:01.544445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:01.562423 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1992/3991] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:01.733117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:01.734829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:01.926716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c204ac-a831-4ab8-84e4-38171f7c1992 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:01.932330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:01.933006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:01.933291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:01.933566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] PATH_INFO: `/v3/projects/bca8699491d9463884206d4a6dfcf794` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:01.941572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca8699491d9463884206d4a6dfcf794)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:01.943707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:02.053048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca8699491d9463884206d4a6dfcf794', 'request_id': 'req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.077017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca8699491d9463884206d4a6dfcf794', 'request_id': 'req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.087720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca8699491d9463884206d4a6dfcf794', 'request_id': 'req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.115143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] The token cache is being invalidate because project bca8699491d9463884206d4a6dfcf794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:02:02.115484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.116414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.119085 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2000/3992] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:01 2022] DELETE /identity/v3/projects/bca8699491d9463884206d4a6dfcf794 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:02:02.123267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:02.141733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a93a2-96a4-4672-ae05-7211e3e6ee6d service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:02.213425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:02.273053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:02.275208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:02.275710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:02.276271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] PATH_INFO: `/v3/users/3591b1f560f645f2a9ed684c09d8d22b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:02.278195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3591b1f560f645f2a9ed684c09d8d22b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:02.280600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:02.400050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3591b1f560f645f2a9ed684c09d8d22b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.427814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3591b1f560f645f2a9ed684c09d8d22b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.429250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3591b1f560f645f2a9ed684c09d8d22b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.449774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3591b1f560f645f2a9ed684c09d8d22b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.450993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a40d7364-3efb-42f3-a013-cb42e503a0d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3591b1f560f645f2a9ed684c09d8d22b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:02.515015 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1993/3993] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:02:02 2022] DELETE /identity/v3/users/3591b1f560f645f2a9ed684c09d8d22b => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:03.966641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:03.970277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:04.008620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c739ab2-0428-43ba-8be0-5f8aac8b8a46 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:04.150577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:04.167759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:04.168434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:04.171140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:04.171656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] PATH_INFO: `/v3/projects/ac4de8b88140448ea3213f9506bde8bf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:04.173157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4de8b88140448ea3213f9506bde8bf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:04.175531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:04.344891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4de8b88140448ea3213f9506bde8bf', 'request_id': 'req-6fd76894-799a-46da-ad6b-620de423ea66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:04.368755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4de8b88140448ea3213f9506bde8bf', 'request_id': 'req-6fd76894-799a-46da-ad6b-620de423ea66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:04.391152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4de8b88140448ea3213f9506bde8bf', 'request_id': 'req-6fd76894-799a-46da-ad6b-620de423ea66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:04.431781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] The token cache is being invalidate because project ac4de8b88140448ea3213f9506bde8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:02:04.432090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:04.435030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6fd76894-799a-46da-ad6b-620de423ea66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:04.443192 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2001/3994] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:03 2022] DELETE /identity/v3/projects/ac4de8b88140448ea3213f9506bde8bf => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:04.451822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:04.452357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:04.452357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:04.486573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:04.487819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:04.593825 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1994/3995] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:04.595506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:04.595790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:04.596070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:04.645296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:04.646684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:04.661401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2002/3996] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:04.662683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:04.703804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a88b96-97f2-4571-b5e9-d97faa02d2b8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:04.721203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:04.722193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:04.723842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:04.724300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:04.726560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:02:04.727209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:04.729250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:04.770279 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1995/3997] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:02:04.777436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:04.789961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce1222-35bf-4d06-9c5a-19e71aba493b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:04.804885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:04.805695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:04.806106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:04.806474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:04.807228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:04.809231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:04.911734 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2003/3998] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:02:04 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:04.915788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:04.934685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267dcf2-0634-44c0-b4c7-deda207bc517 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:05.057601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:05.090453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:05.091010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:05.092391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:05.092391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:05.103914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:05.112963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:05.185574 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1996/3999] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:02:04 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:05.186464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:05.203827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af62e2-77d9-4573-990e-83704213b744 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:05.216990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:05.217629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:05.217953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:05.218225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:05.218873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:05.220923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:05.248045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2004/4000] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:02:05.251860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:05.266582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226e868-6baa-4be5-9696-1c1a0bc8b77b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:05.282900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899694c8-82a3-4b8f-ad3c-8e4bcd399916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:05.283930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899694c8-82a3-4b8f-ad3c-8e4bcd399916 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:05.284497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899694c8-82a3-4b8f-ad3c-8e4bcd399916 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:05.285496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899694c8-82a3-4b8f-ad3c-8e4bcd399916 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:05.286453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899694c8-82a3-4b8f-ad3c-8e4bcd399916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:05.288779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899694c8-82a3-4b8f-ad3c-8e4bcd399916 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:05.313302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1997/4001] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:02:05.317981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:05.332482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b01c7-6ac4-4d30-9df4-6dbb1860031a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:05.346161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:05.347316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:05.347829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:05.348357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] PATH_INFO: `/v3/projects/d38cb94a574b4e97951d270d07305ee1/users/e0ed88979cd8461194236e0ff34e9604/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:05.383608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38cb94a574b4e97951d270d07305ee1, user_id=e0ed88979cd8461194236e0ff34e9604, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:05.386619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:05.419845 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2005/4002] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:02:05 2022] PUT /identity/v3/projects/d38cb94a574b4e97951d270d07305ee1/users/e0ed88979cd8461194236e0ff34e9604/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:02:05.434365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:05.434822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:05.434941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:05.490901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] MFA Rules not processed for user `e0ed88979cd8461194236e0ff34e9604`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:05.492164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:05.634781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1998/4003] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:05.636174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:05.798658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87301-4d72-4d90-8099-d30297378fa9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:05.812397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:05.813553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:05.814040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:05.814476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:05.815664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:05.821499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:05.893981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:05.895899 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2006/4004] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:02:05 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:05.912902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59045d-2adc-43bb-bb16-6c3ccb5f5b3a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:06.039559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:06.040488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:06.040952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:06.041401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:06.042252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:06.044352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:06.093970 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 1999/4005] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:02:05 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:02:06.099051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:06.116362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62dd27-2aa6-4232-bb91-8412899937ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:06.147735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280b7fa-c099-48e6-8316-8e02c8b9994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:06.148382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b7fa-c099-48e6-8316-8e02c8b9994c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:06.148665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b7fa-c099-48e6-8316-8e02c8b9994c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:06.148940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280b7fa-c099-48e6-8316-8e02c8b9994c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:06.150940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280b7fa-c099-48e6-8316-8e02c8b9994c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:06.158158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280b7fa-c099-48e6-8316-8e02c8b9994c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:06.169366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:06.190170 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2007/4006] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:02:06.194950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:06.205715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a987d240-270b-48ce-b2ee-a1b3a9ecbe15 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:06.226254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:06.227266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:06.227717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:06.228165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] PATH_INFO: `/v3/projects/bde17aac61f4460fbfc260ce4e362bd2/users/1e7282a924d94ad7ac25a992f0a8fbe0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:06.260236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde17aac61f4460fbfc260ce4e362bd2, user_id=1e7282a924d94ad7ac25a992f0a8fbe0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:06.263261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:06.293977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2000/4007] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:02:06 2022] PUT /identity/v3/projects/bde17aac61f4460fbfc260ce4e362bd2/users/1e7282a924d94ad7ac25a992f0a8fbe0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:02:06.306126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:06.306390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:06.306730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:06.423387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] MFA Rules not processed for user `1e7282a924d94ad7ac25a992f0a8fbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:06.430217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:06.725880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2008/4008] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:06 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:06.816074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:06.818216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:06.853461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:06.962314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4c1f3-b8eb-49b1-b742-01bd56a9dda0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:06.971030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34655354-6183-49b6-ae6f-a8d0a0b15103 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:06.972403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34655354-6183-49b6-ae6f-a8d0a0b15103 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:06.973110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34655354-6183-49b6-ae6f-a8d0a0b15103 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:06.973690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34655354-6183-49b6-ae6f-a8d0a0b15103 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:06.987231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34655354-6183-49b6-ae6f-a8d0a0b15103 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:06.991137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34655354-6183-49b6-ae6f-a8d0a0b15103 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:07.005920 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2001/4009] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:10.189750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:10.384700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644937fa-4ef1-46bb-bef2-1f799a0d44fe None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:10.392655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:10.393660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:10.394244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:10.394755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] PATH_INFO: `/v3/users/e0ed88979cd8461194236e0ff34e9604` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:10.398014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ed88979cd8461194236e0ff34e9604)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:10.422924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:10.625164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ed88979cd8461194236e0ff34e9604'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:10.644818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ed88979cd8461194236e0ff34e9604'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:10.645661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ed88979cd8461194236e0ff34e9604'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:10.682208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ed88979cd8461194236e0ff34e9604'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:10.684365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ed88979cd8461194236e0ff34e9604'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:10.732683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2009/4010] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:02:10 2022] DELETE /identity/v3/users/e0ed88979cd8461194236e0ff34e9604 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:10.737772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129fe68-c229-46de-8107-3a8896cee666 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:10.738379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129fe68-c229-46de-8107-3a8896cee666 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:10.738919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129fe68-c229-46de-8107-3a8896cee666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:10.787938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5129fe68-c229-46de-8107-3a8896cee666 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:10.790637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5129fe68-c229-46de-8107-3a8896cee666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:10.892207 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2002/4011] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:10.980711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:10.983411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:11.004480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:11.280023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e353b7-39c8-4b0f-8cbb-6073d2258dd4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:11.296157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b132c-1862-45cb-a49c-96cc10a66af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:11.298655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b132c-1862-45cb-a49c-96cc10a66af5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:11.299645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b132c-1862-45cb-a49c-96cc10a66af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:11.300219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b132c-1862-45cb-a49c-96cc10a66af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:11.339490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b132c-1862-45cb-a49c-96cc10a66af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:11.344653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b132c-1862-45cb-a49c-96cc10a66af5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:11.394997 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2010/4012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:02:15.345660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:15.346329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:15.346473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:15.392255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] MFA Rules not processed for user `8c62bd2c7acf4c5ea9f7a9edae332de0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:15.394166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:15.594534 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2003/4013] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:15.604589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:15.605060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:15.605060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:15.663978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] MFA Rules not processed for user `8c62bd2c7acf4c5ea9f7a9edae332de0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:15.665334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:15.713102 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2011/4014] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:15 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:16.260815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:16.262341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:16.381823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:16.489833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18054bda-7d52-4779-b69d-c6545cc7e6a4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:16.510480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:16.512128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:16.512876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:16.513496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:16.530323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:16.532352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:16.578191 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2004/4015] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:02:17.047707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:17.049856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:17.083004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1728-1494-42aa-9e63-bc2203647b4c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:17.097992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:17.098976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:17.101339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:17.101837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] PATH_INFO: `/v3/projects/d38cb94a574b4e97951d270d07305ee1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:17.108037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38cb94a574b4e97951d270d07305ee1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:17.113158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:17.218470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38cb94a574b4e97951d270d07305ee1', 'request_id': 'req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.234816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38cb94a574b4e97951d270d07305ee1', 'request_id': 'req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.248899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38cb94a574b4e97951d270d07305ee1', 'request_id': 'req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.272885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] The token cache is being invalidate because project d38cb94a574b4e97951d270d07305ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:02:17.273182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.273887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.278465 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2012/4016] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:17 2022] DELETE /identity/v3/projects/d38cb94a574b4e97951d270d07305ee1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:17.279782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:17.298844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f367803-667c-4d5e-983c-26a88e899651 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:17.502546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:17.504623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:17.505001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:17.505368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] PATH_INFO: `/v3/users/1e7282a924d94ad7ac25a992f0a8fbe0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:17.515261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7282a924d94ad7ac25a992f0a8fbe0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:17.525198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:17.702612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7282a924d94ad7ac25a992f0a8fbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.735518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7282a924d94ad7ac25a992f0a8fbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.745578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7282a924d94ad7ac25a992f0a8fbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.769163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7282a924d94ad7ac25a992f0a8fbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.770770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2800788a-5833-4294-9d9e-39eb09a8eed9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7282a924d94ad7ac25a992f0a8fbe0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:17.802605 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2005/4017] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:02:17 2022] DELETE /identity/v3/users/1e7282a924d94ad7ac25a992f0a8fbe0 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:18.486756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:18.488398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:18.511844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642d5b4-7530-4d28-be39-f3e5b42e4ecc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:18.658081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:18.658732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:18.659101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:18.659371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] PATH_INFO: `/v3/projects/bde17aac61f4460fbfc260ce4e362bd2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:18.660554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde17aac61f4460fbfc260ce4e362bd2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:18.662975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:18.749202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:18.781864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde17aac61f4460fbfc260ce4e362bd2', 'request_id': 'req-e132aeb1-eef8-4d06-8538-289be84f4037'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:18.801991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde17aac61f4460fbfc260ce4e362bd2', 'request_id': 'req-e132aeb1-eef8-4d06-8538-289be84f4037'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:18.828368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde17aac61f4460fbfc260ce4e362bd2', 'request_id': 'req-e132aeb1-eef8-4d06-8538-289be84f4037'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:18.877736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] The token cache is being invalidate because project bde17aac61f4460fbfc260ce4e362bd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:02:18.878220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:18.883479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e132aeb1-eef8-4d06-8538-289be84f4037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:18.890693 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2013/4018] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:18 2022] DELETE /identity/v3/projects/bde17aac61f4460fbfc260ce4e362bd2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:18.892315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:18.893136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:18.893953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:18.935058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:18.936850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:18.997012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:19.025521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2006/4019] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:02:19.033480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.033770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.034407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.067520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:19.068801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:19.080847 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2014/4020] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:19.082005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.094181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09c963e-2e66-4488-9a44-ed892fb6bfb7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:19.107553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:19.108272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.108648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.109000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.109785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:02:19.110208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:19.113112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:19.151520 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2007/4021] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:02:19.152919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.165123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0d83-2c1d-484f-a87d-913278c520df None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:19.171773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:19.172562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.173548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.173962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.174863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:19.178584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:19.238534 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2015/4022] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:02:19 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:19.242707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.262694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4271b8ab-79be-4c38-841d-f75187d2ffa2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:19.387935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:19.388778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.389451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.390453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.391301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:19.397772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:19.502625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2008/4023] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:02:19 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:19.504026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.524903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d69444-0117-4391-9458-2d07e9667584 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:19.536274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:19.538140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.538996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.542368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.545192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:19.552435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:19.572086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2016/4024] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:02:19.576043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.593906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf356f-1ec2-43e4-9888-a426c94777f6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:19.609413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bb6cb-507a-4cd5-9385-74c895f591ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:19.610606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb6cb-507a-4cd5-9385-74c895f591ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.611445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb6cb-507a-4cd5-9385-74c895f591ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.612170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bb6cb-507a-4cd5-9385-74c895f591ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.615664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bb6cb-507a-4cd5-9385-74c895f591ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:19.618443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bb6cb-507a-4cd5-9385-74c895f591ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:19.642449 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2009/4025] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:02:19.647501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.662187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ee5a6-7148-4a5c-9cf8-a6863fdb8868 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:19.679408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:19.680587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.681767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.682294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] PATH_INFO: `/v3/projects/876cdb4084454584965a3f11aed5e79a/users/14aff6fe639d42bcb968efc58f7e9cad/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.724401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=876cdb4084454584965a3f11aed5e79a, user_id=14aff6fe639d42bcb968efc58f7e9cad, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:19.728393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:19.754741 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2017/4026] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:02:19 2022] PUT /identity/v3/projects/876cdb4084454584965a3f11aed5e79a/users/14aff6fe639d42bcb968efc58f7e9cad/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:19.756454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:19.756792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:19.757032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:19.787197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:19.788547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:19.871070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.873678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:19.901843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2010/4027] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:19.914977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:19.916824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:20.063560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:20.072191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1228e-2a3c-4b9d-a74e-464a08669e11 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:20.072467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2f0c-288e-46a4-8a61-f00cc5248925 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:20.079505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:20.080152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:20.081018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:20.081479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:20.083680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cab9ce-8116-49b1-9aa8-3ad05b84be41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:20.083885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:20.084336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab9ce-8116-49b1-9aa8-3ad05b84be41 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:20.084653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab9ce-8116-49b1-9aa8-3ad05b84be41 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:20.085138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cab9ce-8116-49b1-9aa8-3ad05b84be41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:20.097924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cab9ce-8116-49b1-9aa8-3ad05b84be41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:20.100921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cab9ce-8116-49b1-9aa8-3ad05b84be41 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:20.115187 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2011/4028] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:02:20.166966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:20.200904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:20.207682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:20.220164 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2018/4029] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:02:24.531923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:24.532520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:24.532520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:24.575688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] MFA Rules not processed for user `aa0f9eced1ff41e281ed82bb0465a58b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:24.577020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:24.604519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2012/4030] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:24.642092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:24.643787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:24.661659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69035efc-c6bd-4109-992c-46b5f203fecb service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:24.668997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:24.670002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:24.670503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:24.670965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] PATH_INFO: `/v3/users/adb51369444c42c190b1b7bf5e23ddb9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:24.672894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adb51369444c42c190b1b7bf5e23ddb9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:24.677748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:24.785592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adb51369444c42c190b1b7bf5e23ddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:24.805453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adb51369444c42c190b1b7bf5e23ddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:24.810865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adb51369444c42c190b1b7bf5e23ddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:24.823504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adb51369444c42c190b1b7bf5e23ddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:24.824661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f18946f4-6464-4fc2-9f7d-50fd5f63ff65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adb51369444c42c190b1b7bf5e23ddb9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:24.853867 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2019/4031] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:02:24 2022] DELETE /identity/v3/users/adb51369444c42c190b1b7bf5e23ddb9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:25.260661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:25.276139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac544dd-5886-491a-9e3d-d3b68d5fde96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:25.369576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:25.370779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:25.371223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:25.371673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] PATH_INFO: `/v3/projects/c7a3da1a632d443aba8f5cf3b741714b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:25.373087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a3da1a632d443aba8f5cf3b741714b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:25.375183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:25.461893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a3da1a632d443aba8f5cf3b741714b', 'request_id': 'req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:25.469186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a3da1a632d443aba8f5cf3b741714b', 'request_id': 'req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:25.477289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a3da1a632d443aba8f5cf3b741714b', 'request_id': 'req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:25.504985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] The token cache is being invalidate because project c7a3da1a632d443aba8f5cf3b741714b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:02:25.505356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:25.506078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b46d1cca-88bc-4cfe-82ad-ecdfc962123d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:02:25.511483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2013/4032] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:02:25 2022] DELETE /identity/v3/projects/c7a3da1a632d443aba8f5cf3b741714b => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:25.518215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:25.519207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:25.519851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:25.550950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:25.552763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:25.661124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2020/4033] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:25.669063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:25.670052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:25.670525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:25.695787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:25.697700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:25.708127 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2014/4034] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:25.712043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:25.734539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690a887-64c2-4a7a-8e94-6877899a8942 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:25.754729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:25.756404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:25.756924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:25.758229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:25.759312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:02:25.762218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:25.765610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:25.798176 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2021/4035] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:02:25.803078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:25.816191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011ba62-b4ff-4306-a64a-ef2acdf88b0a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:25.824560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:25.825756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:25.826283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:25.826762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:25.827930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:25.830349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:25.883338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2015/4036] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:02:25 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:25.887317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:25.901626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e4cc-3fed-4cb0-a23d-8c9a795bb35b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:25.983201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:26.039579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:26.040234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:26.040512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:26.040785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:26.041428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:26.044684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:26.081165 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2022/4037] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:02:25 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:26.085172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:26.103494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c67ec0-77c8-467d-bdb1-e18e0ee9c4b5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:26.112100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:26.113159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:26.113665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:26.114721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:26.115602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:26.119170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:26.134674 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2016/4038] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:02:26.138431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:26.158874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cb0de-e575-4a38-8d62-048cbce1d5b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:26.168510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e644c3-73ab-4188-9631-2b4477e79cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:26.169533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e644c3-73ab-4188-9631-2b4477e79cbc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:26.171373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e644c3-73ab-4188-9631-2b4477e79cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:26.171928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e644c3-73ab-4188-9631-2b4477e79cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:26.173857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e644c3-73ab-4188-9631-2b4477e79cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:26.176360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e644c3-73ab-4188-9631-2b4477e79cbc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:26.193559 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2023/4039] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:02:26.198495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:26.214372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bef322-10f9-45e6-b3a7-dc5810a652b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:26.224829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:26.225919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:26.226486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:26.226867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] PATH_INFO: `/v3/projects/fba7db05cea44f799b8dc23ed0203668/users/38fa0f91e15c40678663e11e150016a4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:26.248781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba7db05cea44f799b8dc23ed0203668, user_id=38fa0f91e15c40678663e11e150016a4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:26.252030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:26.276923 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2017/4040] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:02:26 2022] PUT /identity/v3/projects/fba7db05cea44f799b8dc23ed0203668/users/38fa0f91e15c40678663e11e150016a4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:26.280229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c268fab-4f71-4c8f-b228-e4bb38e73af6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:26.280811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c268fab-4f71-4c8f-b228-e4bb38e73af6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:26.281120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c268fab-4f71-4c8f-b228-e4bb38e73af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:26.309094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8c268fab-4f71-4c8f-b228-e4bb38e73af6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:26.310762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c268fab-4f71-4c8f-b228-e4bb38e73af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:26.394707 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2024/4041] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:26.421357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:26.427147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:26.470299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:26.553199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013bb27-1af3-423c-a055-c36de25f929b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:26.571577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:26.574209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:26.574768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:26.575264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:26.598096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:26.600185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:26.613434 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2018/4042] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:02:29.915730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a44c66-e70f-44f3-b6ae-9563fb0b2e02 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:29.916705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a44c66-e70f-44f3-b6ae-9563fb0b2e02 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:29.917174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a44c66-e70f-44f3-b6ae-9563fb0b2e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:29.967610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0a44c66-e70f-44f3-b6ae-9563fb0b2e02 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:29.971884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0a44c66-e70f-44f3-b6ae-9563fb0b2e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:30.122458 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2025/4043] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:02:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:30.123349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:30.124848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:30.266781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5b124-766f-4283-acc7-0421caf8cff1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:30.274181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:30.277913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:30.284780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:30.285387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:30.314040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:30.321759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:30.359946 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2019/4044] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:35.729584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:35.730940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:35.731227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:35.790208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] MFA Rules not processed for user `14aff6fe639d42bcb968efc58f7e9cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:35.793561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:35.921598 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2026/4045] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:35.926349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:35.929583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:35.954918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f38bf-7d0b-4afa-8bc8-9cfec4b89792 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:35.965457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:35.965457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:35.965457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:35.965457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:35.966080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:35.968166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:36.044461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:36.046893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2020/4046] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:02:35 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:36.051027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:36.062498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4469da-ed78-4b68-8491-c59dcca528f6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:36.296337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:36.296993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:36.297272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:36.297542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:36.298235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:36.300700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:36.389977 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2027/4047] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:02:36 2022] POST /identity/v3/users => generated 297 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:02:36.393918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:36.407628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2091-3566-4808-93fe-b15b17ccde0b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:36.417748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:36.420191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:36.420191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:36.420414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:36.421031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:36.426854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:36.453305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:36.454162 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2021/4048] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:02:36.473692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b97700-eaff-46e3-9e1a-b82e094cd6b8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:36.490540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:36.491235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:36.491516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:36.491791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] PATH_INFO: `/v3/projects/060b083096704816ae2c50c96be9414f/users/b8bc76f6d34c4970b9d1148f5a24c3fc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:36.544369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] RBAC: Authorizing `identity:create_grant(project_id=060b083096704816ae2c50c96be9414f, user_id=b8bc76f6d34c4970b9d1148f5a24c3fc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:36.547127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:36.591466 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2028/4049] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:02:36 2022] PUT /identity/v3/projects/060b083096704816ae2c50c96be9414f/users/b8bc76f6d34c4970b9d1148f5a24c3fc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:36.596204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:36.614491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6c081-870d-4e3a-b01c-332804a37350 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:36.783025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eeb860-4482-466a-9036-e31ae201cb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:36.783795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeb860-4482-466a-9036-e31ae201cb08 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:36.786231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeb860-4482-466a-9036-e31ae201cb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:36.786481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eeb860-4482-466a-9036-e31ae201cb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:36.787231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeb860-4482-466a-9036-e31ae201cb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:36.788915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eeb860-4482-466a-9036-e31ae201cb08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:36.841885 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2022/4050] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:02:36.843142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:36.861441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44dd5a8-ba8d-40a4-b906-278858b9556c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:36.878390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:36.879079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:36.879355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:36.879628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] PATH_INFO: `/v3/projects/060b083096704816ae2c50c96be9414f/users/b8bc76f6d34c4970b9d1148f5a24c3fc/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:36.886200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=060b083096704816ae2c50c96be9414f, user_id=b8bc76f6d34c4970b9d1148f5a24c3fc, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:36.891064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:36.948442 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2029/4051] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:02:36 2022] PUT /identity/v3/projects/060b083096704816ae2c50c96be9414f/users/b8bc76f6d34c4970b9d1148f5a24c3fc/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:02:37.466072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cdb30-b663-433d-8dce-652390a80dda None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:37.466687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cdb30-b663-433d-8dce-652390a80dda None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:37.466993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cdb30-b663-433d-8dce-652390a80dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:37.489942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:37.505920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-514cdb30-b663-433d-8dce-652390a80dda None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:37.508956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-514cdb30-b663-433d-8dce-652390a80dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:37.678120 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2023/4052] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:02:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:37.731559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:37.907689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78231914-4420-4c12-85e3-47d044f1c574 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:37.925861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783a528-5c50-4b42-85ef-17c4720dda06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:37.928467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a528-5c50-4b42-85ef-17c4720dda06 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:37.929288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a528-5c50-4b42-85ef-17c4720dda06 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:37.929905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783a528-5c50-4b42-85ef-17c4720dda06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:37.949842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783a528-5c50-4b42-85ef-17c4720dda06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:37.951756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783a528-5c50-4b42-85ef-17c4720dda06 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:37.978396 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2030/4053] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:02:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:02:44.357097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:44.357630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:44.357630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:44.414844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] MFA Rules not processed for user `38fa0f91e15c40678663e11e150016a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:44.416138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:44.563871 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2024/4054] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:44.575369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f4e2-8047-458e-98ac-19327cbb0680 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:44.576413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f4e2-8047-458e-98ac-19327cbb0680 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:44.576987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f4e2-8047-458e-98ac-19327cbb0680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:44.620592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2e1f4e2-8047-458e-98ac-19327cbb0680 None None] MFA Rules not processed for user `38fa0f91e15c40678663e11e150016a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:44.626509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2e1f4e2-8047-458e-98ac-19327cbb0680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:44.649524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2031/4055] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:44.673724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:44.676347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:44.803085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de50b8-c615-41a4-b8b0-9a40cece013e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:44.810223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:44.823357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:44.827779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:44.828079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:44.841566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:44.844704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:44.865453 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2025/4056] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:02:49.677321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:49.677777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:49.677777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:49.741385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] MFA Rules not processed for user `b8bc76f6d34c4970b9d1148f5a24c3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:02:49.743914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:49.774881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:49.870571 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2032/4057] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:02:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:02:49.888006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:49.890174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:02:49.965078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:50.076822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768424e-d64d-4b7d-8bbe-b2a6e2f839b2 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:02:50.092737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:02:50.093309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:02:50.093585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:02:50.093883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:02:50.225790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:02:50.227288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:02:50.264467 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2026/4058] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:02:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:02:59.848459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=17 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:02:59.917377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:02:59.917377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:00.030552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c9096-471b-46c2-a286-43e1cede37df None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:00.035894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:00.036885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:00.037470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:00.037918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] PATH_INFO: `/v3/users/8c62bd2c7acf4c5ea9f7a9edae332de0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:00.039320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c62bd2c7acf4c5ea9f7a9edae332de0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:00.041532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:00.130183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c62bd2c7acf4c5ea9f7a9edae332de0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.136960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c62bd2c7acf4c5ea9f7a9edae332de0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.137959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c62bd2c7acf4c5ea9f7a9edae332de0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.149950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c62bd2c7acf4c5ea9f7a9edae332de0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.150710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6781d8d1-f7d6-44d1-a50d-9eb822ed505d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c62bd2c7acf4c5ea9f7a9edae332de0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.190166 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2033/4059] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:02:59 2022] DELETE /identity/v3/users/8c62bd2c7acf4c5ea9f7a9edae332de0 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:00.242557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=36 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:00.769279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:00.781354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f71fa-de4d-44f5-bf14-8000bdae15f8 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:00.865839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:00.866523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:00.866803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:00.867357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] PATH_INFO: `/v3/projects/ff2d630709a746e386bbb39de2d56cfa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:00.868916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2d630709a746e386bbb39de2d56cfa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:00.871395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:00.930656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2d630709a746e386bbb39de2d56cfa', 'request_id': 'req-0dcf7064-5de5-4e30-8976-6a1a100127c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.941263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2d630709a746e386bbb39de2d56cfa', 'request_id': 'req-0dcf7064-5de5-4e30-8976-6a1a100127c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.949165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2d630709a746e386bbb39de2d56cfa', 'request_id': 'req-0dcf7064-5de5-4e30-8976-6a1a100127c9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.966055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] The token cache is being invalidate because project ff2d630709a746e386bbb39de2d56cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:03:00.966425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.967201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0dcf7064-5de5-4e30-8976-6a1a100127c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:00.968832 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2027/4060] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:03:00 2022] DELETE /identity/v3/projects/ff2d630709a746e386bbb39de2d56cfa => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:00.974179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:00.976547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:00.977027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.008193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:01.010063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:01.089024 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2034/4061] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:03:01.099487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.099771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.100047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.122544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:01.123791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:01.131921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2028/4062] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:01.136438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.147222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8d4ce-22d6-46b3-8ce3-2f7e21cb8ed9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.152594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.153274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.153695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.154130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.154779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:03:01.155972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.157582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.177097 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2035/4063] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:03:01.181698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.192031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f818b3-e4f6-48fc-88f2-53ed72e194eb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.200037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.200669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.200949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.201225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.202039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.204902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.238040 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2029/4064] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:03:01 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:03:01.242592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.258960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c5673-3412-429c-b110-3604ae80d3f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.263461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:01.333953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.334586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.334868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.335142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.335800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.337733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.364674 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2036/4065] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:03:01 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:03:01.369472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.382035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ec3cb-77df-42b2-9109-a76baa8a06bf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.387244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.388200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.388485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.388781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.389432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.391372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.415605 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2030/4066] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:03:01.419754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.430456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed6d07-7b2f-4bb9-8717-7b436799f4b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.435144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b809c-0f62-4f82-ac2f-48f011a82907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.435758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b809c-0f62-4f82-ac2f-48f011a82907 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.436033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b809c-0f62-4f82-ac2f-48f011a82907 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.436299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b809c-0f62-4f82-ac2f-48f011a82907 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.436964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b809c-0f62-4f82-ac2f-48f011a82907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.438586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b809c-0f62-4f82-ac2f-48f011a82907 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.453109 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2037/4067] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:03:01.454331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.465474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d36133-2e8f-4824-bb5f-2f8cc4e1ebe7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.470236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.471207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.471542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.471966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] PATH_INFO: `/v3/projects/d573dd77f3b24ee4b650ca45e657e307/users/cab4906c7a3748b4b0a1df38423d82a9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.489208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d573dd77f3b24ee4b650ca45e657e307, user_id=cab4906c7a3748b4b0a1df38423d82a9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.491883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.506924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2031/4068] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:03:01 2022] PUT /identity/v3/projects/d573dd77f3b24ee4b650ca45e657e307/users/cab4906c7a3748b4b0a1df38423d82a9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:01.512126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e064c3-663d-4155-b679-9da857607fc8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.512438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e064c3-663d-4155-b679-9da857607fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.512711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e064c3-663d-4155-b679-9da857607fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.533845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63e064c3-663d-4155-b679-9da857607fc8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:01.535401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63e064c3-663d-4155-b679-9da857607fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:01.609964 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2038/4069] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:03:01.620064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:01.621929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:01.656847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:01.698978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de38d56-b42c-4d90-87ab-0910bc773c93 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:01.702702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced12738-e136-4591-bbf5-5a5f11bafb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:01.703459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced12738-e136-4591-bbf5-5a5f11bafb51 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:01.703737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced12738-e136-4591-bbf5-5a5f11bafb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:01.704005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced12738-e136-4591-bbf5-5a5f11bafb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:01.717045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced12738-e136-4591-bbf5-5a5f11bafb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:01.718642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced12738-e136-4591-bbf5-5a5f11bafb51 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:01.730283 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2032/4070] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:02.629270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1141-830f-453d-a2b9-fd7b27c9ade7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:02.629780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1141-830f-453d-a2b9-fd7b27c9ade7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:02.629780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d1141-830f-453d-a2b9-fd7b27c9ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:02.671652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0b0d1141-830f-453d-a2b9-fd7b27c9ade7 None None] MFA Rules not processed for user `cab4906c7a3748b4b0a1df38423d82a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:02.673062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b0d1141-830f-453d-a2b9-fd7b27c9ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:02.757940 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2039/4071] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:02.873931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:02.874591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:02.874874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:02.902315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] MFA Rules not processed for user `cab4906c7a3748b4b0a1df38423d82a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:02.904211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:02.913691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2033/4072] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:02.924920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f891-11e3-43a4-b6dc-714cd164b950 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:02.924920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f891-11e3-43a4-b6dc-714cd164b950 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:02.924920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04f891-11e3-43a4-b6dc-714cd164b950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:02.952775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae04f891-11e3-43a4-b6dc-714cd164b950 None None] MFA Rules not processed for user `cab4906c7a3748b4b0a1df38423d82a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:02.954244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae04f891-11e3-43a4-b6dc-714cd164b950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:02.967740 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2040/4073] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:02.974650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:02.976050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:03.105990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ef856-ae43-490b-953d-dc3877753e19 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:03.115200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed080ffd-cdca-4c7f-9129-0431bd254a95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:03.115200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080ffd-cdca-4c7f-9129-0431bd254a95 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:03.115644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080ffd-cdca-4c7f-9129-0431bd254a95 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:03.115987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed080ffd-cdca-4c7f-9129-0431bd254a95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:03.127982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080ffd-cdca-4c7f-9129-0431bd254a95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:03.128965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed080ffd-cdca-4c7f-9129-0431bd254a95 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:03.152863 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2034/4074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:04.064886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:04.065776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:04.066230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:04.102069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] MFA Rules not processed for user `cab4906c7a3748b4b0a1df38423d82a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:04.103401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:04.125306 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2041/4075] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:04.158145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83fdc0-79e4-4236-9a24-c9949048bfd9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:04.158993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83fdc0-79e4-4236-9a24-c9949048bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:04.159470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b83fdc0-79e4-4236-9a24-c9949048bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:04.190196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0b83fdc0-79e4-4236-9a24-c9949048bfd9 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:04.192014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b83fdc0-79e4-4236-9a24-c9949048bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:04.343612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2035/4076] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:03:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:04.380073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:04.382412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:04.387771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:04.489742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419135-94f0-43db-9fcf-63f2b111d924 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:04.506953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:04.508180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:04.508180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:04.508374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:04.518360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:04.520051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:04.535178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2042/4077] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:03:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:10.287593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:10.288685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:10.289103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:10.336310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] MFA Rules not processed for user `cab4906c7a3748b4b0a1df38423d82a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:10.337755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:10.352977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2036/4078] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:14.526627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=31 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:20.319205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=79 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:27.098168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:27.101994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:27.210677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca94ac-64b9-4729-b37f-f97c8e97aab1 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:27.230079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:27.231046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:27.231850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:27.234554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] PATH_INFO: `/v3/users/541c48e9a20d4b04a33018145c1fce9f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:27.236301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=541c48e9a20d4b04a33018145c1fce9f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:27.241554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:27.339907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '541c48e9a20d4b04a33018145c1fce9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.350943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '541c48e9a20d4b04a33018145c1fce9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.352542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '541c48e9a20d4b04a33018145c1fce9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.361648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '541c48e9a20d4b04a33018145c1fce9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.363092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67a5e610-6694-46d9-b5ae-f9597dcd5106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '541c48e9a20d4b04a33018145c1fce9f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.387928 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2043/4079] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:03:27 2022] DELETE /identity/v3/users/541c48e9a20d4b04a33018145c1fce9f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:27.624797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:27.671899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6d300-8679-40a7-87e0-1fc775939c90 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:27.746817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:27.747821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:27.748097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:27.748366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] PATH_INFO: `/v3/projects/189356634b6049a3a44bb701d8529d13` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:27.749574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189356634b6049a3a44bb701d8529d13)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:27.751813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:27.809334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189356634b6049a3a44bb701d8529d13', 'request_id': 'req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.816323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189356634b6049a3a44bb701d8529d13', 'request_id': 'req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.822625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189356634b6049a3a44bb701d8529d13', 'request_id': 'req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.839327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] The token cache is being invalidate because project 189356634b6049a3a44bb701d8529d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:03:27.839896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.841054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fd6ca8b1-0971-4bfd-ac6e-f65b30227800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:27.842921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2037/4080] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:03:27 2022] DELETE /identity/v3/projects/189356634b6049a3a44bb701d8529d13 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:27.850689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:27.851025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:27.851318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:27.882999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:27.884352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:28.021495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.022154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.022630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.024225 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2044/4081] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:28.054432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:28.055955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:28.072331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2038/4082] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:28.075765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.091518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861631bd-c849-4e55-b93f-15ad12a90d04 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:28.101583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:28.102499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.102852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.103190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.103917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:03:28.104292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:28.106474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:28.121847 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2045/4083] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:03:28.125956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.140740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26d566-547b-424c-a9a6-be7adfbd754a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:28.154177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:28.154827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.155105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.155376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.156362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:28.158314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:28.210518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2039/4084] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:03:28 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:03:28.214596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.239956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3544e45-a0ab-459a-b535-7af1084e59bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:28.272715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:28.389284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:28.390037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.390386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.390727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.391680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:28.394000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:28.475764 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2046/4085] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:03:28 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:03:28.479852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.495767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1aae8-1605-4c8d-b5f1-8b35e1260065 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:28.508761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:28.509404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.509685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.510002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.510656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:28.512260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:28.527046 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2040/4086] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:03:28.531318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.547657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d7e69f-fe24-44f7-afda-96ff68abc400 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:28.559362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69495d6-0a46-4b9e-9cec-0bf45b05208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:28.562118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69495d6-0a46-4b9e-9cec-0bf45b05208e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.562404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69495d6-0a46-4b9e-9cec-0bf45b05208e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.562826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69495d6-0a46-4b9e-9cec-0bf45b05208e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.563525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69495d6-0a46-4b9e-9cec-0bf45b05208e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:28.565150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69495d6-0a46-4b9e-9cec-0bf45b05208e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:28.600034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2047/4087] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:03:28.601243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.612947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7333ca4-ecbe-4305-8ab3-6d6d8bb5c62c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:28.630827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:28.631648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.631929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.632254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] PATH_INFO: `/v3/projects/9e1b05d7018447eebe74cc47de363ead/users/cecadca739554f858c269b85690b5cec/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.677150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1b05d7018447eebe74cc47de363ead, user_id=cecadca739554f858c269b85690b5cec, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:28.686262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:28.738679 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2041/4088] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:03:28 2022] PUT /identity/v3/projects/9e1b05d7018447eebe74cc47de363ead/users/cecadca739554f858c269b85690b5cec/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:03:28.744820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:28.745102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:28.745373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:28.780133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:28.781783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:28.907949 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2048/4089] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:28.916736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:28.919429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:28.938041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:29.097523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e4f39-6787-401a-bc3e-a71952667cbd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:29.110497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:29.112301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:29.113146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:29.113572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:29.132003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:29.135551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:29.154499 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2042/4090] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:29.810673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:29.811977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:29.872784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:29.874622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:29.900906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af45a9d-a4fd-4e65-a04f-5b25fbfbd273 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:29.919695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:29.923226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:29.924754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:29.926745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] PATH_INFO: `/v3/users/38fa0f91e15c40678663e11e150016a4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:29.930322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fa0f91e15c40678663e11e150016a4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:29.936363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:30.013684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11885f62-6ae4-47a0-819a-a33c13faa3ba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:30.027773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:30.029954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:30.032625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:30.034030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:30.045154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:30.087667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:30.090040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fa0f91e15c40678663e11e150016a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.097023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:30.110460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fa0f91e15c40678663e11e150016a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.111596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fa0f91e15c40678663e11e150016a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.120609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fa0f91e15c40678663e11e150016a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.121566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21419c58-d123-4ad2-aedf-87a779f4b150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fa0f91e15c40678663e11e150016a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.132826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2049/4091] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:30.142035 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2043/4092] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:03:29 2022] DELETE /identity/v3/users/38fa0f91e15c40678663e11e150016a4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:30.436929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:30.452693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f9454-2850-4608-9c38-7a28d81adae7 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:30.518221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:30.624513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:30.625263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:30.626321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:30.626827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] PATH_INFO: `/v3/projects/fba7db05cea44f799b8dc23ed0203668` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:30.628211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba7db05cea44f799b8dc23ed0203668)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:30.630196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:30.718223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba7db05cea44f799b8dc23ed0203668', 'request_id': 'req-a1bab76f-56b0-4d75-98c8-2abf3a35516a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.733659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba7db05cea44f799b8dc23ed0203668', 'request_id': 'req-a1bab76f-56b0-4d75-98c8-2abf3a35516a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.748733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba7db05cea44f799b8dc23ed0203668', 'request_id': 'req-a1bab76f-56b0-4d75-98c8-2abf3a35516a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.779055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] The token cache is being invalidate because project fba7db05cea44f799b8dc23ed0203668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:03:30.780233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.782770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a1bab76f-56b0-4d75-98c8-2abf3a35516a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:03:30.792319 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2050/4093] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:03:30 2022] DELETE /identity/v3/projects/fba7db05cea44f799b8dc23ed0203668 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:30.794208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:30.794498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:30.794773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:30.841123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:30.844391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:31.034263 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2044/4094] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:31.044105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.044983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.045422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.108208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:31.117264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:31.145935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2051/4095] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:31.150648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:31.214229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0fbbf7-1867-405a-97bb-4c865c7d5c18 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:31.236337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:31.238332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.238615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.242467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.243543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:03:31.243882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:31.245545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:31.254895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:31.273197 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2045/4096] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:03:31.278946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:31.289620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31a606-00fc-47e9-a17d-193a543c89c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:31.304109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:31.306313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.308006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.308287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.310324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:31.314934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:31.393864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2052/4097] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:03:31 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:03:31.397264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:31.414630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0c097-0f94-40fb-a993-4b8d1d1e2fe1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:31.615801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:31.616873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.617348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.618153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.619311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:31.669639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:31.737411 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2046/4098] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:03:31 2022] POST /identity/v3/users => generated 292 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:03:31.740198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:31.754632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed476a7-ad68-4b88-823a-6991776b141f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:31.770447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:31.771083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.771364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.771633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.772289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:31.774931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:31.807729 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2053/4099] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:03:31.814206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:31.826856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb289dc-507a-4e17-b029-c08fa4959fd7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:31.832633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25eabd-ad55-4012-9487-0a09d56f6d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:31.833302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25eabd-ad55-4012-9487-0a09d56f6d47 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.833585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25eabd-ad55-4012-9487-0a09d56f6d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.834431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25eabd-ad55-4012-9487-0a09d56f6d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.835397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25eabd-ad55-4012-9487-0a09d56f6d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:31.837159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25eabd-ad55-4012-9487-0a09d56f6d47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:31.851915 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2047/4100] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:03:31.856341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:31.868820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81b1ac-0cf5-4e82-9fc8-4b7d44f8bbb3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:31.873726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:31.874488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.874788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.875079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] PATH_INFO: `/v3/projects/70b925f5ecdb42e7a2f410c41f9f9cfc/users/9d1b1de72f9d4fd3b3165588054a0a90/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:31.893415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b925f5ecdb42e7a2f410c41f9f9cfc, user_id=9d1b1de72f9d4fd3b3165588054a0a90, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:31.896396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:31.953369 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2054/4101] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:03:31 2022] PUT /identity/v3/projects/70b925f5ecdb42e7a2f410c41f9f9cfc/users/9d1b1de72f9d4fd3b3165588054a0a90/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:03:31.958878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9425-ca1e-4c12-a6b5-9444c130ff9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:31.959054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9425-ca1e-4c12-a6b5-9444c130ff9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:31.959331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d9425-ca1e-4c12-a6b5-9444c130ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:32.013770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fd8d9425-ca1e-4c12-a6b5-9444c130ff9b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:32.015053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd8d9425-ca1e-4c12-a6b5-9444c130ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:32.127950 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2048/4102] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:32.140465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:32.143189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:32.219417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:32.237447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618cf264-d7b4-4efe-babd-c8156415216e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:32.242061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:32.243381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:32.243661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:32.243992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:32.255226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:32.256685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:32.268700 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2055/4103] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:33.238441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:33.239490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:33.240255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:33.270473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:33.273528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:33.387357 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2049/4104] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:03:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:33.402827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:33.404905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:33.591962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7008366-c099-4379-b217-a657dbc8e1be service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:33.604923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:33.605712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:33.606106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:33.606588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:33.630475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:33.633284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:33.653320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2056/4105] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:03:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:38.237055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:38.262778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b825e7f-704d-4f62-b90e-fc2cfb2d1ad2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:38.300155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:38.300981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:38.301981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:38.302361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:38.307568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:38.352781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:38.443310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:38.447302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad8ed7-988c-44ee-ae48-a045dce362ce service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:38.467651 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2050/4106] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:03:40.930976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:40.932537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.000734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:41.001561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:41.002023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:41.102355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:41.111427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.202331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce01b86-7400-4553-9880-f199537bef00 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:41.242208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:41.243164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:41.243475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:41.243746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:41.252528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.304265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:41.307688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a824d-3926-425f-bc35-0a3773e933a6 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:41.339580 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2057/4107] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:41.482214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:41.482727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:41.484354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:41.484733 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2051/4108] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:41.578349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:41.580349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.608878 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2058/4109] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:41.620802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:41.622430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.763158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:41.764587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.794889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befed6c9-19d7-49f7-a4e0-3a1854bb619a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:41.832155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:41.832807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:41.833091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:41.833371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:41.841438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:41.870278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:41.871916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a267-c9d1-422c-8104-dfefd20599d2 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:41.921128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2059/4110] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:41.929424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e68951-0a4e-4ee4-8bca-21d8c66929e7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:41.939530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2d89b-e418-4377-9986-209ff3a23e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:41.940455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d89b-e418-4377-9986-209ff3a23e93 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:41.940894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d89b-e418-4377-9986-209ff3a23e93 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:41.941370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2d89b-e418-4377-9986-209ff3a23e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:41.972863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2d89b-e418-4377-9986-209ff3a23e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:41.974539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2d89b-e418-4377-9986-209ff3a23e93 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:42.000767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2052/4111] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:03:49.769971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac011-0626-41e4-a4c5-88b5677d9850 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:49.770846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac011-0626-41e4-a4c5-88b5677d9850 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:49.771282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ac011-0626-41e4-a4c5-88b5677d9850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:49.851109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b75ac011-0626-41e4-a4c5-88b5677d9850 None None] MFA Rules not processed for user `801730a89d33490d8d6f425f20ce5b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:49.852257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b75ac011-0626-41e4-a4c5-88b5677d9850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:50.028762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:50.095610 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2060/4112] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:51.989688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:03:53.179161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:53.180305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:53.180728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:53.323607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:53.325528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:53.561144 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2053/4113] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:53.625351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd5b1c-1b6b-4e06-9ad6-aa808ac21225 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:53.626906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd5b1c-1b6b-4e06-9ad6-aa808ac21225 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:53.628242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd5b1c-1b6b-4e06-9ad6-aa808ac21225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:53.672239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6bd5b1c-1b6b-4e06-9ad6-aa808ac21225 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:03:53.674227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6bd5b1c-1b6b-4e06-9ad6-aa808ac21225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:03:53.694393 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2061/4114] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:03:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:03:53.698193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:03:53.746038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ddfa7-ab9a-4ab1-bd6e-838625eab684 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:03:53.754592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:03:53.755614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:03:53.756171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:03:53.756771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:03:53.773027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:03:53.775361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:03:53.807086 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2054/4115] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:03:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:04:03.664702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:03.794106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:06.683094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:06.683963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:06.684400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:06.728172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:06.729732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:06.754539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2062/4116] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:08.002214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:08.032545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e889b-97a8-45cd-b757-ff0dd632f775 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:08.048983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:08.050759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:08.051044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:08.052468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:08.058260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:08.078677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:08.089137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:08.090863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f052d7b-dd76-4388-8e22-f990a5f91ef6 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:08.101866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8d91c-c964-42bb-91dc-bd416119f0e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:08.111534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:08.112169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:08.112448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:08.112720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:08.114023 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2055/4117] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:04:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:04:08.115615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:08.151719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:08.157484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e39fc-f41c-4448-8352-8daf108111ac service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:08.175217 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2063/4118] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:04:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:04:08.330876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:08.331139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:08.331394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:08.355444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:08.356822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:08.374139 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2056/4119] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:04:11.213106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009cd1-f4d7-4088-8789-5848617e0eed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:11.214093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009cd1-f4d7-4088-8789-5848617e0eed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:11.214527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b009cd1-f4d7-4088-8789-5848617e0eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:11.267560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2b009cd1-f4d7-4088-8789-5848617e0eed None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:11.268853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b009cd1-f4d7-4088-8789-5848617e0eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:11.282005 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2064/4120] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:04:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:11.300901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:11.323220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71c076-fd67-4e61-9212-d7f1645d30c8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:11.335134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:11.337230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:11.337680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:11.338324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:11.350637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:11.353247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:11.365702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2057/4121] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:04:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:04:18.283512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc3435-52db-4792-8c6c-565dacd5f452 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:18.284113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc3435-52db-4792-8c6c-565dacd5f452 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:18.284113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc3435-52db-4792-8c6c-565dacd5f452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:18.350063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fedc3435-52db-4792-8c6c-565dacd5f452 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:18.355880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fedc3435-52db-4792-8c6c-565dacd5f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:18.387183 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2065/4122] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:04:18.683428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:18.701308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a60d2-d3d4-4a2b-807b-aaa56c0f5852 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:18.708160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:18.708906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:18.709195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:18.709467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:18.711385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:18.726873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:18.729790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:18.758424 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2058/4123] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:04:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:04:28.327443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=19 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:28.745750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=21 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:32.401585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937152d-0313-41b4-ba6d-863b3a203c57 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:32.402390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937152d-0313-41b4-ba6d-863b3a203c57 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:32.402390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b937152d-0313-41b4-ba6d-863b3a203c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:32.426413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b937152d-0313-41b4-ba6d-863b3a203c57 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:32.427836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b937152d-0313-41b4-ba6d-863b3a203c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:32.446380 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2066/4124] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:04:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:32.460918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:32.477178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ea25b-0e6b-473a-afaa-6bdc131496c7 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:32.484292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9cc21-46a0-439d-82ae-891e54347626 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:32.485019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9cc21-46a0-439d-82ae-891e54347626 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:32.485197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9cc21-46a0-439d-82ae-891e54347626 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:32.485504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9cc21-46a0-439d-82ae-891e54347626 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:32.495683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9cc21-46a0-439d-82ae-891e54347626 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:32.498213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9cc21-46a0-439d-82ae-891e54347626 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:32.508347 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2059/4125] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:04:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:32.899097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97d7b-ebf5-4a97-bfbd-3cd6e0d75af6 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:32.899373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97d7b-ebf5-4a97-bfbd-3cd6e0d75af6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:32.899640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97d7b-ebf5-4a97-bfbd-3cd6e0d75af6 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:32.901607 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2067/4126] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:04:32.917431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25d046-b834-4199-9d8e-6ae910b515b9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:32.917431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25d046-b834-4199-9d8e-6ae910b515b9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:32.917431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25d046-b834-4199-9d8e-6ae910b515b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:32.998073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad25d046-b834-4199-9d8e-6ae910b515b9 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:32.999803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad25d046-b834-4199-9d8e-6ae910b515b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:33.007846 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2060/4127] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:04:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:33.023982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97d7b-ebf5-4a97-bfbd-3cd6e0d75af6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:33.048485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97d7b-ebf5-4a97-bfbd-3cd6e0d75af6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:33.052170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:33.052851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:33.053193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:33.053527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:33.061304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:33.062941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:33.071314 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2068/4128] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:04:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:04:33.817242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957d69-1acb-4e7f-a238-a2bdd1dec441 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:33.817772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957d69-1acb-4e7f-a238-a2bdd1dec441 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:33.817772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1957d69-1acb-4e7f-a238-a2bdd1dec441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:33.838396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d1957d69-1acb-4e7f-a238-a2bdd1dec441 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:33.839896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1957d69-1acb-4e7f-a238-a2bdd1dec441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:33.847846 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2061/4129] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:04:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:33.862307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:33.875263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84713c8-1865-4430-8aa5-b48cb5df0ae8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:33.881348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:33.882120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:33.882482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:33.882810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:33.892437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:33.894214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:33.905129 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2069/4130] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:04:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:34.337039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53ca3-e62e-4ae8-a9d6-e169ca39a181 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:34.337315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53ca3-e62e-4ae8-a9d6-e169ca39a181 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:34.337908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53ca3-e62e-4ae8-a9d6-e169ca39a181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:34.374484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-13d53ca3-e62e-4ae8-a9d6-e169ca39a181 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:34.375974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-13d53ca3-e62e-4ae8-a9d6-e169ca39a181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:34.385164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2062/4131] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:04:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:34.401184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:34.414307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef301426-d5e9-4b5e-a9c5-817d7761b0ff service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:34.432423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:34.433064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:34.433343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:34.447015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:34.471502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:34.473314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:34.503850 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2070/4132] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:04:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:38.796234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:38.798369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:38.799273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:38.839898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:38.841666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:38.857032 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2063/4133] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:39.291121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:39.292726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:39.336706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56606026-21d3-4a74-bed6-08a6f1ed5b49 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:39.341497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:39.342372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:39.343096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:39.343583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] PATH_INFO: `/v3/users/cab4906c7a3748b4b0a1df38423d82a9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:39.345368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab4906c7a3748b4b0a1df38423d82a9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:39.347666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:39.410006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab4906c7a3748b4b0a1df38423d82a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.419573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab4906c7a3748b4b0a1df38423d82a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.420524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab4906c7a3748b4b0a1df38423d82a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.430163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab4906c7a3748b4b0a1df38423d82a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.431345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-779cc504-fb2f-4ce5-a7be-e3219b5b19e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab4906c7a3748b4b0a1df38423d82a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.456581 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2071/4134] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:04:39 2022] DELETE /identity/v3/users/cab4906c7a3748b4b0a1df38423d82a9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:04:39.705442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:39.728732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e71565-df5c-45f6-81c6-3a91193cd849 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:39.857936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:39.859479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:39.859905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:39.860334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] PATH_INFO: `/v3/projects/d573dd77f3b24ee4b650ca45e657e307` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:39.862302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d573dd77f3b24ee4b650ca45e657e307)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:39.865243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:39.931378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd573dd77f3b24ee4b650ca45e657e307', 'request_id': 'req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.939625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd573dd77f3b24ee4b650ca45e657e307', 'request_id': 'req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.948741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd573dd77f3b24ee4b650ca45e657e307', 'request_id': 'req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.964046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] The token cache is being invalidate because project d573dd77f3b24ee4b650ca45e657e307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:04:39.964478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.965367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e00d8934-6c46-49ce-a9ff-4b2b90d74aca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:04:39.967009 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2064/4135] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:04:39 2022] DELETE /identity/v3/projects/d573dd77f3b24ee4b650ca45e657e307 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:04:39.972293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:39.972610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:39.972871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.038135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:40.039724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:40.132078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:40.170983 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2072/4136] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:40.178685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.179120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.179607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.217986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:40.219448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:40.228744 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2065/4137] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:40.233090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.244175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb32bde-9649-4e92-a48d-72a6e488e241 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.251089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.251893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.252308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.252648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.253444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:04:40.253846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.256023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.271395 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2073/4138] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:04:40.276032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.287035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9763577-6008-4bfa-b1ab-bb147ad99a83 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.292437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.293365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.293842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.294217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.295194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.297276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.321381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:40.333986 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2066/4139] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:04:40 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:04:40.339248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.355307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe6d9-c330-4570-95cd-29109360fb85 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.423409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.424038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.424320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.424594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.425373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.427420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.453874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2074/4140] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:04:40 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:04:40.457928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.468569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba70f54-3c56-43b7-bb33-35ea01764468 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.483421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.484338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.484622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.484891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.486067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.487924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.500304 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2067/4141] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:04:40.504176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.516534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a7ff3-9a8b-4516-a7d2-6107533872f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.521912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002f1c-7938-4d2e-9771-1ac850a95ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.522668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002f1c-7938-4d2e-9771-1ac850a95ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.523092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002f1c-7938-4d2e-9771-1ac850a95ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.523502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002f1c-7938-4d2e-9771-1ac850a95ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.524637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002f1c-7938-4d2e-9771-1ac850a95ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.526458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002f1c-7938-4d2e-9771-1ac850a95ad3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.538584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2075/4142] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:04:40.542997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.563277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e9edd-35e4-4368-8e44-5e6d5a9efc66 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.568492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435c9eb-8a8d-4c8b-b8ad-419558aa94d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.569357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c9eb-8a8d-4c8b-b8ad-419558aa94d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.569781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c9eb-8a8d-4c8b-b8ad-419558aa94d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.570236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435c9eb-8a8d-4c8b-b8ad-419558aa94d8 admin admin] PATH_INFO: `/v3/projects/803f70c407f64cbc9818e1b856d60d2c/users/a93753777d5f4b4885e4ce1e0b13ed98/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.602649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c9eb-8a8d-4c8b-b8ad-419558aa94d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803f70c407f64cbc9818e1b856d60d2c, user_id=a93753777d5f4b4885e4ce1e0b13ed98, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.603384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e435c9eb-8a8d-4c8b-b8ad-419558aa94d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.634215 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2068/4143] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:04:40 2022] PUT /identity/v3/projects/803f70c407f64cbc9818e1b856d60d2c/users/a93753777d5f4b4885e4ce1e0b13ed98/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:04:40.639829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.640091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.640468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.664639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:40.666007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:40.743718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.744198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.744642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.767926 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2076/4144] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:40.769621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:40.771538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:40.777908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.780911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:40.853532 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2069/4145] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:04:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:04:40.854647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:40.856137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:40.861059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934bf8d-41e6-4524-a5f3-98eeb74724a4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.865430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093632c4-9d1c-45f1-ad05-20bbbd61a273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.866082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093632c4-9d1c-45f1-ad05-20bbbd61a273 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.866358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093632c4-9d1c-45f1-ad05-20bbbd61a273 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.866626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093632c4-9d1c-45f1-ad05-20bbbd61a273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.875237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:40.879144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093632c4-9d1c-45f1-ad05-20bbbd61a273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.881010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093632c4-9d1c-45f1-ad05-20bbbd61a273 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:40.892276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2077/4146] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:04:40.944896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b394e-42c0-49d9-b48c-f2d94e67fce4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:40.964426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd302beb-3186-4461-93ae-0af2094c3426 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:40.965068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd302beb-3186-4461-93ae-0af2094c3426 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:40.965421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd302beb-3186-4461-93ae-0af2094c3426 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:40.967571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd302beb-3186-4461-93ae-0af2094c3426 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:40.991165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd302beb-3186-4461-93ae-0af2094c3426 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:40.995836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd302beb-3186-4461-93ae-0af2094c3426 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:41.023292 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2070/4147] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:04:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:04:45.878552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f9a1-805d-4bb9-8678-db00c3c6f149 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:45.879029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f9a1-805d-4bb9-8678-db00c3c6f149 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:45.879135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe0f9a1-805d-4bb9-8678-db00c3c6f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:45.942392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ebe0f9a1-805d-4bb9-8678-db00c3c6f149 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:45.944006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ebe0f9a1-805d-4bb9-8678-db00c3c6f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:46.130757 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2078/4148] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:49.304916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7eab-ba31-4cc4-a848-b4a1c149597f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:49.305413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7eab-ba31-4cc4-a848-b4a1c149597f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:49.305493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c7eab-ba31-4cc4-a848-b4a1c149597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:49.352870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-540c7eab-ba31-4cc4-a848-b4a1c149597f None None] MFA Rules not processed for user `dc4e17d222e0426698d1ef9a17921d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:49.375235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-540c7eab-ba31-4cc4-a848-b4a1c149597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:49.589871 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2071/4149] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:50.101330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d06c-2334-433f-84e3-cd88d659163d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:50.101993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d06c-2334-433f-84e3-cd88d659163d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:50.101993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d06c-2334-433f-84e3-cd88d659163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:50.181990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bb78d06c-2334-433f-84e3-cd88d659163d None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:50.183911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb78d06c-2334-433f-84e3-cd88d659163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:50.217192 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2079/4150] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:51.838080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:51.838618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:51.838618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:51.847579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:04:51.913997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] MFA Rules not processed for user `a93753777d5f4b4885e4ce1e0b13ed98`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:51.915273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:52.135664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2072/4151] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:52.145857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebd50a-e61a-4c72-bc68-1cabdc900b1d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:52.146834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebd50a-e61a-4c72-bc68-1cabdc900b1d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:52.147249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebd50a-e61a-4c72-bc68-1cabdc900b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:52.186607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c2ebd50a-e61a-4c72-bc68-1cabdc900b1d None None] MFA Rules not processed for user `a93753777d5f4b4885e4ce1e0b13ed98`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:52.191232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2ebd50a-e61a-4c72-bc68-1cabdc900b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:52.221539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2080/4152] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:52.233062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:04:52.234952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:52.433154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54c1e6-b2ed-4ab7-bf29-e7c921a606d9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:04:52.448781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ad079-8166-40ad-93ff-f2e0b8ac319a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:04:52.449482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ad079-8166-40ad-93ff-f2e0b8ac319a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:52.449766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ad079-8166-40ad-93ff-f2e0b8ac319a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:52.450069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ad079-8166-40ad-93ff-f2e0b8ac319a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:52.470828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ad079-8166-40ad-93ff-f2e0b8ac319a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:04:52.475139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ad079-8166-40ad-93ff-f2e0b8ac319a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:04:52.506993 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2073/4153] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:04:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:04:55.125989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73556-5fed-40cd-b757-e99f2e8f782a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:55.126347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73556-5fed-40cd-b757-e99f2e8f782a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:55.126498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73556-5fed-40cd-b757-e99f2e8f782a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:55.149827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-76e73556-5fed-40cd-b757-e99f2e8f782a None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:55.168017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76e73556-5fed-40cd-b757-e99f2e8f782a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:55.181986 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2081/4154] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:04:56.549846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afecba-30f7-44ce-9636-e053086bba64 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:56.555445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afecba-30f7-44ce-9636-e053086bba64 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:56.555934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afecba-30f7-44ce-9636-e053086bba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:56.615537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b9afecba-30f7-44ce-9636-e053086bba64 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:56.617425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9afecba-30f7-44ce-9636-e053086bba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:56.639880 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2074/4155] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:57.328219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d26b-636e-41ef-a217-5de5bbff3aa7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:57.328678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d26b-636e-41ef-a217-5de5bbff3aa7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:57.330406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824d26b-636e-41ef-a217-5de5bbff3aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:57.430963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8824d26b-636e-41ef-a217-5de5bbff3aa7 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:57.435621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8824d26b-636e-41ef-a217-5de5bbff3aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:57.469562 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2082/4156] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:04:58.796338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7db-9ca5-49f1-9b8b-c3bb247d8c6c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:04:58.797771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7db-9ca5-49f1-9b8b-c3bb247d8c6c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:04:58.798422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171a7db-9ca5-49f1-9b8b-c3bb247d8c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:04:58.824624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1171a7db-9ca5-49f1-9b8b-c3bb247d8c6c None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:04:58.826452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1171a7db-9ca5-49f1-9b8b-c3bb247d8c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:04:58.843010 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2075/4157] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:04:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:00.537170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd39f9f-9054-4e51-9dcf-f060e34fceea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:00.538234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd39f9f-9054-4e51-9dcf-f060e34fceea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:00.538725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd39f9f-9054-4e51-9dcf-f060e34fceea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:00.611404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2cd39f9f-9054-4e51-9dcf-f060e34fceea None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:00.613010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2cd39f9f-9054-4e51-9dcf-f060e34fceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:00.621503 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2083/4158] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:01.908820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c121f-8012-4c82-8247-108429584d39 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:01.909402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c121f-8012-4c82-8247-108429584d39 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:01.909402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c121f-8012-4c82-8247-108429584d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:01.941345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-679c121f-8012-4c82-8247-108429584d39 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:01.942894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-679c121f-8012-4c82-8247-108429584d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:01.967968 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2076/4159] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:02.792542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed687-8c65-4170-a13b-de945756b4b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:02.793333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed687-8c65-4170-a13b-de945756b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:02.793736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ed687-8c65-4170-a13b-de945756b4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:02.848829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a42ed687-8c65-4170-a13b-de945756b4b6 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:02.850768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a42ed687-8c65-4170-a13b-de945756b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:03.021214 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2084/4160] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:03.259744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:03.260259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:03.260499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:03.327959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:03.330876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:03.354994 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2077/4161] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:06.229298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:06.230495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:06.230977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:06.298340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:06.301342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:06.318826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2085/4162] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:10.394040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:10.396054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:10.443624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1a3f1-bad1-46f0-8c58-3eb20fa473dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:10.457307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:10.458358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:10.458942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:10.459430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] PATH_INFO: `/v3/users/aa0f9eced1ff41e281ed82bb0465a58b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:10.460799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0f9eced1ff41e281ed82bb0465a58b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:10.470523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:10.505898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:10.531800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0f9eced1ff41e281ed82bb0465a58b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:10.567790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0f9eced1ff41e281ed82bb0465a58b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:10.569094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0f9eced1ff41e281ed82bb0465a58b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:10.579504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0f9eced1ff41e281ed82bb0465a58b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:10.580976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0f9eced1ff41e281ed82bb0465a58b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:10.603236 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2078/4163] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:05:10 2022] DELETE /identity/v3/users/aa0f9eced1ff41e281ed82bb0465a58b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:11.152077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:11.159281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=72 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:11.167846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe47f07-2960-495d-a85a-74c3f6cdd92d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:11.308802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:11.309460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:11.309738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:11.310055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] PATH_INFO: `/v3/projects/6f701d727812417a860406464cf0f757` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:11.312675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f701d727812417a860406464cf0f757)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:11.314636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:11.380458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f701d727812417a860406464cf0f757', 'request_id': 'req-35b66977-2b67-46e6-92e7-e03bb799ec0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.388875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f701d727812417a860406464cf0f757', 'request_id': 'req-35b66977-2b67-46e6-92e7-e03bb799ec0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.395472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f701d727812417a860406464cf0f757', 'request_id': 'req-35b66977-2b67-46e6-92e7-e03bb799ec0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.410492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] The token cache is being invalidate because project 6f701d727812417a860406464cf0f757 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:05:11.410869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.411672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.413332 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2086/4164] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:05:11 2022] DELETE /identity/v3/projects/6f701d727812417a860406464cf0f757 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:11.417542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:11.419197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:11.436389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ec6e6-4d21-4b34-a309-7fc96b326fc2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:11.539823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:11.540552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:11.541085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:11.541439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] PATH_INFO: `/v3/users/69929b60d43a48e39c99989d804c61d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:11.550257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69929b60d43a48e39c99989d804c61d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:11.552059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:11.642337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69929b60d43a48e39c99989d804c61d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.659125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69929b60d43a48e39c99989d804c61d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.659935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69929b60d43a48e39c99989d804c61d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.691361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69929b60d43a48e39c99989d804c61d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.692326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eea36deb-2158-4eea-80cc-bd8149b89fa8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69929b60d43a48e39c99989d804c61d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:11.728527 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2079/4165] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:05:11 2022] DELETE /identity/v3/users/69929b60d43a48e39c99989d804c61d1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:05:12.132663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:12.134808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:12.156792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66977-2b67-46e6-92e7-e03bb799ec0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:12.280886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:12.283665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:12.284473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:12.285350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] PATH_INFO: `/v3/projects/0215f0cfe2da4db7aa63ee37b50b090c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:12.287014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0215f0cfe2da4db7aa63ee37b50b090c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:12.289021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:12.339969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:12.354533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0215f0cfe2da4db7aa63ee37b50b090c', 'request_id': 'req-b9ba4d7a-2472-45ce-a271-3a5e638b9516'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:12.366959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0215f0cfe2da4db7aa63ee37b50b090c', 'request_id': 'req-b9ba4d7a-2472-45ce-a271-3a5e638b9516'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:12.374414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0215f0cfe2da4db7aa63ee37b50b090c', 'request_id': 'req-b9ba4d7a-2472-45ce-a271-3a5e638b9516'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:12.391449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] The token cache is being invalidate because project 0215f0cfe2da4db7aa63ee37b50b090c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:05:12.392542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:12.392978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b9ba4d7a-2472-45ce-a271-3a5e638b9516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:12.401702 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2087/4166] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:05:12 2022] DELETE /identity/v3/projects/0215f0cfe2da4db7aa63ee37b50b090c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:12.402501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:12.402923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:12.403330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:12.462856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:12.496153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:12.576649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:12.712444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2080/4167] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:12.721420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:12.721712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:12.722097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:12.771153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:12.772684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:12.797127 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2088/4168] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:12.799070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:12.812911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42fed6-9a50-42f1-b413-bbfca3a59407 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:12.826913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:12.827849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:12.828329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:12.829339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:12.831111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:05:12.843611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:12.851727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:12.894271 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2081/4169] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:05:12.898090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:12.910577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce5cdb-1490-4c04-9ab9-ca108f5fed45 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:12.925342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:12.925926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:12.926553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:12.926883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:12.927708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:12.929618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:12.994923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:13.003411 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2089/4170] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:05:12 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:05:13.008037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda6d0-defa-4537-b30d-99bd9271019c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:13.125381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:13.126250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:13.126798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:13.127168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:13.128533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:13.134461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:13.186569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2082/4171] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:05:12 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:05:13.190747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:13.201671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4599-2719-4a48-8ec6-fb45ea366f04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:13.226891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:13.228113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:13.228397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:13.228957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:13.229349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:13.231389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:13.249457 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2090/4172] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:05:13.250683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:13.267644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99212222-9fad-46cc-a083-9008c907af41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:13.277055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b50b0-b86a-422a-bcf6-8808640d5676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:13.277969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b50b0-b86a-422a-bcf6-8808640d5676 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:13.278454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b50b0-b86a-422a-bcf6-8808640d5676 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:13.278928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b50b0-b86a-422a-bcf6-8808640d5676 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:13.279857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b50b0-b86a-422a-bcf6-8808640d5676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:13.282936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b50b0-b86a-422a-bcf6-8808640d5676 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:13.311621 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2083/4173] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:05:13.315917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:13.334219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d882c-0fb8-432b-94cb-66445aa573c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:13.342394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:13.343082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:13.343361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:13.343631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] PATH_INFO: `/v3/projects/5bf76541414e40fe9ac135e8ab1eb4f7/users/0e351a850ca24abaa386e717b8acfbb8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:13.372042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf76541414e40fe9ac135e8ab1eb4f7, user_id=0e351a850ca24abaa386e717b8acfbb8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:13.375083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:13.404956 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2091/4174] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:05:13 2022] PUT /identity/v3/projects/5bf76541414e40fe9ac135e8ab1eb4f7/users/0e351a850ca24abaa386e717b8acfbb8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:13.410120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b783d-9e33-468b-8a27-cac6a4dd2a4e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:13.410414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b783d-9e33-468b-8a27-cac6a4dd2a4e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:13.410697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b783d-9e33-468b-8a27-cac6a4dd2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:13.430841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-394b783d-9e33-468b-8a27-cac6a4dd2a4e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:13.432842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-394b783d-9e33-468b-8a27-cac6a4dd2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:13.613268 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2084/4175] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:13.632630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:13.632630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:13.786251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577387b-9b11-444c-befc-796dc6862729 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:13.791532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9835e53-7a11-422b-8f18-0e629148b084 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:13.792170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9835e53-7a11-422b-8f18-0e629148b084 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:13.792442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9835e53-7a11-422b-8f18-0e629148b084 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:13.793188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9835e53-7a11-422b-8f18-0e629148b084 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:13.804655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9835e53-7a11-422b-8f18-0e629148b084 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:13.806286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9835e53-7a11-422b-8f18-0e629148b084 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:13.832713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2092/4176] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:14.420730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524bad-b2f7-431d-a5f8-09968e614395 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:14.421033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524bad-b2f7-431d-a5f8-09968e614395 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:14.421297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e524bad-b2f7-431d-a5f8-09968e614395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:14.455269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e524bad-b2f7-431d-a5f8-09968e614395 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:14.458563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e524bad-b2f7-431d-a5f8-09968e614395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:14.503053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:14.544024 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2085/4177] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:05:15.540820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:15.542174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:15.542598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:15.573485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:15.577840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:15.594632 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2093/4178] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:21.026911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c3f52-49a2-495b-b14d-7bda01bc1457 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:21.027286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c3f52-49a2-495b-b14d-7bda01bc1457 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:21.027476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c3f52-49a2-495b-b14d-7bda01bc1457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:21.098326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-556c3f52-49a2-495b-b14d-7bda01bc1457 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:21.099642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-556c3f52-49a2-495b-b14d-7bda01bc1457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:21.265985 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2086/4179] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:05:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:21.304186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:21.306209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:21.388974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:21.441548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fefc2-a70b-453a-8c5f-2b0f8a1fb806 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:21.453969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:21.454613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:21.454895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:21.455169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:21.472851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:21.474507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:21.504702 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2094/4180] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:05:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:05:21.642115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89903-e21c-47c2-88cf-623a3ad28e1e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:21.642293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89903-e21c-47c2-88cf-623a3ad28e1e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:21.642575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a89903-e21c-47c2-88cf-623a3ad28e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:21.698484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7a89903-e21c-47c2-88cf-623a3ad28e1e None None] MFA Rules not processed for user `0e351a850ca24abaa386e717b8acfbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:21.699739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7a89903-e21c-47c2-88cf-623a3ad28e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:21.949347 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2087/4181] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:22.111326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:22.112991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:22.337204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997fe239-39b2-40bd-8fac-951b973824b6 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:22.353086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:22.353841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:22.354179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:22.354489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:22.372987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:22.380266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:22.414831 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2095/4182] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:22.755264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:22.756149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:22.756788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:22.794808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:22.803804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:22.926048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2088/4183] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:32.394568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=53 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:32.909984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:34.902088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:34.914362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ae64a-1d83-4fcf-9312-0a0773da4855 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:34.922112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:34.922820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:34.923340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:34.923801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:34.926082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:34.942132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:34.943986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cacfed-40f8-4be5-aec1-0259df12a291 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:34.961510 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2096/4184] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:36.999037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:37.001265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:37.021703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7803f-adcc-4c51-ba9f-0408028d01dd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:37.039469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:37.042310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:37.042954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:37.043465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:37.046794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:37.073134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:37.081096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:37.120819 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2089/4185] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:38.652449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:38.652939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:38.653032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:38.693296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] MFA Rules not processed for user `9d1b1de72f9d4fd3b3165588054a0a90`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:38.703533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:38.714149 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2097/4186] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:45.781932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:45.795362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304f8f1-182f-43aa-9ac9-79216284e49a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:45.800372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:45.800995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:45.801277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:45.801550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] PATH_INFO: `/v3/users/0e351a850ca24abaa386e717b8acfbb8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:45.803139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e351a850ca24abaa386e717b8acfbb8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:45.805494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:45.890859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e351a850ca24abaa386e717b8acfbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:45.931892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e351a850ca24abaa386e717b8acfbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:45.932660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e351a850ca24abaa386e717b8acfbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:45.944490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e351a850ca24abaa386e717b8acfbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:45.945473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c098eede-0b6f-44aa-8a1f-34c833f3aa41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e351a850ca24abaa386e717b8acfbb8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:45.979601 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2090/4187] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:05:45 2022] DELETE /identity/v3/users/0e351a850ca24abaa386e717b8acfbb8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:46.348702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:46.362741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525e488-da77-4999-83ce-481d667eeb5c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:46.504553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:46.505524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:46.505794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:46.506332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] PATH_INFO: `/v3/projects/5bf76541414e40fe9ac135e8ab1eb4f7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:46.508254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf76541414e40fe9ac135e8ab1eb4f7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:46.514129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:46.681152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf76541414e40fe9ac135e8ab1eb4f7', 'request_id': 'req-4077adfb-0ba4-4695-914b-02b86fd35a36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:46.697713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf76541414e40fe9ac135e8ab1eb4f7', 'request_id': 'req-4077adfb-0ba4-4695-914b-02b86fd35a36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:46.711547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf76541414e40fe9ac135e8ab1eb4f7', 'request_id': 'req-4077adfb-0ba4-4695-914b-02b86fd35a36'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:46.735408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] The token cache is being invalidate because project 5bf76541414e40fe9ac135e8ab1eb4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:05:46.736033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:46.737071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4077adfb-0ba4-4695-914b-02b86fd35a36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:46.739840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2098/4188] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:05:46 2022] DELETE /identity/v3/projects/5bf76541414e40fe9ac135e8ab1eb4f7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:46.745058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709c83-f054-4182-9a22-16952f55ba8c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:46.745555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709c83-f054-4182-9a22-16952f55ba8c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:46.746025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61709c83-f054-4182-9a22-16952f55ba8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:46.772725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-61709c83-f054-4182-9a22-16952f55ba8c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:46.774316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61709c83-f054-4182-9a22-16952f55ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:46.854783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:46.855063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:46.855338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:46.861951 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2091/4189] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:46.869974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:46.870517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:46.870810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:46.886733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] MFA Rules not processed for user `dc4e17d222e0426698d1ef9a17921d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:46.888441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:46.904864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:46.904864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:46.917238 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2092/4190] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:46.921633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:46.935985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b45882-bedd-4ca1-b6e0-8eddec96f89e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:46.941795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:46.942457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:46.942759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:46.943225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:46.944360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:05:46.944918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:46.947115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:46.963309 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2093/4191] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:05:46.968189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:46.980530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5c5de-b82d-4cff-8aa7-bf9e419f9bbc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:46.985609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:46.986321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:46.987385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:46.987847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:46.989001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:46.993697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2099/4192] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:47.006824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:47.053978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2094/4193] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:05:46 2022] POST /identity/v3/projects => generated 411 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:05:47.055839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:47.069867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612e71a-74c0-48b9-9b35-62694901318d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:47.084699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:47.161936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:47.163044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:47.163734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:47.164158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:47.165086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:47.167468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:47.216695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2100/4194] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:05:47 2022] POST /identity/v3/users => generated 306 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:05:47.221101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:47.272317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba0e4e-4bdb-438e-9f0a-a157ac403137 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:47.287357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:47.288107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:47.288455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:47.288805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:47.289541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:47.291243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:47.296559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:47.307253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2095/4195] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:05:47.311878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:47.322742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5018-2a71-4929-bd03-75ab06a6cbf3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:47.328985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c443b-fb12-49a3-bab7-0d1dfe77d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:47.329988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c443b-fb12-49a3-bab7-0d1dfe77d437 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:47.330462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c443b-fb12-49a3-bab7-0d1dfe77d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:47.330946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c443b-fb12-49a3-bab7-0d1dfe77d437 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:47.332187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c443b-fb12-49a3-bab7-0d1dfe77d437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:47.334316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c443b-fb12-49a3-bab7-0d1dfe77d437 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:47.346978 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2101/4196] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:05:47.351302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:47.365213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6cc2c-2d4e-47f8-a614-e47f5a7dfa29 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:47.371066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:47.371916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:47.372354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:47.372855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] PATH_INFO: `/v3/projects/2e8d515c679e481b83d7001b99442d35/users/735d6338d29c46ee9b6065580413f201/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:47.391937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e8d515c679e481b83d7001b99442d35, user_id=735d6338d29c46ee9b6065580413f201, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:47.396188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:47.417681 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2096/4197] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:05:47 2022] PUT /identity/v3/projects/2e8d515c679e481b83d7001b99442d35/users/735d6338d29c46ee9b6065580413f201/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:47.422657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:47.424229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:47.424889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:47.450926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:47.452181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:47.603448 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2102/4198] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:47.615025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:47.617081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:47.729264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf63ca4-c2fb-48b8-9b13-b3c9d95656ac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:47.745110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:47.748095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:47.748380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:47.748651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:47.798155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:47.799648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:47.831619 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2097/4199] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:55.866630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:55.868435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:56.043105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df09ec-67c3-4fe9-86f3-d85fe6d0ffe1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:56.052981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:56.053856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:56.053856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:56.054413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:56.060934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:56.154104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:56.273489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:56.281149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:56.310015 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2103/4200] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:56.473154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:56.488056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb1a74-463a-4d81-be8e-0d40b549a472 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:56.496366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:56.497025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:56.497364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:56.499106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:56.504460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:56.527159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:56.532201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:56.600969 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2098/4201] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:05:57.035228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:57.039053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:57.064957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c663d-356e-467f-8781-6fcff5aca4bc service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:57.073154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:57.073818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:57.074124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:57.074407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:57.077459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:57.123073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:57.125021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:57.173095 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2104/4202] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:05:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:05:58.015842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:58.018329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:58.063670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf9632-49ec-43b5-ba18-ba501df7616e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:58.070413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:58.071270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:58.072057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:58.072806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] PATH_INFO: `/v3/users/a93753777d5f4b4885e4ce1e0b13ed98` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:58.075588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a93753777d5f4b4885e4ce1e0b13ed98)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:58.079352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:58.203335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a93753777d5f4b4885e4ce1e0b13ed98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:58.247252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a93753777d5f4b4885e4ce1e0b13ed98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:58.250600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a93753777d5f4b4885e4ce1e0b13ed98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:58.275359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a93753777d5f4b4885e4ce1e0b13ed98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:58.277025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-361208b4-b06f-4ab8-9404-87e80d2b43c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a93753777d5f4b4885e4ce1e0b13ed98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:58.312158 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2099/4203] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:05:58 2022] DELETE /identity/v3/users/a93753777d5f4b4885e4ce1e0b13ed98 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:05:59.311180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:59.341050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cdd71-7249-4991-b834-b50ba69c2351 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:59.449656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:59.450510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:59.450884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:59.451384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] PATH_INFO: `/v3/projects/803f70c407f64cbc9818e1b856d60d2c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:59.462769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=803f70c407f64cbc9818e1b856d60d2c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:05:59.466113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:05:59.577778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803f70c407f64cbc9818e1b856d60d2c', 'request_id': 'req-dcddd8f1-fd94-4583-8368-99ffe224a0f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:59.591865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803f70c407f64cbc9818e1b856d60d2c', 'request_id': 'req-dcddd8f1-fd94-4583-8368-99ffe224a0f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:59.602016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803f70c407f64cbc9818e1b856d60d2c', 'request_id': 'req-dcddd8f1-fd94-4583-8368-99ffe224a0f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:59.647388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] The token cache is being invalidate because project 803f70c407f64cbc9818e1b856d60d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:05:59.647877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:59.649761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcddd8f1-fd94-4583-8368-99ffe224a0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:05:59.655391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2105/4204] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:05:59 2022] DELETE /identity/v3/projects/803f70c407f64cbc9818e1b856d60d2c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:05:59.659294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:59.659781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:59.659872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:59.689077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:59.690548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:59.767429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:05:59.879193 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2100/4205] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:59.888297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:59.889501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:59.890188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:59.924641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:05:59.926352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:05:59.939395 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2106/4206] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:05:59.945832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:05:59.969941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0651c-0242-4942-b7f8-4c0c216e5533 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:05:59.996161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:05:59.996989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:05:59.997606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:05:59.998103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:05:59.999359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:05:59.999851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:00.001719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:00.071928 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2101/4207] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:06:00.076604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:00.107435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1af9f5-7e91-49da-8a77-cac36293c017 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:00.120553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:00.125692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.126956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.126956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.127916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:00.133855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:00.228842 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2107/4208] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:06:00 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:06:00.233138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:00.259788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e4da5-8d62-4658-a08b-1d63ac0c3cce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:00.470534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:00.471150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.471653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.472127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.472859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:00.475124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:00.503079 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2102/4209] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:06:00 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:06:00.507302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:00.517677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:00.527433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f08dc6-df72-4fd8-89b5-553689a3a2df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:00.539799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269db092-f25c-4520-a2b5-6d155363de79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:00.543125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db092-f25c-4520-a2b5-6d155363de79 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.543720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db092-f25c-4520-a2b5-6d155363de79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.545101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269db092-f25c-4520-a2b5-6d155363de79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.547120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269db092-f25c-4520-a2b5-6d155363de79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:00.551230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269db092-f25c-4520-a2b5-6d155363de79 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:00.581075 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2108/4210] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:06:00.585206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:00.601173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e3e64-7856-4b49-8699-3fb9bd2e4e67 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:00.608277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7f536-d670-4f61-be5f-bd35ba9e83b0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.608568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7f536-d670-4f61-be5f-bd35ba9e83b0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.608843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7f536-d670-4f61-be5f-bd35ba9e83b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.633675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:00.634298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.634632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.634877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.635604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:00.642888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:00.682446 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2103/4211] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:06:00.684353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0f7f536-d670-4f61-be5f-bd35ba9e83b0 None None] MFA Rules not processed for user `735d6338d29c46ee9b6065580413f201`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:00.685769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0f7f536-d670-4f61-be5f-bd35ba9e83b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:00.694609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:00.715381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4428-e750-4a95-a20a-5bde751968ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:00.727475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e38a5e9-fac9-46ae-8127-fb3aa9fec2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:00.728697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a5e9-fac9-46ae-8127-fb3aa9fec2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.729154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a5e9-fac9-46ae-8127-fb3aa9fec2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.729604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38a5e9-fac9-46ae-8127-fb3aa9fec2a2 admin admin] PATH_INFO: `/v3/projects/515e073461f640f698fb302b4b9b0779/users/cda37fbe7dd9480592f14e99d24296e6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.768196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a5e9-fac9-46ae-8127-fb3aa9fec2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515e073461f640f698fb302b4b9b0779, user_id=cda37fbe7dd9480592f14e99d24296e6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:00.774264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e38a5e9-fac9-46ae-8127-fb3aa9fec2a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:00.777229 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2109/4212] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:00 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:06:00.792292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.792292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.792292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.811607 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2104/4213] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:06:00 2022] PUT /identity/v3/projects/515e073461f640f698fb302b4b9b0779/users/cda37fbe7dd9480592f14e99d24296e6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:06:00.816710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:00.817066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:00.817399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:00.853166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] MFA Rules not processed for user `735d6338d29c46ee9b6065580413f201`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:00.854783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:00.901674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:00.903025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:01.054349 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2105/4214] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:01.068089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:01.071679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:01.105120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:01.176736 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2110/4215] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:00 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:06:01.178818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46df30-5df7-4487-ad73-0d6bc58a42d6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:01.193326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:01.194961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:01.195342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc96a-c11f-4510-8f82-9eb18c76361d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:01.196148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc96a-c11f-4510-8f82-9eb18c76361d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:01.197503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc96a-c11f-4510-8f82-9eb18c76361d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:01.198046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc96a-c11f-4510-8f82-9eb18c76361d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:01.233956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc96a-c11f-4510-8f82-9eb18c76361d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:01.235564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc96a-c11f-4510-8f82-9eb18c76361d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:01.266441 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2106/4216] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:06:01.268053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:01.271122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:01.271646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:01.325255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:01.328988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:01.345349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd61c19-3bd0-4b2c-90e3-239b80cad81e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:01.352253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892cce35-9ec1-40d4-9595-52203d59f801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:01.353273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cce35-9ec1-40d4-9595-52203d59f801 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:01.353737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cce35-9ec1-40d4-9595-52203d59f801 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:01.354219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892cce35-9ec1-40d4-9595-52203d59f801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:01.364417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cce35-9ec1-40d4-9595-52203d59f801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:01.366589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892cce35-9ec1-40d4-9595-52203d59f801 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:01.378285 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2111/4217] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:01 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:06:01.443982 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2107/4218] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:04.595967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847002f-041f-4a21-827e-f1ca26f348be None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:04.596898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847002f-041f-4a21-827e-f1ca26f348be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:04.598084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847002f-041f-4a21-827e-f1ca26f348be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:04.625898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:04.671868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1847002f-041f-4a21-827e-f1ca26f348be None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:04.673085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1847002f-041f-4a21-827e-f1ca26f348be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:04.747609 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2112/4219] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:06:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:04.761879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:04.763955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:04.969716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da751d20-e7b2-437f-8c42-6d01933c37a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:04.987887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:04.989663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:04.991779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:04.993349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:05.021911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:05.026784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:05.075664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2108/4220] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:06:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:05.099509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:05.099794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:05.100065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:05.190863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:05.192250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:05.221348 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2113/4221] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:06:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:05.237507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:05.269019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534a6f8-8727-4992-8966-6f54aa95d50d service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:05.295943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:05.299161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:05.300373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:05.302391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:05.343726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:05.351865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:05.386408 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2109/4222] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:06:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:08.169068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:08.171679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:08.204652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6405b8-9e44-48ad-a1b0-57838e6489c6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:08.213447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:08.214651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:08.218253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:08.218535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:08.223245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:08.264252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:08.269249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21662b-47dc-4f50-abeb-d3d52faaed53 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:08.315039 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2114/4223] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:12.323531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:12.330774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:12.370812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247e87-15eb-4828-b558-854c6b4a9d0b service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:12.394978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:12.395614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:12.395900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:12.396264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:12.407433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:12.450449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:12.477770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeac325-72bb-4006-9e05-a38849fa6763 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:12.529397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2110/4224] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:18.296867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=39 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:19.387817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:19.388271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:19.388271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:19.416581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] MFA Rules not processed for user `14aff6fe639d42bcb968efc58f7e9cad`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:19.417954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:19.548721 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2115/4225] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:20.008310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:20.009552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:20.010202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:20.107274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] MFA Rules not processed for user `cda37fbe7dd9480592f14e99d24296e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:20.108537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:20.120163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:20.123183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:20.147872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6cf1e-3a3b-4dfa-860c-c734804850d7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:20.153069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:20.153692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:20.154001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:20.154266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:20.156063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:20.176541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:20.178547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ce281e-cbf9-4b57-ad73-5d1eb6e090fa service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:20.206322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2116/4226] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:20.309512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:20.310008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:20.311227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:20.318226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2111/4227] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:20.383782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] MFA Rules not processed for user `cda37fbe7dd9480592f14e99d24296e6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:20.391572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:20.417240 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2117/4228] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:20.829407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:20.863124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb8287-4d60-443d-bfa9-8505f61cf9a3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:20.883120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:20.884105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:20.884862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:20.885866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:20.897912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:20.900178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:20.916856 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2112/4229] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:21.415190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:21.416963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:21.654424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba2510-eae2-4bdb-8b3b-58d2d3e482c9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:21.677987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:21.678643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:21.678923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:21.679196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:21.687920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:21.710066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:21.720434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:21.756319 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2118/4230] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:06:24.732297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:24.762319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd742b-272b-4690-9ca2-09043653326a service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:24.797924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:24.799392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:24.800045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:24.800645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:24.808464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:24.862395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:24.871810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:24.928174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2113/4231] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:26.464058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:26.490432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c873dec1-b699-4a5c-a192-bef68774d171 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:26.510802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:26.511445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:26.511718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:26.518693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:26.529109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:26.626226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:26.627714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:26.649863 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2119/4232] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:33.523373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:33.537987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80604d38-39ff-45a7-9645-6b5c8f6716c8 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:33.549324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:33.549996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:33.550244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:33.550723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:33.552655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:33.566979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:33.568587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:33.580758 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2114/4233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:35.773535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:35.790659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c699c1-0ae3-4598-b04e-eefb07528cc7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:35.796458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:35.797479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:35.798007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:35.798648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:35.800812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:35.859239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:35.871141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:35.872878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:35.883366 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2120/4234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:36.180446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:36.182061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:36.247780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf892130-ddba-4e6f-a1cb-a21723ce3150 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:36.251960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801e37-2607-4138-901e-086908b53937 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:36.252576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801e37-2607-4138-901e-086908b53937 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:36.252853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801e37-2607-4138-901e-086908b53937 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:36.253124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2801e37-2607-4138-901e-086908b53937 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:36.254933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2801e37-2607-4138-901e-086908b53937 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:36.271348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801e37-2607-4138-901e-086908b53937 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:36.272943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2801e37-2607-4138-901e-086908b53937 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:36.286369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2115/4235] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:36.371162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:36.381687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700bcfe-5447-4f95-9f57-fafa3026ed5e service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:36.386505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:36.387323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:36.387925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:36.388274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:36.390261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:36.400803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:36.402464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:36.413933 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2121/4236] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:36.543135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801e37-2607-4138-901e-086908b53937 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:36.559508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2801e37-2607-4138-901e-086908b53937 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:36.563808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:36.564688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:36.565172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:36.565636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:36.568252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:36.594437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:36.596179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ad8dd-b7ed-40e2-8ece-eaf4bddc13a4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:36.608338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2116/4237] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:39.282613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:39.298038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4f458-229d-422d-b75e-e422c933ce97 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:39.303777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:39.304385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:39.304648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:39.304914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:39.306679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:39.367960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:39.369547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:39.379568 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2122/4238] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:40.153473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146f6c-0406-43be-bd0c-6a4dcd762e12 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:40.154459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146f6c-0406-43be-bd0c-6a4dcd762e12 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:40.154975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b146f6c-0406-43be-bd0c-6a4dcd762e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:40.198508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b146f6c-0406-43be-bd0c-6a4dcd762e12 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:40.199798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b146f6c-0406-43be-bd0c-6a4dcd762e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:40.211348 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2117/4239] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:06:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:40.231924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:40.257424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc221e-4622-4e4f-832f-3f5669946759 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:40.278008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c5ef8-78bc-4ec0-99ed-f325974d87f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:40.280503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5ef8-78bc-4ec0-99ed-f325974d87f6 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:40.280909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5ef8-78bc-4ec0-99ed-f325974d87f6 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:40.281404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c5ef8-78bc-4ec0-99ed-f325974d87f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:40.298328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5ef8-78bc-4ec0-99ed-f325974d87f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:40.301324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c5ef8-78bc-4ec0-99ed-f325974d87f6 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:40.314841 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2123/4240] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:06:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:42.983596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:42.983596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:42.984112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:43.006069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] MFA Rules not processed for user `cecadca739554f858c269b85690b5cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:43.007290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:43.016180 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2118/4241] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:45.499329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:45.500446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:45.500946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:45.521262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:45.522764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:45.532910 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2124/4242] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:06:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:45.546797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:45.562802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e160bb-1899-4d43-b95d-865e30442233 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:45.569598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:45.571253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:45.571753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:45.572280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:45.592422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:45.594824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:45.605640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2119/4243] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:06:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:06:50.676950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:50.691681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bb26b-0baa-426a-ba74-837d0f5a8f45 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:50.696300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:50.697933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:50.698654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:50.699637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:50.702918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:50.812023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:50.814477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:50.828396 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2125/4244] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:06:55.601158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:57.995288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:58.009656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16289ca2-07e8-4cb4-bec3-63ace4729e6f service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:58.016726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:58.017747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:58.018218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:58.018835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] PATH_INFO: `/v3/users/cda37fbe7dd9480592f14e99d24296e6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:58.020165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda37fbe7dd9480592f14e99d24296e6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:58.022448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:58.097476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda37fbe7dd9480592f14e99d24296e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.111947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda37fbe7dd9480592f14e99d24296e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.114228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda37fbe7dd9480592f14e99d24296e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.124188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda37fbe7dd9480592f14e99d24296e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.124917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ad5cb3d2-a9df-4861-a8f3-3dcbc257553b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda37fbe7dd9480592f14e99d24296e6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.139761 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2120/4245] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:06:57 2022] DELETE /identity/v3/users/cda37fbe7dd9480592f14e99d24296e6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:06:58.408183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:58.426623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a68e92-9e94-495c-945e-b70be5a44dfd service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:58.489818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:58.500288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:58.501026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:58.501377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:58.501707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] PATH_INFO: `/v3/projects/515e073461f640f698fb302b4b9b0779` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:58.502937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=515e073461f640f698fb302b4b9b0779)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:58.505181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:58.575759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515e073461f640f698fb302b4b9b0779', 'request_id': 'req-67d8492a-851e-434a-b386-774c3d7ff3c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.582750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515e073461f640f698fb302b4b9b0779', 'request_id': 'req-67d8492a-851e-434a-b386-774c3d7ff3c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.590602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515e073461f640f698fb302b4b9b0779', 'request_id': 'req-67d8492a-851e-434a-b386-774c3d7ff3c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.606831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] The token cache is being invalidate because project 515e073461f640f698fb302b4b9b0779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:06:58.607159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.607907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-67d8492a-851e-434a-b386-774c3d7ff3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:06:58.609540 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2126/4246] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:06:58 2022] DELETE /identity/v3/projects/515e073461f640f698fb302b4b9b0779 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:06:58.614569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:58.614902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:58.615130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:58.636641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:58.639275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:58.761400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2121/4247] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:06:58.768415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:58.770673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:58.771159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:58.805989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:58.809155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:58.822480 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2127/4248] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:06:58.826957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:58.842641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c8be9-e4cc-4b69-b3c4-618eedf0981c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:58.848717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:58.849627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:58.850066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:58.850710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:58.851706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:06:58.852114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:58.854434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:58.872334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2122/4249] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:06:58.876941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:58.908386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407142d-4bbb-449e-a430-98c7d84222ca None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:58.916677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:58.918563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:58.918972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:58.919348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:58.920100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:58.923592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:58.970354 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2128/4250] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:06:58 2022] POST /identity/v3/projects => generated 395 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:06:58.974553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:58.986689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d95db-9432-4d4e-bbc2-d059bbb50a4e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:59.056169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:59.056911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:59.057041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:59.057645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:59.058748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:59.060678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:59.071216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:06:59.097779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2123/4251] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:06:58 2022] POST /identity/v3/users => generated 298 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:06:59.099224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:59.114459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af99af-650e-4e09-9a35-c9788a5247d8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:59.122202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:59.123154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:59.123545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:59.123910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:59.125310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:59.127984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:59.143715 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2129/4252] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:06:59.147604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:59.160237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0af52-512f-4340-8041-577f4a3e9d22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:59.166103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8d0db-30aa-4b9a-8ec1-de63d3a3433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:59.166721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d0db-30aa-4b9a-8ec1-de63d3a3433e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:59.167697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d0db-30aa-4b9a-8ec1-de63d3a3433e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:59.168296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8d0db-30aa-4b9a-8ec1-de63d3a3433e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:59.168947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d0db-30aa-4b9a-8ec1-de63d3a3433e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:59.170740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8d0db-30aa-4b9a-8ec1-de63d3a3433e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:59.182238 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2124/4253] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:06:59.186433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:59.197850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983d99f-adea-4fcb-8ef7-90d5710f04bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:59.205458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:59.206175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:59.206449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:59.206726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] PATH_INFO: `/v3/projects/173e87fac5564c2db6ccff6fc14e0520/users/f97cdb72a2424ca2b8487d71b7f22c0c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:59.224972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173e87fac5564c2db6ccff6fc14e0520, user_id=f97cdb72a2424ca2b8487d71b7f22c0c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:59.228847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:59.249652 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2130/4254] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:06:59 2022] PUT /identity/v3/projects/173e87fac5564c2db6ccff6fc14e0520/users/f97cdb72a2424ca2b8487d71b7f22c0c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:06:59.253792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ef04-406f-4882-b268-867759fe2ffc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:59.254598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ef04-406f-4882-b268-867759fe2ffc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:59.255151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018ef04-406f-4882-b268-867759fe2ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:59.275944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c018ef04-406f-4882-b268-867759fe2ffc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:06:59.277293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c018ef04-406f-4882-b268-867759fe2ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:59.385855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2125/4255] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:06:59.443738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:06:59.446978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:06:59.522618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224d5fb-515d-464b-84ba-96add04182f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:06:59.527514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:06:59.528243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:06:59.528515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:06:59.528792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:06:59.539886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:06:59.541335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:06:59.553273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2131/4256] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:05.072330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f872f-1b14-45ed-8d41-29c8b98a0ba7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:05.073254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f872f-1b14-45ed-8d41-29c8b98a0ba7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:05.073765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f872f-1b14-45ed-8d41-29c8b98a0ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:05.098716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fb5f872f-1b14-45ed-8d41-29c8b98a0ba7 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:05.100678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb5f872f-1b14-45ed-8d41-29c8b98a0ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:05.186829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2126/4257] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:07:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:05.201579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:05.203833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:05.233121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:05.336459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dea951-7b83-4771-89ac-bbde4821704c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:05.344536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c5169-5498-42ca-9aff-f3e31b2ec2ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:05.345545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c5169-5498-42ca-9aff-f3e31b2ec2ff service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:05.346008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c5169-5498-42ca-9aff-f3e31b2ec2ff service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:05.346425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c5169-5498-42ca-9aff-f3e31b2ec2ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:05.359013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c5169-5498-42ca-9aff-f3e31b2ec2ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:05.361560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c5169-5498-42ca-9aff-f3e31b2ec2ff service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:05.373870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2132/4258] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:07:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:06.683329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:06.683905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:06.683905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:06.713733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] MFA Rules not processed for user `f97cdb72a2424ca2b8487d71b7f22c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:06.715028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:06.794456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2127/4259] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:06.806142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:06.806618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:06.806703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:06.831637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] MFA Rules not processed for user `f97cdb72a2424ca2b8487d71b7f22c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:06.833205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:06.843913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2133/4260] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:07.013622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:07.014775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:07.038524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:07.196178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b37bac-7aa7-4a08-8980-e23e324fb793 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:07.203931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:07.204810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:07.205195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:07.205569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:07.215980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:07.218860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:07.230147 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2128/4261] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:07 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:12.567924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:12.569630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:12.605939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5706ee3-333f-43b6-bd49-4b331a311cc8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:12.620737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:12.621933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:12.622826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:12.623292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] PATH_INFO: `/v3/users/735d6338d29c46ee9b6065580413f201` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:12.625557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=735d6338d29c46ee9b6065580413f201)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:12.629495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:12.738115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735d6338d29c46ee9b6065580413f201'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:12.774671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735d6338d29c46ee9b6065580413f201'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:12.775379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735d6338d29c46ee9b6065580413f201'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:12.786592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735d6338d29c46ee9b6065580413f201'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:12.787721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-010e9c8d-dbcf-4c1e-86eb-b3ad2637c8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735d6338d29c46ee9b6065580413f201'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:12.836679 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2134/4262] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:07:12 2022] DELETE /identity/v3/users/735d6338d29c46ee9b6065580413f201 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:13.094998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:13.117070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50258964-c6a5-49f7-9c0d-250779bd60ff service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:13.252334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:13.253286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:13.253720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:13.254345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] PATH_INFO: `/v3/projects/2e8d515c679e481b83d7001b99442d35` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:13.256065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e8d515c679e481b83d7001b99442d35)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:13.258730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:13.363955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e8d515c679e481b83d7001b99442d35', 'request_id': 'req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:13.414265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e8d515c679e481b83d7001b99442d35', 'request_id': 'req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:13.443615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e8d515c679e481b83d7001b99442d35', 'request_id': 'req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:13.465905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] The token cache is being invalidate because project 2e8d515c679e481b83d7001b99442d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:07:13.466346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:13.467248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e35df75e-3aa7-4e08-be6e-0a90ba4606d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:13.469068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2129/4263] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:07:13 2022] DELETE /identity/v3/projects/2e8d515c679e481b83d7001b99442d35 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:13.474392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:13.474887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:13.475243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:13.507728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:13.509601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:13.619077 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2135/4264] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:13.627956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:13.628307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:13.628669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:13.658363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:13.659814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:13.674107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:13.685297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7eb2a-8ae3-4730-b98a-345726b513df None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:13.686389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2130/4265] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:13.691334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:13.691959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:13.692332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:13.692610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:13.693465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:07:13.693769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:13.695610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:13.735263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:13.744531 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2136/4266] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:07:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:07:13.751613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d73b2f-3b5b-4cf8-9c1e-2eeda26fbe79 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:13.759088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:13.759930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:13.760210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:13.760710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:13.761570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:13.763841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:13.805780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:13.824754 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2131/4267] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:07:13 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:07:13.825213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:13.829231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:13.835782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e54c40-fe0e-4c42-bd76-12024fad12b3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:13.930786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:13.931494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:13.937875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:13.940552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:13.941443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:13.946887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:13.986699 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2137/4268] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:07:13 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:07:13.987354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:14.005295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ecabd-cbba-4ef8-84a7-a9870169e30b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:14.014296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:14.015136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:14.015639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:14.016063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:14.016945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:14.019251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:14.054734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:14.066953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2132/4269] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:07:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:07:14.069899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd5c75-ad06-47c2-ab58-25980368c7ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:14.075412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b067570-fbfc-4c9d-bf56-fc0d00f2843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:14.076047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b067570-fbfc-4c9d-bf56-fc0d00f2843a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:14.076355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b067570-fbfc-4c9d-bf56-fc0d00f2843a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:14.076630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b067570-fbfc-4c9d-bf56-fc0d00f2843a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:14.077326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b067570-fbfc-4c9d-bf56-fc0d00f2843a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:14.080123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b067570-fbfc-4c9d-bf56-fc0d00f2843a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:14.098348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:14.106204 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2138/4270] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:07:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:07:14.111340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689756d-b8b5-4a4e-b355-5b26f456091e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:14.116394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:14.117077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:14.117763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:14.118113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] PATH_INFO: `/v3/projects/5caef7a8538d4d7989bb8ef4efe2b1b0/users/c1d70ebe6a464d21afcad6cc68bcb9c4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:14.136765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5caef7a8538d4d7989bb8ef4efe2b1b0, user_id=c1d70ebe6a464d21afcad6cc68bcb9c4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:14.140413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:14.165898 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2133/4271] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:07:14 2022] PUT /identity/v3/projects/5caef7a8538d4d7989bb8ef4efe2b1b0/users/c1d70ebe6a464d21afcad6cc68bcb9c4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:14.166856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db11c-89e6-4051-ad52-df699c0a2e22 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:14.167143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db11c-89e6-4051-ad52-df699c0a2e22 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:14.167587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1db11c-89e6-4051-ad52-df699c0a2e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:14.204607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fc1db11c-89e6-4051-ad52-df699c0a2e22 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:14.207836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc1db11c-89e6-4051-ad52-df699c0a2e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:14.326952 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2139/4272] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:14.383912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:14.385719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:14.476795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceacc83-d143-4812-886b-b5b4e832406a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:14.480941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:14.481744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:14.482111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:14.482392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:14.492820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:14.494681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:14.506935 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2134/4273] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:21.456010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:21.456575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:21.456785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:21.503545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] MFA Rules not processed for user `c1d70ebe6a464d21afcad6cc68bcb9c4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:21.505596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:21.622343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2140/4274] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:21.722514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:21.724531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:21.842804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c7d8-47a7-4028-9a84-88f784e2ce05 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:21.852951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:21.854129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:21.854822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:21.855297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:21.868349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:21.871175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:21.883604 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2135/4275] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:21 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:31.618646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:31.879104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:38.496409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:38.498053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:38.652050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa4679-c064-427d-a393-4f1fd468e2df None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:38.691069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:38.694450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:38.695276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:38.695686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:38.701332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:38.745166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:38.747941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:38.761111 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2141/4276] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:46.472445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:46.473993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:46.517232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c190c9a-d72d-48dc-834c-65abfda147fb service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:46.538039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:46.538821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:46.539232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:46.539614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] PATH_INFO: `/v3/users/9d1b1de72f9d4fd3b3165588054a0a90` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:46.542120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1b1de72f9d4fd3b3165588054a0a90)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:46.545577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:46.815100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1b1de72f9d4fd3b3165588054a0a90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:46.892965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1b1de72f9d4fd3b3165588054a0a90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:46.911348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1b1de72f9d4fd3b3165588054a0a90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:46.955403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1b1de72f9d4fd3b3165588054a0a90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:46.956568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1b1de72f9d4fd3b3165588054a0a90'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:46.987272 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2136/4277] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:07:46 2022] DELETE /identity/v3/users/9d1b1de72f9d4fd3b3165588054a0a90 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:47.286516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:47.313033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620a327-7b64-4d67-8d45-5db1f407f2d7 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:47.555729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:47.556358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:47.556636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:47.556907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:47.569537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:47.817629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:47.823494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c96ba3-5214-44d6-81b6-388998411b38 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:47.863122 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2142/4278] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:48.063657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:48.065760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:48.133135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6dbc8-b0c9-49df-9fc8-e71136e9f302 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:48.155610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:48.156674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:48.165585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:48.166081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] PATH_INFO: `/v3/projects/70b925f5ecdb42e7a2f410c41f9f9cfc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:48.168376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b925f5ecdb42e7a2f410c41f9f9cfc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:48.170918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:48.330575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'request_id': 'req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:48.342788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'request_id': 'req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:48.368061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b925f5ecdb42e7a2f410c41f9f9cfc', 'request_id': 'req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:48.394889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] The token cache is being invalidate because project 70b925f5ecdb42e7a2f410c41f9f9cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:07:48.395301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:48.396071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5596ed6b-0638-43cf-aa3c-e78aa5c5f806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:48.397677 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2137/4279] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:07:48 2022] DELETE /identity/v3/projects/70b925f5ecdb42e7a2f410c41f9f9cfc => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:48.402850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:48.403398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:48.404179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:48.488988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:48.492975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:48.616541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:48.690831 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2143/4280] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:07:48.700173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:48.700840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:48.701313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:48.744444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:48.746088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:48.767988 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2138/4281] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:48.769592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:48.782130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759cb88-6ff4-4938-a4f1-24d39ce5086b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:48.796113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:48.797071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:48.798042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:48.798418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:48.799285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:07:48.799684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:48.801378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:48.835738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2144/4282] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:07:48.840731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:48.853591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee87108-8744-4385-add7-abd77b3de669 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:48.865220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:48.866178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:48.866636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:48.867161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:48.868317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:48.873465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:48.949293 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2139/4283] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:07:48 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:07:48.953439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:48.974108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa027014-e48d-4658-979f-24c9de828b8a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:49.144127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:49.144759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:49.145030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:49.145296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:49.145963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:49.154736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:49.208678 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2145/4284] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:07:48 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:07:49.212966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:49.244689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c445d9-d2f8-44cb-a131-cdccd2d797c9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:49.286693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:49.287334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:49.287662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:49.287932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:49.288580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:49.293435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:49.340371 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2140/4285] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:07:49.341657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:49.362249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46a40c-149e-4c88-a2c4-036059212c85 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:49.381843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8929dc-309e-49e5-b2b4-d44d456976e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:49.382679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8929dc-309e-49e5-b2b4-d44d456976e8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:49.383108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8929dc-309e-49e5-b2b4-d44d456976e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:49.383527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8929dc-309e-49e5-b2b4-d44d456976e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:49.384327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8929dc-309e-49e5-b2b4-d44d456976e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:49.386472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8929dc-309e-49e5-b2b4-d44d456976e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:49.440526 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2146/4286] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:07:49.441258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:49.464421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eeb6a-acb8-4e37-aa8d-0dd8ad8553c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:49.478507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:49.479264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:49.479542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:49.479813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] PATH_INFO: `/v3/projects/14cfab0b8daa4f2e935f8bb883bf6392/users/31c787a53d064a8aba1dffdea6815f0b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:49.537231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:49.570887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=14cfab0b8daa4f2e935f8bb883bf6392, user_id=31c787a53d064a8aba1dffdea6815f0b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:49.577387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:49.637661 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2141/4287] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:07:49 2022] PUT /identity/v3/projects/14cfab0b8daa4f2e935f8bb883bf6392/users/31c787a53d064a8aba1dffdea6815f0b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:07:49.642525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:49.642995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:49.643408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:49.683828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:49.685472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:49.861004 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2147/4288] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:49.940059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:49.942668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:50.124471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c94f-c5f9-445b-8ee4-1e09e7637fbd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:50.132482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:50.133391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:50.135079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:50.135623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:50.156107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:50.157948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:50.191308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2142/4289] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:51.302251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:51.303728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:51.455143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:51.499375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:51.501592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:51.522489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e510333-4e32-4546-b46a-8579f74150c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:51.523458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7b073-99ab-464c-b7fd-9e4dc6792bc5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:51.534539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:51.535189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:51.535381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:51.535527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:51.535723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:51.536196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:51.536533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:51.536866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] PATH_INFO: `/v3/users/c1d70ebe6a464d21afcad6cc68bcb9c4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:51.538765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d70ebe6a464d21afcad6cc68bcb9c4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:51.546465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:51.546796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:51.642491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d70ebe6a464d21afcad6cc68bcb9c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:51.673578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d70ebe6a464d21afcad6cc68bcb9c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:51.675286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d70ebe6a464d21afcad6cc68bcb9c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:51.690460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:51.691924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:51.698007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d70ebe6a464d21afcad6cc68bcb9c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:51.699127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bf766ab-8473-41a2-8e86-821abdbe6e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d70ebe6a464d21afcad6cc68bcb9c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:51.711421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2148/4290] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:51.742906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2143/4291] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:07:51 2022] DELETE /identity/v3/users/c1d70ebe6a464d21afcad6cc68bcb9c4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:52.161673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:52.178204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d915436-5990-45d0-83dd-9f260959a1a7 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:52.362776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:52.364156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:52.364593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:52.365029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] PATH_INFO: `/v3/projects/5caef7a8538d4d7989bb8ef4efe2b1b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:52.366438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5caef7a8538d4d7989bb8ef4efe2b1b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:52.368810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:52.459069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5caef7a8538d4d7989bb8ef4efe2b1b0', 'request_id': 'req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:52.478439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5caef7a8538d4d7989bb8ef4efe2b1b0', 'request_id': 'req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:52.490523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5caef7a8538d4d7989bb8ef4efe2b1b0', 'request_id': 'req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:52.510653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] The token cache is being invalidate because project 5caef7a8538d4d7989bb8ef4efe2b1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:07:52.511242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:52.512100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c5bd0b0d-71a7-4b7a-822d-83518a7aba33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:52.516924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2149/4292] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:07:52 2022] DELETE /identity/v3/projects/5caef7a8538d4d7989bb8ef4efe2b1b0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:52.525255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:52.526036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:52.532993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:52.621783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:52.624891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:52.822692 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2144/4293] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:52.828274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:52.829049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:52.829522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:52.896182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:52.899729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:52.924655 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2150/4294] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:52.928681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:52.943168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5ed73-d074-4d7c-b90f-5e03084b93e7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:52.960212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:52.960855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:52.961134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:52.961404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:52.966092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:07:52.966644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:52.973035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:52.987641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:53.023612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2145/4295] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:07:53.028524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:53.036468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:53.040554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be57a4-e09d-4319-af38-f5232774e32b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:53.056383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:53.057415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:53.057906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:53.058326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:53.059138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:53.061245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:53.149224 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2151/4296] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:07:53 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:07:53.153257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:53.169900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80cffc-21ad-4244-b024-3ce23afe7e59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:53.337323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:53.340350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:53.340641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:53.340921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:53.342741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:53.348583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:53.397212 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2146/4297] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:07:53 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:07:53.401758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:53.416243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325d99b-d4da-408d-8c27-cfcc2ad891d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:53.421297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:53.422565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:53.422964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:53.423184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:53.423801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:53.425646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:53.465543 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2152/4298] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:07:53.469649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:53.491845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150256d-a878-4c16-956f-5f20280799a8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:53.506076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2330-8749-4333-82b6-f977b060837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:53.507830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2330-8749-4333-82b6-f977b060837f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:53.511007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2330-8749-4333-82b6-f977b060837f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:53.511943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2330-8749-4333-82b6-f977b060837f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:53.513615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2330-8749-4333-82b6-f977b060837f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:53.518010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2330-8749-4333-82b6-f977b060837f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:53.580702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2147/4299] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:07:53.581994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:53.596521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac364e-645f-46c7-93f4-9b20308a91b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:53.609976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:53.610692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:53.611181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:53.611651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] PATH_INFO: `/v3/projects/ac55b5631b734e7283ed3ddd685b061e/users/7aa28bf5c15d4a79b61bb9cae94481fb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:53.648140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac55b5631b734e7283ed3ddd685b061e, user_id=7aa28bf5c15d4a79b61bb9cae94481fb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:53.651568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:53.668685 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2153/4300] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:07:53 2022] PUT /identity/v3/projects/ac55b5631b734e7283ed3ddd685b061e/users/7aa28bf5c15d4a79b61bb9cae94481fb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:53.679474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:53.680185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:53.680626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:53.735445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] MFA Rules not processed for user `7aa28bf5c15d4a79b61bb9cae94481fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:53.737614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:53.897539 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2148/4301] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:53.898233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:53.900571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:54.074028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4315abf-30a8-4aae-af7c-a3dc914db822 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:54.082710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd542d58-fd7b-4e60-a851-8e905adb346f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:54.083604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542d58-fd7b-4e60-a851-8e905adb346f service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:54.084192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542d58-fd7b-4e60-a851-8e905adb346f service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:54.084623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd542d58-fd7b-4e60-a851-8e905adb346f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:54.103185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542d58-fd7b-4e60-a851-8e905adb346f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:54.105063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd542d58-fd7b-4e60-a851-8e905adb346f service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:54.126931 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2154/4302] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:07:54.141172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:54.144967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:54.333975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ec7d48-21eb-4e46-9036-5d2be8547aac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:54.342111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:54.342905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:54.342994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:54.351712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:54.353722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:54.375786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:54.502914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:54.503461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:54.503892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:54.523653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:54.527024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:54.574427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:54.580605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:54.582618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2149/4303] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:07:54.692750 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2155/4304] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:54.718354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:54.720203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:54.931473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea0a49-4ad8-493d-a285-8ed59e2b0d8e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:54.950712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:54.951469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:54.951856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:54.952228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:54.977980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:54.980155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:54.993868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2150/4305] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:07:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:07:58.686036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:58.687615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:58.712330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a224108-1379-422c-94cd-e0005f417e81 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:58.729968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:58.730653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:58.730872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:58.731984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] PATH_INFO: `/v3/users/801730a89d33490d8d6f425f20ce5b1d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:58.736048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=801730a89d33490d8d6f425f20ce5b1d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:58.744245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:58.905044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '801730a89d33490d8d6f425f20ce5b1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:58.909757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:58.918383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '801730a89d33490d8d6f425f20ce5b1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:58.920506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '801730a89d33490d8d6f425f20ce5b1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:58.942595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '801730a89d33490d8d6f425f20ce5b1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:58.949438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4df8ceff-17f8-47b9-91bf-05051dd8c4b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '801730a89d33490d8d6f425f20ce5b1d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:59.019585 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2156/4306] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:07:58 2022] DELETE /identity/v3/users/801730a89d33490d8d6f425f20ce5b1d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:59.424377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:07:59.445581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a344a-b9b8-4f03-bfb4-6469c58362c7 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:07:59.602018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:07:59.602840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:59.603119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:59.603386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] PATH_INFO: `/v3/projects/3ef09834b750437e9fa350df7b4bb0f3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:59.604615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef09834b750437e9fa350df7b4bb0f3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:07:59.606563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:07:59.732943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:07:59.748704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef09834b750437e9fa350df7b4bb0f3', 'request_id': 'req-4dc402b8-a767-4213-89d2-241d1c2017a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:59.771562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef09834b750437e9fa350df7b4bb0f3', 'request_id': 'req-4dc402b8-a767-4213-89d2-241d1c2017a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:59.781731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef09834b750437e9fa350df7b4bb0f3', 'request_id': 'req-4dc402b8-a767-4213-89d2-241d1c2017a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:59.805575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] The token cache is being invalidate because project 3ef09834b750437e9fa350df7b4bb0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:07:59.807120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:59.808599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4dc402b8-a767-4213-89d2-241d1c2017a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:07:59.812074 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2151/4307] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:07:59 2022] DELETE /identity/v3/projects/3ef09834b750437e9fa350df7b4bb0f3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:07:59.819477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:59.819891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:59.820016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:07:59.871933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:07:59.877321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:07:59.953914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2157/4308] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:07:59.958400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:07:59.958937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:07:59.959400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.000574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:00.004241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:00.030314 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2152/4309] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:00.034443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:00.061295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488385a8-a6c2-47a1-bc36-e081d5cb33e4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:00.077146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:00.077978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.078556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.078556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.079139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:00.079747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:00.081569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:00.143254 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2158/4310] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:00.143705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:00.161066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3bfa52-5abb-4be8-b393-d4935ff404d2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:00.175699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:00.176793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.177287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.177783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.178672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:00.180974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:00.268107 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2153/4311] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:00 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:08:00.269593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:00.283418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308f428-69e6-4036-b20c-db13daa1a28d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:00.437132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:00.438020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.439592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.440030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.442723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:00.444837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:00.511623 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2159/4312] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:00 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:00.513188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:00.525776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6909c6-2f0d-492c-959d-2df7ba95f068 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:00.558605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:00.559691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.560205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.560707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.572291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:00.574777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:00.605528 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2154/4313] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:00.610153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:00.624146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e3bd1-a1e2-4ce1-841c-bd242052b6d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:00.630806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e3ce6-1de5-43ff-814a-15309377a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:00.631707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3ce6-1de5-43ff-814a-15309377a1da admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.632222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3ce6-1de5-43ff-814a-15309377a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.634401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e3ce6-1de5-43ff-814a-15309377a1da admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.636045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e3ce6-1de5-43ff-814a-15309377a1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:00.639754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e3ce6-1de5-43ff-814a-15309377a1da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:00.668880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2160/4314] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:00.670545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:00.685297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efeef16-2947-47b0-aef1-dfffcc441e0f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:00.701169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:00.702158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.702629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.704386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] PATH_INFO: `/v3/projects/501eac100a614a719b6ccdaffee756ff/users/ffebad20b25a4c49b625e9198eb6530f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.743728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501eac100a614a719b6ccdaffee756ff, user_id=ffebad20b25a4c49b625e9198eb6530f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:00.747747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:00.788542 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2155/4315] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:00 2022] PUT /identity/v3/projects/501eac100a614a719b6ccdaffee756ff/users/ffebad20b25a4c49b625e9198eb6530f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:00.792941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:00.793481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:00.793859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:00.855335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] MFA Rules not processed for user `ffebad20b25a4c49b625e9198eb6530f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:00.857391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:00.910714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:01.047361 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2161/4316] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:01.186534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:01.188728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:01.370343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc54182-3881-4ab9-b935-412a68c6c804 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:01.382791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4783d9-2aae-48a9-9154-214b876481d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:01.383433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4783d9-2aae-48a9-9154-214b876481d6 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:01.383709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4783d9-2aae-48a9-9154-214b876481d6 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:01.384111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4783d9-2aae-48a9-9154-214b876481d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:01.432904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4783d9-2aae-48a9-9154-214b876481d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:01.436860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4783d9-2aae-48a9-9154-214b876481d6 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:01.489765 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2156/4317] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:03.087145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:03.089572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:03.214748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089a034-422d-4a57-b507-47b7d9b146eb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:03.224130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:03.226498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:03.226952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:03.227445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:03.238217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:03.375050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:03.376626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:03.401608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2162/4318] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:03.619897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:03.620784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:03.621205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:03.670918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:03.672355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:03.805011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:03.816360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2157/4319] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:08:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:03.831470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:03.832998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:03.986534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855e591-a6fe-4970-b451-f83aa62e5970 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:04.006106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3bc2b-8b1f-41d5-8670-a0ebabc914ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:04.008340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3bc2b-8b1f-41d5-8670-a0ebabc914ac service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:04.009470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3bc2b-8b1f-41d5-8670-a0ebabc914ac service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:04.011261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3bc2b-8b1f-41d5-8670-a0ebabc914ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:04.043501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3bc2b-8b1f-41d5-8670-a0ebabc914ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:04.050750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3bc2b-8b1f-41d5-8670-a0ebabc914ac service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:04.063906 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2163/4320] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:08:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:04.255131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:04.257221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:04.289189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f7a9b-6a6b-44fc-87ce-857dc4ac5dc8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:04.305514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:04.306523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:04.307494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:04.307936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] PATH_INFO: `/v3/users/7aa28bf5c15d4a79b61bb9cae94481fb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:04.310883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa28bf5c15d4a79b61bb9cae94481fb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:04.315258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:04.432517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa28bf5c15d4a79b61bb9cae94481fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:04.466927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa28bf5c15d4a79b61bb9cae94481fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:04.467957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa28bf5c15d4a79b61bb9cae94481fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:04.488587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa28bf5c15d4a79b61bb9cae94481fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:04.490394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa28bf5c15d4a79b61bb9cae94481fb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:04.520837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2158/4321] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:04 2022] DELETE /identity/v3/users/7aa28bf5c15d4a79b61bb9cae94481fb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:04.522010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:04.522865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:04.523289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:04.536246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:04.586753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:04.588126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:04.743192 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2164/4322] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:04.763404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:04.765333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:04.919382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f6408-bf7e-49e8-9e00-fb79b2a58181 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:04.939933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:04.940601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:04.940902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:04.941167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:04.956458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:04.958836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:04.976256 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2159/4323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:05.582928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:05.585580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:05.623517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065ccf-014c-4edf-af34-bdbd38f8d008 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:05.636763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:05.638700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:05.639815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:05.645759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] PATH_INFO: `/v3/users/ffebad20b25a4c49b625e9198eb6530f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:05.648331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffebad20b25a4c49b625e9198eb6530f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:05.650665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:05.807790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:05.810150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:05.827168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f41e-0733-43db-b775-de9eaab60f68 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:05.833764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:05.834701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:05.835173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:05.835597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] PATH_INFO: `/v3/projects/ac55b5631b734e7283ed3ddd685b061e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:05.836945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac55b5631b734e7283ed3ddd685b061e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:05.839518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:05.845074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffebad20b25a4c49b625e9198eb6530f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:05.865452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffebad20b25a4c49b625e9198eb6530f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:05.866218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffebad20b25a4c49b625e9198eb6530f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:05.890286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffebad20b25a4c49b625e9198eb6530f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:05.891231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9025dee5-4432-482f-ae69-5e661053c3a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffebad20b25a4c49b625e9198eb6530f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:05.945937 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2165/4324] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:05 2022] DELETE /identity/v3/users/ffebad20b25a4c49b625e9198eb6530f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:05.950381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:05.952087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:05.952544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:05.962073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac55b5631b734e7283ed3ddd685b061e', 'request_id': 'req-35da75d1-ae7a-4122-ba96-83e81a48cd7e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:05.976019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:05.977770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:05.982640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac55b5631b734e7283ed3ddd685b061e', 'request_id': 'req-35da75d1-ae7a-4122-ba96-83e81a48cd7e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:06.003734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac55b5631b734e7283ed3ddd685b061e', 'request_id': 'req-35da75d1-ae7a-4122-ba96-83e81a48cd7e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:06.013356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:06.040156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] The token cache is being invalidate because project ac55b5631b734e7283ed3ddd685b061e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:06.040491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:06.041331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-35da75d1-ae7a-4122-ba96-83e81a48cd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:06.055160 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2160/4325] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:05 2022] DELETE /identity/v3/projects/ac55b5631b734e7283ed3ddd685b061e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:06.061615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f1a0-eae9-4340-abc0-6106301472ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.062253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f1a0-eae9-4340-abc0-6106301472ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.062958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f1a0-eae9-4340-abc0-6106301472ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.099614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0411f1a0-eae9-4340-abc0-6106301472ac None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:06.102278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0411f1a0-eae9-4340-abc0-6106301472ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:06.157228 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2166/4326] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:06.182627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.184957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:06.221600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2161/4327] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:06.232015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:06.238032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.238542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.239015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.273256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:06.275126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:06.300636 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2162/4328] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:06.301478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.312748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2d6bf-6b02-42af-8109-ed2794a5daea None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.321784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba891cb1-3bd7-4001-b23f-fc10078e3a9e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.323442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.324174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.324550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.324937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.325708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:06.326050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.326239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.326833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.327112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.327387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.329613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.343686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.345678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.350916 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2163/4329] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:06.355585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.369777 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2167/4330] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:06.377468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc479eb-d47e-448a-98d3-37c0eb283675 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.383229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.384215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.384215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.384401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.385906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.387586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.422614 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2164/4331] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:06 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:06.426902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.439449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62cd81-bb6a-4c5b-9797-013d558b0984 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.604791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.607163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.607903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.608363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.609275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.611981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.671495 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2168/4332] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:06 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:06.674308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.688010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7686c-c94f-4d9f-b0a5-d5457c52babe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.692956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.694418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.694716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.694992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.696348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.699905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.719383 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2165/4333] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:06.725738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.747333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2611513-fc37-491e-a984-1cf749fa165c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.752622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8216a-7b64-421b-804e-c27dfa3ae845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.753297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8216a-7b64-421b-804e-c27dfa3ae845 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.753585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8216a-7b64-421b-804e-c27dfa3ae845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.753903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8216a-7b64-421b-804e-c27dfa3ae845 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.754719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8216a-7b64-421b-804e-c27dfa3ae845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.756578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8216a-7b64-421b-804e-c27dfa3ae845 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.775268 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2169/4334] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:06.777166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:06.801106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a30a-7424-41aa-96bb-88ab83aeff21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:06.809483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:06.811294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.811757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.812185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] PATH_INFO: `/v3/projects/431409236f15444e85495d233664fff8/users/d1dc27c611114996857a8c1ee7a573a6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.832943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=431409236f15444e85495d233664fff8, user_id=d1dc27c611114996857a8c1ee7a573a6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:06.836103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:06.870355 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2166/4335] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:06 2022] PUT /identity/v3/projects/431409236f15444e85495d233664fff8/users/d1dc27c611114996857a8c1ee7a573a6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:06.881693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5680-0343-4a70-9be5-52b116796ce4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:06.882025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5680-0343-4a70-9be5-52b116796ce4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:06.882528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5680-0343-4a70-9be5-52b116796ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:06.915289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b5ea5680-0343-4a70-9be5-52b116796ce4 None None] MFA Rules not processed for user `d1dc27c611114996857a8c1ee7a573a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:06.916764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5ea5680-0343-4a70-9be5-52b116796ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:06.998532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2170/4336] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:07.007833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:07.010151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:07.090269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480de9d9-961f-42f2-a3a3-79b5195d4d6e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:07.094703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:07.096145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:07.096662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:07.097154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:07.109735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:07.111245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:07.122458 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2167/4337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:07.178353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342180a-eef6-4be5-a564-5a72f6812d7b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:07.179029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342180a-eef6-4be5-a564-5a72f6812d7b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:07.179536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342180a-eef6-4be5-a564-5a72f6812d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:07.232239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b342180a-eef6-4be5-a564-5a72f6812d7b None None] MFA Rules not processed for user `dc4e17d222e0426698d1ef9a17921d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:07.234353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b342180a-eef6-4be5-a564-5a72f6812d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:07.272275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:07.361711 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2171/4338] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:08.090913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:08.123071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:08.160513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075932b7-790b-4438-a6c8-279213d23116 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:08.165695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:08.166420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:08.166742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:08.167226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:08.169540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:08.182562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:08.184026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:08.196244 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2168/4339] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:08.372311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:08.373280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:08.374284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:08.409855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:08.411670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:08.535418 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2172/4340] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:08:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:08.571794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:08.573851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:08.645067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:08.646509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:08.681436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4548a34-ae75-4096-afd1-be29210c095b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:08.695465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e73ec-ed6c-4cba-9c0e-d4045f9b0966 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:08.696376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e73ec-ed6c-4cba-9c0e-d4045f9b0966 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:08.696734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e73ec-ed6c-4cba-9c0e-d4045f9b0966 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:08.697010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e73ec-ed6c-4cba-9c0e-d4045f9b0966 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:08.726899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e73ec-ed6c-4cba-9c0e-d4045f9b0966 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:08.729056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e73ec-ed6c-4cba-9c0e-d4045f9b0966 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:08.760324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec618fa9-7b69-459e-9d1c-e7088374b682 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:08.767434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:08.768094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:08.768708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:08.768708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] PATH_INFO: `/v3/projects/501eac100a614a719b6ccdaffee756ff` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:08.770008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501eac100a614a719b6ccdaffee756ff)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:08.771868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:08.774119 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2169/4341] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:08.862154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501eac100a614a719b6ccdaffee756ff', 'request_id': 'req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:08.875688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501eac100a614a719b6ccdaffee756ff', 'request_id': 'req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:08.884692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501eac100a614a719b6ccdaffee756ff', 'request_id': 'req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:08.924229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] The token cache is being invalidate because project 501eac100a614a719b6ccdaffee756ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:08.925039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:08.926296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaae6eb-9174-4716-81d9-1df7ca3465b9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:08.926759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaae6eb-9174-4716-81d9-1df7ca3465b9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:08.927289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-450fa71e-4a6b-4b67-9b82-a04ea7a567e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:08.927666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaae6eb-9174-4716-81d9-1df7ca3465b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:08.937481 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2173/4342] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:08 2022] DELETE /identity/v3/projects/501eac100a614a719b6ccdaffee756ff => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:08.940474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:08.940961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:08.941424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:08.998985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-faaae6eb-9174-4716-81d9-1df7ca3465b9 None None] MFA Rules not processed for user `31c787a53d064a8aba1dffdea6815f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:09.000251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-faaae6eb-9174-4716-81d9-1df7ca3465b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:09.001117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:09.031015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:09.033737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:09.164208 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2170/4343] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:09.219234 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2174/4344] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:09.220991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.221281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.221559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.266433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:09.267686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:09.285131 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2171/4345] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:09.289372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:09.304933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90aa75-b0a1-4c84-9def-1ec1e36fe684 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:09.319699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:09.320661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.321570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.322034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.322888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:09.323351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:09.327665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:09.359219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2175/4346] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:09.363527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:09.381659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b086d-c27d-4a52-a666-e2a66d2524c8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:09.410892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:09.411315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.411600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.411875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.412532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:09.414572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:09.512014 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2172/4347] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:09 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:09.514302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:09.535236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac28de-e9b0-45b7-b8f4-54d06f7dd969 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:09.655967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:09.656604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.656884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.657156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.657818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:09.660276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:09.777293 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2176/4348] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:09 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:09.781490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:09.792883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be1f23-b154-4794-8c96-d145c1b773df admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:09.811939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:09.812624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.818923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.825647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.826589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:09.828356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:09.856512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:09.867662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2173/4349] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:09.871216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3e7e6-2dc5-4178-9ca4-d912b452f5cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:09.883043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36953959-26ce-4092-8f24-71223b5fcfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:09.883680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953959-26ce-4092-8f24-71223b5fcfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.883954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953959-26ce-4092-8f24-71223b5fcfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.889858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36953959-26ce-4092-8f24-71223b5fcfc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.890652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36953959-26ce-4092-8f24-71223b5fcfc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:09.892304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36953959-26ce-4092-8f24-71223b5fcfc2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:09.925304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:09.932104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:09.937919 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2177/4350] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:09.942726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ed6795-1abb-49d7-8192-9b74668192b1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:09.958625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:09.959317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:09.959597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:09.959872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] PATH_INFO: `/v3/projects/f18d0bc8c7514b83b479bdb3cda7048d/users/dec33bee75ab415d90031e77699a893b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:09.992819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18d0bc8c7514b83b479bdb3cda7048d, user_id=dec33bee75ab415d90031e77699a893b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:09.996222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:10.026494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2174/4351] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:09 2022] PUT /identity/v3/projects/f18d0bc8c7514b83b479bdb3cda7048d/users/dec33bee75ab415d90031e77699a893b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:10.038175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:10.038484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:10.038757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:10.093451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] MFA Rules not processed for user `dec33bee75ab415d90031e77699a893b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:10.098093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:10.268750 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2178/4352] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:10.273556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:10.473281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0db1f-c684-4351-85ce-845df6d8bc87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:10.490238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:10.491716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:10.491998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:10.492272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:10.498024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:10.501952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:10.569651 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2175/4353] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:10 2022] POST /identity/v3/projects => generated 371 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:10.574700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:10.580305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:10.595779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dbcd3-c2b4-4695-afd5-a783ba288b95 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:10.751673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:10.766446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:10.767973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:10.768314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:10.773726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:10.783238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:10.821544 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2179/4354] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:10 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:10.824646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:10.843859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b09d3a-03cc-4bc8-a107-f61677c02215 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:10.855573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:10.856231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:10.856497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:10.856768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:10.857433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:10.859249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:10.880236 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2176/4355] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:10.884745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:10.903168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f542a34b-98c8-4020-96b0-bda302df11bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:10.910983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:10.912141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:10.912666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:10.913140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] PATH_INFO: `/v3/projects/001ce3fe0ee243cd814729cce07f25e8/users/9b35baa6e58a495ea468c49fb945471d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:10.945152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=001ce3fe0ee243cd814729cce07f25e8, user_id=9b35baa6e58a495ea468c49fb945471d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:10.948610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:10.970302 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2180/4356] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:10 2022] PUT /identity/v3/projects/001ce3fe0ee243cd814729cce07f25e8/users/9b35baa6e58a495ea468c49fb945471d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:10.973857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:10.984159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06c0ae-a60a-4dce-8394-e17630b71faf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.056855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43e2ab-c8c7-4c74-a166-3bf1e1d38b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.057668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e2ab-c8c7-4c74-a166-3bf1e1d38b9f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.058076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e2ab-c8c7-4c74-a166-3bf1e1d38b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.058442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43e2ab-c8c7-4c74-a166-3bf1e1d38b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.059171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e2ab-c8c7-4c74-a166-3bf1e1d38b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.061025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43e2ab-c8c7-4c74-a166-3bf1e1d38b9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.072742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2177/4357] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:11.076723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.089193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f642-b664-484c-8572-76b27103d5bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.095420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.096216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.096586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.097019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] PATH_INFO: `/v3/projects/001ce3fe0ee243cd814729cce07f25e8/users/9b35baa6e58a495ea468c49fb945471d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.099256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=001ce3fe0ee243cd814729cce07f25e8, user_id=9b35baa6e58a495ea468c49fb945471d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.102194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.114861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2181/4358] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:11 2022] PUT /identity/v3/projects/001ce3fe0ee243cd814729cce07f25e8/users/9b35baa6e58a495ea468c49fb945471d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:11.125540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.126439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.126819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.176618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] MFA Rules not processed for user `9b35baa6e58a495ea468c49fb945471d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:11.176618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:11.261569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:11.297319 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2178/4359] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:11.301604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.314832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98fd8b2-ac25-48d9-b18f-d4d8eef6b19a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.320844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cff518-80fb-4892-ae16-81e8edcc0ab6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.321925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff518-80fb-4892-ae16-81e8edcc0ab6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.322478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff518-80fb-4892-ae16-81e8edcc0ab6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.323177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cff518-80fb-4892-ae16-81e8edcc0ab6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/services` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.324094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cff518-80fb-4892-ae16-81e8edcc0ab6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.326183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cff518-80fb-4892-ae16-81e8edcc0ab6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.346903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2182/4360] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/services => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:08:11.352925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.370075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d43efe-ef13-4ea5-bc13-b127b2a2fbb9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.404332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.405110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.405392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.405662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.406460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.407646 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:11.407646 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:11.407646 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:11.408560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.450525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.451039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.451651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.476603 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1692633603. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:11.476603 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:11.476603 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:11.499429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:11.504903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:11.541645 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2179/4361] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/endpoints => generated 360 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:11.544424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.596234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a42f-5303-4b59-ad35-34f347cc0598 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.609844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.610858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.611288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.611737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-1692633603` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.612620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1692633603)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.614896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.621205 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2180/4362] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:08:11 2022] GET /identity/v3/regions/tempest-region-1692633603 => generated 180 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:11.625248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.640781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdce6b1-9498-4847-a734-dc93755eea28 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.646165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.646915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.650060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.650630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.652877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.655090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.670001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2183/4363] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/auth/tokens => generated 3507 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:11.681392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.683583 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2181/4364] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/services => generated 288 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:11.686375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.691655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:11.705594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b701e399-2135-42ef-b465-2ed5124e81b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.724450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.725381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.725974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.726339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.727476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.728700 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:11.728700 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:11.728700 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:11.729854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.767993 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1424928155. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:11.767993 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:11.767993 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:11.791427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:11.817372 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2184/4365] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/endpoints => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:11.821455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.871063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796d8ea-fcbc-4b10-ab28-9ec96c73a410 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.911986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1abb093-f1ef-44ab-a5ab-c2a072f8131e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.919496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.921832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.922398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.923660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-1424928155` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.926190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1424928155)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.929241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.931734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.932925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.933944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.935883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.938320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2185/4366] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:08:11 2022] GET /identity/v3/regions/tempest-region-1424928155 => generated 180 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:11.944031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:11.961760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bf1f0-1dc0-4335-8fa9-2266dbefaa6a tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:11.963036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.965284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.982193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:11.983029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:11.983762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:11.984028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:11.986966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:11.988058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:11.989740 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2182/4367] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:08:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:12.105625 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-790714193. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:12.105625 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:12.105625 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:12.192913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2186/4368] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:11 2022] POST /identity/v3/endpoints => generated 358 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:12.195270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.223085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be33a9-695d-4797-b08c-0e92ccee10df service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.275085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.276224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.276604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.276993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-790714193` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.277835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-790714193)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.279569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.288251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.289500 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2183/4369] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 03:08:12 2022] GET /identity/v3/regions/tempest-region-790714193 => generated 178 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:12.317466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6361c27-d480-46ab-b020-afd097b54a57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.341210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.342207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.342585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.343100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.344487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.346791 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:12.346791 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:12.346791 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:12.349219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.371835 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2187/4370] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 03:08:12 2022] GET /identity/v3/endpoints => generated 4393 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:08:12.376571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.395967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dcd0-6fc0-4e84-a6d4-7da93e3280ed tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.405401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.406695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.407071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.407437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/4573640fdc3a417d8b462236351b0890` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.420142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=4573640fdc3a417d8b462236351b0890)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.422254 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:12.422254 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:12.422254 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:12.426709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.434243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.440431 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2184/4371] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:12 2022] GET /identity/v3/endpoints/4573640fdc3a417d8b462236351b0890 => generated 358 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:12.449121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faed55-d9df-4a1e-b76f-c37c96cd7db6 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.461461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.462503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.463159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.464549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/4573640fdc3a417d8b462236351b0890` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.467281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4573640fdc3a417d8b462236351b0890)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.470005 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:12.470005 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:12.470005 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:12.471362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.509816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4573640fdc3a417d8b462236351b0890', 'request_id': 'req-ca274600-5656-4962-a883-576bbf49ae33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:12.560716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.561264 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2188/4372] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:12 2022] DELETE /identity/v3/endpoints/4573640fdc3a417d8b462236351b0890 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:12.577453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e3677-1cdf-4d9d-8ee3-69fccf22eab4 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.599687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:12.609688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.611307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.611427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.612463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.613633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.615683 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:12.615683 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:12.615683 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:12.616856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.647201 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2185/4373] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 03:08:12 2022] GET /identity/v3/endpoints => generated 4048 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:12.652051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.685834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca274600-5656-4962-a883-576bbf49ae33 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.704335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.704999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.705282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.705554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/4573640fdc3a417d8b462236351b0890` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.718644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Could not find endpoint: 4573640fdc3a417d8b462236351b0890.: keystone.exception.EndpointNotFound: Could not find endpoint: 4573640fdc3a417d8b462236351b0890. Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._iter().one() Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._only_one_row( Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:08:12.775131 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 4573640fdc3a417d8b462236351b0890. Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:08:12.776570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:08:12.777731 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 4573640fdc3a417d8b462236351b0890. Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:08:12.778819 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2189/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:12 2022] DELETE /identity/v3/endpoints/4573640fdc3a417d8b462236351b0890 => generated 114 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:08:12.780678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.794856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837eefe-7861-4b80-8786-187596c6c86b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.803869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.805920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.806368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.807060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-790714193` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.809730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-790714193)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.812876 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:12.812876 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:12.812876 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:12.814277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.849641 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-790714193. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:12.849641 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:12.849641 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:12.864489 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2186/4375] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:08:12 2022] DELETE /identity/v3/regions/tempest-region-790714193 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:12.869989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:12.880778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67d3f-e457-45e6-a195-4ec96730b6e0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:12.949953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:12.953743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:12.954058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:12.954338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:12.954984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:12.956611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:12.994419 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2190/4376] 10.222.0.16 () {58 vars in 1134 bytes} [Sat Oct 29 03:08:12 2022] GET /identity/v3/endpoints => generated 4048 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:13.010396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.032715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9c69c-2d2c-40be-b935-5168c3d76b46 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.050240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.050888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.051167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.051433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.052150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Adding query filter params (service_id=65128d09fadb43958d90bbc0724896b5) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:13.052390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.054017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.070362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2187/4377] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:08:13 2022] GET /identity/v3/endpoints?service_id=65128d09fadb43958d90bbc0724896b5 => generated 502 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:13.073733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.100549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7db9f3-20f2-4f54-ad6f-d8e4bba7d5e7 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.106993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.107835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.108295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.108747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.109598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Adding query filter params (service_id=ed100fa59c754a93898d55bf13a4c5b3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:13.110135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.112296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.120810 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2191/4378] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:08:13 2022] GET /identity/v3/endpoints?service_id=ed100fa59c754a93898d55bf13a4c5b3 => generated 503 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:13.124636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.141267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94e395-d2af-4a3b-a38b-e6cbc89c5184 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.159922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.162343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.162631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.162908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.164084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:13.164084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.166274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.492746 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2188/4379] 10.222.0.16 () {58 vars in 1167 bytes} [Sat Oct 29 03:08:13 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:13.496868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.512588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a86196-1642-47c1-a87d-3d00b0fd9aff tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.523997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.524744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.525194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.526517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.528869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:13.529865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.533053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.556475 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2192/4380] 10.222.0.16 () {58 vars in 1171 bytes} [Sat Oct 29 03:08:13 2022] GET /identity/v3/endpoints?interface=internal => generated 478 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:08:13.564474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.581220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c324626-330d-4961-9bd1-4a50032b2114 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.587972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.587972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.587972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.588365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.588595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.590820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.619568 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2189/4381] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:13 2022] POST /identity/v3/services => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:13.623712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.644424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ee28-4a9a-4475-9c61-6c5f969c8e6e tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.674509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.675134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.675505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.675783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.676651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.678412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.710436 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-513754496. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:13.710436 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:13.710436 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:13.760878 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2193/4382] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:08:13 2022] POST /identity/v3/endpoints => generated 359 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:13.762168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.774253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576ad5f-d4ee-4c95-b551-9e7a77f7d8de tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.811911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.812789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.813221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.813653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-513754496` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.814817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-513754496)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.820537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.823395 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2190/4383] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 03:08:13 2022] GET /identity/v3/regions/tempest-region-513754496 => generated 178 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:13.827305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.840093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bfc87-31c8-4179-b352-1e3c0e494308 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.845353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.846135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.846411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.846678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/69e33c28e31e40f1bb25e64bbe9bc8a0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.853000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=69e33c28e31e40f1bb25e64bbe9bc8a0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.854845 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:13.854845 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:13.854845 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:13.856272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.880052 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-311332460. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:13.880052 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:13.880052 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:13.912114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:13.941934 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2194/4384] 10.222.0.16 () {60 vars in 1256 bytes} [Sat Oct 29 03:08:13 2022] PATCH /identity/v3/endpoints/69e33c28e31e40f1bb25e64bbe9bc8a0 => generated 360 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:13.943120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:13.956469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e4564-da25-4db8-ba6d-e7e8f50891e3 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:13.979054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:13.980088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:13.980520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:13.980989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-311332460` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:13.981856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-311332460)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:13.983369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:13.988448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2191/4385] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 03:08:13 2022] GET /identity/v3/regions/tempest-region-311332460 => generated 178 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:13.992717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.011227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c23582-a030-45cf-b713-eaf5947bfa11 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.041486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.042407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.043587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.045767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/69e33c28e31e40f1bb25e64bbe9bc8a0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.061791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=69e33c28e31e40f1bb25e64bbe9bc8a0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.063623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.079961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '69e33c28e31e40f1bb25e64bbe9bc8a0', 'request_id': 'req-990171aa-5ab9-4942-a2d1-f42c67b5a35b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:14.106156 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2195/4386] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:13 2022] DELETE /identity/v3/endpoints/69e33c28e31e40f1bb25e64bbe9bc8a0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:14.107809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.124660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1d449-0aea-47eb-b91a-b6e0170080ef tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.154725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.156453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.158076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.159598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-311332460` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.161051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-311332460)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.162897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.183475 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-311332460. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:14.183475 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:14.183475 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:14.202378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.203392 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2192/4387] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/regions/tempest-region-311332460 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:14.214632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990171aa-5ab9-4942-a2d1-f42c67b5a35b tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.248848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.249515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.249821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.250110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-513754496` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.250708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-513754496)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.251742 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:14.251742 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:14.251742 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:14.252700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.303628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2196/4388] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/regions/tempest-region-513754496 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:14.306760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.325092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52149c47-8fb5-42ad-b482-0a577796dc2d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.371090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.371981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.372259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.372531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/services/342842dd9bb94557afcf30716565b64e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.373115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_service(service_id=342842dd9bb94557afcf30716565b64e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.374736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.403393 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2193/4389] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/services/342842dd9bb94557afcf30716565b64e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:14.409210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.430567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c1eb6-ff95-4453-9a34-b3dca0a94011 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.467423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.468264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.468662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.469166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/e804dabafc0c46c8a58e646ae8868268` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.475984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=e804dabafc0c46c8a58e646ae8868268)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.478892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.491263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'e804dabafc0c46c8a58e646ae8868268', 'request_id': 'req-98e382c9-7834-4200-8001-84da616c4f07'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:14.508102 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2197/4390] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/endpoints/e804dabafc0c46c8a58e646ae8868268 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:14.512362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.525330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f86a80-604a-45da-a4b9-c3a21726755c tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.567334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.568095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.568786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.569161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-1424928155` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.569926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1424928155)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.574587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.597430 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1424928155. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:14.597430 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:14.597430 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:14.612277 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2194/4391] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/regions/tempest-region-1424928155 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:14.616485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.629269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e382c9-7834-4200-8001-84da616c4f07 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.649623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20b018-e5b9-446f-adc7-a14116d18c5d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.651217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b018-e5b9-446f-adc7-a14116d18c5d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.651533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b018-e5b9-446f-adc7-a14116d18c5d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.651806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20b018-e5b9-446f-adc7-a14116d18c5d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/services/ed100fa59c754a93898d55bf13a4c5b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.652470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20b018-e5b9-446f-adc7-a14116d18c5d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ed100fa59c754a93898d55bf13a4c5b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.654988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20b018-e5b9-446f-adc7-a14116d18c5d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.698384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2198/4392] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/services/ed100fa59c754a93898d55bf13a4c5b3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:14.702432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.720326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda7731-9418-4caa-acc8-457139e5abc0 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.766746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.767264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.767264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.800315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:14.801055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:14.801396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:14.801761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/endpoints/7fe1d1f9ca0b4a1eae2152e081d3b306` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:14.812178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:14.813467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:14.835884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7fe1d1f9ca0b4a1eae2152e081d3b306)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:14.851104 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:14.851104 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:14.851104 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:14.854399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:14.856748 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2199/4393] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:08:14 2022] POST /identity/v3/auth/tokens => generated 3507 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:14.870354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7fe1d1f9ca0b4a1eae2152e081d3b306', 'request_id': 'req-26a003d8-a5dc-41ef-a5b8-b1e312899b57'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:14.887686 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2195/4394] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/endpoints/7fe1d1f9ca0b4a1eae2152e081d3b306 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:14.887876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.900126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:14.950417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:14.959628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5560cd2-539b-48ee-ad67-3354a9c8c2f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.984795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a003d8-a5dc-41ef-a5b8-b1e312899b57 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:14.998624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:15.001089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:15.001466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:15.002760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/regions/tempest-region-1692633603` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:15.004530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1692633603)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:15.006276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:15.008860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:15.008860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:15.008860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:15.010162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:15.035443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:15.041281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:15.066617 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2196/4395] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 03:08:14 2022] DELETE /identity/v3/regions/tempest-region-1692633603 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:15.068334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:15.071863 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2200/4396] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:08:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:08:15.102815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bf4e9-558d-4509-9487-45713ef13660 tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:15.120732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bde5-d504-4ac4-a7bf-9d87cb9dbf4d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b35baa6e58a495ea468c49fb945471d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '001ce3fe0ee243cd814729cce07f25e8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:15.121570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bde5-d504-4ac4-a7bf-9d87cb9dbf4d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:15.121908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bde5-d504-4ac4-a7bf-9d87cb9dbf4d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:15.122228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bde5-d504-4ac4-a7bf-9d87cb9dbf4d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] PATH_INFO: `/v3/services/65128d09fadb43958d90bbc0724896b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:15.123210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bde5-d504-4ac4-a7bf-9d87cb9dbf4d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorizing `identity:delete_service(service_id=65128d09fadb43958d90bbc0724896b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:15.127467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bde5-d504-4ac4-a7bf-9d87cb9dbf4d tempest-EndPointsTestJSON-1739895884 tempest-EndPointsTestJSON-1739895884-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:15.206285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2197/4397] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:15 2022] DELETE /identity/v3/services/65128d09fadb43958d90bbc0724896b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:15.210542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:15.394310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:15.458333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8586b-7f53-406a-9bb3-9a6b3f602712 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:15.498466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:15.499140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:15.499418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:15.499692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] PATH_INFO: `/v3/users/dec33bee75ab415d90031e77699a893b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:15.504105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec33bee75ab415d90031e77699a893b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:15.506108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:15.644068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec33bee75ab415d90031e77699a893b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:15.666158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec33bee75ab415d90031e77699a893b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:15.666892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec33bee75ab415d90031e77699a893b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:15.679177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec33bee75ab415d90031e77699a893b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:15.682297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec33bee75ab415d90031e77699a893b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:15.746873 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2201/4398] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:15 2022] DELETE /identity/v3/users/dec33bee75ab415d90031e77699a893b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:15.749129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de908-f563-4de7-966f-d11af7a6ac4b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:15.750510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de908-f563-4de7-966f-d11af7a6ac4b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:15.750510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728de908-f563-4de7-966f-d11af7a6ac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:15.826089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-728de908-f563-4de7-966f-d11af7a6ac4b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:15.827571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-728de908-f563-4de7-966f-d11af7a6ac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:16.064945 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2198/4399] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:16.172583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:16.174069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:16.210171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c766ee-7d70-4997-a789-7197d20fdb67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:16.211032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c766ee-7d70-4997-a789-7197d20fdb67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:16.211520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c766ee-7d70-4997-a789-7197d20fdb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:16.248941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8c766ee-7d70-4997-a789-7197d20fdb67 None None] MFA Rules not processed for user `d1dc27c611114996857a8c1ee7a573a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:16.251718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8c766ee-7d70-4997-a789-7197d20fdb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:16.323690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5960c22-eaf8-4655-8b37-61f6e2476af8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:16.331140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:16.333676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:16.334139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:16.334570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:16.350406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2199/4400] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:16.361119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:16.362744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:16.391433 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2202/4401] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:17.428419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:17.428913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:17.429014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:17.466475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] MFA Rules not processed for user `d1dc27c611114996857a8c1ee7a573a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:17.468954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:17.499761 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2200/4402] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:17.967926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:17.971539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:18.017176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd285e-2a70-4927-a12f-726d15c65ea3 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:18.054642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:18.055306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:18.055585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:18.055856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] PATH_INFO: `/v3/projects/f18d0bc8c7514b83b479bdb3cda7048d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:18.069649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18d0bc8c7514b83b479bdb3cda7048d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:18.072631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:18.166257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:18.178779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18d0bc8c7514b83b479bdb3cda7048d', 'request_id': 'req-2878f8e4-c9e8-459a-962c-bf6fad33106f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.193499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18d0bc8c7514b83b479bdb3cda7048d', 'request_id': 'req-2878f8e4-c9e8-459a-962c-bf6fad33106f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.207055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18d0bc8c7514b83b479bdb3cda7048d', 'request_id': 'req-2878f8e4-c9e8-459a-962c-bf6fad33106f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.228787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] The token cache is being invalidate because project f18d0bc8c7514b83b479bdb3cda7048d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:18.229383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.230424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.232569 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2203/4403] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:17 2022] DELETE /identity/v3/projects/f18d0bc8c7514b83b479bdb3cda7048d => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:18.236409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:18.263101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e687d8f-09f1-4097-a61f-33efab4e42c0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:18.324208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:18.367071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:18.368138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:18.368723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:18.369287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] PATH_INFO: `/v3/users/9b35baa6e58a495ea468c49fb945471d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:18.370810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b35baa6e58a495ea468c49fb945471d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:18.372974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:18.460625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b35baa6e58a495ea468c49fb945471d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.478569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b35baa6e58a495ea468c49fb945471d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.479635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b35baa6e58a495ea468c49fb945471d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.495475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b35baa6e58a495ea468c49fb945471d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.496231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7b049760-8e81-4d36-b3f2-ae1fbad87ca1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b35baa6e58a495ea468c49fb945471d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:18.522720 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2201/4404] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:18 2022] DELETE /identity/v3/users/9b35baa6e58a495ea468c49fb945471d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:20.994820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:20.996421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:21.013413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878f8e4-c9e8-459a-962c-bf6fad33106f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.107303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.108500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.109033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.109776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] PATH_INFO: `/v3/projects/001ce3fe0ee243cd814729cce07f25e8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.111524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=001ce3fe0ee243cd814729cce07f25e8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:21.113918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:21.207200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '001ce3fe0ee243cd814729cce07f25e8', 'request_id': 'req-51a31eab-3ba1-421b-907b-7c9d394b8b3e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:21.215597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '001ce3fe0ee243cd814729cce07f25e8', 'request_id': 'req-51a31eab-3ba1-421b-907b-7c9d394b8b3e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:21.224333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '001ce3fe0ee243cd814729cce07f25e8', 'request_id': 'req-51a31eab-3ba1-421b-907b-7c9d394b8b3e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:21.255375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] The token cache is being invalidate because project 001ce3fe0ee243cd814729cce07f25e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:21.256719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:21.258728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51a31eab-3ba1-421b-907b-7c9d394b8b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:21.268403 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2204/4405] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:20 2022] DELETE /identity/v3/projects/001ce3fe0ee243cd814729cce07f25e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:21.273549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.274069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.274165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.324631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:21.325905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:21.467720 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2202/4406] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:21.475033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.475340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.475960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.514719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:21.517901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:21.531962 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2205/4407] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:21.536087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:21.550834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14f087-6d0d-4f50-b31a-ef61e4b07ff6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.566437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.567299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.567732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.568157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.568994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:21.569474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:21.571489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:21.603340 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2203/4408] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:21.603601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:21.615061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78925e8-1105-43cc-a671-abd4b4998314 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.621454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.622149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.622431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.622702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.623371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:21.625319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:21.658726 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2206/4409] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:21 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:21.663324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:21.677350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a415c4e-ce76-42a9-ac79-79fead15ea91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.728696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:21.756671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.757360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.757644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.757947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.758591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:21.772597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:21.824515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2204/4410] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:21 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:21.828827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:21.842032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2479ae-e306-49a0-b9ea-e608e6c7b183 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.856875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.857523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.857822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.858274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.858937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:21.860575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:21.878177 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2207/4411] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:21.880082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:21.902598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1afb18-a6f5-4267-825b-63164d22e438 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.918987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7f083-40d6-4e43-bece-229000fcf692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.919220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7f083-40d6-4e43-bece-229000fcf692 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.919498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7f083-40d6-4e43-bece-229000fcf692 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.919773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7f083-40d6-4e43-bece-229000fcf692 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:21.920434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7f083-40d6-4e43-bece-229000fcf692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:21.923088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7f083-40d6-4e43-bece-229000fcf692 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:21.940860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2205/4412] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:21.942676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:21.970753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39352ba9-fea1-49ff-bbf4-f261d33177e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:21.976198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:21.979042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:21.979534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:21.979997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] PATH_INFO: `/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9/users/24297a1c570a49feafb4e47452bd009e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.004709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d792d86b50fa42c2a37e2e580c75b5f9, user_id=24297a1c570a49feafb4e47452bd009e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.016181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.026033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:22.055904 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2208/4413] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:21 2022] PUT /identity/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9/users/24297a1c570a49feafb4e47452bd009e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:22.058900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6178-d023-490e-8302-858a60674cde None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.059190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6178-d023-490e-8302-858a60674cde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.059468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f6178-d023-490e-8302-858a60674cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.098308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba7f6178-d023-490e-8302-858a60674cde None None] MFA Rules not processed for user `24297a1c570a49feafb4e47452bd009e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:22.101413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba7f6178-d023-490e-8302-858a60674cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:22.221939 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2206/4414] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:22.226512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:22.386177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d543455-9209-4762-ab5a-c20b53fb70f9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:22.398565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:22.399217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.399487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.400287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.401108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.404814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.455327 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2209/4415] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:22 2022] POST /identity/v3/projects => generated 387 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:22.459221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f6178-d023-490e-8302-858a60674cde None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:22.475336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f6178-d023-490e-8302-858a60674cde None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:22.553942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:22.554579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.554858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.555131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.555844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.558679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.592673 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2207/4416] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:22 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:22.598030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:22.616814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0675ea-79b9-45a8-b5e7-cbd99517294b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:22.626726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:22.627578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.628138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.628582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.630386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.632417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.658711 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2210/4417] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:22.659897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:22.670487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91956c7f-201a-44f3-8810-7a6f8319e3ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:22.675725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:22.676697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.677205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.677701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] PATH_INFO: `/v3/projects/56d6aef3150c4051880f8cf6800506fb/users/f41217634e834a138e8903b0b0a54aab/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.709729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d6aef3150c4051880f8cf6800506fb, user_id=f41217634e834a138e8903b0b0a54aab, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.712695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.740112 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2208/4418] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:22 2022] PUT /identity/v3/projects/56d6aef3150c4051880f8cf6800506fb/users/f41217634e834a138e8903b0b0a54aab/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:22.748260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:22.762324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320c5f7-b1e9-4183-8b8e-360314af926f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:22.898052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc04e980-f4d5-4dea-b8ee-ff0f276c1833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:22.898946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04e980-f4d5-4dea-b8ee-ff0f276c1833 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.899485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04e980-f4d5-4dea-b8ee-ff0f276c1833 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.899956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc04e980-f4d5-4dea-b8ee-ff0f276c1833 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.900868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04e980-f4d5-4dea-b8ee-ff0f276c1833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.902930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc04e980-f4d5-4dea-b8ee-ff0f276c1833 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.927523 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2211/4419] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:22.928490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:22.943386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043afd4f-76b8-4bc6-9025-2b99eafddfc1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:22.948506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:22.949187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.949463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.949740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] PATH_INFO: `/v3/projects/56d6aef3150c4051880f8cf6800506fb/users/f41217634e834a138e8903b0b0a54aab/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:22.951862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d6aef3150c4051880f8cf6800506fb, user_id=f41217634e834a138e8903b0b0a54aab, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:22.954548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:22.962541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:22.978888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2209/4420] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:22 2022] PUT /identity/v3/projects/56d6aef3150c4051880f8cf6800506fb/users/f41217634e834a138e8903b0b0a54aab/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:22.980862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:22.981150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:22.981778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.015528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] MFA Rules not processed for user `f41217634e834a138e8903b0b0a54aab`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:23.016887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:23.093642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:23.135940 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2212/4421] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:23.140962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.160390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438befd9-46d6-4b75-b37a-e3da2d6f6da8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.175166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.177023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.177445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.181035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.181035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:get_project(project_id=d792d86b50fa42c2a37e2e580c75b5f9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.193885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.197005 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2210/4422] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9 => generated 389 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:23.203094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.214867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8dca38-b293-4208-9ae8-b164fc05191f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.221478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.222287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.223339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.223339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.223757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.225686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.278459 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2213/4423] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:08:23 2022] POST /identity/v3/projects => generated 339 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:23.280000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.297419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2d832-bf89-447b-ba97-541ffa23ea6d tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.422122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.428302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.428510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.428845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.429625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.438131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.485631 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2211/4424] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects => generated 6971 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:23.487547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.513693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fec0b-774b-4c44-abb1-b1ee586dfd6f tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.562520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.564423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.564872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.566157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.573502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:get_project(project_id=d792d86b50fa42c2a37e2e580c75b5f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.576362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.583011 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2214/4425] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9 => generated 389 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:23.584179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.598931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a26040-6b10-445e-8075-7c03ab7a2515 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.607085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.607993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.608392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.608795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects/85b14f133b824e21915a6bb0868d2ee1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.610793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:get_project(project_id=85b14f133b824e21915a6bb0868d2ee1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.616321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.620641 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2212/4426] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects/85b14f133b824e21915a6bb0868d2ee1 => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:23.628478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.647432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b5f1c-46f3-4e39-a811-eb032827cc27 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.677547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.678351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.679283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.679671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.682483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.683615 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:23.683615 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:23.683615 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:23.687519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.734296 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2215/4427] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects => generated 6971 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:23.739005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.767957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8351aa6-d34f-4e89-97fb-03ccf7f70a20 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.775934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.776714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.777110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.777839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.778806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:23.779215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.782925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.825862 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2213/4428] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects?domain_id=default => generated 6640 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:23.828198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.844935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb9872-e1ba-4a0c-8506-2c9f941de8e2 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.857995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.858800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.860100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.860100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.860341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.863125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.897462 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2216/4429] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects => generated 6971 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:23.902949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.920500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8f3f9-4302-4532-af35-f3ed3f27db04 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.929481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.930362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.930749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.931315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.932568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:23.932980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.935038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:23.967892 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2214/4430] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects?domain_id=default => generated 6640 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:23.970039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:23.986949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486c5f1-4b67-4d10-ac29-4a67c4c53582 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:23.993555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:23.994623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:23.995282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:23.995775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:23.996711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:23.999282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:24.030472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2217/4431] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 03:08:23 2022] GET /identity/v3/projects => generated 6971 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:24.035322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:24.048301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e091e4-17ba-4dba-944a-5ef3c4a85df5 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:24.053777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:24.054649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:24.055567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:24.055567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:24.056720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1817470845) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:24.056720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:24.059064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:24.079263 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2215/4432] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Oct 29 03:08:24 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1817470845 => generated 537 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:24.083996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:24.096040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7c46b-f77b-4b39-bee2-b8adbbb88db1 tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:24.101377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f41217634e834a138e8903b0b0a54aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '56d6aef3150c4051880f8cf6800506fb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:24.102187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:24.102576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:24.102978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] PATH_INFO: `/v3/projects/85b14f133b824e21915a6bb0868d2ee1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:24.104387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85b14f133b824e21915a6bb0868d2ee1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:24.106651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:24.166978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b14f133b824e21915a6bb0868d2ee1', 'request_id': 'req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.173916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b14f133b824e21915a6bb0868d2ee1', 'request_id': 'req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.179877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b14f133b824e21915a6bb0868d2ee1', 'request_id': 'req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.195328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] The token cache is being invalidate because project 85b14f133b824e21915a6bb0868d2ee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:24.195778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.197214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a48cc7be-5b94-4fcf-a986-42abaa7e7cfe tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.198951 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2218/4433] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:24 2022] DELETE /identity/v3/projects/85b14f133b824e21915a6bb0868d2ee1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:24.202825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:24.204730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:24.296310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201656ef-02fd-4969-86b7-62c8eda8f8ef tempest-ListProjectsStaticTestJSON-664692572 tempest-ListProjectsStaticTestJSON-664692572-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:24.370827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:24.386598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:24.387423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:24.387810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:24.388209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] PATH_INFO: `/v3/users/24297a1c570a49feafb4e47452bd009e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:24.389545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24297a1c570a49feafb4e47452bd009e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:24.391676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:24.458444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24297a1c570a49feafb4e47452bd009e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.477969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24297a1c570a49feafb4e47452bd009e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.479285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24297a1c570a49feafb4e47452bd009e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.488971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24297a1c570a49feafb4e47452bd009e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.490675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24297a1c570a49feafb4e47452bd009e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:24.518427 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2216/4434] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:24 2022] DELETE /identity/v3/users/24297a1c570a49feafb4e47452bd009e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:24.519657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:24.519952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:24.520226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:24.572121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:24.573930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:24.659935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2219/4435] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:24.710989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:24.712728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:24.805366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc889db-a4c4-4fe9-ac32-c6e3860a5f71 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:24.813357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:24.814376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:24.815416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:24.815711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:24.828442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:24.830532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:24.844132 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2217/4436] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:26.966435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:26.968693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:26.991288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68d8bd-b5c5-4c24-8960-5bff868f5b07 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:27.003807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:27.004558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:27.004765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:27.005252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] PATH_INFO: `/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:27.006670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d792d86b50fa42c2a37e2e580c75b5f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:27.009343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:27.018494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:27.129126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd792d86b50fa42c2a37e2e580c75b5f9', 'request_id': 'req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.142651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd792d86b50fa42c2a37e2e580c75b5f9', 'request_id': 'req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.169173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd792d86b50fa42c2a37e2e580c75b5f9', 'request_id': 'req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.200975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] The token cache is being invalidate because project d792d86b50fa42c2a37e2e580c75b5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:27.205212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.206473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.215706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:27.216729 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2220/4437] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:26 2022] DELETE /identity/v3/projects/d792d86b50fa42c2a37e2e580c75b5f9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:27.229062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e0139-d1de-45f7-aabb-21fed8a72182 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:27.376506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:27.377502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:27.377970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:27.378598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] PATH_INFO: `/v3/users/f41217634e834a138e8903b0b0a54aab` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:27.381158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41217634e834a138e8903b0b0a54aab)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:27.387663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:27.423124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:27.488516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41217634e834a138e8903b0b0a54aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.515753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41217634e834a138e8903b0b0a54aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.517388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41217634e834a138e8903b0b0a54aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.534784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41217634e834a138e8903b0b0a54aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.536622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41217634e834a138e8903b0b0a54aab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:27.599405 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2218/4438] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:27 2022] DELETE /identity/v3/users/f41217634e834a138e8903b0b0a54aab => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:29.432979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:29.434460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:29.447981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d546e-2b7b-44b9-adb9-5c78aa70531f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:29.509443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:29.510255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:29.510706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:29.511145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] PATH_INFO: `/v3/users/31c787a53d064a8aba1dffdea6815f0b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:29.512488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c787a53d064a8aba1dffdea6815f0b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:29.514638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:29.568927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c787a53d064a8aba1dffdea6815f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:29.578165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c787a53d064a8aba1dffdea6815f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:29.578960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c787a53d064a8aba1dffdea6815f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:29.586844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c787a53d064a8aba1dffdea6815f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:29.587628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c787a53d064a8aba1dffdea6815f0b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:29.612304 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2221/4439] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:29 2022] DELETE /identity/v3/users/31c787a53d064a8aba1dffdea6815f0b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:29.615843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:29.618221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:29.710850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:29.712492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:29.726001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731775f5-dd85-48a2-9b4c-f8f2d6ee2949 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:29.735221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:29.867599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8a64d-77d6-405f-ad60-e38a09c5a57d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:29.879107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:29.881763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:29.894489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:29.896488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] PATH_INFO: `/v3/users/14aff6fe639d42bcb968efc58f7e9cad` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:29.896805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:29.898725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:29.900003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:29.900560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:29.905107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14aff6fe639d42bcb968efc58f7e9cad)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:29.907860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:29.908206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:29.943580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:29.945655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:29.959311 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2219/4440] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:08:30.022062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14aff6fe639d42bcb968efc58f7e9cad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.039411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14aff6fe639d42bcb968efc58f7e9cad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.040139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14aff6fe639d42bcb968efc58f7e9cad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.055647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14aff6fe639d42bcb968efc58f7e9cad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.059382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14aff6fe639d42bcb968efc58f7e9cad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.088523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:30.090217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.114202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b341d49-91c4-447a-8625-195dfa3b8a3f service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:30.123609 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2222/4441] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:29 2022] DELETE /identity/v3/users/14aff6fe639d42bcb968efc58f7e9cad => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:30.147692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:30.234537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2037029-173e-4563-b73a-516149124797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:30.235557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2037029-173e-4563-b73a-516149124797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.236116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2037029-173e-4563-b73a-516149124797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.236590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2037029-173e-4563-b73a-516149124797 admin admin] PATH_INFO: `/v3/users/cecadca739554f858c269b85690b5cec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.237996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2037029-173e-4563-b73a-516149124797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cecadca739554f858c269b85690b5cec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:30.240777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2037029-173e-4563-b73a-516149124797 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:30.281565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:30.283274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.314849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74527525-f79d-403c-bd2b-49cfc792da25 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:30.333743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:30.335498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.335498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.337004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] PATH_INFO: `/v3/projects/56d6aef3150c4051880f8cf6800506fb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.340691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d6aef3150c4051880f8cf6800506fb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:30.343888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:30.369794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cecadca739554f858c269b85690b5cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.385109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cecadca739554f858c269b85690b5cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.386119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cecadca739554f858c269b85690b5cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.397787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cecadca739554f858c269b85690b5cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.398637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cecadca739554f858c269b85690b5cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.428641 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2220/4442] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:30 2022] DELETE /identity/v3/users/cecadca739554f858c269b85690b5cec => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:30.429994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:30.434541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.434695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d6aef3150c4051880f8cf6800506fb', 'request_id': 'req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.443114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d6aef3150c4051880f8cf6800506fb', 'request_id': 'req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.471207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d6aef3150c4051880f8cf6800506fb', 'request_id': 'req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.514269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] The token cache is being invalidate because project 56d6aef3150c4051880f8cf6800506fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:30.515791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.516495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.535681 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2223/4443] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:30 2022] DELETE /identity/v3/projects/56d6aef3150c4051880f8cf6800506fb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:30.538588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:30.547274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.581508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:30.593510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2037029-173e-4563-b73a-516149124797 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:30.602635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:30.604533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.604915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.605332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] PATH_INFO: `/v3/projects/14cfab0b8daa4f2e935f8bb883bf6392` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.606873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14cfab0b8daa4f2e935f8bb883bf6392)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:30.608904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:30.668538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:30.690577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14cfab0b8daa4f2e935f8bb883bf6392', 'request_id': 'req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.702525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14cfab0b8daa4f2e935f8bb883bf6392', 'request_id': 'req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.707554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e17c2a-d64e-40e8-9718-9c79e3203e2e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:30.711899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14cfab0b8daa4f2e935f8bb883bf6392', 'request_id': 'req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.736096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] The token cache is being invalidate because project 14cfab0b8daa4f2e935f8bb883bf6392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:30.736464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.737679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a67974ed-5f9a-4c29-8006-3eb2a6d0a9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:30.739486 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2221/4444] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:30 2022] DELETE /identity/v3/projects/14cfab0b8daa4f2e935f8bb883bf6392 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:30.745820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.746113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.746417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.772562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:30.774160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.839555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:30.841038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.841479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.842536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.845376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.865943 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2222/4445] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:30.865943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:30.870429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.886414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f33ac-d5f3-4673-9d4d-dc2bb05d5f02 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:30.893688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:30.894822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.895389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.895836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] PATH_INFO: `/v3/projects/876cdb4084454584965a3f11aed5e79a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.895982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:30.897437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48609f22-2171-45e3-b12f-382f155244a2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:30.897793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=876cdb4084454584965a3f11aed5e79a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:30.900844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:30.919378 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2224/4446] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:30.920724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:30.921010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:30.921277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:30.978004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:30.979653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:30.985333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '876cdb4084454584965a3f11aed5e79a', 'request_id': 'req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.017520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '876cdb4084454584965a3f11aed5e79a', 'request_id': 'req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.037894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '876cdb4084454584965a3f11aed5e79a', 'request_id': 'req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.086388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] The token cache is being invalidate because project 876cdb4084454584965a3f11aed5e79a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:31.088390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.092023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d61ea693-f6bf-45af-a7d8-13c64a9fac9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.094967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2223/4447] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:30 2022] DELETE /identity/v3/projects/876cdb4084454584965a3f11aed5e79a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:31.096750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332989-b724-459b-a171-63ed29bcd40a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.102231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332989-b724-459b-a171-63ed29bcd40a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.102511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae332989-b724-459b-a171-63ed29bcd40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.110079 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2225/4448] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:31.111065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.124049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.146032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ac380-f00f-42fc-a32c-298ab670d967 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.160249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.161244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ae332989-b724-459b-a171-63ed29bcd40a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:31.164979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae332989-b724-459b-a171-63ed29bcd40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.176355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.176717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.178603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] PATH_INFO: `/v3/users/b8bc76f6d34c4970b9d1148f5a24c3fc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.183266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8bc76f6d34c4970b9d1148f5a24c3fc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.185285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.186168 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2224/4449] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:31.187604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.187947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.188276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.213098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:31.214654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.226989 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2225/4450] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:31.229201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.244409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90b409-c3ad-41ec-8772-a7c795927582 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.258444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.258729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.261409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.261888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.263135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:31.264277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.268393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.299640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2226/4451] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:31.301507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.327346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576fdc22-54eb-4fc1-9264-31b57c199e57 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.328382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8bc76f6d34c4970b9d1148f5a24c3fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.342558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8bc76f6d34c4970b9d1148f5a24c3fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.343107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.343345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8bc76f6d34c4970b9d1148f5a24c3fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.343937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.344319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.344696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.346768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:31.346768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.350826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.357647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8bc76f6d34c4970b9d1148f5a24c3fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.359719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8bc76f6d34c4970b9d1148f5a24c3fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.365985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:31.389678 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2226/4452] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:31 2022] DELETE /identity/v3/users/b8bc76f6d34c4970b9d1148f5a24c3fc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:31.392146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.394213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.401662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2227/4453] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:31.402741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.411802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.442285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1dc933-a913-407d-b645-ba511ea190bc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.459946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:31.506041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b980b6-4a25-4617-b7fc-29d4ebcba19f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.517427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.522498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.522875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.523159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.523826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.529034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.553477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.554203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.554483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.554761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] PATH_INFO: `/v3/projects/9e1b05d7018447eebe74cc47de363ead` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.557435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1b05d7018447eebe74cc47de363ead)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.561327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.601212 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2227/4454] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:31 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:31.605191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.611276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.692340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1b05d7018447eebe74cc47de363ead', 'request_id': 'req-2a691648-51e8-448b-b022-1b809be32356'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.704872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1b05d7018447eebe74cc47de363ead', 'request_id': 'req-2a691648-51e8-448b-b022-1b809be32356'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.719584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1b05d7018447eebe74cc47de363ead', 'request_id': 'req-2a691648-51e8-448b-b022-1b809be32356'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.744942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] The token cache is being invalidate because project 9e1b05d7018447eebe74cc47de363ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:31.745250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.746588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:31.750528 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2228/4455] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:31 2022] DELETE /identity/v3/projects/9e1b05d7018447eebe74cc47de363ead => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:31.752453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:31.755016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:31.766348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af1cb5-ad4f-435c-93fc-e174d9e771e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.924738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01dd20b-e899-4423-b484-9b82ce8ec6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.925377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dd20b-e899-4423-b484-9b82ce8ec6bb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.925685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dd20b-e899-4423-b484-9b82ce8ec6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.926025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01dd20b-e899-4423-b484-9b82ce8ec6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.926668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dd20b-e899-4423-b484-9b82ce8ec6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.928598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01dd20b-e899-4423-b484-9b82ce8ec6bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.952704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a691648-51e8-448b-b022-1b809be32356 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:31.976691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:31.977467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.977895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.978913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.979568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:31.981523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:31.982114 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2228/4456] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:31 2022] POST /identity/v3/projects => generated 377 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:31.984155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:31.984446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:31.985267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:31.995420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:32.015181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:32.017567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:32.023727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2229/4457] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:31 2022] POST /identity/v3/users => generated 294 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:32.024657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.027070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:32.042994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561382a-8663-4c2c-91e1-ed93316e084c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.085657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:32.161164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8e9e8-f759-4a20-8059-9ccc8e5fe0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.162268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e9e8-f759-4a20-8059-9ccc8e5fe0da admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.162734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e9e8-f759-4a20-8059-9ccc8e5fe0da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.162856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8e9e8-f759-4a20-8059-9ccc8e5fe0da admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.163468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8e9e8-f759-4a20-8059-9ccc8e5fe0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.166589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8e9e8-f759-4a20-8059-9ccc8e5fe0da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.189651 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2229/4458] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:32.190583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.219323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78018-4326-4052-bb10-2804cf878dd3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.224672 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2230/4459] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:32 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:32.228144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.228501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.228770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.233836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.234481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.234761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.235178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.236334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.238591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.264923 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2230/4460] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:32.265674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.275807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:32.279738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:32.307455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41b042-fd6f-41ca-9158-7129468f941e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.323226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2231/4461] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:32.323226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.325073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.325916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.326169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.327051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.327724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.332885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.344174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc646a04-92b4-41ef-8f6f-02862e2b019d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.353276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2231/4462] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:32.354705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.356346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.357144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.357431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.357712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.358383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.361184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.378372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ec348-f63e-43e5-91fb-a3279cf58af7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.386663 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2232/4463] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:32.386663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.389142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.389780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.394271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.394864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.395432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:32.395894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.397573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.408901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec67e2a1-7fe5-4d13-be5d-7182c2d19ba2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.420147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.421796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.422102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.422372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.423021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.427302 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2232/4464] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:32.428002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.429216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.452948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a318c-7b94-4a1b-982e-0fecead06782 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.453203 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2233/4465] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:32.453203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.461896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.462634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.463032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.463308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] PATH_INFO: `/v3/projects/183e669ba5fb4339bff2e904802029ee/users/9947e043ea8749eba2ebb1527cb10426/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.475869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31595-8017-43f0-bfd5-ffb2a81d7a32 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.485665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.487854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.489641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.489960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.490760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.495181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.500353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183e669ba5fb4339bff2e904802029ee, user_id=9947e043ea8749eba2ebb1527cb10426, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.506401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.534029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2233/4466] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:32 2022] PUT /identity/v3/projects/183e669ba5fb4339bff2e904802029ee/users/9947e043ea8749eba2ebb1527cb10426/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:32.535480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.562036 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2234/4467] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:32 2022] POST /identity/v3/projects => generated 403 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:32.564081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.568053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:32.689358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1fd31-2617-40ab-b4f3-8f1f9cd93046 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.729133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5bf650-632b-4c5a-916d-46285fc91c69 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:32.758726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:32.766601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.767904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.770685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.771001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] PATH_INFO: `/v3/projects/060b083096704816ae2c50c96be9414f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.773431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21247222-7312-42ad-9010-de01128c74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:32.774344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21247222-7312-42ad-9010-de01128c74db admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.774907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21247222-7312-42ad-9010-de01128c74db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.775345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21247222-7312-42ad-9010-de01128c74db admin admin] PATH_INFO: `/v3/projects/70185f31a11248d79b722001900d890a/users/4aab5eb9a3764e75863bf930c2bbd8bd/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.778757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=060b083096704816ae2c50c96be9414f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.787347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.796821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21247222-7312-42ad-9010-de01128c74db admin admin] RBAC: Authorizing `identity:create_grant(project_id=70185f31a11248d79b722001900d890a, user_id=4aab5eb9a3764e75863bf930c2bbd8bd, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:32.800075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21247222-7312-42ad-9010-de01128c74db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:32.839600 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2234/4468] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:32 2022] PUT /identity/v3/projects/70185f31a11248d79b722001900d890a/users/4aab5eb9a3764e75863bf930c2bbd8bd/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:32.842035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198022fe-493f-4440-a8b1-143540e519ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:32.844090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198022fe-493f-4440-a8b1-143540e519ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:32.844638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198022fe-493f-4440-a8b1-143540e519ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:32.892321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-198022fe-493f-4440-a8b1-143540e519ad None None] MFA Rules not processed for user `9947e043ea8749eba2ebb1527cb10426`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:32.893710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-198022fe-493f-4440-a8b1-143540e519ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:32.899070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060b083096704816ae2c50c96be9414f', 'request_id': 'req-a699da69-279d-491f-8c1d-856e8f73ceb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:32.910978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060b083096704816ae2c50c96be9414f', 'request_id': 'req-a699da69-279d-491f-8c1d-856e8f73ceb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:32.922417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060b083096704816ae2c50c96be9414f', 'request_id': 'req-a699da69-279d-491f-8c1d-856e8f73ceb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:32.941272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:32.948248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] The token cache is being invalidate because project 060b083096704816ae2c50c96be9414f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:32.948556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:32.950484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:32.956529 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2235/4469] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:32 2022] DELETE /identity/v3/projects/060b083096704816ae2c50c96be9414f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:32.967063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:32.993186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.043573 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2235/4470] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:33.048706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.048991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.049264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.115893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:33.116997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.191431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699da69-279d-491f-8c1d-856e8f73ceb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.206219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.206855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.207129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.207399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.208050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.210077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.273264 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2236/4471] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:32 2022] POST /identity/v3/users => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:33.274613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.278207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.291120 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2236/4472] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:33.301928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.306631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.321649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f3698-fa9f-4316-820a-7ed185bca56f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.337331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.338320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.338724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.339006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] PATH_INFO: `/v3/users/0bb215bc0435419eb2659aceb19ea58a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.342119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb215bc0435419eb2659aceb19ea58a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.346924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666deab-5d87-40b1-9537-558824e49c2f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.348499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.362671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.363318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.363596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.363867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.364526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.374115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.480310 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2237/4473] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:33 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:33.483809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.511440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb215bc0435419eb2659aceb19ea58a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:33.555342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb215bc0435419eb2659aceb19ea58a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:33.556208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb215bc0435419eb2659aceb19ea58a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:33.567523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb215bc0435419eb2659aceb19ea58a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:33.568898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb215bc0435419eb2659aceb19ea58a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:33.588459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:33.593270 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2237/4474] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:33 2022] DELETE /identity/v3/users/0bb215bc0435419eb2659aceb19ea58a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:33.595338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.610137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.626743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a53d7-9415-48cf-bc58-f8d5835ecd1d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.711416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.712235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.712767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.713604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.714753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.715400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea8228-2c8f-4fda-9d55-49836467fd6a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.716829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.721577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.722513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.723049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.723520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.726958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.732168 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2238/4475] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:33.732168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.732168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.756002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.757673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd126-b53b-473f-af08-bed8c5126113 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.757875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.763161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.764101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.764442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.765665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.766689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.769282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.771952 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2238/4476] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:33.772818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.774158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:33.785013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:33.807137 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2239/4477] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:33 2022] POST /identity/v3/users => generated 299 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:33.809220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.811735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8da04c-7ac9-4ca9-ba45-8a9ec1868097 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.823599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.824230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.824507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.827197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e3c5cd-ff12-44e6-8645-31574e981d0e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.827478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.828170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.833752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.834704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.836086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.836774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.837055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.838216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.841491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.857427 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2239/4478] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:33.858391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.860908 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2240/4479] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:33.867783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:33.876089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bd903-e58c-4f4b-afdc-377c2b6f36f1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.902544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412dfd7-dc7e-42dd-adb1-6530f4399913 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:33.911517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.913721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.914045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.915642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] PATH_INFO: `/v3/projects/722f5fa0e56d4962b0a2c1282eb489dd/users/2020cf091fa14d54b2051d7a5a49f082/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.919879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1976043a-87f5-4ff7-ad0c-c0c17ad21319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:33.921732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976043a-87f5-4ff7-ad0c-c0c17ad21319 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.922267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976043a-87f5-4ff7-ad0c-c0c17ad21319 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.922691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976043a-87f5-4ff7-ad0c-c0c17ad21319 admin admin] PATH_INFO: `/v3/projects/4a7326dd3a814cd1a644dae72e750379/users/b1e7eb5f12d044cebd33dd3d8463acc6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.952537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976043a-87f5-4ff7-ad0c-c0c17ad21319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7326dd3a814cd1a644dae72e750379, user_id=b1e7eb5f12d044cebd33dd3d8463acc6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.955932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1976043a-87f5-4ff7-ad0c-c0c17ad21319 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.958247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f5fa0e56d4962b0a2c1282eb489dd, user_id=2020cf091fa14d54b2051d7a5a49f082, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:33.961490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:33.981111 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2240/4480] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:33 2022] PUT /identity/v3/projects/4a7326dd3a814cd1a644dae72e750379/users/b1e7eb5f12d044cebd33dd3d8463acc6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:33.987553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2241/4481] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:33 2022] PUT /identity/v3/projects/722f5fa0e56d4962b0a2c1282eb489dd/users/2020cf091fa14d54b2051d7a5a49f082/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:33.990903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bde79b-e340-4163-8076-9617efb00810 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:33.991286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bde79b-e340-4163-8076-9617efb00810 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:33.991803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bde79b-e340-4163-8076-9617efb00810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:33.993011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.041427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-02bde79b-e340-4163-8076-9617efb00810 None None] MFA Rules not processed for user `b1e7eb5f12d044cebd33dd3d8463acc6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:34.042811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02bde79b-e340-4163-8076-9617efb00810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:34.082592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84eba-2b72-4ce7-a848-1d9365b687b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:34.090473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:34.091195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.091516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.091796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.092439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:34.095066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:34.110199 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2242/4482] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:08:34.114868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.132125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8eb5f-6a38-4f39-8a95-225170083b3c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:34.144425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:34.145345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.147020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.147566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] PATH_INFO: `/v3/projects/722f5fa0e56d4962b0a2c1282eb489dd/users/2020cf091fa14d54b2051d7a5a49f082/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.151025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722f5fa0e56d4962b0a2c1282eb489dd, user_id=2020cf091fa14d54b2051d7a5a49f082, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:34.156905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:34.164603 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2241/4483] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:33 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:34.182921 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2243/4484] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:34 2022] PUT /identity/v3/projects/722f5fa0e56d4962b0a2c1282eb489dd/users/2020cf091fa14d54b2051d7a5a49f082/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:34.187979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.188611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.188982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.189935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.229793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:34.250269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] MFA Rules not processed for user `2020cf091fa14d54b2051d7a5a49f082`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:34.251660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:34.353377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2ab67-9073-4cc2-9d28-16893c42d420 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:34.364988 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2242/4485] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:34.365977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.369084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:34.373072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:34.373774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.374429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.378769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] PATH_INFO: `/v3/users/b1e7eb5f12d044cebd33dd3d8463acc6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.383003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e7eb5f12d044cebd33dd3d8463acc6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:34.388307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:34.393380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df5e8f-c3c6-4865-a190-e5b2e791c518 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:34.418211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:34.419057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.419504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.419870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] PATH_INFO: `/v3/projects/bf7809d4281c4efa9330464b86c1ee27` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.421657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7809d4281c4efa9330464b86c1ee27)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:34.424519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:34.527512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:34.545604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7809d4281c4efa9330464b86c1ee27', 'request_id': 'req-8bc9f2c2-3ee5-48e6-8711-60082cbca403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.555785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e7eb5f12d044cebd33dd3d8463acc6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.561691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7809d4281c4efa9330464b86c1ee27', 'request_id': 'req-8bc9f2c2-3ee5-48e6-8711-60082cbca403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.570244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7809d4281c4efa9330464b86c1ee27', 'request_id': 'req-8bc9f2c2-3ee5-48e6-8711-60082cbca403'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.575610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e7eb5f12d044cebd33dd3d8463acc6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.576601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e7eb5f12d044cebd33dd3d8463acc6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.587512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e7eb5f12d044cebd33dd3d8463acc6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.588728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e7eb5f12d044cebd33dd3d8463acc6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.594280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] The token cache is being invalidate because project bf7809d4281c4efa9330464b86c1ee27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:34.594589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.598397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.604025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2243/4486] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:34 2022] DELETE /identity/v3/projects/bf7809d4281c4efa9330464b86c1ee27 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:34.604025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.604025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:34.620629 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2244/4487] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:34 2022] DELETE /identity/v3/users/b1e7eb5f12d044cebd33dd3d8463acc6 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:34.627650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.630357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:34.730114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc9f2c2-3ee5-48e6-8711-60082cbca403 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:34.731232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b21bd-1413-41b4-9601-ffad3b877a33 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:34.739995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:34.740745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.741025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.741341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] PATH_INFO: `/v3/users/9a75f856a9ef4d479257a73a9b4c118d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.743909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a75f856a9ef4d479257a73a9b4c118d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:34.746972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:34.827269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44693da9-ca61-472e-a6f1-ee6b21352bd0 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:34.828167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693da9-ca61-472e-a6f1-ee6b21352bd0 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.828877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693da9-ca61-472e-a6f1-ee6b21352bd0 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.829288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44693da9-ca61-472e-a6f1-ee6b21352bd0 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.829460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:34.830857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44693da9-ca61-472e-a6f1-ee6b21352bd0 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:34.834858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44693da9-ca61-472e-a6f1-ee6b21352bd0 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:34.853221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a75f856a9ef4d479257a73a9b4c118d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.868819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a75f856a9ef4d479257a73a9b4c118d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.869595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a75f856a9ef4d479257a73a9b4c118d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.878943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a75f856a9ef4d479257a73a9b4c118d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.880900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a75f856a9ef4d479257a73a9b4c118d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:34.903641 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2244/4488] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:34 2022] POST /identity/v3/projects => generated 359 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:34.905509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:34.905794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:34.906108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:34.950672 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2245/4489] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:34 2022] DELETE /identity/v3/users/9a75f856a9ef4d479257a73a9b4c118d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:34.951882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:34.955263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:34.956189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:34.956843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:35.072846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbbc3f-5e82-43bb-a432-3f41a0c9320b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.079559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.080660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.081172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.081644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-2014355092` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.084004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=aa268d5b36bc4367a301bc1b99c4b246, value=tempest-tag-2014355092)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.099267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.099493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:35.125067 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2245/4490] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:35.179590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.180976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:35.207907 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2014355092. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:35.207907 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:35.207907 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:35.241309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2246/4491] 10.222.0.16 () {60 vars in 1333 bytes} [Sat Oct 29 03:08:34 2022] PUT /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-2014355092 => generated 0 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Oct 29 03:08:35.257771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.293849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25629d-5cd4-4486-9ded-c30119bbf5fd tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.300365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.301108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.301298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.301567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-2014355092` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.310487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0b18-aec6-4c21-b4fe-d44b7b197e09 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.321041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.321843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.322225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.322407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.324209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=aa268d5b36bc4367a301bc1b99c4b246, value=tempest-tag-2014355092)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.327022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.343978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.345391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2247/4492] 10.222.0.16 () {58 vars in 1314 bytes} [Sat Oct 29 03:08:35 2022] GET /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-2014355092 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:35.348659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.371571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2246/4493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:08:35.381182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.400805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d65ab2-d73b-4ed4-a04b-6fbdc56b37e2 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.408384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.409564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.410116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.410642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.412223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=aa268d5b36bc4367a301bc1b99c4b246)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.416985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.490155 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2248/4494] 10.222.0.16 () {60 vars in 1265 bytes} [Sat Oct 29 03:08:35 2022] PUT /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags => generated 140 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:35.494307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.505511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b0b6c-ecf7-4299-932d-b275314fc34b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.511757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.512247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.512527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.512798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.528882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=aa268d5b36bc4367a301bc1b99c4b246)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.531133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.547106 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2247/4495] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:35 2022] GET /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags => generated 140 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:35.551411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.563819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0573b-d598-4e7e-89cb-18bdbf48ac01 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.571050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.571725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.572009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.572282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-702166510` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.574412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=aa268d5b36bc4367a301bc1b99c4b246, value=tempest-tag-702166510)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.577853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.589975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:35.658677 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-702166510. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:08:35.658677 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:08:35.658677 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:35.665941 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2249/4496] 10.222.0.16 () {58 vars in 1314 bytes} [Sat Oct 29 03:08:35 2022] DELETE /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-702166510 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:35.670465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.686226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab7aad-e9d8-4ad3-9c84-ab4b712c96a3 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.695634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.696459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.696825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.697136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-702166510` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.710394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.716273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:35.743246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=aa268d5b36bc4367a301bc1b99c4b246, value=tempest-tag-702166510)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.745539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.751229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28df5d-0021-4ed2-bf64-1bf0593e241b tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.757195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.758153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.758820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.761731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] PATH_INFO: `/v3/projects/0270f9d8b3c54ac8b5539ad17f363faa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.764351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0270f9d8b3c54ac8b5539ad17f363faa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.766639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Could not find project tag: tempest-tag-702166510.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-702166510. Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 29 03:08:35.777703 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 29 03:08:35.779037 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:08:35.779037 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:08:35.779037 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 29 03:08:35.779037 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 29 03:08:35.779037 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-702166510. Oct 29 03:08:35.779037 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:08:35.782716 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2248/4497] 10.222.0.16 () {58 vars in 1311 bytes} [Sat Oct 29 03:08:35 2022] GET /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags/tempest-tag-702166510 => generated 106 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 03:08:35.783629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.794407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433b3c0-efc0-44e0-a3d1-e6367a9cb374 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.799770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:35.800101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.800377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.800647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.801958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=aa268d5b36bc4367a301bc1b99c4b246)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:35.804226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:35.879444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0270f9d8b3c54ac8b5539ad17f363faa', 'request_id': 'req-b7b86408-277f-45cd-85d0-62b80c950ee1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:35.891014 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2249/4498] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:08:35 2022] DELETE /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:35.892183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:35.897931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0270f9d8b3c54ac8b5539ad17f363faa', 'request_id': 'req-b7b86408-277f-45cd-85d0-62b80c950ee1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:35.909471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6bfb9-2d0e-40f9-9985-ad0a04135909 tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:35.911753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0270f9d8b3c54ac8b5539ad17f363faa', 'request_id': 'req-b7b86408-277f-45cd-85d0-62b80c950ee1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:35.932641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] The token cache is being invalidate because project 0270f9d8b3c54ac8b5539ad17f363faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:35.932641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:35.934413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b7b86408-277f-45cd-85d0-62b80c950ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:35.945311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2250/4499] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:35 2022] DELETE /identity/v3/projects/0270f9d8b3c54ac8b5539ad17f363faa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:35.946913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def71b9a-98ad-468a-83f2-4ceaeac28047 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:35.948299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def71b9a-98ad-468a-83f2-4ceaeac28047 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:35.948472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def71b9a-98ad-468a-83f2-4ceaeac28047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:35.982991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-def71b9a-98ad-468a-83f2-4ceaeac28047 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:35.984608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-def71b9a-98ad-468a-83f2-4ceaeac28047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.006506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.007285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.007412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.007740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.031153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=aa268d5b36bc4367a301bc1b99c4b246)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.034400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.069051 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2250/4500] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:08:35 2022] GET /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246/tags => generated 66 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:08:36.073027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.076412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.128957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2251/4501] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:36.129907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ff61-faaa-4fa4-ae6b-df4fe13966ed tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.132004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.132404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.133246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.144104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2020cf091fa14d54b2051d7a5a49f082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '722f5fa0e56d4962b0a2c1282eb489dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.145266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.146179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.146640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] PATH_INFO: `/v3/projects/aa268d5b36bc4367a301bc1b99c4b246` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.148656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa268d5b36bc4367a301bc1b99c4b246)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.152168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.156500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:36.173833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:36.175545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.190977 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2252/4502] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:36.198057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.222838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164358d-98bb-4b10-8adb-1038a1b9cb2a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.229694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa268d5b36bc4367a301bc1b99c4b246', 'request_id': 'req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.239090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa268d5b36bc4367a301bc1b99c4b246', 'request_id': 'req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.246223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa268d5b36bc4367a301bc1b99c4b246', 'request_id': 'req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.267262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] The token cache is being invalidate because project aa268d5b36bc4367a301bc1b99c4b246 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:36.267816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.268830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.270977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2251/4503] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:36 2022] DELETE /identity/v3/projects/aa268d5b36bc4367a301bc1b99c4b246 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:36.276142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.277664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.297288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:36.336658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.338632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.339409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.340741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.341762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:36.342145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.345406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.361618 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2253/4504] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:36.366470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.368249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ddf23-3bb3-4776-bef9-fd47f2e6860c tempest-IdentityV3ProjectTagsTest-665883039 tempest-IdentityV3ProjectTagsTest-665883039-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.369978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.373957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.375076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.375552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.378414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] PATH_INFO: `/v3/users/9947e043ea8749eba2ebb1527cb10426` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.380038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9947e043ea8749eba2ebb1527cb10426)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.382413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.390763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af3419-6bc8-43ec-910a-206808b65612 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.397261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.398268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.398731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.399079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.400485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.402523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.458591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9947e043ea8749eba2ebb1527cb10426'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.472919 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2254/4505] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:36 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:08:36.476892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.485538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9947e043ea8749eba2ebb1527cb10426'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.488312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9947e043ea8749eba2ebb1527cb10426'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.504971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9947e043ea8749eba2ebb1527cb10426'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.505869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-64c21773-9b97-4858-a304-136dee396222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9947e043ea8749eba2ebb1527cb10426'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:36.529188 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2252/4506] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:36 2022] DELETE /identity/v3/users/9947e043ea8749eba2ebb1527cb10426 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:36.532576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.532576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.532820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.601312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:36.603508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.610175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:36.617646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad63e3-b000-49ee-a26a-2e1a72b62d25 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.735428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.736049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.736370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.736640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.737410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.740415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.751698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2253/4507] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:36.774535 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2255/4508] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:36 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:08:36.783237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.787675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.792731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.795483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:36.822541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194cfe5-31e0-4088-9196-69882c56bc81 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.843774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.843774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.843774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.843774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.844306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.844306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.878404 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2254/4509] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:36.881567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.901753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cf921-b31e-4692-95e2-031b657d5bc5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.907170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.908128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.908509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.908854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.910188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.913543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.930334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2255/4510] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:08:36.931693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a86c1e-9f81-4394-a100-4db36841f986 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.934934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:36.942156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.943405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.946009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.947091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.947811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873645e-a555-4778-91cd-8b4a00f6ec99 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:36.953303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03d27-def0-43d1-afd8-d46fe6053e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:36.954011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03d27-def0-43d1-afd8-d46fe6053e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:36.954292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03d27-def0-43d1-afd8-d46fe6053e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:36.954561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03d27-def0-43d1-afd8-d46fe6053e3d admin admin] PATH_INFO: `/v3/projects/a78ba05b911f4f31bfff66f61b0c08e0/users/064cddda4929478ea0897edd51f0392b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:36.961403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:36.966732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.969768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.973435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03d27-def0-43d1-afd8-d46fe6053e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ba05b911f4f31bfff66f61b0c08e0, user_id=064cddda4929478ea0897edd51f0392b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:36.976168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea03d27-def0-43d1-afd8-d46fe6053e3d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:36.987052 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2256/4511] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:08:37.015630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.017928 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2256/4512] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:36 2022] PUT /identity/v3/projects/a78ba05b911f4f31bfff66f61b0c08e0/users/064cddda4929478ea0897edd51f0392b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:37.018593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.029617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.029967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.030207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.039999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b5d52-0280-457c-aa6a-4f394c694994 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.060599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] MFA Rules not processed for user `064cddda4929478ea0897edd51f0392b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:37.061865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.139297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.140962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.143393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.144086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] PATH_INFO: `/v3/projects/4a7326dd3a814cd1a644dae72e750379` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.145554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7326dd3a814cd1a644dae72e750379)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.150035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.190811 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2257/4513] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:37.195096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.209531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b82e7-a024-4fb6-b292-2e363df9da88 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.216609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.217894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.218389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.218889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.219734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.223445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.274214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7326dd3a814cd1a644dae72e750379', 'request_id': 'req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.285767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2258/4514] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:37 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:37.286937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.287937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7326dd3a814cd1a644dae72e750379', 'request_id': 'req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.296617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7326dd3a814cd1a644dae72e750379', 'request_id': 'req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.322085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] The token cache is being invalidate because project 4a7326dd3a814cd1a644dae72e750379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:37.322407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.324381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35e42bb6-28ec-4b7e-bb24-7d666a1e5f29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.331789 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2257/4515] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:37 2022] DELETE /identity/v3/projects/4a7326dd3a814cd1a644dae72e750379 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:37.333351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66d33-eb3e-4e67-b6bf-12eec759b551 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.333633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66d33-eb3e-4e67-b6bf-12eec759b551 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.333934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba66d33-eb3e-4e67-b6bf-12eec759b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.357462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cba66d33-eb3e-4e67-b6bf-12eec759b551 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:37.358780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cba66d33-eb3e-4e67-b6bf-12eec759b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.363687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:37.428412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c6999-e705-4358-8e97-8b5353d9e45f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.442756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f2d1e-48b0-49f0-9be7-4355b6d28843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.443392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2d1e-48b0-49f0-9be7-4355b6d28843 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.443665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2d1e-48b0-49f0-9be7-4355b6d28843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.443938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f2d1e-48b0-49f0-9be7-4355b6d28843 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.444574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f2d1e-48b0-49f0-9be7-4355b6d28843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.448994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f2d1e-48b0-49f0-9be7-4355b6d28843 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.488979 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2258/4516] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:37.491866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966853c4-c90d-4074-b379-8319fce54388 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.492785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966853c4-c90d-4074-b379-8319fce54388 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.493303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966853c4-c90d-4074-b379-8319fce54388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.526724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-966853c4-c90d-4074-b379-8319fce54388 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:37.526929 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2259/4517] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:37 2022] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:37.526929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.527124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-966853c4-c90d-4074-b379-8319fce54388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.527208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.527208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.536175 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2259/4518] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:37.537331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966853c4-c90d-4074-b379-8319fce54388 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.547619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-966853c4-c90d-4074-b379-8319fce54388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.563228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966853c4-c90d-4074-b379-8319fce54388 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.569316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.570366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.570794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.571237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] PATH_INFO: `/v3/projects/183e669ba5fb4339bff2e904802029ee` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.573363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183e669ba5fb4339bff2e904802029ee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.576088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] MFA Rules not processed for user `dc4e17d222e0426698d1ef9a17921d64`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:37.576479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.578044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.596657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:37.655819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183e669ba5fb4339bff2e904802029ee', 'request_id': 'req-111dc98e-9a84-4e9c-abc3-f3dbc427f684'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.666395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183e669ba5fb4339bff2e904802029ee', 'request_id': 'req-111dc98e-9a84-4e9c-abc3-f3dbc427f684'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.677531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183e669ba5fb4339bff2e904802029ee', 'request_id': 'req-111dc98e-9a84-4e9c-abc3-f3dbc427f684'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.684530 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2260/4519] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:37.685696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.687581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.701661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] The token cache is being invalidate because project 183e669ba5fb4339bff2e904802029ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:37.701987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.702806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:37.709020 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2260/4520] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:37 2022] DELETE /identity/v3/projects/183e669ba5fb4339bff2e904802029ee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:37.709020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.709020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.710782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b70c-0400-4a11-a6f5-8b03b00d74a2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.845025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111dc98e-9a84-4e9c-abc3-f3dbc427f684 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.858142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.858780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.859057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.859327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.864425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.866914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.871738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.876834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.877122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.877403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.885602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:37.888085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.894987 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2261/4521] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:37.895356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.895890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.899802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.915985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7505e32-1be8-4c2c-a9c7-d0ea9a4ee526 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.923829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.924479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.924757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.925029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] PATH_INFO: `/v3/users/2020cf091fa14d54b2051d7a5a49f082` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:37.928082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2020cf091fa14d54b2051d7a5a49f082)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:37.938517 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2261/4522] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:37.939734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:37.941789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:37.945473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:37.964490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657954b5-a8ba-4059-acfb-94491bfc503a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:37.970566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:37.971626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:37.972101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:37.973302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] PATH_INFO: `/v3/projects/3cd7f4fbbf0a48779817251b990b6160/users/992ca899957441ed82c9563381043bbe/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.003335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd7f4fbbf0a48779817251b990b6160, user_id=992ca899957441ed82c9563381043bbe, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.008010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.034429 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2262/4523] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:37 2022] PUT /identity/v3/projects/3cd7f4fbbf0a48779817251b990b6160/users/992ca899957441ed82c9563381043bbe/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:38.034429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.061124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2020cf091fa14d54b2051d7a5a49f082'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:38.063338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:38.080827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2020cf091fa14d54b2051d7a5a49f082'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:38.082115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2020cf091fa14d54b2051d7a5a49f082'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:38.095462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2020cf091fa14d54b2051d7a5a49f082'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:38.096518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2020cf091fa14d54b2051d7a5a49f082'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:38.115835 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2262/4524] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:37 2022] DELETE /identity/v3/users/2020cf091fa14d54b2051d7a5a49f082 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:38.118409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.121068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:38.149151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b59490-0442-41e3-8d01-5c4699cc42fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.177032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:38.294949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.296125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.296760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.297293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.298512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7fb9a-7c4a-492b-b1fa-af3b0c7b177b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.298770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.301396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.304426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.305085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.305421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.305757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.307329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.310723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.330763 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2263/4525] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:38.335072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.348545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72def9-a4a0-4d86-84b4-71d80106fbf4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.355035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a202bb6-8299-4726-a2dc-c4566200729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.355895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202bb6-8299-4726-a2dc-c4566200729f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.356273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202bb6-8299-4726-a2dc-c4566200729f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.357009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a202bb6-8299-4726-a2dc-c4566200729f admin admin] PATH_INFO: `/v3/projects/3cd7f4fbbf0a48779817251b990b6160/users/992ca899957441ed82c9563381043bbe/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.358973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a202bb6-8299-4726-a2dc-c4566200729f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd7f4fbbf0a48779817251b990b6160, user_id=992ca899957441ed82c9563381043bbe, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.362078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a202bb6-8299-4726-a2dc-c4566200729f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.365424 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2263/4526] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:38 2022] POST /identity/v3/projects => generated 363 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:38.370076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.374748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:38.396007 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2264/4527] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:38 2022] PUT /identity/v3/projects/3cd7f4fbbf0a48779817251b990b6160/users/992ca899957441ed82c9563381043bbe/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:38.402904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.403197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.403837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.455553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] MFA Rules not processed for user `992ca899957441ed82c9563381043bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:38.463979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:38.509606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683e6b-d4f5-451b-8903-4e4eed01498a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.593379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.594216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.594585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.595110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.596187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.598620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.633266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2264/4528] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:38 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:08:38.634681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.636273 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2265/4529] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:38.637674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.660039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dec6b-9cfc-436b-b332-5409455a01f9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.668445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.669664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.670218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.670736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.672749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.674548 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:38.674548 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:38.674548 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:38.676323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.677699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e0d0-98b6-40c6-83c6-e739bd079dd1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.707700 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2266/4530] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:08:38 2022] POST /identity/v3/domains => generated 277 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:38.708234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.708599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.709224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.709675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.710175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.711218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.714078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.733747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2265/4531] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:38.735337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.745750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:38.749985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685b166-daa7-4be5-94b7-5b683d36e22f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.803849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:38.872929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.874444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.874992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.875432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.876477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a04d564-007f-4805-909f-d52f3c1e5955 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.876681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.879451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.898663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce56705-aaec-430f-a957-f4e08aef83b4 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.899472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce56705-aaec-430f-a957-f4e08aef83b4 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.901317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce56705-aaec-430f-a957-f4e08aef83b4 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.901704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce56705-aaec-430f-a957-f4e08aef83b4 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.904073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce56705-aaec-430f-a957-f4e08aef83b4 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.908772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce56705-aaec-430f-a957-f4e08aef83b4 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:38.916704 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2266/4532] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:38.921908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:38.937555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356b3fa-2b06-4e60-bd8d-92ef4a94d44c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:38.957041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:38.958903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:38.960443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:38.960908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1/users/904447cf3fd642f5ae2d618e3444fba3/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:38.984957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24916df98a104710b7939e018de25ca1, user_id=904447cf3fd642f5ae2d618e3444fba3, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:38.988321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:39.024339 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2267/4533] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:38 2022] PUT /identity/v3/projects/24916df98a104710b7939e018de25ca1/users/904447cf3fd642f5ae2d618e3444fba3/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:39.025941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:39.036028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:39.039580 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2267/4534] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:38 2022] POST /identity/v3/projects => generated 402 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:39.047824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.050154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.050596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.104893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] MFA Rules not processed for user `904447cf3fd642f5ae2d618e3444fba3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:39.135195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:39.145594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb46c1-9ba6-4f8e-9d78-a9887c48bf94 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:39.230373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:39.231065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.232099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.232381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] PATH_INFO: `/v3/projects/722f5fa0e56d4962b0a2c1282eb489dd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.233969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=722f5fa0e56d4962b0a2c1282eb489dd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:39.236591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:39.251771 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2268/4535] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:39.253053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:39.358978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240ffe1-fbb4-45b3-aa53-3ff41bb783e7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:39.359752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:39.360378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.360660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.360930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.361564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:39.368898 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:39.368898 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:39.368898 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:39.370160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:39.388673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722f5fa0e56d4962b0a2c1282eb489dd', 'request_id': 'req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:39.391516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:39.398484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722f5fa0e56d4962b0a2c1282eb489dd', 'request_id': 'req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:39.415659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722f5fa0e56d4962b0a2c1282eb489dd', 'request_id': 'req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:39.428984 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2269/4536] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:08:39 2022] POST /identity/v3/groups => generated 301 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:39.430005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:39.437702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:39.443815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] The token cache is being invalidate because project 722f5fa0e56d4962b0a2c1282eb489dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:39.444258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:39.445040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:39.447405 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2268/4537] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:39 2022] DELETE /identity/v3/projects/722f5fa0e56d4962b0a2c1282eb489dd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:39.449463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:39.451974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:39.509561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:39.593231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2a6b5-8eca-4188-8e67-7dde25b8e40a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:39.605522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1274cad-1b7e-4eac-aee2-667bed907735 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:39.607595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274cad-1b7e-4eac-aee2-667bed907735 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.607888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274cad-1b7e-4eac-aee2-667bed907735 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.608164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274cad-1b7e-4eac-aee2-667bed907735 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.609361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274cad-1b7e-4eac-aee2-667bed907735 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:39.616021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1274cad-1b7e-4eac-aee2-667bed907735 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:39.657783 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2269/4538] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:39 2022] POST /identity/v3/users => generated 442 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:39.659585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.659806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.660082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.680156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b44a713-0fd4-4801-ae08-6a8106ca1e58 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:39.707562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:39.709890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:39.900733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:39.903100 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2270/4539] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:39.903591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.903883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.904016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:39.906436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.913930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:39.916598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30bcdc-55cb-4138-8e6e-7d04f5003deb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:39.923300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:39.924099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.924569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.924936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:39.925946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:39.927813 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:39.927813 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:39.927813 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:39.929411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d22576a-6456-406f-b7a3-bf89caf84ac1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:39.975767 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2271/4540] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:08:39 2022] POST /identity/v3/roles => generated 240 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:39.977446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:39.978591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:39.979281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.022182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:40.023502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:40.055476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2272/4541] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:40.056795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.081998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c581a01-14bf-4b7f-8220-d76cc6dc5495 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.115929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.117795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.118091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.119097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/groups/8de4adbba9b74d6487e95617ac3205d5/roles/1426e205d2b142c7bc5bb5e8755645fa/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.140258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b34060db0fa6498cab59f44e4cbced66, group_id=8de4adbba9b74d6487e95617ac3205d5, role_id=1426e205d2b142c7bc5bb5e8755645fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.146647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.170949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.171694 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2273/4542] 10.222.0.16 () {60 vars in 1585 bytes} [Sat Oct 29 03:08:40 2022] PUT /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/groups/8de4adbba9b74d6487e95617ac3205d5/roles/1426e205d2b142c7bc5bb5e8755645fa/inherited_to_projects => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:40.172850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.173991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.203334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2270/4543] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:40.204502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.229278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ec66c-b1a1-447c-b137-f39707fc2373 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.271778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:40.342622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfa353e-f62a-454a-8df4-cae169e6b7b6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.353089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:40.353394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.354265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.354623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.355144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.355880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:40.356137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.359319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333edffb-154c-4b75-957c-472dc4aa439d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.389738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.391285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.391285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.391497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/groups/8de4adbba9b74d6487e95617ac3205d5/roles/1426e205d2b142c7bc5bb5e8755645fa/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.398930 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2274/4544] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:40.400369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc37a-c1d6-4cdc-bb54-4a149ebdd4fb None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.400653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc37a-c1d6-4cdc-bb54-4a149ebdd4fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.400927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bc37a-c1d6-4cdc-bb54-4a149ebdd4fb None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.403665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b34060db0fa6498cab59f44e4cbced66, group_id=8de4adbba9b74d6487e95617ac3205d5, role_id=1426e205d2b142c7bc5bb5e8755645fa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.409581 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2275/4545] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:08:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:08:40.417249 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:40.417249 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:40.417249 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:40.419809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.425510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bc37a-c1d6-4cdc-bb54-4a149ebdd4fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.451112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bc37a-c1d6-4cdc-bb54-4a149ebdd4fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.453696 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2271/4546] 10.222.0.16 () {58 vars in 1567 bytes} [Sat Oct 29 03:08:40 2022] HEAD /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/groups/8de4adbba9b74d6487e95617ac3205d5/roles/1426e205d2b142c7bc5bb5e8755645fa/inherited_to_projects => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:40.454774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:08:40.463469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.464559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:40.464944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.465440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.465888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.466687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.468787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.540851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2276/4547] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:40 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:40.543180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.623395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.716677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7e4d5-a679-4611-8f05-b45f5cd95908 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.774634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fb5d2-1029-4654-a362-6543c48a71a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.779390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.780179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.780477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.780820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/groups/8de4adbba9b74d6487e95617ac3205d5/roles/1426e205d2b142c7bc5bb5e8755645fa/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.783168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b34060db0fa6498cab59f44e4cbced66, group_id=8de4adbba9b74d6487e95617ac3205d5, role_id=1426e205d2b142c7bc5bb5e8755645fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.785094 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:40.785094 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:40.785094 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:40.787792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.798638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 1426e205d2b142c7bc5bb5e8755645fa was removed from group 8de4adbba9b74d6487e95617ac3205d5 on project b34060db0fa6498cab59f44e4cbced66. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:40.798931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:40.799674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:40.817622 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2277/4548] 10.222.0.16 () {58 vars in 1569 bytes} [Sat Oct 29 03:08:40 2022] DELETE /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/groups/8de4adbba9b74d6487e95617ac3205d5/roles/1426e205d2b142c7bc5bb5e8755645fa/inherited_to_projects => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:40.819030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.820948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:40.824800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904447cf3fd642f5ae2d618e3444fba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24916df98a104710b7939e018de25ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.827959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.828242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.828527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.833203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorizing `identity:get_project(project_id=24916df98a104710b7939e018de25ca1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.838831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:40.845231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2272/4549] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:08:40 2022] GET /identity/v3/projects/24916df98a104710b7939e018de25ca1 => generated 363 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:40.846161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:40.852341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:40.918437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:40.955206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef94c4-41a3-4dd5-a3e3-7d120c8d92bc tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.971987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c62af3-5d96-4c8b-839b-dac74a310072 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:40.978238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:40.978973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:40.979423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:40.980103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:40.980859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:40.983011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.016082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2278/4550] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:40 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:41.016082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.017759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.058638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:41.081556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.082234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.082658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.082799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.084672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.099702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.100891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616bcf0c-2ac2-4b0f-b1fe-1612426ab4fe service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.112870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0496d-4b36-4320-8daf-dcb87c25d221 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.113709 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2273/4551] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:41.115193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7487a-5b6f-4f25-94b0-d0c207b0f88a None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.115634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7487a-5b6f-4f25-94b0-d0c207b0f88a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.115977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7487a-5b6f-4f25-94b0-d0c207b0f88a None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.117989 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2274/4552] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:08:41.120152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7487a-5b6f-4f25-94b0-d0c207b0f88a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.134619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7487a-5b6f-4f25-94b0-d0c207b0f88a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.135067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.136163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.138298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.138298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles/1426e205d2b142c7bc5bb5e8755645fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.141558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.141558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.141558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.141860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1426e205d2b142c7bc5bb5e8755645fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.142687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.142687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.144576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.146711 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:41.146711 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:41.146711 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:41.147664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.160577 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2275/4553] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:41 2022] GET /identity/v3/roles => generated 1651 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:41.161839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:08:41.163905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.211317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 1426e205d2b142c7bc5bb5e8755645fa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:41.211514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.213167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.221347 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2279/4554] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:41 2022] DELETE /identity/v3/roles/1426e205d2b142c7bc5bb5e8755645fa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:41.224076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.228439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.275789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.277559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.337401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee709ee6-b982-4dbb-a590-4b73f0ee1fa3 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.343414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.343882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.344356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.344826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] PATH_INFO: `/v3/users/f97cdb72a2424ca2b8487d71b7f22c0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.346226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97cdb72a2424ca2b8487d71b7f22c0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.348596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.355080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:41.360934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11d32e-e23f-4174-a815-da7ffcea9988 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.422406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97cdb72a2424ca2b8487d71b7f22c0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.433307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97cdb72a2424ca2b8487d71b7f22c0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.434610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97cdb72a2424ca2b8487d71b7f22c0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.446124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97cdb72a2424ca2b8487d71b7f22c0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.447303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97cdb72a2424ca2b8487d71b7f22c0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:41.448523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904447cf3fd642f5ae2d618e3444fba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24916df98a104710b7939e018de25ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.449596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.450004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.450381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.452046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorizing `identity:get_project(project_id=24916df98a104710b7939e018de25ca1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.454431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.456974 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2276/4555] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:08:41 2022] GET /identity/v3/projects/24916df98a104710b7939e018de25ca1 => generated 363 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:41.458551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.462597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.475415 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2280/4556] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:41 2022] DELETE /identity/v3/users/f97cdb72a2424ca2b8487d71b7f22c0c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:41.477129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.479192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.499019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c05bfd-4541-488c-ae20-8c668e1e02c7 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.504503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:41.633893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da3f7c-1618-4545-9ccc-1f8a24d0304b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.639770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69419703-3600-4c7d-bf0a-834f8f4a9266 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.640967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419703-3600-4c7d-bf0a-834f8f4a9266 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.641642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419703-3600-4c7d-bf0a-834f8f4a9266 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.642238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69419703-3600-4c7d-bf0a-834f8f4a9266 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.643165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69419703-3600-4c7d-bf0a-834f8f4a9266 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.645771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69419703-3600-4c7d-bf0a-834f8f4a9266 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.665982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.666714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.666998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.667348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.668006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.670709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.674313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2281/4557] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:08:41 2022] POST /identity/v3/roles => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:41.690736 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2277/4558] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:41 2022] GET /identity/v3/roles => generated 1651 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:41.690948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ad2a3-4c1f-447c-a407-cb688dbac306 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.691038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.691127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ad2a3-4c1f-447c-a407-cb688dbac306 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.691127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ad2a3-4c1f-447c-a407-cb688dbac306 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.693970 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2282/4559] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:08:41 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:08:41.697390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ad2a3-4c1f-447c-a407-cb688dbac306 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.704733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622ef17-159a-4689-9f9d-b8b652aba060 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.709903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.710820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.711211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.711590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/a1c670e1ead8440c91371dabdd53f326/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.716760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ad2a3-4c1f-447c-a407-cb688dbac306 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.722097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:41.723453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:41.723762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:41.724193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] PATH_INFO: `/v3/projects/84272c8d4e724b41be52f69854ded58a/users/805f816832b74d31a27efc89f5af1a41/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:41.731675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b34060db0fa6498cab59f44e4cbced66, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=a1c670e1ead8440c91371dabdd53f326)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.734297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.749277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=84272c8d4e724b41be52f69854ded58a, user_id=805f816832b74d31a27efc89f5af1a41, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:41.756183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:41.760698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2278/4560] 10.222.0.16 () {60 vars in 1582 bytes} [Sat Oct 29 03:08:41 2022] PUT /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/a1c670e1ead8440c91371dabdd53f326/inherited_to_projects => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:41.760698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:08:41.763385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:41.774855 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2283/4561] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:41 2022] PUT /identity/v3/projects/84272c8d4e724b41be52f69854ded58a/users/805f816832b74d31a27efc89f5af1a41/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:41.785980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.991768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f51ee-88af-4c53-bebe-2a3a0b1f29fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:41.996246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:41.998053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.001389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:42.002119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.002403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.002683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/a1c670e1ead8440c91371dabdd53f326/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.010725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b34060db0fa6498cab59f44e4cbced66, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=a1c670e1ead8440c91371dabdd53f326)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:42.011828 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:42.011828 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:42.011828 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:42.013888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331f5be3-3709-4276-93ea-6b2df3c37841 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:42.031671 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2284/4562] 10.222.0.16 () {58 vars in 1564 bytes} [Sat Oct 29 03:08:41 2022] HEAD /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/a1c670e1ead8440c91371dabdd53f326/inherited_to_projects => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:42.031671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.031671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.031671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.050728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:42.102050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] MFA Rules not processed for user `805f816832b74d31a27efc89f5af1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:42.104045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.123786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3b287-78fc-4b70-8c0d-779f8f8ed73a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:42.210078 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2285/4563] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:42.210078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:42.238253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72965b4-106c-44a8-9924-c2097c585511 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:42.248426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904447cf3fd642f5ae2d618e3444fba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24916df98a104710b7939e018de25ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:42.249108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.249451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.249668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.251478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:42.252458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.253192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.253987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/a1c670e1ead8440c91371dabdd53f326/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.254142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorizing `identity:get_project(project_id=24916df98a104710b7939e018de25ca1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:42.257295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b34060db0fa6498cab59f44e4cbced66, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=a1c670e1ead8440c91371dabdd53f326)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:42.260107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:42.261180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:42.266471 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2279/4564] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:08:41 2022] GET /identity/v3/projects/24916df98a104710b7939e018de25ca1 => generated 363 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:42.267375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:42.275791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:42.298935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role a1c670e1ead8440c91371dabdd53f326 was removed from user ad225e3fbcf34b368ddd1be79a82da98 on project b34060db0fa6498cab59f44e4cbced66. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:42.299213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.300300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bbc67000-71ae-47c4-b562-8200b52a854c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.324757 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2286/4565] 10.222.0.16 () {58 vars in 1566 bytes} [Sat Oct 29 03:08:42 2022] DELETE /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/a1c670e1ead8440c91371dabdd53f326/inherited_to_projects => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:42.327316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a2a7f-4d09-4eb1-ba3e-aea72ef6fe46 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.327602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a2a7f-4d09-4eb1-ba3e-aea72ef6fe46 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.327948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a2a7f-4d09-4eb1-ba3e-aea72ef6fe46 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.334136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2287/4566] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:08:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:08:42.335455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a2a7f-4d09-4eb1-ba3e-aea72ef6fe46 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:42.338706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc6a2a7f-4d09-4eb1-ba3e-aea72ef6fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.411046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88488a47-9767-4170-9f49-4449701cab86 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:42.448994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a2a7f-4d09-4eb1-ba3e-aea72ef6fe46 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:42.459434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:42.461090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.463507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.464013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles/a1c670e1ead8440c91371dabdd53f326` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.466908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a1c670e1ead8440c91371dabdd53f326)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:42.473389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:42.572646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:42.573389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role a1c670e1ead8440c91371dabdd53f326 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:42.575226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.575650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.576624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.577133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.577610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.579145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:42.582951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:42.583634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2288/4567] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:42 2022] DELETE /identity/v3/roles/a1c670e1ead8440c91371dabdd53f326 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:42.584683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:08:42.592204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.648587 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2280/4568] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:42 2022] POST /identity/v3/projects => generated 371 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:42.650114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:42.655924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.686129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:42.763873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4359a-4f91-4804-bb38-53e1fc0e2dda admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:42.770194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:42.770867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:42.771202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:42.771477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] PATH_INFO: `/v3/projects/173e87fac5564c2db6ccff6fc14e0520` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:42.772668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=173e87fac5564c2db6ccff6fc14e0520)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:42.774848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:42.808278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:42.810224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.841977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173e87fac5564c2db6ccff6fc14e0520', 'request_id': 'req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.854743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173e87fac5564c2db6ccff6fc14e0520', 'request_id': 'req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.862275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173e87fac5564c2db6ccff6fc14e0520', 'request_id': 'req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.881195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] The token cache is being invalidate because project 173e87fac5564c2db6ccff6fc14e0520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:42.881895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:42.882535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.883617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:42.886910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2281/4569] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:42 2022] DELETE /identity/v3/projects/173e87fac5564c2db6ccff6fc14e0520 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:42.889998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:42.892290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:42.917529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30622bc5-e02f-431d-804d-449c94f6c399 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.001503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904447cf3fd642f5ae2d618e3444fba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24916df98a104710b7939e018de25ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.001744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119ac4-8fdc-4e1e-ac63-419b6d1521ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.002216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.002641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.003056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.004080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorizing `identity:get_project(project_id=24916df98a104710b7939e018de25ca1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.006648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.006834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.007422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.007699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.007967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.008463 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2289/4570] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:08:42 2022] GET /identity/v3/projects/24916df98a104710b7939e018de25ca1 => generated 363 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:43.008633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.009161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.010377 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:43.010377 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:43.010377 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:43.011036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:43.011543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970daf0b-1b5e-4a4d-aba5-ee5da9e63f5f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.035259 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2282/4571] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:08:42 2022] POST /identity/v3/roles => generated 239 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:43.039411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a62f6-c0e1-43e6-a3aa-d6a5fa7ca765 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.040008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a62f6-c0e1-43e6-a3aa-d6a5fa7ca765 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.040688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a62f6-c0e1-43e6-a3aa-d6a5fa7ca765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.065942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9e7a62f6-c0e1-43e6-a3aa-d6a5fa7ca765 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:43.067167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e7a62f6-c0e1-43e6-a3aa-d6a5fa7ca765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:43.091407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afcb13-fabc-4886-9649-52576a1ce4c2 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.096931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.098152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.098468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.098742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.099621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.101154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:43.101600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.145552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2290/4572] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:43 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:43.147310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.170588 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2283/4573] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:43.172464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763832b-09e1-423a-b748-e1e75f7b01a1 None None] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.172950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763832b-09e1-423a-b748-e1e75f7b01a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.173368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763832b-09e1-423a-b748-e1e75f7b01a1 None None] PATH_INFO: `/` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.175121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2284/4574] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:08:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:08:43.175985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763832b-09e1-423a-b748-e1e75f7b01a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.192383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89265fe-a302-428e-9e71-737e908cfd99 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.201698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763832b-09e1-423a-b748-e1e75f7b01a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.209612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.210205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.210446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.211084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/35de5328be6341809946bd451e7159fa/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.214907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af0b1a-80d3-4b85-a330-b573c036bdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.215863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af0b1a-80d3-4b85-a330-b573c036bdab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.216319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af0b1a-80d3-4b85-a330-b573c036bdab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.216773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af0b1a-80d3-4b85-a330-b573c036bdab admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.218125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af0b1a-80d3-4b85-a330-b573c036bdab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.220440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af0b1a-80d3-4b85-a330-b573c036bdab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.224873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, group_id=8de4adbba9b74d6487e95617ac3205d5, role_id=35de5328be6341809946bd451e7159fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.232902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.250660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2285/4575] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:43 2022] GET /identity/v3/roles => generated 1650 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:43.252405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.252692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.253049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.258321 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2291/4576] 10.222.0.16 () {60 vars in 1582 bytes} [Sat Oct 29 03:08:43 2022] PUT /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/35de5328be6341809946bd451e7159fa/inherited_to_projects => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:43.259588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating service token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:08:43.261425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:43.277958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:43.279279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:43.375938 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2286/4577] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:43.377039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.388656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d323b-184a-4d21-b11a-30e70c093705 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.394575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.395502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.395908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.396391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] PATH_INFO: `/v3/projects/54e5845341eb4f4f8e5b4d9c4bef9397/users/251c9e13016a4b0fb41aea12fd1dbef0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.414397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e5845341eb4f4f8e5b4d9c4bef9397, user_id=251c9e13016a4b0fb41aea12fd1dbef0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.417523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.438183 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2287/4578] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:43 2022] PUT /identity/v3/projects/54e5845341eb4f4f8e5b4d9c4bef9397/users/251c9e13016a4b0fb41aea12fd1dbef0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:43.439879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.460270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.461602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:43.483454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:43.549469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f2365-9fae-48c8-8809-2ce9533b9a2e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.560601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f64335-28ff-42f3-a25d-56db978b95d0 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.562805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.563782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.564214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.565424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.568736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=5cc11acec7d845e1b2e65245f503508b, group_id=8de4adbba9b74d6487e95617ac3205d5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.574086 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:43.574086 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:43.574086 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:43.576396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.592698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2288/4579] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Oct 29 03:08:43 2022] GET /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/inherited_to_projects => generated 447 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:43.597769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.640775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:43.651236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '904447cf3fd642f5ae2d618e3444fba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '24916df98a104710b7939e018de25ca1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.651900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.652177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.652448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.653353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorizing `identity:get_project(project_id=24916df98a104710b7939e018de25ca1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.658343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.671695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2292/4580] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:08:43 2022] GET /identity/v3/projects/24916df98a104710b7939e018de25ca1 => generated 363 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:43.673154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.688417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787edf5-a99e-4662-ad82-8686275da32c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.695843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.696856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.697508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.698102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.699038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:43.699379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6cbe-00ec-461b-a52d-64f3f27a9be4 tempest-QuotasTestJSON-905892163 tempest-QuotasTestJSON-905892163-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.699993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.702232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.717903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.718952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.719219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.720064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.720202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.723568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.728438 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2289/4581] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:43.729684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.737123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2293/4582] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:43 2022] GET /identity/v3/roles => generated 1650 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:43.738416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.741357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:43.754246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c27352-ee7f-4337-b7f1-c7c9e7cb9ab5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.760845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d6614-3b4f-4dc0-b688-593fe528f078 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.766699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.769086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.769243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.769481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.769836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/35de5328be6341809946bd451e7159fa/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.770140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.770506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.770868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] PATH_INFO: `/v3/users/904447cf3fd642f5ae2d618e3444fba3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.772074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=904447cf3fd642f5ae2d618e3444fba3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.772268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, group_id=8de4adbba9b74d6487e95617ac3205d5, role_id=35de5328be6341809946bd451e7159fa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.774835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.775490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.782425 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2290/4583] 10.222.0.16 () {58 vars in 1564 bytes} [Sat Oct 29 03:08:43 2022] HEAD /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/35de5328be6341809946bd451e7159fa/inherited_to_projects => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:43.783662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.799287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b103e18-bbac-495c-9e28-50dbbc33ed04 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.805326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:43.806165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.806531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.807095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.807890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:43.809987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:43.852207 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2291/4584] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:43 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:43.853143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:43.853287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904447cf3fd642f5ae2d618e3444fba3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:43.865338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904447cf3fd642f5ae2d618e3444fba3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:43.867850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904447cf3fd642f5ae2d618e3444fba3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:43.880091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904447cf3fd642f5ae2d618e3444fba3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:43.881323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-25ce8a71-ab8f-4127-ad8e-c44a652d76ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904447cf3fd642f5ae2d618e3444fba3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:43.928559 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2294/4585] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:43 2022] DELETE /identity/v3/users/904447cf3fd642f5ae2d618e3444fba3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:43.932706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:43.933243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:43.933689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:43.945317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2705ec-4239-4b8e-a982-3ffdd53e23b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:43.968660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:43.970564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.017998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:44.023196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.024884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.025176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.025448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] PATH_INFO: `/v3/projects/54e5845341eb4f4f8e5b4d9c4bef9397/users/251c9e13016a4b0fb41aea12fd1dbef0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.028281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e5845341eb4f4f8e5b4d9c4bef9397, user_id=251c9e13016a4b0fb41aea12fd1dbef0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.036416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.053309 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2292/4586] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:43 2022] PUT /identity/v3/projects/54e5845341eb4f4f8e5b4d9c4bef9397/users/251c9e13016a4b0fb41aea12fd1dbef0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:44.054353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.056122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.081539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2295/4587] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:08:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:44.083051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.084736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.105306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb90edd-33fc-4f5e-aaf8-45a87344188c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:44.130399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:44.165437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04115905-a624-435a-9a68-2db29352fb06 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:44.172347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.174808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.175221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.175655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/35de5328be6341809946bd451e7159fa/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.182153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, group_id=8de4adbba9b74d6487e95617ac3205d5, role_id=35de5328be6341809946bd451e7159fa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.185100 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:44.185100 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:44.185100 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:44.191638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.195947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3668b1-2c19-4273-94ed-547a59eb79f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.196651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3668b1-2c19-4273-94ed-547a59eb79f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.197046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3668b1-2c19-4273-94ed-547a59eb79f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.197550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3668b1-2c19-4273-94ed-547a59eb79f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.199253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3668b1-2c19-4273-94ed-547a59eb79f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.202931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3668b1-2c19-4273-94ed-547a59eb79f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.211007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 35de5328be6341809946bd451e7159fa was removed from group 8de4adbba9b74d6487e95617ac3205d5 on domain 5cc11acec7d845e1b2e65245f503508b. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:44.211720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:44.214241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d7a0a1d-d1f4-465d-80f1-58c5f8e22faf tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:44.237698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2293/4588] 10.222.0.16 () {58 vars in 1566 bytes} [Sat Oct 29 03:08:44 2022] DELETE /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/groups/8de4adbba9b74d6487e95617ac3205d5/roles/35de5328be6341809946bd451e7159fa/inherited_to_projects => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:44.239200 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2296/4589] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:44 2022] POST /identity/v3/users => generated 302 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:44.239976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.241047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.241650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.241862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.245341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.245960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.278844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:44.280360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.283238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] MFA Rules not processed for user `251c9e13016a4b0fb41aea12fd1dbef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:44.284493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.363285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2294/4590] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:44.366543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.368767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.420501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2297/4591] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:44.425583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.427307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.492244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cac43-dde7-49c7-ac9a-6ad91d7a9d73 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:44.500848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.501715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.502252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.502619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.505063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.506705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:44.547300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29da6a-4ffb-488a-94fe-fd8dd4cfad57 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:44.569837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.570521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.570804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.571636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles/35de5328be6341809946bd451e7159fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.574358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_role(role_id=35de5328be6341809946bd451e7159fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.578650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.619699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.623429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.628953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:44.647230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 35de5328be6341809946bd451e7159fa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:44.647761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:44.648620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:44.649668 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2295/4592] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:08:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:08:44.651154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.652983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.654775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2298/4593] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:44 2022] DELETE /identity/v3/roles/35de5328be6341809946bd451e7159fa => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:44.656527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.659659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.700436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2a3a-e241-45b2-b5b1-b43e18637875 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:44.778706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f750a7-767c-4ec4-841e-4c0b737968d6 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:44.786439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.788472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.789020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.789489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.793156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.840627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:44.841279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:44.841546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:44.841972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:44.845609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.847299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.891801 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2296/4594] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:44.893825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.896693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:44.934092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:44.935838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:44.960621 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2299/4595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:44.961818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:44.963633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:45.111361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa72592-c612-434d-9665-930e7c74f9bc service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.115001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246dd75-8319-429a-9326-bc696b709813 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.121265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.121919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.122333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.122616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.123288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.129035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.130558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.131294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.131586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.131877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.132791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.139835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.146207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:45.164586 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2300/4596] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:08:44 2022] POST /identity/v3/roles => generated 239 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:45.166711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.171382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:45.203454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31384292-f583-4d84-a3ab-0f7027acb241 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.217428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.218065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.218376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.218599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.219379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.221088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.229961 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2297/4597] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:44 2022] POST /identity/v3/projects => generated 360 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:45.234648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.249062 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2301/4598] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:45 2022] GET /identity/v3/roles => generated 1650 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:45.249062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.272914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a6a3-939c-48a3-82b5-8ea2436774ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.404981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429ccec-ac6a-4abe-99dd-0049bbdf949d tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.411703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.412204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.413225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.413586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/278224acb7aa42bd8296949b43891cb7/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.416880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=278224acb7aa42bd8296949b43891cb7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.420601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.428910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.429666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.429994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.430266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.431142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.437147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.445163 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2298/4599] 10.222.0.16 () {60 vars in 1579 bytes} [Sat Oct 29 03:08:45 2022] PUT /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/278224acb7aa42bd8296949b43891cb7/inherited_to_projects => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:45.447118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.450815 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.server.flask.common [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 29 03:08:45.466342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:45.514262 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2302/4600] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:45 2022] POST /identity/v3/users => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:45.515639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.551573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b59ca-4864-4810-b3c7-4ea666bfb1ad tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.624073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93bbea2-f78e-4268-9b2e-8fc7cd901f9b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.649337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.649853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.649998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.650259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] PATH_INFO: `/v3/projects/6f3b3b4572cb4ca0a03dee7dc0da988b/users/575da00069cc4e7bbeeeb78925b9beba/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.703251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f3b3b4572cb4ca0a03dee7dc0da988b, user_id=575da00069cc4e7bbeeeb78925b9beba, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.705991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.735587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.736696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.737229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.737729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.740024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=5cc11acec7d845e1b2e65245f503508b, user_id=ad225e3fbcf34b368ddd1be79a82da98)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.741483 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:45.741483 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:45.741483 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:45.742709 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2299/4601] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:45 2022] PUT /identity/v3/projects/6f3b3b4572cb4ca0a03dee7dc0da988b/users/575da00069cc4e7bbeeeb78925b9beba/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:45.744613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac759ad7-e457-45b6-bf8d-e861a4929222 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.745255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.774347 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2303/4602] 10.222.0.16 () {58 vars in 1461 bytes} [Sat Oct 29 03:08:45 2022] GET /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/inherited_to_projects => generated 446 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:45.776044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.776349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.776597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.840376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:45.842790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:45.889146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb9877-fef5-480d-b54f-c29385ce2faf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:45.903306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:45.904104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:45.904484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:45.904849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:45.906049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:45.906049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:45.907370 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:45.907370 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:45.907370 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:45.910105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:45.969376 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2300/4603] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Oct 29 03:08:45 2022] GET /identity/v3/users?domain_id=default => generated 7452 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:45.970652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.978860 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2304/4604] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:45.978860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:45.988390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.001924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9a28-7e4e-4b38-a039-4328537f1581 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:46.007953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:46.008722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.009280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.009625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] PATH_INFO: `/v3/projects/24916df98a104710b7939e018de25ca1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.010914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24916df98a104710b7939e018de25ca1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:46.013781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:46.017923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:46.114779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe4bf-62bc-4879-97c3-f2aadeca4fb8 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:46.153626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24916df98a104710b7939e018de25ca1', 'request_id': 'req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.168460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24916df98a104710b7939e018de25ca1', 'request_id': 'req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.177635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24916df98a104710b7939e018de25ca1', 'request_id': 'req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.229239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] The token cache is being invalidate because project 24916df98a104710b7939e018de25ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:46.229563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.234504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.236395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:46.237527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2305/4605] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:45 2022] DELETE /identity/v3/projects/24916df98a104710b7939e018de25ca1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:46.239330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:46.243904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.273423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:46.274581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.275236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.276294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/278224acb7aa42bd8296949b43891cb7/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.280479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=278224acb7aa42bd8296949b43891cb7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:46.287038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:46.310403 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2301/4606] 10.222.0.16 () {58 vars in 1561 bytes} [Sat Oct 29 03:08:45 2022] HEAD /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/278224acb7aa42bd8296949b43891cb7/inherited_to_projects => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:46.311059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:46.315998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.408581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b9042-d04a-41c8-8d48-0af8e4cc90c5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:46.424372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:46.427077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.428952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.429400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/users/454d9234286e4956918c6beda3f2588a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.475427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:update_user(user_id=454d9234286e4956918c6beda3f2588a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:46.477398 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:46.477398 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:46.477398 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:46.479507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:46.506100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4990e00-06f8-4f7a-bade-cabd598a7b46 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:46.511199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:46.511886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.512165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.512437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.520336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.541170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '454d9234286e4956918c6beda3f2588a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.563196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invalidating the token cache because user 454d9234286e4956918c6beda3f2588a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:46.563196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.563196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d021232b-5a5b-422d-a2b0-3f6ef17a6155 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.565792 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2306/4607] 10.222.0.16 () {60 vars in 1244 bytes} [Sat Oct 29 03:08:46 2022] PATCH /identity/v3/users/454d9234286e4956918c6beda3f2588a => generated 485 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:46.569031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d1874-4b3f-4948-bf14-92bbbf9bfb9e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.569031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d1874-4b3f-4948-bf14-92bbbf9bfb9e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.569031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d1874-4b3f-4948-bf14-92bbbf9bfb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.624369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-042d1874-4b3f-4948-bf14-92bbbf9bfb9e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:46.628451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-042d1874-4b3f-4948-bf14-92bbbf9bfb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.679179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:46.682559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:46.707546 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2302/4608] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:46.708531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:46.713823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.744040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a890fb4-ff8d-42de-9d07-14ec15527e24 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:46.771467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:46.772491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.772780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.773058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/278224acb7aa42bd8296949b43891cb7/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.777309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=278224acb7aa42bd8296949b43891cb7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:46.780059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:46.786061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:46.788220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 278224acb7aa42bd8296949b43891cb7 was removed from user ad225e3fbcf34b368ddd1be79a82da98 on domain 5cc11acec7d845e1b2e65245f503508b. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:46.792096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.793603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0317a43-3ccf-436c-b884-1b16c0044bfc tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:46.816509 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2307/4609] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:46.818030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.818316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.818655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.859446 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2303/4610] 10.222.0.16 () {58 vars in 1563 bytes} [Sat Oct 29 03:08:46 2022] DELETE /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/278224acb7aa42bd8296949b43891cb7/inherited_to_projects => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:46.863481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:46.863811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:46.864017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:46.866988 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.auth.plugins.core [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] User is disabled: 454d9234286e4956918c6beda3f2588a: AssertionError: User is disabled: 454d9234286e4956918c6beda3f2588a Oct 29 03:08:46.906454 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 29 03:08:46.912288 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2308/4611] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:46 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 95 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 29 03:08:46.913535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:46.922163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:46.942648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:46.947235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.090375 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2304/4612] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:47.092899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:47.095651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.098292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ff338-8242-44f5-b097-3788de46ada1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:47.108711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:47.109382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:47.109663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:47.110200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles/278224acb7aa42bd8296949b43891cb7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:47.113579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_role(role_id=278224acb7aa42bd8296949b43891cb7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:47.119720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:47.131354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:47.202538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 278224acb7aa42bd8296949b43891cb7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:47.202538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.204104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.209724 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2309/4613] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:46 2022] DELETE /identity/v3/roles/278224acb7aa42bd8296949b43891cb7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:47.214126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:47.219114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.283338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b328f-dcd8-46d7-b543-0b61b55ab7f5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:47.394112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:47.394787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:47.395063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:47.395333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/users/454d9234286e4956918c6beda3f2588a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:47.407683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d32998-0917-4c14-8d73-e37138be5938 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:47.413781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:47.414779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:47.415285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:47.415735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:47.418045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.434071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:delete_user(user_id=454d9234286e4956918c6beda3f2588a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:47.435464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:47.437423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:47.439104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:47.470591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2310/4614] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:47.471289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:47.487586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.542346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454d9234286e4956918c6beda3f2588a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.559598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454d9234286e4956918c6beda3f2588a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.560694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454d9234286e4956918c6beda3f2588a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.569885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454d9234286e4956918c6beda3f2588a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.570670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454d9234286e4956918c6beda3f2588a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:47.591385 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2305/4615] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:47 2022] DELETE /identity/v3/users/454d9234286e4956918c6beda3f2588a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:47.592239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:47.593959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.667663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:47.687883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:47.721047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b31054-ece7-45ac-971a-de4a2d130ff9 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:47.836375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828e95e-771b-4e1c-9c29-ac2f6be4fcf5 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:47.862406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:47.863059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:47.863397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:47.863678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:47.866680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:47.867196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:47.869355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:47.870030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:47.870906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:47.871266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:47.872849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:47.873521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:47.880104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:47.905896 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2311/4616] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:47.906969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:47.910773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.910957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2306/4617] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:08:47 2022] POST /identity/v3/roles => generated 240 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:47.911825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:47.918545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:47.947291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812412d6-b065-4afc-9e1f-6fb7d48b0c43 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:47.960846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:47.961482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:47.961768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:47.962111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:47.962859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:47.968629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.039332 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2307/4618] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:47 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:48.041627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:48.075169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec55c68-2ebe-43c0-b3b7-266534f7d1a1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:48.209837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:48.211400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:48.212341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:48.212859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/projects/bd10de7a51b94efca8f8928c64e75730` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:48.215274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd10de7a51b94efca8f8928c64e75730)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:48.221382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.268992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47fcf80-2605-44ce-8769-86dae1532a11 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:48.282264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:48.283600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:48.284373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:48.284811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:48.285631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:48.303258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.320108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:48.344232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd10de7a51b94efca8f8928c64e75730', 'request_id': 'req-f55f724e-d2bf-4c2c-abe8-a41373793875'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:48.363450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd10de7a51b94efca8f8928c64e75730', 'request_id': 'req-f55f724e-d2bf-4c2c-abe8-a41373793875'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:48.385434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd10de7a51b94efca8f8928c64e75730', 'request_id': 'req-f55f724e-d2bf-4c2c-abe8-a41373793875'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:48.416366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] The token cache is being invalidate because project bd10de7a51b94efca8f8928c64e75730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:48.417003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:48.418147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:48.429103 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2312/4619] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:47 2022] DELETE /identity/v3/projects/bd10de7a51b94efca8f8928c64e75730 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:48.429103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:48.429393 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2308/4620] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:48 2022] POST /identity/v3/projects => generated 409 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:48.429498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:48.430715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:48.433623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:48.607025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f724e-d2bf-4c2c-abe8-a41373793875 tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:48.610874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b62-8e40-44e6-b12d-bcfa34026699 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:48.629498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '251c9e13016a4b0fb41aea12fd1dbef0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54e5845341eb4f4f8e5b4d9c4bef9397', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:48.630999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:48.631333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:48.632262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:48.632573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:48.637830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Could not find domain: 952a6e3bdc514b9792b61d5d03c35333.: keystone.exception.DomainNotFound: Could not find domain: 952a6e3bdc514b9792b61d5d03c35333. Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 952a6e3bdc514b9792b61d5d03c35333. Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:08:48.681234 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:08:48.682527 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:08:48.683705 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:08:48.684766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:08:48.684766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:08:48.684766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 952a6e3bdc514b9792b61d5d03c35333. Oct 29 03:08:48.684766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:08:48.692843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2309/4621] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:48 2022] POST /identity/v3/users => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:08:48.693705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:48.696139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:48.745463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:48.777613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:48.778751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:48.778751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:48.778751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:48.779389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:48.784551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.834938 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2313/4622] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:48 2022] POST /identity/v3/users => generated 287 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:48.835907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:48.846475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:48.879605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75940e4e-a76a-47f7-be00-d079b6acd5c7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:48.884126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c44f3-fa29-4c23-b6ec-3bb07c39f6ba tempest-UsersNegativeTest-1219585290 tempest-UsersNegativeTest-1219585290-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:48.885716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:48.886440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:48.886725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:48.887120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] PATH_INFO: `/v3/users/805f816832b74d31a27efc89f5af1a41` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:48.888212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805f816832b74d31a27efc89f5af1a41)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:48.890233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.902995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:48.903698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:48.904003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:48.904256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/5d7c4062688a42a187d4589671861716/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:48.912720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=5d7c4062688a42a187d4589671861716)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:48.915518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:48.939652 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2310/4623] 10.222.0.16 () {60 vars in 1579 bytes} [Sat Oct 29 03:08:48 2022] PUT /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/5d7c4062688a42a187d4589671861716/inherited_to_projects => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:48.941493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:48.989005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805f816832b74d31a27efc89f5af1a41'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.007772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805f816832b74d31a27efc89f5af1a41'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.008569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805f816832b74d31a27efc89f5af1a41'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.014498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=12,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:49.021641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805f816832b74d31a27efc89f5af1a41'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.022560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805f816832b74d31a27efc89f5af1a41'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.074414 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2314/4624] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:48 2022] DELETE /identity/v3/users/805f816832b74d31a27efc89f5af1a41 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:49.075692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.079679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:49.157573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383690-89b9-4678-aabb-a0f0244d4a0e tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.264055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cf293-9766-41bc-8e6f-708d424dddc0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.270593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.271222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.271496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.271764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.277573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Adding query filter params (scope.project.id=b34060db0fa6498cab59f44e4cbced66, user.id=ad225e3fbcf34b368ddd1be79a82da98) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:49.278388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.279438 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:49.279438 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:49.279438 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:49.285216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.285644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d60ae-db45-45f2-87cb-8923f83eb801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.289318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d60ae-db45-45f2-87cb-8923f83eb801 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.289605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d60ae-db45-45f2-87cb-8923f83eb801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.290079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d60ae-db45-45f2-87cb-8923f83eb801 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.290830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d60ae-db45-45f2-87cb-8923f83eb801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.292473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d60ae-db45-45f2-87cb-8923f83eb801 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.320406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2311/4625] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:48 2022] GET /identity/v3/roles => generated 1651 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:49.321790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.322126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.322368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.370177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:49.371438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:49.397597 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2312/4626] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:49.398493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.410446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:49.430896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1648-9e76-4e54-83e8-2b162562a130 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.438411 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2315/4627] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:08:49 2022] GET /identity/v3/role_assignments?scope.project.id=b34060db0fa6498cab59f44e4cbced66&user.id=ad225e3fbcf34b368ddd1be79a82da98&effective => generated 648 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:49.442086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.442704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.442847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.443014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.443261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.443916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.449385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.466774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f073c-167c-42b1-9715-0f7f14baed74 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.475268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.476105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.476246 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2313/4628] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:49 2022] GET /identity/v3/roles => generated 1651 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:49.477112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.477237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.477322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.478131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Adding query filter params (scope.project.id=f864a2430c214a5db906d5ea90ee06ca, user.id=ad225e3fbcf34b368ddd1be79a82da98) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:49.478712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.481325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.482841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:49.554720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2316/4629] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:08:49 2022] GET /identity/v3/role_assignments?scope.project.id=f864a2430c214a5db906d5ea90ee06ca&user.id=ad225e3fbcf34b368ddd1be79a82da98&effective => generated 648 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:08:49.555864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.573621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d08e42-b1db-4339-ab1e-11591a9dbb52 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.580578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.581403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.582190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.582571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] PATH_INFO: `/v3/projects/c639ff72d2fe4a879f8ef8aa060ff134/users/46106f84fe6c4f4ab0d291148780806b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.589257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:49.608578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c639ff72d2fe4a879f8ef8aa060ff134, user_id=46106f84fe6c4f4ab0d291148780806b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.613239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.630164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ad70e-8ed1-4511-83d3-ac5eacd060eb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.645569 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2317/4630] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:49 2022] PUT /identity/v3/projects/c639ff72d2fe4a879f8ef8aa060ff134/users/46106f84fe6c4f4ab0d291148780806b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:49.646717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.702192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:49.756595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.757573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.757877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.760010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.863396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bd1c9-2739-443a-ae9f-11b7791bd7e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:49.893902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:49.896751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.897035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.897312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/5d7c4062688a42a187d4589671861716/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.904999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5cc11acec7d845e1b2e65245f503508b, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=5d7c4062688a42a187d4589671861716)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.908518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.926012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 5d7c4062688a42a187d4589671861716 was removed from user ad225e3fbcf34b368ddd1be79a82da98 on domain 5cc11acec7d845e1b2e65245f503508b. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:49.926306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.928217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-35c81fd7-8c1f-41a7-9ee1-5905cc7ebb32 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:49.935978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:49.937453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:49.953021 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2318/4631] 10.222.0.16 () {58 vars in 1563 bytes} [Sat Oct 29 03:08:49 2022] DELETE /identity/v3/OS-INHERIT/domains/5cc11acec7d845e1b2e65245f503508b/users/ad225e3fbcf34b368ddd1be79a82da98/roles/5d7c4062688a42a187d4589671861716/inherited_to_projects => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:49.957426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:49.957708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:49.958030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:49.962360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2314/4632] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:49.968799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:49.999043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c1469-4e54-44b3-b57e-aa64912eb30d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:50.027199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] MFA Rules not processed for user `46106f84fe6c4f4ab0d291148780806b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:50.028484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:50.188021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:50.188671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:50.188956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:50.189495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:50.190003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Adding query filter params (scope.project.id=b34060db0fa6498cab59f44e4cbced66, user.id=ad225e3fbcf34b368ddd1be79a82da98) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:50.190315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:50.204076 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:50.204076 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:50.204076 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:50.205833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:50.284209 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2319/4633] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:50.297075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:50.301738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:50.379398 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2315/4634] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:08:49 2022] GET /identity/v3/role_assignments?scope.project.id=b34060db0fa6498cab59f44e4cbced66&user.id=ad225e3fbcf34b368ddd1be79a82da98&effective => generated 228 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:50.383558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:50.386787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:50.407735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:50.415631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90952f56-085d-46e0-bebe-2278f66ca4ef tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:50.430120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:50.434043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:50.437690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:50.439129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:50.444210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Adding query filter params (scope.project.id=f864a2430c214a5db906d5ea90ee06ca, user.id=ad225e3fbcf34b368ddd1be79a82da98) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:50.444850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:50.448812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5705ef-d191-4c40-b01f-a78388b55afe tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:50.497417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d1d65-1727-4a78-824b-fd950684720a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:50.507515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:50.508417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:50.509136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:50.509577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:50.523539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:50.525995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:50.544071 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2320/4635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:50.549196 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2316/4636] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:08:50 2022] GET /identity/v3/role_assignments?scope.project.id=f864a2430c214a5db906d5ea90ee06ca&user.id=ad225e3fbcf34b368ddd1be79a82da98&effective => generated 228 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:08:50.553043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:50.575791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43457822-dac5-40ab-9ac3-092367edb4e9 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:50.593156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:50.593862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:50.594134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:50.594432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/projects/f864a2430c214a5db906d5ea90ee06ca` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:50.596077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f864a2430c214a5db906d5ea90ee06ca)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:50.598223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:50.618439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:50.619405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:50.619923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:50.635925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:50.707293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f864a2430c214a5db906d5ea90ee06ca', 'request_id': 'req-87bdfe20-0796-4a62-9da7-594a4099ac62'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:50.717409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f864a2430c214a5db906d5ea90ee06ca', 'request_id': 'req-87bdfe20-0796-4a62-9da7-594a4099ac62'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:50.732137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f864a2430c214a5db906d5ea90ee06ca', 'request_id': 'req-87bdfe20-0796-4a62-9da7-594a4099ac62'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:50.738845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] MFA Rules not processed for user `4aab5eb9a3764e75863bf930c2bbd8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:50.748269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:50.759693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] The token cache is being invalidate because project f864a2430c214a5db906d5ea90ee06ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:50.759693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:50.761141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:50.767128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2321/4637] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:50 2022] DELETE /identity/v3/projects/f864a2430c214a5db906d5ea90ee06ca => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:50.770445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:50.773423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:50.960111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdfe20-0796-4a62-9da7-594a4099ac62 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:50.985404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:50.986675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:50.986961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:50.987236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles/5d7c4062688a42a187d4589671861716` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:50.988759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5d7c4062688a42a187d4589671861716)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:50.990487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:51.024850 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2317/4638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:51.142728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role 5d7c4062688a42a187d4589671861716 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:51.143035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:51.144850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:51.151293 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2322/4639] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:50 2022] DELETE /identity/v3/roles/5d7c4062688a42a187d4589671861716 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:51.152686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:51.172100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:51.173975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:51.178037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea553942-749d-42af-a073-f2a45912aa5d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:51.369672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fc986-6785-4461-bf20-53cf9013c05f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:51.385027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:51.385962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:51.390484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:51.390787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:51.393377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:51.401852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:51.446680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:51.447850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:51.448303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:51.448752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:51.450181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:51.455523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:51.492926 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2318/4640] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:08:51 2022] POST /identity/v3/roles => generated 240 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:51.495078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:51.501145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:51.549682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:51.555919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:51.557255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19ccd7-a993-422d-a8f9-44aa3cd5aacd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:51.578623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:51.579584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:51.580072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:51.580688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:51.581522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:51.587100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:51.625422 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2323/4641] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:08:51.685850 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2319/4642] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:51 2022] POST /identity/v3/projects => generated 409 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:51.689657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:51.708120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa298e-4d2b-4751-a931-8335e3466ec1 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:51.887692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:51.890059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:51.892423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:51.893265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/e7385f1da03341bcb8a7670d56153bf0/inherited_to_projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:51.904781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b34060db0fa6498cab59f44e4cbced66, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=e7385f1da03341bcb8a7670d56153bf0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:51.910722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:51.941384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2324/4643] 10.222.0.16 () {60 vars in 1582 bytes} [Sat Oct 29 03:08:51 2022] PUT /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/e7385f1da03341bcb8a7670d56153bf0/inherited_to_projects => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:51.946062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:51.969894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d1605-cd99-4781-8a5b-f3adc1e3379b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:51.981919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:52.209248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:52.215787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:52.226186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:52.227535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:52.228908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Adding query filter params (scope.project.id=dd2d1860c48740559a8104bad3dd8def, user.id=ad225e3fbcf34b368ddd1be79a82da98) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:52.229332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:52.232834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:52.329416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:52.331449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:52.484432 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2320/4644] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:08:51 2022] GET /identity/v3/role_assignments?scope.project.id=dd2d1860c48740559a8104bad3dd8def&user.id=ad225e3fbcf34b368ddd1be79a82da98&effective => generated 649 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:52.488869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:52.541105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317f062-0be6-41e4-95a0-26bd5c44a7f1 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:52.572803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:52.573620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:52.574193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:52.574577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/e7385f1da03341bcb8a7670d56153bf0/inherited_to_projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:52.583192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b34060db0fa6498cab59f44e4cbced66, user_id=ad225e3fbcf34b368ddd1be79a82da98, role_id=e7385f1da03341bcb8a7670d56153bf0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:52.586043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:52.592278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a14eb-8c68-4207-bf69-2e3e3ddf43a2 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:52.603955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:52.604672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:52.604951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:52.605224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] PATH_INFO: `/v3/projects/84272c8d4e724b41be52f69854ded58a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:52.607049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84272c8d4e724b41be52f69854ded58a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:52.611135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:52.633051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role e7385f1da03341bcb8a7670d56153bf0 was removed from user ad225e3fbcf34b368ddd1be79a82da98 on project b34060db0fa6498cab59f44e4cbced66. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:52.634246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.635478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.659431 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2321/4645] 10.222.0.16 () {58 vars in 1566 bytes} [Sat Oct 29 03:08:52 2022] DELETE /identity/v3/OS-INHERIT/projects/b34060db0fa6498cab59f44e4cbced66/users/ad225e3fbcf34b368ddd1be79a82da98/roles/e7385f1da03341bcb8a7670d56153bf0/inherited_to_projects => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:52.663308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:52.666706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:52.701033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:52.719450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84272c8d4e724b41be52f69854ded58a', 'request_id': 'req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.732010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84272c8d4e724b41be52f69854ded58a', 'request_id': 'req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.748614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84272c8d4e724b41be52f69854ded58a', 'request_id': 'req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.770327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] The token cache is being invalidate because project 84272c8d4e724b41be52f69854ded58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:52.770327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.773588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:52.779459 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2325/4646] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:52 2022] DELETE /identity/v3/projects/84272c8d4e724b41be52f69854ded58a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:52.780696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:52.782290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:52.818777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60c75e-dbb9-4161-b458-23c8447b3f60 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:52.926470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:52.957065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:52.958253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:52.959629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:52.960590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:52.963433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Adding query filter params (scope.project.id=dd2d1860c48740559a8104bad3dd8def, user.id=ad225e3fbcf34b368ddd1be79a82da98) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:52.964320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:52.971057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:53.004134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62df84e4-1a60-49c1-b4c3-b37f026f0ff2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:53.028136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:53.028989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:53.029365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:53.029925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] PATH_INFO: `/v3/users/251c9e13016a4b0fb41aea12fd1dbef0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:53.031777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=251c9e13016a4b0fb41aea12fd1dbef0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:53.033842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:53.217981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251c9e13016a4b0fb41aea12fd1dbef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.258488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251c9e13016a4b0fb41aea12fd1dbef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.268196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251c9e13016a4b0fb41aea12fd1dbef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.271910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2322/4647] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:08:52 2022] GET /identity/v3/role_assignments?scope.project.id=dd2d1860c48740559a8104bad3dd8def&user.id=ad225e3fbcf34b368ddd1be79a82da98&effective => generated 228 bytes in 609 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:08:53.287372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:53.310091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:53.337151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251c9e13016a4b0fb41aea12fd1dbef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.344740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251c9e13016a4b0fb41aea12fd1dbef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.400421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c8794-471f-45ec-bc24-f74aa9612b03 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:53.422292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:53.424332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:53.428201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:53.428828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/projects/dd2d1860c48740559a8104bad3dd8def` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:53.434392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dd2d1860c48740559a8104bad3dd8def)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:53.447269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:53.451644 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2326/4648] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:52 2022] DELETE /identity/v3/users/251c9e13016a4b0fb41aea12fd1dbef0 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:53.649021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2d1860c48740559a8104bad3dd8def', 'request_id': 'req-01190f20-ed19-4b61-bf7b-f4006c2ef59b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.662453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2d1860c48740559a8104bad3dd8def', 'request_id': 'req-01190f20-ed19-4b61-bf7b-f4006c2ef59b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.681750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2d1860c48740559a8104bad3dd8def', 'request_id': 'req-01190f20-ed19-4b61-bf7b-f4006c2ef59b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.708847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] The token cache is being invalidate because project dd2d1860c48740559a8104bad3dd8def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:53.709594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.710940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:53.718708 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2323/4649] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:53 2022] DELETE /identity/v3/projects/dd2d1860c48740559a8104bad3dd8def => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:53.722601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:53.857555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:53.898340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d7e1c-6d73-4f85-a082-409a3f921b8c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:54.189782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:54.190878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:54.192406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:54.194778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/roles/e7385f1da03341bcb8a7670d56153bf0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:54.199503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e7385f1da03341bcb8a7670d56153bf0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:54.202739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:54.337355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invalidating the token cache because role e7385f1da03341bcb8a7670d56153bf0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:54.339263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.340024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.342766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2327/4650] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:53 2022] DELETE /identity/v3/roles/e7385f1da03341bcb8a7670d56153bf0 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:54.347914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:54.349707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:54.390822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01190f20-ed19-4b61-bf7b-f4006c2ef59b tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:54.610004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:54.611430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:54.611722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:54.612551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/users/ad225e3fbcf34b368ddd1be79a82da98` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:54.614838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ad225e3fbcf34b368ddd1be79a82da98)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:54.624462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:54.757494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:54.799381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad225e3fbcf34b368ddd1be79a82da98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.817718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad225e3fbcf34b368ddd1be79a82da98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.818878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad225e3fbcf34b368ddd1be79a82da98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.830322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad225e3fbcf34b368ddd1be79a82da98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.831299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad225e3fbcf34b368ddd1be79a82da98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:54.875671 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2324/4651] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:54 2022] DELETE /identity/v3/users/ad225e3fbcf34b368ddd1be79a82da98 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:54.879699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:54.881771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:54.908461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65e89b-47d1-4b6d-bcf1-116567f82d15 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:55.201169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:55.201870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:55.202156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:55.202425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/groups/8de4adbba9b74d6487e95617ac3205d5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:55.204180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8de4adbba9b74d6487e95617ac3205d5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:55.205210 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:55.205210 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:55.205210 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:55.206665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:55.408903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2328/4652] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:08:54 2022] DELETE /identity/v3/groups/8de4adbba9b74d6487e95617ac3205d5 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:55.412877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:55.414490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:55.444228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f632da-8909-4932-8abc-11cdcbe45b8c tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:55.625109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:55.629526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:55.629861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:55.632012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/projects/b34060db0fa6498cab59f44e4cbced66` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:55.634624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b34060db0fa6498cab59f44e4cbced66)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:55.644651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:55.772388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34060db0fa6498cab59f44e4cbced66', 'request_id': 'req-c2906e5e-90c1-4ece-85cf-5975b740b8cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:55.788374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34060db0fa6498cab59f44e4cbced66', 'request_id': 'req-c2906e5e-90c1-4ece-85cf-5975b740b8cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:55.801331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34060db0fa6498cab59f44e4cbced66', 'request_id': 'req-c2906e5e-90c1-4ece-85cf-5975b740b8cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:55.830124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] The token cache is being invalidate because project b34060db0fa6498cab59f44e4cbced66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:55.830422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:55.833348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:55.835107 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2325/4653] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:55 2022] DELETE /identity/v3/projects/b34060db0fa6498cab59f44e4cbced66 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:55.839781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:55.841605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:55.871974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb35a07-84c5-46e5-bfc3-44ac1fd6bd2a tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:55.910835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:56.029046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:56.029868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:56.030165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:56.030433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/domains/5cc11acec7d845e1b2e65245f503508b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:56.035090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5cc11acec7d845e1b2e65245f503508b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:56.038326 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:56.038326 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:08:56.038326 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:08:56.041992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:56.100111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5cc11acec7d845e1b2e65245f503508b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.100538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5cc11acec7d845e1b2e65245f503508b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.154044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5cc11acec7d845e1b2e65245f503508b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.155418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5cc11acec7d845e1b2e65245f503508b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.162982 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2329/4654] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:08:55 2022] PATCH /identity/v3/domains/5cc11acec7d845e1b2e65245f503508b => generated 278 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:56.164172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:56.177636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2906e5e-90c1-4ece-85cf-5975b740b8cd tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:56.285493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:56.329455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '992ca899957441ed82c9563381043bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd7f4fbbf0a48779817251b990b6160', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:56.330196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:56.330475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:56.330750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] PATH_INFO: `/v3/domains/5cc11acec7d845e1b2e65245f503508b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:56.361477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5cc11acec7d845e1b2e65245f503508b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:56.362651 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:08:56.362651 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:08:56.362651 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:08:56.363542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:56.424674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5cc11acec7d845e1b2e65245f503508b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.454438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5cc11acec7d845e1b2e65245f503508b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.563039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cc11acec7d845e1b2e65245f503508b', 'request_id': 'req-d582c89a-7a11-4502-86ae-0fc425dc0209'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.578874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cc11acec7d845e1b2e65245f503508b', 'request_id': 'req-d582c89a-7a11-4502-86ae-0fc425dc0209'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.608079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cc11acec7d845e1b2e65245f503508b', 'request_id': 'req-d582c89a-7a11-4502-86ae-0fc425dc0209'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.651077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] The token cache is being invalidate because project 5cc11acec7d845e1b2e65245f503508b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:56.652929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.655352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.670849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5cc11acec7d845e1b2e65245f503508b', 'request_id': 'req-d582c89a-7a11-4502-86ae-0fc425dc0209'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.671648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5cc11acec7d845e1b2e65245f503508b', 'request_id': 'req-d582c89a-7a11-4502-86ae-0fc425dc0209'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.673578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d582c89a-7a11-4502-86ae-0fc425dc0209 tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5cc11acec7d845e1b2e65245f503508b', 'request_id': 'req-d582c89a-7a11-4502-86ae-0fc425dc0209'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:56.697688 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2326/4655] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:08:56 2022] DELETE /identity/v3/domains/5cc11acec7d845e1b2e65245f503508b => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:56.698306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:56.699948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:56.880787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8c8b-25a2-4640-aaf1-d57ef80f618c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:56.881071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8c8b-25a2-4640-aaf1-d57ef80f618c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:56.881345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8c8b-25a2-4640-aaf1-d57ef80f618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:56.958140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-936b8c8b-25a2-4640-aaf1-d57ef80f618c None None] MFA Rules not processed for user `4aab5eb9a3764e75863bf930c2bbd8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:56.963269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1a28f-d098-41ea-9841-2800c367b62f tempest-InheritsV3TestJSON-910487377 tempest-InheritsV3TestJSON-910487377-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:56.966468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-936b8c8b-25a2-4640-aaf1-d57ef80f618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:57.166500 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2327/4656] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:08:57.179576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:57.180733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:57.181238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:57.181692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] PATH_INFO: `/v3/users/064cddda4929478ea0897edd51f0392b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:57.187258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=064cddda4929478ea0897edd51f0392b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:57.189423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:57.264393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:57.288169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064cddda4929478ea0897edd51f0392b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.296683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064cddda4929478ea0897edd51f0392b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.297441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064cddda4929478ea0897edd51f0392b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.311842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064cddda4929478ea0897edd51f0392b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.312639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064cddda4929478ea0897edd51f0392b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.351027 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2330/4657] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:56 2022] DELETE /identity/v3/users/064cddda4929478ea0897edd51f0392b => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:57.356266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:57.356550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:57.356860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:57.410058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:57.414207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:57.478430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:57.500067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:57.501708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:57.656272 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2328/4658] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:57.708589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a749be-47ee-4aee-90aa-ea11a10934c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:57.732865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:57.733543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:57.733833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:57.734116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] PATH_INFO: `/v3/projects/54e5845341eb4f4f8e5b4d9c4bef9397` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:57.736111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e5845341eb4f4f8e5b4d9c4bef9397)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:57.744077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:57.745589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:57.763670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:57.912753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e5845341eb4f4f8e5b4d9c4bef9397', 'request_id': 'req-72075815-6fac-417c-ab63-10d73bf060cc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.923253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef4611-1ea9-47f3-bbb0-8e943a96aefa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:57.927151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e5845341eb4f4f8e5b4d9c4bef9397', 'request_id': 'req-72075815-6fac-417c-ab63-10d73bf060cc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.942265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e5845341eb4f4f8e5b4d9c4bef9397', 'request_id': 'req-72075815-6fac-417c-ab63-10d73bf060cc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.967302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] The token cache is being invalidate because project 54e5845341eb4f4f8e5b4d9c4bef9397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:08:57.967958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.970600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-72075815-6fac-417c-ab63-10d73bf060cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:57.975234 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2331/4659] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:08:57 2022] DELETE /identity/v3/projects/54e5845341eb4f4f8e5b4d9c4bef9397 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:57.982401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ee24-efb4-4270-b197-3aeae6bbbb6a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:57.984605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ee24-efb4-4270-b197-3aeae6bbbb6a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:57.985019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20ee24-efb4-4270-b197-3aeae6bbbb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.064002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a20ee24-efb4-4270-b197-3aeae6bbbb6a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:58.069626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a20ee24-efb4-4270-b197-3aeae6bbbb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:58.087408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:58.090213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:58.090751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:58.091095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.094388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:58.199355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:58.291637 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2332/4660] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:58.293691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:58.294007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:58.294359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.334998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:58.337486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:58.349455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:58.351114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:58.358904 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2329/4661] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:08:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:08:58.379733 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2333/4662] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:58.380851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:58.398455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae628616-bfb1-4bd3-b6aa-7ac01b02c7b4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:58.414046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:58.414693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:58.415039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:58.415490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.416553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:08:58.416674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:58.420097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:58.458492 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2330/4663] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:08:58.459688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:58.471684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5a2cf-2585-4b4a-958e-fb22966f219a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:58.484916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:58.485558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:58.485883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:58.486473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.487294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:58.494443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:58.592899 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2334/4664] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:08:58 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:58.594112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:58.609466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05f60a-440c-4d20-ba8a-e7630c4e5dcc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:58.674402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:58.824091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:58.824854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:58.825234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:58.825600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.826489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:58.828561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:58.875135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2331/4665] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:08:58 2022] POST /identity/v3/users => generated 296 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:58.879067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:58.922236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a141a0-336a-4cc2-9ef5-f684bed8ba38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:58.940186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:58.949436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:58.949892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:58.950182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:58.951165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:58.961544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:59.014048 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2335/4666] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:59.017168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:59.035241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8496481-60c7-4f9f-928c-97384085b0b6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:59.056132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01b467-2ec1-4486-bb61-f20923c3be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:59.056991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01b467-2ec1-4486-bb61-f20923c3be4b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:59.057393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01b467-2ec1-4486-bb61-f20923c3be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:59.057767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01b467-2ec1-4486-bb61-f20923c3be4b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:59.058548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01b467-2ec1-4486-bb61-f20923c3be4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:59.062992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01b467-2ec1-4486-bb61-f20923c3be4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:59.108363 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2332/4667] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:08:59.112687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:59.132373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fc1af-1e88-473a-bb58-0d84664408bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:59.155710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:59.156406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:59.156709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:59.156954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] PATH_INFO: `/v3/projects/6c640fe77e9149a3998dc75912f351de/users/e015ef0128c54bc5b9c809d92a05d666/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:59.216822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c640fe77e9149a3998dc75912f351de, user_id=e015ef0128c54bc5b9c809d92a05d666, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:59.223237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:59.273073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2336/4668] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:08:59 2022] PUT /identity/v3/projects/6c640fe77e9149a3998dc75912f351de/users/e015ef0128c54bc5b9c809d92a05d666/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:08:59.284980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:59.284980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:59.284980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:59.285762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:59.286352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:59.378851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] MFA Rules not processed for user `e015ef0128c54bc5b9c809d92a05d666`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:59.380096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:59.511464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e542e-fedc-41ec-9ffc-0fb7ef2d543f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:59.527477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:59.528309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:59.530750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:59.531165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] PATH_INFO: `/v3/users/46106f84fe6c4f4ab0d291148780806b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:59.534679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=46106f84fe6c4f4ab0d291148780806b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:59.549929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:59.588157 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2333/4669] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:08:59.598898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:59.635995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76468056-8cec-44ec-b885-dda0ecb1e844 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:08:59.655783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:08:59.656449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:59.656922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:59.657352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:59.658205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:08:59.659521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:08:59.695690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46106f84fe6c4f4ab0d291148780806b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:59.718288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46106f84fe6c4f4ab0d291148780806b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:59.719066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46106f84fe6c4f4ab0d291148780806b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:59.747477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46106f84fe6c4f4ab0d291148780806b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:59.748679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-68b4a8e1-ea2e-439f-b8dc-8f2975469bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46106f84fe6c4f4ab0d291148780806b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:08:59.795513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:08:59.824633 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2337/4670] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:08:59 2022] DELETE /identity/v3/users/46106f84fe6c4f4ab0d291148780806b => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:08:59.827048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:08:59.828821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:08:59.831321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:08:59.891034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2334/4671] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Oct 29 03:08:59 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 788 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:08:59.892084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:08:59.907499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:59.908510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:08:59.909919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:08:59.939909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1d75f-081a-40f7-afdf-63461acc64b5 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:00.012929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:00.127008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2338/4672] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:00.128079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:00.135457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:00.178980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21ca6-63f0-4d63-8595-c192488c9c75 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:00.179804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:00.182078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:00.188383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:00.189536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/543df4cc223c4c1ead267faf3364b592` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:00.196755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:00.197619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:00.198067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:00.198455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] PATH_INFO: `/v3/projects/a78ba05b911f4f31bfff66f61b0c08e0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:00.201275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78ba05b911f4f31bfff66f61b0c08e0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:00.203563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:00.255020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:get_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=543df4cc223c4c1ead267faf3364b592)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:00.256689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:00.275567 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2335/4673] 10.222.0.16 () {58 vars in 1392 bytes} [Sat Oct 29 03:08:59 2022] GET /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/543df4cc223c4c1ead267faf3364b592 => generated 688 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:00.276310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:00.288840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:00.357828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78ba05b911f4f31bfff66f61b0c08e0', 'request_id': 'req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:00.375891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78ba05b911f4f31bfff66f61b0c08e0', 'request_id': 'req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:00.412834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78ba05b911f4f31bfff66f61b0c08e0', 'request_id': 'req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:00.447523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] The token cache is being invalidate because project a78ba05b911f4f31bfff66f61b0c08e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:00.448314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:00.449470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d3ec3a4b-76ae-4a59-bed8-2f046ddfb260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:00.454861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2339/4674] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:00 2022] DELETE /identity/v3/projects/a78ba05b911f4f31bfff66f61b0c08e0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:00.456176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:00.456456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:00.456725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:00.526808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aae11-b6e3-4c40-af0f-a9e476f80140 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:00.533183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] MFA Rules not processed for user `e015ef0128c54bc5b9c809d92a05d666`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:00.539760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:00.682042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:00.683442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:00.683948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:00.684424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:00.706496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:00.784543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:00.898689 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2340/4675] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:00 2022] POST /identity/v3/auth/tokens => generated 3424 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 29 03:09:00.901639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:00.901973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:00.923389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:00.931458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:00.957835 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2336/4676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:00.959289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:00.961206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:00.992771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7002de1-a758-4b03-adce-451c82a387dc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:01.019401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:01.020258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:01.020904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:01.021196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:01.021441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] PATH_INFO: `/v3/users/992ca899957441ed82c9563381043bbe` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:01.027506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=992ca899957441ed82c9563381043bbe)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:01.037659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:01.147258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640a7a0-c026-49d1-84a2-ea27a1d203db service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:01.170054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:01.172948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:01.173352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:01.174204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/543df4cc223c4c1ead267faf3364b592` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:01.189175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=543df4cc223c4c1ead267faf3364b592)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:01.195877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:01.232198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '992ca899957441ed82c9563381043bbe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:01.263009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '992ca899957441ed82c9563381043bbe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:01.266765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '992ca899957441ed82c9563381043bbe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:01.282087 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2337/4677] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:00 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/543df4cc223c4c1ead267faf3364b592 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:01.290162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:01.296800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:01.323278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '992ca899957441ed82c9563381043bbe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:01.328073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e30a85-74f8-4634-9260-46d16f292ce7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:01.328844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '992ca899957441ed82c9563381043bbe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:01.358982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:01.361861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:01.362208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:01.364558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:01.365422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:01.372265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:01.398243 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2341/4678] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:00 2022] DELETE /identity/v3/users/992ca899957441ed82c9563381043bbe => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:01.719395 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2338/4679] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Oct 29 03:09:01 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 921 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:01.724542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:01.903312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f932-9493-4fc9-9f2f-ecfa6f2f5e7b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:01.922052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:01.922918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:01.923697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:01.923697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/e305c24df5b8448381b2aaabfc7889f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:01.947069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=e305c24df5b8448381b2aaabfc7889f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:01.948936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:02.028951 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2342/4680] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:01 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/e305c24df5b8448381b2aaabfc7889f9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:02.036080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:02.071781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0d5af-624e-4e80-b7b1-65b115406378 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:02.116210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:02.116908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:02.119621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:02.119928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:02.122340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:02.123979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:02.226026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:02.228948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:02.301063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:02.486836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c806966-e871-4fbc-b2d0-58ae31abf863 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:02.505287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:02.508281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:02.508281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:02.508281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] PATH_INFO: `/v3/projects/3cd7f4fbbf0a48779817251b990b6160` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:02.510416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd7f4fbbf0a48779817251b990b6160)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:02.514092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:02.516346 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2339/4681] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Oct 29 03:09:02 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 812 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:02.522377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:02.558642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a82f6b-b3bc-4cb0-b442-a6edd2e1ecba tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:02.579664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:02.584103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:02.585159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:02.587125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/705691dfb64940199a3cedc141a9e4d5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:02.612876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=705691dfb64940199a3cedc141a9e4d5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:02.618944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:02.664410 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2340/4682] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:02 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/705691dfb64940199a3cedc141a9e4d5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:02.665494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:02.675652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:02.682302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd7f4fbbf0a48779817251b990b6160', 'request_id': 'req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.696460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:02.697719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd7f4fbbf0a48779817251b990b6160', 'request_id': 'req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.711373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d3b4-092d-46ea-be86-508f3cb26f3e tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:02.718174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd7f4fbbf0a48779817251b990b6160', 'request_id': 'req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.745283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] The token cache is being invalidate because project 3cd7f4fbbf0a48779817251b990b6160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:02.746721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.748889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.759936 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2343/4683] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:02 2022] DELETE /identity/v3/projects/3cd7f4fbbf0a48779817251b990b6160 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:02.760935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:02.766070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:02.842414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:02.843308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:02.843728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:02.844103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] PATH_INFO: `/v3/projects/c639ff72d2fe4a879f8ef8aa060ff134` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:02.846178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c639ff72d2fe4a879f8ef8aa060ff134)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:02.850706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:02.972047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c639ff72d2fe4a879f8ef8aa060ff134', 'request_id': 'req-0911d5b7-c23e-49f2-a865-6fe9fe94b173'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.996122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c639ff72d2fe4a879f8ef8aa060ff134', 'request_id': 'req-0911d5b7-c23e-49f2-a865-6fe9fe94b173'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:02.996400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce8852-36bc-4ed9-8cdd-c0a9cb13456b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:03.005949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c639ff72d2fe4a879f8ef8aa060ff134', 'request_id': 'req-0911d5b7-c23e-49f2-a865-6fe9fe94b173'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:03.043862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] The token cache is being invalidate because project c639ff72d2fe4a879f8ef8aa060ff134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:03.044687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:03.046985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0911d5b7-c23e-49f2-a865-6fe9fe94b173 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:03.055208 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2341/4684] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:02 2022] DELETE /identity/v3/projects/c639ff72d2fe4a879f8ef8aa060ff134 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:03.059031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae54f-216e-4547-9cec-a0c34a7960d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.060090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae54f-216e-4547-9cec-a0c34a7960d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.063442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ae54f-216e-4547-9cec-a0c34a7960d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.114953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c01ae54f-216e-4547-9cec-a0c34a7960d8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:03.116268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c01ae54f-216e-4547-9cec-a0c34a7960d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.207299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b89fcf-da9e-467a-b95f-a7757bbaa268 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:03.208266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b89fcf-da9e-467a-b95f-a7757bbaa268 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.208266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b89fcf-da9e-467a-b95f-a7757bbaa268 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.208496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b89fcf-da9e-467a-b95f-a7757bbaa268 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.209159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b89fcf-da9e-467a-b95f-a7757bbaa268 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:03.217909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b89fcf-da9e-467a-b95f-a7757bbaa268 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:03.283736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:03.319816 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2342/4685] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:03.319816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30038-711e-4528-9a89-81e7e649562f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.319816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30038-711e-4528-9a89-81e7e649562f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.319816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e30038-711e-4528-9a89-81e7e649562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.409660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-03e30038-711e-4528-9a89-81e7e649562f None None] MFA Rules not processed for user `575da00069cc4e7bbeeeb78925b9beba`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:03.409660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03e30038-711e-4528-9a89-81e7e649562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.433381 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2344/4686] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Oct 29 03:09:02 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 789 bytes in 671 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:03.433381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de7109-d8c2-4dbf-a9a6-028604a74045 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.434092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de7109-d8c2-4dbf-a9a6-028604a74045 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.434092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de7109-d8c2-4dbf-a9a6-028604a74045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.485629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-23de7109-d8c2-4dbf-a9a6-028604a74045 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:03.485739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23de7109-d8c2-4dbf-a9a6-028604a74045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.503579 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2345/4687] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:03.503579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.503579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.503579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.540309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:03.541521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.550447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:03.579282 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2346/4688] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:03.581699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:03.595575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.655577 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2343/4689] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:03.655577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.655577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.655577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.675690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156133cd-010f-4f01-96a8-002cffb479c4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:03.686971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:03.688284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.701217 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2344/4690] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:03.706255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:03.714604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:03.718966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.719251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.719533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.720214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:03.720453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3425db7-be43-47a2-9efd-c00e2cd4bb1c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:03.724807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:03.727141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:03.727917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.728317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.728665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.729428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:03.730161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:03.732111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:03.753126 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2345/4691] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:03.753126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:03.754603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:03.791857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a6b69-e8cd-447d-a500-aeb3d29f82b5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:03.798666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:03.799950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:03.800319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:03.801138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:03.801897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:03.805632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:03.873576 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2346/4692] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:03.876460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:03.945603 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2347/4693] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 789 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:03.949543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:03.982310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1332e-464d-474b-844a-7a78f62116d7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.012013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778928d9-0fde-4abd-95e3-6f8205a443ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.025950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.026623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.028763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.029893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.032393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:04.033303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.038187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.068574 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2347/4694] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:04.070058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.090372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cb7ec-1a1b-4bfa-ac02-24a5a658da84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.104318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.105609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.106530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.106787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.107437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.111068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.132970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.133850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.134280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.134620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.135627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.141763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.161793 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2348/4695] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:04 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:04.163740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.226641 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2348/4696] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:03 2022] POST /identity/v3/projects => generated 377 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:04.231215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.280399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:04.342351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7da4d-026d-4ad3-989e-9e69d59cfe26 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.346319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f1a4a-0a97-41a3-ad2c-8ddea0f7bdd9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.352700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.353398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.353852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.354191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.354963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.357490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.370097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:04.417499 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2349/4697] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:04 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:04.418311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.483766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.484910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.485385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.485908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.486768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:list_application_credentials(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.488654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.510425 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2349/4698] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 03:09:04 2022] GET /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:04.511915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.541687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60e383-23f2-49e5-b755-fbe2ec1599c0 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.596978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae1d25-5492-46e7-b002-c02b26c93ce1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.624211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.625108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.625596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.626539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.627588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.630786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.651283 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2350/4699] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:04.654091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.679171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59262b72-686a-478b-bf93-bcaa2d1d75e5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.684366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.685358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.685358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.685719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.686547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.688756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.692122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.693966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.694703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.695049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.695792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.700861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.724363 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2350/4700] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:04 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:04.725425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.760365 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2351/4701] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:04 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:04.761456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.784502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf90c-7422-431d-90bc-e1a6534355a7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.793706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.794895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.795206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.795508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.797249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b2f70-8b4f-4d39-af94-0e333f4b9822 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.798263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.801430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.802292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.803227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.803571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.803948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/bbca6165565f4a65860d2ff49f9534c3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.817181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=bbca6165565f4a65860d2ff49f9534c3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.818892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.828783 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2352/4702] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:04.828783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.842025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2351/4703] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:04 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/bbca6165565f4a65860d2ff49f9534c3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:04.844214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.845516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b01545-1bc7-46e9-b269-ef498aa329ec admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.851949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.852921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.854025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.854363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.855132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.857011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.860745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb180c8-676f-4c8f-8f11-973954f39086 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.867022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.868725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.869128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.869378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.870064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.871670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.884504 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2352/4704] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:04.885760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.892085 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2353/4705] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:04.893344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.896696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:04.905233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8042d2-926b-4745-b438-ee168c058697 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.911871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.913007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.913572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.914284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] PATH_INFO: `/v3/projects/5a73f6a2f07c484eafb35e4d55bf493e/users/c0b9cd5c1cd349f3b1e6af834f5cc35a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.924979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03d968-ad7f-4bc7-b519-75c23548f2a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:04.934756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a73f6a2f07c484eafb35e4d55bf493e, user_id=c0b9cd5c1cd349f3b1e6af834f5cc35a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.935722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:04.936432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:04.936718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:04.937000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/711fb3742ad34c2fb1db1f9c4895d005` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:04.938945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:04.962080 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2353/4706] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:04 2022] PUT /identity/v3/projects/5a73f6a2f07c484eafb35e4d55bf493e/users/c0b9cd5c1cd349f3b1e6af834f5cc35a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:04.962080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:04.964872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=711fb3742ad34c2fb1db1f9c4895d005)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:04.969901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:05.017722 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2354/4707] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:04 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/711fb3742ad34c2fb1db1f9c4895d005 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:05.019082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:05.046766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa0e08-55d6-4263-b677-fcdb1a161777 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:05.119023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2c196-0342-43b8-82f0-57774511fa17 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:05.124125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:05.130520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:05.131540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.131824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.132095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.132742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:05.135745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:05.174605 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2354/4708] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:05.174605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:05.198092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:05.200234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.200923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.202023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.203689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:05.207234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:05.237343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2355/4709] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:05.240372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:05.280966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca998326-481a-4376-b995-a46443264b38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:05.299629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:05.300857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.301504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.305817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] PATH_INFO: `/v3/projects/14032fdc7e224fccb3b9a1893e51be03/users/f5d5030985b8459f9d3d6febb67e233b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.320647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf193-d88d-4fbd-9720-d74abcc4d29c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:05.333344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d2584-5d8a-453f-a54b-a8b22ace7840 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:05.334034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2584-5d8a-453f-a54b-a8b22ace7840 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.334317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2584-5d8a-453f-a54b-a8b22ace7840 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.334589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d2584-5d8a-453f-a54b-a8b22ace7840 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.335247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d2584-5d8a-453f-a54b-a8b22ace7840 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:05.336406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d2584-5d8a-453f-a54b-a8b22ace7840 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:05.346802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14032fdc7e224fccb3b9a1893e51be03, user_id=f5d5030985b8459f9d3d6febb67e233b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:05.352310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:05.395024 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2356/4710] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:05 2022] PUT /identity/v3/projects/14032fdc7e224fccb3b9a1893e51be03/users/f5d5030985b8459f9d3d6febb67e233b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:05.397470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:05.602601 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2355/4711] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Oct 29 03:09:05 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 786 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:05.604718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38a463-c357-4bdd-89bf-a3f5f5d96fc2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.610083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38a463-c357-4bdd-89bf-a3f5f5d96fc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.612600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38a463-c357-4bdd-89bf-a3f5f5d96fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.653338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9278faf-5cde-4810-9e8a-f119d12111a4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:05.667115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:05.670863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.671587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.673687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] PATH_INFO: `/v3/projects/af9d22baab5e438fa7b420b3ef1698ef/users/165b5ace9fd144508d1663cdc258b720/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.727565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1b38a463-c357-4bdd-89bf-a3f5f5d96fc2 None None] MFA Rules not processed for user `f5d5030985b8459f9d3d6febb67e233b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:05.729003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b38a463-c357-4bdd-89bf-a3f5f5d96fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:05.731373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af9d22baab5e438fa7b420b3ef1698ef, user_id=165b5ace9fd144508d1663cdc258b720, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:05.734080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:05.751463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:05.783190 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2357/4712] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:05 2022] PUT /identity/v3/projects/af9d22baab5e438fa7b420b3ef1698ef/users/165b5ace9fd144508d1663cdc258b720/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:05.797854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:05.879591 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2356/4713] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:05.881581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.882217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.882903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.925835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] MFA Rules not processed for user `165b5ace9fd144508d1663cdc258b720`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:05.929384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:05.968027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1d21a-9a36-4b31-9cf8-e4c83ce5d884 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:05.974227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:05.974900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:05.975184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:05.975467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:05.976716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:create_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:05.979753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.091511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:06.111710 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2357/4714] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:06.113505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.163656 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2358/4715] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Oct 29 03:09:05 2022] POST /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials => generated 788 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:06.164744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.274556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdfe41-2185-447b-ac34-31edfd7713b4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.299518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.300173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.300439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.300711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.301354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.303327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.343667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dd8d3-ba7b-4622-ad49-4211868c7281 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.351567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.352458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.352845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.365646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.366472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.372043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.382896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2358/4716] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:06 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:06.386252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.446673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:06.458919 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2359/4717] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:06 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:06.460186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.540137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7376e0-aadf-4e37-8535-e62b6f13348c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.604937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857ebfb-9d1f-4fd9-b717-c7f8ffacdc7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.630607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.631258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.631546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.631836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.632472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.634526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.683614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.684426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.684803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.685406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.686594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Adding query filter params (name=tempest-application_credential-231996989) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:06.687009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:list_application_credentials(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.689501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.708466 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2359/4718] 10.222.0.16 () {58 vars in 1384 bytes} [Sat Oct 29 03:09:06 2022] GET /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials?name=tempest-application_credential-231996989 => generated 885 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:06.709680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.718796 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2360/4719] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:06 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:06.719730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.732729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec0325-311c-4b1f-93bc-fe29cb97bcd7 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.749551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.750860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.751400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.754468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.754849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931ca9-76db-4f3e-85e4-569ae3c40839 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.756667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.762790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.775840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.776799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.777270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.777720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/70106c4f814d4a588eaf6e68b901967a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.814884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=70106c4f814d4a588eaf6e68b901967a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.816641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.853323 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2361/4721] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:06 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/70106c4f814d4a588eaf6e68b901967a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:06.855349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.861165 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2360/4721] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:06 2022] POST /identity/v3/users => generated 295 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:06.862486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.872898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e24754-de83-4609-a4e5-19162353ce80 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.879926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3b825-ca28-4283-b8fd-024e213f1f04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.880928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.881554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.881851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.882127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.882912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.885305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.889189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.889895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.890174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.890448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.891091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:06.893026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:06.909015 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2361/4722] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:06.910711 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2362/4723] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:06.919254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.919589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:06.933614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d93136-8e28-44e3-8e67-35933f98ff49 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.946056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731911-f860-47e7-979f-d15ea97a0c39 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:06.952064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e015ef0128c54bc5b9c809d92a05d666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c640fe77e9149a3998dc75912f351de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.952758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.956104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:06.958068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.958424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/6981631aa1764ad4b3fb92d834a48aef` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.962199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:06.962504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:06.962784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] PATH_INFO: `/v3/projects/3f5b3468b6a04699afa1ec9895a31125/users/289c5088caa24e3ea236e21f2538319c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:06.970333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:07.005023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorizing `identity:delete_application_credential(user_id=e015ef0128c54bc5b9c809d92a05d666, application_credential_id=6981631aa1764ad4b3fb92d834a48aef)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.006579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.007382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5b3468b6a04699afa1ec9895a31125, user_id=289c5088caa24e3ea236e21f2538319c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.018476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.045468 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2362/4724] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:09:06 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666/application_credentials/6981631aa1764ad4b3fb92d834a48aef => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:07.048946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.062789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5286ef9-4c11-41a1-80a7-489776178243 tempest-ApplicationCredentialsV3Test-553085759 tempest-ApplicationCredentialsV3Test-553085759-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:07.089300 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2363/4725] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:06 2022] PUT /identity/v3/projects/3f5b3468b6a04699afa1ec9895a31125/users/289c5088caa24e3ea236e21f2538319c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:07.094244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.104701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:07.193940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:07.194903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.195181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.195455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] PATH_INFO: `/v3/projects/7abf246582d64d389b062bece8d0ff8a/users/53add2f4de0b4d8ba5081472d8f72184/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.228357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f90e9e-6c9a-4270-88d7-2d3917ddee72 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:07.229308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abf246582d64d389b062bece8d0ff8a, user_id=53add2f4de0b4d8ba5081472d8f72184, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.236633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.250618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:07.251388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.251719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.252069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] PATH_INFO: `/v3/users/e015ef0128c54bc5b9c809d92a05d666` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.253452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e015ef0128c54bc5b9c809d92a05d666)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.255725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.271671 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2363/4726] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:07 2022] PUT /identity/v3/projects/7abf246582d64d389b062bece8d0ff8a/users/53add2f4de0b4d8ba5081472d8f72184/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:07.272870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.301933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:07.400642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e015ef0128c54bc5b9c809d92a05d666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:07.413173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e015ef0128c54bc5b9c809d92a05d666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:07.413914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e015ef0128c54bc5b9c809d92a05d666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:07.434300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e015ef0128c54bc5b9c809d92a05d666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:07.435567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e015ef0128c54bc5b9c809d92a05d666'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:07.465728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36512a06-6d38-4e31-9e2c-1b93a96a3408 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:07.484319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4f3d4-c20c-4b62-bb54-ed1219d09a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:07.487020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4f3d4-c20c-4b62-bb54-ed1219d09a7d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.488085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4f3d4-c20c-4b62-bb54-ed1219d09a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.488998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4f3d4-c20c-4b62-bb54-ed1219d09a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.491559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4f3d4-c20c-4b62-bb54-ed1219d09a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.498492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4f3d4-c20c-4b62-bb54-ed1219d09a7d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.510390 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2364/4727] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:07 2022] DELETE /identity/v3/users/e015ef0128c54bc5b9c809d92a05d666 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:07.510390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.511833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:07.533273 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2364/4728] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:07.543271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.543561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.543844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.598335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:07.604733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:07.676934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45cb35-4649-4f3c-97c4-c2ad03bd4fd8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:07.683123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:07.683762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.684119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.684416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.685015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.686696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.688228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:07.718609 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2365/4729] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:07.719541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.724434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:07.760074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce8059-3258-4be7-abc4-ad84203c9def admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:07.775614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:07.780287 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2365/4730] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:07.781290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.781781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.782236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.782520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] PATH_INFO: `/v3/projects/3f5b3468b6a04699afa1ec9895a31125/users/289c5088caa24e3ea236e21f2538319c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.788177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f5b3468b6a04699afa1ec9895a31125, user_id=289c5088caa24e3ea236e21f2538319c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.795959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.805766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85991e-55d4-4d69-b6cb-23f12ad6cc83 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:07.822955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f78b6-1270-4ea2-8be6-f4ab1a905432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:07.824537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f78b6-1270-4ea2-8be6-f4ab1a905432 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.824817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f78b6-1270-4ea2-8be6-f4ab1a905432 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.825090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f78b6-1270-4ea2-8be6-f4ab1a905432 admin admin] PATH_INFO: `/v3/projects/7abf246582d64d389b062bece8d0ff8a/users/53add2f4de0b4d8ba5081472d8f72184/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.836263 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2366/4731] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:07 2022] PUT /identity/v3/projects/3f5b3468b6a04699afa1ec9895a31125/users/289c5088caa24e3ea236e21f2538319c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:07.837466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:07.840375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f78b6-1270-4ea2-8be6-f4ab1a905432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abf246582d64d389b062bece8d0ff8a, user_id=53add2f4de0b4d8ba5081472d8f72184, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:07.842304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:07.844330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f78b6-1270-4ea2-8be6-f4ab1a905432 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:07.874129 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2366/4732] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:07 2022] PUT /identity/v3/projects/7abf246582d64d389b062bece8d0ff8a/users/53add2f4de0b4d8ba5081472d8f72184/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:07.875625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7e5b-da51-41ea-a22d-b8d4aa490998 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:07.880000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7e5b-da51-41ea-a22d-b8d4aa490998 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:07.880401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7e5b-da51-41ea-a22d-b8d4aa490998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:07.936423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7fcd7e5b-da51-41ea-a22d-b8d4aa490998 None None] MFA Rules not processed for user `289c5088caa24e3ea236e21f2538319c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:07.938644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fcd7e5b-da51-41ea-a22d-b8d4aa490998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:07.985676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5707c60-2797-466d-b6cd-45ccdd15ff43 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.093716 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2367/4733] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:08.100890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.101219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.101625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.133560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:08.172117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.172914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.173305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.173687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.174623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] MFA Rules not processed for user `53add2f4de0b4d8ba5081472d8f72184`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:08.176436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:08.307581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.309383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.331083 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2368/4734] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:08.332979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.333404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2367/4735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:08.334540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.347571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d7dce-21c5-4d4d-939a-500844dada6d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.361209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.362058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329cb02-435e-43d5-83a4-1f9b4b660639 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.362185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.362904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.363720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.364769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.365961 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:08.365961 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:09:08.365961 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:09:08.367874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.378534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.379474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.379867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.380278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.381051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.383294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.401507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2369/4736] 10.222.0.16 () {60 vars in 1185 bytes} [Sat Oct 29 03:09:08 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:08.405714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.442774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93761d35-0f2c-48a2-9d4a-d9388cda12da tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.452530 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2368/4737] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:08 2022] POST /identity/v3/projects => generated 351 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:08.453157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.464947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.465621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.466119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.466384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3cdf083cde5a450999fbc6429046dae9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.466981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3cdf083cde5a450999fbc6429046dae9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.482622 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:08.482622 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:09:08.482622 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:09:08.482622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.504353 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2370/4738] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:09:08 2022] GET /identity/v3/OS-OAUTH1/consumers/3cdf083cde5a450999fbc6429046dae9 => generated 220 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:08.509189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.525639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:08.531028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b109a75-a774-4488-bfcf-03405a561112 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.586251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdcaaf-ed74-4d2c-97b8-c69aca48b43f tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.594541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.595383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.595786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.596191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.602873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.605194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.670181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2369/4739] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:09:08 2022] POST /identity/v3/projects => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:08.671766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.743956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.745116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.746364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.746364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3cdf083cde5a450999fbc6429046dae9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.747253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3cdf083cde5a450999fbc6429046dae9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.752357 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:08.752357 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:09:08.752357 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:09:08.754724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.754724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invalidating token cache because consumer 3cdf083cde5a450999fbc6429046dae9 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:08.754993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:08.756267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:08.791112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '3cdf083cde5a450999fbc6429046dae9', 'request_id': 'req-6b432cea-dd81-4875-819c-2b27e89c41bf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:08.831066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cafed-280a-4d8f-bc5b-a5c8ed199c92 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.835252 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2371/4740] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:09:08 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3cdf083cde5a450999fbc6429046dae9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:08.840799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.844960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:08.846431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.847709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.850755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.850755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/users/f5d5030985b8459f9d3d6febb67e233b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.852222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:get_user(user_id=f5d5030985b8459f9d3d6febb67e233b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.861703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:08.868339 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2370/4741] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:09:08 2022] GET /identity/v3/users/f5d5030985b8459f9d3d6febb67e233b => generated 287 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:08.870848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:08.874450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b432cea-dd81-4875-819c-2b27e89c41bf tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.876086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:08.901407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb3740-2eac-4f35-87f5-e2eec50ca6cc tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:08.923378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:08.924177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:08.924728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:08.925112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:08.926368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:08.927799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.002932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2371/4742] 10.222.0.16 () {60 vars in 1162 bytes} [Sat Oct 29 03:09:08 2022] POST /identity/v3/credentials => generated 429 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:09.006160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.008589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:09.023733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.026530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.027373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.029299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.030578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.036133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb8c5e3-94d1-4a48-b1f1-41f2fd29b3f4 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.036455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.049073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.050039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.050526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.050915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials/28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.055481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.063674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.066494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2372/4743] 10.222.0.16 () {60 vars in 1185 bytes} [Sat Oct 29 03:09:08 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:09.070210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.071559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.076849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.093931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134ccf5-493c-4754-9a41-3ef8caf2f208 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.100903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.106384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.106384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.106384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.106384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4ef826aaf5274c0ca39887c4be604827)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.107370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.116305 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2373/4744] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:09:09 2022] GET /identity/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827 => generated 221 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:09.117870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.126489 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2372/4745] 10.222.0.16 () {60 vars in 1358 bytes} [Sat Oct 29 03:09:09 2022] PATCH /identity/v3/credentials/28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4 => generated 435 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:09.127290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.135724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc5e76b-b85f-48da-baaa-a1520e541315 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.144946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.145717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.146364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.146364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.147140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4ef826aaf5274c0ca39887c4be604827)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.149405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.149738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invalidating token cache because consumer 4ef826aaf5274c0ca39887c4be604827 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:09.150104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.151075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.157444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b4554-ec13-4063-8da4-9b7f5e6eb390 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.170108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4ef826aaf5274c0ca39887c4be604827', 'request_id': 'req-c0010c02-22c0-4591-949d-5b70b8227bcb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.186670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.188225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.188225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.188225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials/28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.193038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.195293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.204293 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2373/4746] 10.222.0.16 () {58 vars in 1335 bytes} [Sat Oct 29 03:09:09 2022] GET /identity/v3/credentials/28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4 => generated 435 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:09.212637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.215812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:09.219802 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2374/4747] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:09:09 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:09.225719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.227803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:09.249715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719713-1355-4356-acca-4db5f398223a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.268158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.272140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0010c02-22c0-4591-949d-5b70b8227bcb tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.272810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.273124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.273432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials/28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.285547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.287479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.288333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.289186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.291584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.292037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.292866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4ef826aaf5274c0ca39887c4be604827)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.297943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.321904 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2374/4748] 10.222.0.16 () {58 vars in 1338 bytes} [Sat Oct 29 03:09:09 2022] DELETE /identity/v3/credentials/28ecca43789e47d79506f1f591e683fba320fc4a5a1b849ed2f9f93a35fee1f4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:09.327567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.336250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 29 03:09:09.338610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 29 03:09:09.339817 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:09.345429 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2375/4749] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:09:09 2022] GET /identity/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827 => generated 74 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 03:09:09.346989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.365012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b53be-8764-40b4-a4cf-390d87413a0e tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.373261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.374261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.374724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.375162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.376007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.378975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.422218 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2376/4750] 10.222.0.16 () {60 vars in 1162 bytes} [Sat Oct 29 03:09:09 2022] POST /identity/v3/credentials => generated 431 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:09.428178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.463901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149ef93-e155-4f66-ad24-5d4c197f4c08 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.475878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.476737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.477184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.480410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.481328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4ef826aaf5274c0ca39887c4be604827)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.483103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.486252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invalidating token cache because consumer 4ef826aaf5274c0ca39887c4be604827 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:09.486738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.489853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.554613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1444d8-8539-42b7-92df-021120d1c129 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.564846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.565902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.566333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.566779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] PATH_INFO: `/v3/projects/6c640fe77e9149a3998dc75912f351de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.571282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c640fe77e9149a3998dc75912f351de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.573497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 29 03:09:09.578647 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 29 03:09:09.579780 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:09.585121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2377/4751] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:09:09 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4ef826aaf5274c0ca39887c4be604827 => generated 74 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 03:09:09.586503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.590468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:09.609313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:09.682271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c640fe77e9149a3998dc75912f351de', 'request_id': 'req-91aeacca-ccfa-439c-88bf-428c2d0ec336'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.689844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbf15d-b339-4390-a591-b5f6e617a6d9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.690960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c640fe77e9149a3998dc75912f351de', 'request_id': 'req-91aeacca-ccfa-439c-88bf-428c2d0ec336'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.708355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c640fe77e9149a3998dc75912f351de', 'request_id': 'req-91aeacca-ccfa-439c-88bf-428c2d0ec336'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.725576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] The token cache is being invalidate because project 6c640fe77e9149a3998dc75912f351de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:09.726204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.727368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:09.729720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2375/4752] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:09 2022] DELETE /identity/v3/projects/6c640fe77e9149a3998dc75912f351de => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:09.730726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.737867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:09.854574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf711c5f-5e7d-4aac-86d9-18bad534c2e3 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.855212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711c5f-5e7d-4aac-86d9-18bad534c2e3 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.855501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711c5f-5e7d-4aac-86d9-18bad534c2e3 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.855764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf711c5f-5e7d-4aac-86d9-18bad534c2e3 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.856842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf711c5f-5e7d-4aac-86d9-18bad534c2e3 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.858860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf711c5f-5e7d-4aac-86d9-18bad534c2e3 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.893569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2378/4753] 10.222.0.16 () {60 vars in 1162 bytes} [Sat Oct 29 03:09:09 2022] POST /identity/v3/credentials => generated 429 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:09.894986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.895272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.895553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.911312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aeacca-ccfa-439c-88bf-428c2d0ec336 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:09.923143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:09.923995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:09.924438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:09.925063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:09.926145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:09.927932 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:09.927932 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:09.927932 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:09.929315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:09.942049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:09.943305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:09.981701 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2376/4754] 10.222.0.16 () {60 vars in 1185 bytes} [Sat Oct 29 03:09:09 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:09.983602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:09.992776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.063997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d7a36-fd17-4e60-97e3-8dd6a83e7342 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.087010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.087667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.087948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.088230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.088847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.091597 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2379/4755] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:10.091597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.092354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.108071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.109873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.113770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.115822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3ca98-82bd-4464-a3d9-32c2661efa1f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.118421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c9757-95b0-44cc-ae36-3a1130f1948a tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.120481 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2377/4756] 10.222.0.16 () {58 vars in 1140 bytes} [Sat Oct 29 03:09:09 2022] GET /identity/v3/credentials => generated 945 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:10.125641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.126607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207c64d-6062-4ec5-8ca9-9264eb2f6f5c tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.127331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c64d-6062-4ec5-8ca9-9264eb2f6f5c tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.127616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c64d-6062-4ec5-8ca9-9264eb2f6f5c tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.127894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207c64d-6062-4ec5-8ca9-9264eb2f6f5c tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.128553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c64d-6062-4ec5-8ca9-9264eb2f6f5c tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.130231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207c64d-6062-4ec5-8ca9-9264eb2f6f5c tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.131825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.131974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.148061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:10.162714 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2380/4757] 10.222.0.16 () {60 vars in 1185 bytes} [Sat Oct 29 03:09:10 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:10.162714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.162714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.162714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.172581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:10.174995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.202936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:10.204182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.227421 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2381/4758] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:10.228394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.250644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd9502-3b51-43bf-b1f1-a0a8d76f5c0e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.266012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.266821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.267109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.267389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials/90005e4ed7ea5d1d8ec3e5aef4343cbdc3d92f35cfed95efe0d4c667652a6730` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.271002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=90005e4ed7ea5d1d8ec3e5aef4343cbdc3d92f35cfed95efe0d4c667652a6730)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.272769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.303330 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2378/4759] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:10.304770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.308829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2382/4760] 10.222.0.16 () {58 vars in 1338 bytes} [Sat Oct 29 03:09:10 2022] DELETE /identity/v3/credentials/90005e4ed7ea5d1d8ec3e5aef4343cbdc3d92f35cfed95efe0d4c667652a6730 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:10.309703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.330819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1b5f1-ce87-440c-8e06-181b7c6413b5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.332438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3f54e3-ca59-45a8-a391-387fadbf9b13 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.339285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.339932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.340213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.340361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.340510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.341062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.343999 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:10.343999 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:10.343999 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:10.343999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.345845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.346232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.348833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.349655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:10.350103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.350845 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2379/4761] 10.222.0.16 () {58 vars in 1164 bytes} [Sat Oct 29 03:09:10 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:10.351549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.358684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.375576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f819509-42c0-4b00-8456-4d7195f6a441 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.382798 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2383/4762] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:10.383913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.385055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.385224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.385417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.385706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/credentials/efc5f9367f1d64b69d878a480bba987546d257b7f42e45d432e94aafe9733c68` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.387890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=efc5f9367f1d64b69d878a480bba987546d257b7f42e45d432e94aafe9733c68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.389375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.389658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.422765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2380/4763] 10.222.0.16 () {58 vars in 1338 bytes} [Sat Oct 29 03:09:10 2022] DELETE /identity/v3/credentials/efc5f9367f1d64b69d878a480bba987546d257b7f42e45d432e94aafe9733c68 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:10.424309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.442528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102391-1fd9-4963-ad73-0b67f91f9710 tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.452947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.454950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.455564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.456002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/239596db790b4b8dbe5fc8607af6ec09` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.456740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=239596db790b4b8dbe5fc8607af6ec09)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.458762 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:10.458762 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:10.458762 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:10.461571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.462235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invalidating token cache because consumer 239596db790b4b8dbe5fc8607af6ec09 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:10.462969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.463948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.466699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:10.494420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '239596db790b4b8dbe5fc8607af6ec09', 'request_id': 'req-89b6aeaf-9480-4826-ac92-1fa824d330b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.518436 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2381/4764] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:09:10 2022] DELETE /identity/v3/OS-OAUTH1/consumers/239596db790b4b8dbe5fc8607af6ec09 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:10.519541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.523347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.565686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6aeaf-9480-4826-ac92-1fa824d330b7 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.574067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd635c5-3b34-453d-b5a9-79194eebe935 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.579387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.580892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.581034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.582177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.582177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.582523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.583929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.584363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.584963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.587904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.597646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.614252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.616771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.634815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2384/4765] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:10.635506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.637538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.667276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5afed-6803-4067-b1bc-ad6cf5863858 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.673855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:10.674858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:10.675248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:10.675623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/projects/f107a9d1255d4f9c8d294c9c63dcb9d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:10.676914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f107a9d1255d4f9c8d294c9c63dcb9d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:10.679093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:10.710639 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2382/4766] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:10 2022] POST /identity/v3/projects => generated 397 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:10.712243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.714797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:10.803419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f107a9d1255d4f9c8d294c9c63dcb9d1', 'request_id': 'req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.820877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f107a9d1255d4f9c8d294c9c63dcb9d1', 'request_id': 'req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.839832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f107a9d1255d4f9c8d294c9c63dcb9d1', 'request_id': 'req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.880364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] The token cache is being invalidate because project f107a9d1255d4f9c8d294c9c63dcb9d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:10.881081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.882097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:10.883932 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2385/4767] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:10 2022] DELETE /identity/v3/projects/f107a9d1255d4f9c8d294c9c63dcb9d1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:10.891233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:10.895262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06226675-de63-44fd-935c-4f8f509e44a8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:10.896694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:11.025816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:11.088832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80254ae-f979-4fb9-91d3-bb0aee72d0aa tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:11.099291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.100120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.100505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.100881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.101631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.104029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.170619 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2386/4768] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:10 2022] POST /identity/v3/users => generated 305 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:11.171973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.180092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:11.242893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.243758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.243934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.245195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cd733ca4fad647e3bb32deba51e2cb28` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.245933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=cd733ca4fad647e3bb32deba51e2cb28)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.251366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.251652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invalidating token cache because consumer cd733ca4fad647e3bb32deba51e2cb28 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:11.251941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.254797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.280155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'cd733ca4fad647e3bb32deba51e2cb28', 'request_id': 'req-ea761ab8-399e-49e5-b73f-6ebab92698ea'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.301442 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2383/4769] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:09:10 2022] DELETE /identity/v3/OS-OAUTH1/consumers/cd733ca4fad647e3bb32deba51e2cb28 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:11.302411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.303799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:11.331657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea761ab8-399e-49e5-b73f-6ebab92698ea tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:11.343644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.344287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.344568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.344838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.345492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.355019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.393567 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2384/4770] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:11.394560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.402268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:11.435251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e875ae-bbfa-4e49-9fa4-9b1a77076cfd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:11.451559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53add2f4de0b4d8ba5081472d8f72184', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7abf246582d64d389b062bece8d0ff8a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.452337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363ed3c-2dec-4cfe-b014-3180833de948 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:11.452477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.452844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.453334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] PATH_INFO: `/v3/projects/efda5c0847be467385d2d1ee18e08dc1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.454697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorizing `identity:delete_project(project_id=efda5c0847be467385d2d1ee18e08dc1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.460647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.463424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.464217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.464500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.464773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.466454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.473031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.508266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2385/4771] 10.222.0.16 () {60 vars in 1185 bytes} [Sat Oct 29 03:09:11 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:11.509600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.530607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806a9ba-1bcc-4733-bc50-9b35863f82e0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:11.537085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.538350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.538637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.538945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] PATH_INFO: `/v3/projects/abe0aca6204c4fdab16c6deb7478cbcb/users/151c49ec33454800892ff9ced11afa80/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.584980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe0aca6204c4fdab16c6deb7478cbcb, user_id=151c49ec33454800892ff9ced11afa80, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.589164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.594529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efda5c0847be467385d2d1ee18e08dc1', 'request_id': 'req-a9413448-8e33-4339-a40c-fd8549e8d48d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.607177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efda5c0847be467385d2d1ee18e08dc1', 'request_id': 'req-a9413448-8e33-4339-a40c-fd8549e8d48d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.607935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:11.621560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efda5c0847be467385d2d1ee18e08dc1', 'request_id': 'req-a9413448-8e33-4339-a40c-fd8549e8d48d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.627935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2386/4772] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:11 2022] PUT /identity/v3/projects/abe0aca6204c4fdab16c6deb7478cbcb/users/151c49ec33454800892ff9ced11afa80/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:11.629036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.726441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] The token cache is being invalidate because project efda5c0847be467385d2d1ee18e08dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:11.729079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.730878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:11.736903 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2387/4773] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:11 2022] DELETE /identity/v3/projects/efda5c0847be467385d2d1ee18e08dc1 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:11.741204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.744621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:11.777435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36d8db-eed3-4834-9c86-c61c133445c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:11.791756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:11.792437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:11.792717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:11.801305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f3b3a4a7ec6645449247222d0bd673b6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:11.803560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=f3b3a4a7ec6645449247222d0bd673b6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:11.804646 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:11.804646 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:11.804646 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:11.805863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:11.869870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2387/4774] 10.222.0.16 () {60 vars in 1285 bytes} [Sat Oct 29 03:09:11 2022] PATCH /identity/v3/OS-OAUTH1/consumers/f3b3a4a7ec6645449247222d0bd673b6 => generated 220 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:11.874474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:11.877015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.025851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:12.048564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413448-8e33-4339-a40c-fd8549e8d48d tempest-CredentialsTestJSON-2115005592 tempest-CredentialsTestJSON-2115005592-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:12.227303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf671ea-d6f1-420d-af30-371c1bdaded9 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:12.251751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:12.252359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.254970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.255325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] PATH_INFO: `/v3/users/f5d5030985b8459f9d3d6febb67e233b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.258837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d5030985b8459f9d3d6febb67e233b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:12.261085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:12.334223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:12.334865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.335145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.335417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.337231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:12.337746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:12.383681 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2388/4775] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:11 2022] GET /identity/v3/roles => generated 1420 bytes in 646 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:12.384650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:12.395639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.417039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d5030985b8459f9d3d6febb67e233b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.429866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d5030985b8459f9d3d6febb67e233b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.431144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d5030985b8459f9d3d6febb67e233b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.436109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50ba3-a95b-4d1a-9996-4572d88798fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:12.453069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d5030985b8459f9d3d6febb67e233b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.453991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:12.458300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d5030985b8459f9d3d6febb67e233b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.460035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.460368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.460647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f3b3a4a7ec6645449247222d0bd673b6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.461440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=f3b3a4a7ec6645449247222d0bd673b6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:12.463245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:12.485525 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2389/4776] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:09:12 2022] GET /identity/v3/OS-OAUTH1/consumers/f3b3a4a7ec6645449247222d0bd673b6 => generated 220 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:12.486527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:12.493159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.516177 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2388/4777] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:11 2022] DELETE /identity/v3/users/f5d5030985b8459f9d3d6febb67e233b => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:12.517149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:12.521542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.554344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:12.574249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a364f-3c15-4e59-9fe7-d3bf6695c6a0 tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:12.669253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2121e8-0a72-4601-be67-05a1eb124244 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:12.676699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '289c5088caa24e3ea236e21f2538319c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f5b3468b6a04699afa1ec9895a31125', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:12.677368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.677650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.677961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/f3b3a4a7ec6645449247222d0bd673b6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.678551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=f3b3a4a7ec6645449247222d0bd673b6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:12.680205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:12.680629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invalidating token cache because consumer f3b3a4a7ec6645449247222d0bd673b6 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:12.681203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.682166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.715782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-053dd6db-5117-4fec-9042-bc2f9a279cca tempest-OAUTHConsumersV3Test-2043364043 tempest-OAUTHConsumersV3Test-2043364043-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'f3b3a4a7ec6645449247222d0bd673b6', 'request_id': 'req-053dd6db-5117-4fec-9042-bc2f9a279cca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:12.754306 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2389/4778] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:09:12 2022] DELETE /identity/v3/OS-OAUTH1/consumers/f3b3a4a7ec6645449247222d0bd673b6 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:12.759851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.760141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.760413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.801224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:12.803068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.804124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.805898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] PATH_INFO: `/v3/projects/abe0aca6204c4fdab16c6deb7478cbcb/users/151c49ec33454800892ff9ced11afa80/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.817652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=abe0aca6204c4fdab16c6deb7478cbcb, user_id=151c49ec33454800892ff9ced11afa80, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:12.820599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:12.823916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:12.836144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.854747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2390/4779] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:12.857633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:12.859985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.862406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2390/4780] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:12 2022] PUT /identity/v3/projects/abe0aca6204c4fdab16c6deb7478cbcb/users/151c49ec33454800892ff9ced11afa80/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:12.873564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:12.876544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:12.885227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e77e9-2ebd-4a41-9acc-5cf29c7ceecb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:12.986388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:12.987123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:12.987417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:12.987943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] PATH_INFO: `/v3/users/165b5ace9fd144508d1663cdc258b720` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:12.989412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=165b5ace9fd144508d1663cdc258b720)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:12.991487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:13.068817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165b5ace9fd144508d1663cdc258b720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:13.089764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165b5ace9fd144508d1663cdc258b720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:13.090604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165b5ace9fd144508d1663cdc258b720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:13.096241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bf191-8975-49a4-b0ba-74f2518baf5e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:13.105149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165b5ace9fd144508d1663cdc258b720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:13.106082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad7a563c-493b-451a-bd27-405af6a76e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165b5ace9fd144508d1663cdc258b720'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:13.108737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:13.110466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:13.112687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:13.115432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:13.122264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:13.133544 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2391/4781] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:12 2022] DELETE /identity/v3/users/165b5ace9fd144508d1663cdc258b720 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:13.136530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:13.136861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:13.137139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:13.146628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:13.177115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:13.178827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b90291-4487-4675-8851-b3e1f1c96bfa service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:13.190973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] MFA Rules not processed for user `151c49ec33454800892ff9ced11afa80`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:13.198387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:13.205231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2391/4782] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:09:13.213771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:13.216937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:13.217377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:13.296639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:13.300744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:13.410233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:13.431049 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2392/4783] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:13 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:13.432912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:13.436955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:13.535303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2392/4784] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:13.623095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3de5e8-d85e-44e6-b435-673dddc1801b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:13.630438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:13.632107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:13.655635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:13.656575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:13.658323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:13.658804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:13.659715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:13.672044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:13.766773 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2393/4785] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:13 2022] POST /identity/v3/projects => generated 397 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:13.770867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:13.856429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cda991-3a41-4439-bcf9-ead18361e7e1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.020495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c29af1-1d2b-4e27-b8cf-4e58329190fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.037889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.039841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.040647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.041077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.041770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.044099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.044527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.045973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.046844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.050036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.084873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.087052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.110843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2393/4786] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:14.135666 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2394/4787] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:13 2022] POST /identity/v3/users => generated 299 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:14.136664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:14.155550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03527e-d09d-4ea6-9b79-c23ca4683def service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.171425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.172145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.172496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.172848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.173552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.175404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.195767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2394/4788] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:09:14.201328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:14.202551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:14.203137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:14.213553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:14.220585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b648921-d122-44ac-9650-96779a45e500 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.234569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fda62-756e-40e0-ae1a-d8b88c18c4f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.236497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.237502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.238038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.238696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.239583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.241449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.250536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.251194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.251471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.251739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] PATH_INFO: `/v3/projects/14032fdc7e224fccb3b9a1893e51be03` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.263583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14032fdc7e224fccb3b9a1893e51be03)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.266870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.267256 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2395/4789] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:14.278629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:14.304685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bfb05-68dd-4b72-a404-6a8b86fb64ce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.316133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447e845-5471-4586-8a1b-b5411c0037eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.316996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e845-5471-4586-8a1b-b5411c0037eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.317378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e845-5471-4586-8a1b-b5411c0037eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.317760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447e845-5471-4586-8a1b-b5411c0037eb admin admin] PATH_INFO: `/v3/projects/f9517d7f80e341f0b6341e9363e589bf/users/a6059e4a6f8d41f1af7b8ceccf79d049/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.352341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447e845-5471-4586-8a1b-b5411c0037eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9517d7f80e341f0b6341e9363e589bf, user_id=a6059e4a6f8d41f1af7b8ceccf79d049, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.355330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447e845-5471-4586-8a1b-b5411c0037eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.408518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2396/4790] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:14 2022] PUT /identity/v3/projects/f9517d7f80e341f0b6341e9363e589bf/users/a6059e4a6f8d41f1af7b8ceccf79d049/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:14.412174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.412174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.412174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.458647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14032fdc7e224fccb3b9a1893e51be03', 'request_id': 'req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.460502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] MFA Rules not processed for user `a6059e4a6f8d41f1af7b8ceccf79d049`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:14.462949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:14.482746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14032fdc7e224fccb3b9a1893e51be03', 'request_id': 'req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.500574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14032fdc7e224fccb3b9a1893e51be03', 'request_id': 'req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.530752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] The token cache is being invalidate because project 14032fdc7e224fccb3b9a1893e51be03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:14.531058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.531967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.537298 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2395/4791] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:14 2022] DELETE /identity/v3/projects/14032fdc7e224fccb3b9a1893e51be03 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:14.538530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:14.540266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:14.544161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:14.644905 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2397/4792] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:14.659527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:14.661212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:14.662077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2d3611-e5ac-4d55-adc8-b52fa06b8921 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.668480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.669132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.669407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.669676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] PATH_INFO: `/v3/users/53add2f4de0b4d8ba5081472d8f72184` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.670939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=53add2f4de0b4d8ba5081472d8f72184)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:14.672923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:14.771322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53add2f4de0b4d8ba5081472d8f72184'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.785161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53add2f4de0b4d8ba5081472d8f72184'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.786135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53add2f4de0b4d8ba5081472d8f72184'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.800499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53add2f4de0b4d8ba5081472d8f72184'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.802029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53add2f4de0b4d8ba5081472d8f72184'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:14.831910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9824-c94f-452e-ae22-472f283e0f3c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:14.839191 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2396/4793] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:14 2022] DELETE /identity/v3/users/53add2f4de0b4d8ba5081472d8f72184 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:14.845368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:14.846579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:14.846865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:14.847188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:14.850340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:15.034532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:15.036580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:15.075571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2398/4794] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:14 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:09:15.364901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:15.366651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:15.378558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:15.549968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7898c09-09bd-4400-9986-e8290e847d7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:15.569187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:15.571171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:15.572089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:15.572827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] PATH_INFO: `/v3/projects/af9d22baab5e438fa7b420b3ef1698ef` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:15.576679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=af9d22baab5e438fa7b420b3ef1698ef)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:15.582505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:15.703287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af9d22baab5e438fa7b420b3ef1698ef', 'request_id': 'req-d89c2a06-4110-4bd6-90c5-05fe575198ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:15.714762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af9d22baab5e438fa7b420b3ef1698ef', 'request_id': 'req-d89c2a06-4110-4bd6-90c5-05fe575198ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:15.724698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af9d22baab5e438fa7b420b3ef1698ef', 'request_id': 'req-d89c2a06-4110-4bd6-90c5-05fe575198ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:15.748535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] The token cache is being invalidate because project af9d22baab5e438fa7b420b3ef1698ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:15.748807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:15.751148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:15.754070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2397/4795] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:15 2022] DELETE /identity/v3/projects/af9d22baab5e438fa7b420b3ef1698ef => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:15.756655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:15.777074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892907de-96d0-4fde-8bda-f35cc885bd81 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:15.895042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:15.896063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:15.897883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:15.898170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] PATH_INFO: `/v3/users/289c5088caa24e3ea236e21f2538319c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:15.905033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:15.906790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:15.908947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=289c5088caa24e3ea236e21f2538319c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:15.910935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:15.940848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:15.945238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2a06-4110-4bd6-90c5-05fe575198ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:15.950410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:15.951067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:15.951350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:15.951621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] PATH_INFO: `/v3/users/151c49ec33454800892ff9ced11afa80` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:15.952799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151c49ec33454800892ff9ced11afa80)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:15.954769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:16.057587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151c49ec33454800892ff9ced11afa80'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.066528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289c5088caa24e3ea236e21f2538319c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.071214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151c49ec33454800892ff9ced11afa80'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.072080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151c49ec33454800892ff9ced11afa80'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.090846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151c49ec33454800892ff9ced11afa80'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.092649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d03002c8-c3e5-40be-b683-479a02c1b501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151c49ec33454800892ff9ced11afa80'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.109450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289c5088caa24e3ea236e21f2538319c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.110526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289c5088caa24e3ea236e21f2538319c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.134455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289c5088caa24e3ea236e21f2538319c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.135611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289c5088caa24e3ea236e21f2538319c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.149159 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2398/4796] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:15 2022] DELETE /identity/v3/users/151c49ec33454800892ff9ced11afa80 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:16.151557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab416f-f472-402b-a918-a78add460044 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:16.151783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab416f-f472-402b-a918-a78add460044 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:16.152126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab416f-f472-402b-a918-a78add460044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:16.178013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:16.192275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-00ab416f-f472-402b-a918-a78add460044 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:16.194962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00ab416f-f472-402b-a918-a78add460044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:16.209455 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2399/4797] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:15 2022] DELETE /identity/v3/users/289c5088caa24e3ea236e21f2538319c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:16.340947 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2399/4798] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:16.362163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:16.364588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:16.516468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab416f-f472-402b-a918-a78add460044 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:16.521514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00ab416f-f472-402b-a918-a78add460044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:16.553482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab416f-f472-402b-a918-a78add460044 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:16.557058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d1b1-e0c8-4c18-827f-d7cb1658859b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:16.574573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593da83f-909d-404b-b710-3622cd66c89a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:16.577711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593da83f-909d-404b-b710-3622cd66c89a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:16.577711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593da83f-909d-404b-b710-3622cd66c89a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:16.580503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593da83f-909d-404b-b710-3622cd66c89a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:16.661704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:16.662768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:16.662945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:16.663369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] PATH_INFO: `/v3/projects/7abf246582d64d389b062bece8d0ff8a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:16.664813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abf246582d64d389b062bece8d0ff8a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:16.667491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:16.728744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abf246582d64d389b062bece8d0ff8a', 'request_id': 'req-5fc202b6-841c-4da0-8134-ded8efe7b64c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.736348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abf246582d64d389b062bece8d0ff8a', 'request_id': 'req-5fc202b6-841c-4da0-8134-ded8efe7b64c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.746342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abf246582d64d389b062bece8d0ff8a', 'request_id': 'req-5fc202b6-841c-4da0-8134-ded8efe7b64c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.768944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] The token cache is being invalidate because project 7abf246582d64d389b062bece8d0ff8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:16.768944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.771233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5fc202b6-841c-4da0-8134-ded8efe7b64c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:16.779611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2400/4799] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:16 2022] DELETE /identity/v3/projects/7abf246582d64d389b062bece8d0ff8a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:16.781561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:16.781943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:16.782218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:16.832892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:16.834265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:16.874692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:16.882235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593da83f-909d-404b-b710-3622cd66c89a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:16.892566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593da83f-909d-404b-b710-3622cd66c89a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:16.969931 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2400/4800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:16.999735 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2401/4801] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:17.008283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.008615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.008840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.098018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:17.099186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:17.123887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2401/4802] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:17.128864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.145184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0a0c-c555-4186-bdf9-711ed46f8c18 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:17.157170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:17.157868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.158121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.158393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.161559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:17.161950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:17.165000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:17.207376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.221536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df716dfd-2ca3-4113-84b6-c9d1b24b0648 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:17.222273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2402/4803] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:17.234196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:17.234747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.235030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.235304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.235948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:17.249197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:17.321144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.322284 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2402/4804] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:17 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:17.332525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8a19-6f57-429f-a8e0-38330e7774bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:17.490319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:17.492987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.495302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.495978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.499057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:17.504010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:17.597828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.605224 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2403/4805] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:17 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:17.610994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776af30-f345-45c2-b16b-065d3d241114 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:17.618425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:17.619038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.619451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.619648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.620312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:17.622190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:17.642288 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2403/4806] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:17.642555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.658111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e707aa-3f40-4fc6-9f8a-5990874a788f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:17.674492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da62c4-9975-4130-abcc-d9a7b43f6d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:17.675143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da62c4-9975-4130-abcc-d9a7b43f6d24 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.675423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da62c4-9975-4130-abcc-d9a7b43f6d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.675697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da62c4-9975-4130-abcc-d9a7b43f6d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.676350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da62c4-9975-4130-abcc-d9a7b43f6d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:17.678005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da62c4-9975-4130-abcc-d9a7b43f6d24 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:17.716091 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2404/4807] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:17.718893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.729685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:17.737973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d7f96-e348-4dbf-bc8e-cd04ae9aa7f1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:17.745637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:17.746353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.746635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.746908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] PATH_INFO: `/v3/projects/87f02b87f281486185807f3254be920e/users/04e5fba57bb542d9998c0de3b90a06a8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.798405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87f02b87f281486185807f3254be920e, user_id=04e5fba57bb542d9998c0de3b90a06a8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:17.801689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:17.849882 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2404/4808] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:17 2022] PUT /identity/v3/projects/87f02b87f281486185807f3254be920e/users/04e5fba57bb542d9998c0de3b90a06a8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:17.850478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:17.850867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:17.851257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:17.905657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] MFA Rules not processed for user `04e5fba57bb542d9998c0de3b90a06a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:17.907962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:17.976083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:17.978757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:18.013673 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2405/4809] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:18.014805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:18.057165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:18.136062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e4f0b-4293-4af7-9ad0-35cf57402af1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:18.146249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:18.147063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.147347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.147619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.148266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:18.161500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:18.182440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ade53-efb9-4ec0-b5e5-e6af95a0ddc4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:18.195274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:18.196165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.196448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.196723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] PATH_INFO: `/v3/projects/3f5b3468b6a04699afa1ec9895a31125` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.201951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f5b3468b6a04699afa1ec9895a31125)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:18.203905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:18.250477 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2406/4810] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:18 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:18.251741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:18.379539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f5b3468b6a04699afa1ec9895a31125', 'request_id': 'req-710f47ee-0601-4310-8a92-ee72ff4705ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.424524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f5b3468b6a04699afa1ec9895a31125', 'request_id': 'req-710f47ee-0601-4310-8a92-ee72ff4705ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.444515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f5b3468b6a04699afa1ec9895a31125', 'request_id': 'req-710f47ee-0601-4310-8a92-ee72ff4705ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.444771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d9666-77d5-4c87-8891-c72547d31737 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:18.490181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] The token cache is being invalidate because project 3f5b3468b6a04699afa1ec9895a31125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:18.490808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.491894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.523566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2405/4811] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:17 2022] DELETE /identity/v3/projects/3f5b3468b6a04699afa1ec9895a31125 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:18.524950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:18.535411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:18.600406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabdc36-181d-4463-907a-4296652d26b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:18.601142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabdc36-181d-4463-907a-4296652d26b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.601487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabdc36-181d-4463-907a-4296652d26b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.602105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabdc36-181d-4463-907a-4296652d26b4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.602685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabdc36-181d-4463-907a-4296652d26b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:18.605123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabdc36-181d-4463-907a-4296652d26b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:18.669737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2407/4812] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:18 2022] POST /identity/v3/users => generated 298 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:18.671299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.671600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.671877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.700577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f47ee-0601-4310-8a92-ee72ff4705ee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:18.708435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:18.709155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.709427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.709751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] PATH_INFO: `/v3/projects/abe0aca6204c4fdab16c6deb7478cbcb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.711160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abe0aca6204c4fdab16c6deb7478cbcb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:18.713406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:18.725112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:18.727641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:18.729102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:18.753924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2408/4813] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:18.755218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:18.756900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:18.772234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fcd5d-6f49-40f0-9345-9266d09c9c34 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:18.778592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c2dd0-a747-49bd-8057-4aaafa5f73c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:18.779840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2dd0-a747-49bd-8057-4aaafa5f73c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.780359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2dd0-a747-49bd-8057-4aaafa5f73c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.780851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c2dd0-a747-49bd-8057-4aaafa5f73c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.781727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c2dd0-a747-49bd-8057-4aaafa5f73c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:18.785666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c2dd0-a747-49bd-8057-4aaafa5f73c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:18.801360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2409/4814] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:18.803840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c7012-c682-4301-a772-9b578964d883 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.804472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c7012-c682-4301-a772-9b578964d883 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.805173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c7012-c682-4301-a772-9b578964d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.833659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-465c7012-c682-4301-a772-9b578964d883 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:18.835361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-465c7012-c682-4301-a772-9b578964d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:18.851402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abe0aca6204c4fdab16c6deb7478cbcb', 'request_id': 'req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.866962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abe0aca6204c4fdab16c6deb7478cbcb', 'request_id': 'req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.882470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abe0aca6204c4fdab16c6deb7478cbcb', 'request_id': 'req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.912654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:18.951865 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2410/4815] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:18.951865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c7012-c682-4301-a772-9b578964d883 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:18.965180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] The token cache is being invalidate because project abe0aca6204c4fdab16c6deb7478cbcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:18.965446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c7012-c682-4301-a772-9b578964d883 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:18.968955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.971459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:18.975419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:18.976552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:18.977074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:18.977507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] PATH_INFO: `/v3/projects/f5a884ba63e740ff8ea713691b703cae/users/58740cdd37594175beab6fdff710c093/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:18.979509 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2406/4816] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:18 2022] DELETE /identity/v3/projects/abe0aca6204c4fdab16c6deb7478cbcb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:18.981199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:18.990365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:19.002229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a884ba63e740ff8ea713691b703cae, user_id=58740cdd37594175beab6fdff710c093, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:19.005865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:19.042248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b432f-a34e-46fc-af61-5e8a0f6877b4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:19.045957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2411/4817] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:18 2022] PUT /identity/v3/projects/f5a884ba63e740ff8ea713691b703cae/users/58740cdd37594175beab6fdff710c093/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:19.047556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:19.050417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:19.207576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:19.208221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:19.208499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:19.208794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:19.211420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:19.211797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:19.222242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c3185-42b6-407c-b1bb-137b36444955 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:19.229934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1072f91-92e7-4878-b878-4a33bc77ff81 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:19.258360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2407/4818] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:19.260043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:19.260246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:19.260628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:19.270196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:19.271190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:19.271470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:19.271760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] PATH_INFO: `/v3/users/a6059e4a6f8d41f1af7b8ceccf79d049` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:19.277372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6059e4a6f8d41f1af7b8ceccf79d049)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:19.280688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:19.395402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] MFA Rules not processed for user `c0b9cd5c1cd349f3b1e6af834f5cc35a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:19.396890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:19.431978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6059e4a6f8d41f1af7b8ceccf79d049'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:19.459570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6059e4a6f8d41f1af7b8ceccf79d049'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:19.460267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6059e4a6f8d41f1af7b8ceccf79d049'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:19.473237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6059e4a6f8d41f1af7b8ceccf79d049'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:19.474402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6059e4a6f8d41f1af7b8ceccf79d049'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:19.518126 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2412/4819] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:19 2022] DELETE /identity/v3/users/a6059e4a6f8d41f1af7b8ceccf79d049 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:19.519337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:19.520956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:19.623219 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2408/4820] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:19.623219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:19.623219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:19.659699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86558af-851b-4da4-bc72-fa9a1ecdf744 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:19.671309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:19.722946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:19.757046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d30f1-cdc7-47a8-9d1b-75f5ece26701 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:19.770327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd58ac-63ca-457c-a553-408bccce171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:19.771642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd58ac-63ca-457c-a553-408bccce171c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:19.772415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd58ac-63ca-457c-a553-408bccce171c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:19.772892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd58ac-63ca-457c-a553-408bccce171c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:19.774136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd58ac-63ca-457c-a553-408bccce171c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:19.778608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd58ac-63ca-457c-a553-408bccce171c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:19.806801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2413/4821] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:19.810770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:19.811368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:19.814198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:19.834487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:19.835224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:19.835499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:19.835773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:19.836562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:19.842742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:19.872289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] MFA Rules not processed for user `575da00069cc4e7bbeeeb78925b9beba`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:19.874344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:19.909640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2409/4822] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:19 2022] POST /identity/v3/projects => generated 369 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:19.910465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.015648 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2414/4823] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:19 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:20.016732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.037979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc98b8-284a-43f3-92ee-a32062b457a6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.115394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ae08f-40e7-4bcb-8087-dcad60a772a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.135855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.136713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.137106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.137279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] PATH_INFO: `/v3/projects/f5a884ba63e740ff8ea713691b703cae/users/58740cdd37594175beab6fdff710c093/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.140062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5a884ba63e740ff8ea713691b703cae, user_id=58740cdd37594175beab6fdff710c093, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.142818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.145078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.145757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.146082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.146288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.146903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.149511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.161999 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2410/4824] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:19 2022] PUT /identity/v3/projects/f5a884ba63e740ff8ea713691b703cae/users/58740cdd37594175beab6fdff710c093/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:20.163109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.175645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.203961 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2415/4825] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:20 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:20.204930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.209386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.314440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:20.323426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9258c-1815-4201-bf01-f9260e802200 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.329921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cbca48-ecf6-4751-8f40-4c61a99a3845 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.341228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.343995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.345551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.345863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] PATH_INFO: `/v3/projects/f9517d7f80e341f0b6341e9363e589bf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.348259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9517d7f80e341f0b6341e9363e589bf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.353475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.427075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.428420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.428918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.429323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.432326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.447766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:20.456530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9517d7f80e341f0b6341e9363e589bf', 'request_id': 'req-91437d45-55c4-4de8-8935-ab01de29286f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:20.474295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9517d7f80e341f0b6341e9363e589bf', 'request_id': 'req-91437d45-55c4-4de8-8935-ab01de29286f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:20.489837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9517d7f80e341f0b6341e9363e589bf', 'request_id': 'req-91437d45-55c4-4de8-8935-ab01de29286f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:20.508669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] The token cache is being invalidate because project f9517d7f80e341f0b6341e9363e589bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:20.509185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:20.510542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91437d45-55c4-4de8-8935-ab01de29286f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:20.513702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2411/4826] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:20 2022] DELETE /identity/v3/projects/f9517d7f80e341f0b6341e9363e589bf => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:20.517645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72567aa-821e-4f57-8001-d9485e1fcfd7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.527223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72567aa-821e-4f57-8001-d9485e1fcfd7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.527223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72567aa-821e-4f57-8001-d9485e1fcfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.535269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.537225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.550125 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2416/4827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:20 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:20.551002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.564446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc002b7-20e2-4075-a166-7fca74485114 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.623907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d72567aa-821e-4f57-8001-d9485e1fcfd7 None None] MFA Rules not processed for user `58740cdd37594175beab6fdff710c093`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:20.625175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d72567aa-821e-4f57-8001-d9485e1fcfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.747447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.748083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.748365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.748635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.749281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.750942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.776799 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2412/4828] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:20.781300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.781300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.782065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.798749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2417/4829] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:20.799635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.835489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf802-81d3-47a3-af0e-da8d22f13cdc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.837919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:20.846251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.848732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.849381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.849668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.849997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.850661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.851885 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:20.851885 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:20.851885 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:20.853455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invalid input for field 'name': '' is too short Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'minLength' in schema['properties']['name']: Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: On instance['name']: Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'minLength' in schema['properties']['name']: Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: On instance['name']: Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: '' Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['name']: Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application '' Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.862059 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 03:09:20.864354 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['name']: Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application '' Oct 29 03:09:20.865761 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:20.869839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2418/4830] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:20 2022] POST /identity/v3/domains => generated 283 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:09:20.870812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.873309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.873480 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2413/4831] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:20.874310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.888727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c4f84-0623-4987-918a-2deb9a1449f3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.900297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ca80f-ce64-49d2-9ce0-5d6c8d0dbffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.900942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca80f-ce64-49d2-9ce0-5d6c8d0dbffb admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.901242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca80f-ce64-49d2-9ce0-5d6c8d0dbffb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.902198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ca80f-ce64-49d2-9ce0-5d6c8d0dbffb admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.902856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ca80f-ce64-49d2-9ce0-5d6c8d0dbffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.905286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ca80f-ce64-49d2-9ce0-5d6c8d0dbffb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.905676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f950410-d5b1-4687-b91d-6745ea62f8dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.917434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.918015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.918304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.918601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.919567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:20.921272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:20.926025 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2419/4832] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:20.926025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.926025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.926025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'maxLength' in schema['properties']['name']: Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: On instance['name']: Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'maxLength' in schema['properties']['name']: Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: On instance['name']: Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.930672 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 29 03:09:20.932393 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['name']: Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2414/4833] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:20 2022] POST /identity/v3/domains => generated 412 bytes in 58 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:09:20.933531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:20.967031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:20.967751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea859e-3958-4f7c-aa7a-71abdbe9996c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:20.968073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:20.982781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:20.983478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:20.983757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:20.984028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] PATH_INFO: `/v3/projects/665d64ba17ab4d2aaa27f56517475b82/users/e1ab77e1ec5b41c5b2fe6cef093541a8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.001861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2420/4834] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:21.002929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.022729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=665d64ba17ab4d2aaa27f56517475b82, user_id=e1ab77e1ec5b41c5b2fe6cef093541a8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.024155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e114e2a-21ae-48ed-b996-05f633a879d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:21.025519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.039026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ab749-4098-4b35-9164-c9406e3a14a3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:21.040181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab749-4098-4b35-9164-c9406e3a14a3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.040641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab749-4098-4b35-9164-c9406e3a14a3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.041065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ab749-4098-4b35-9164-c9406e3a14a3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.041941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab749-4098-4b35-9164-c9406e3a14a3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.043771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ab749-4098-4b35-9164-c9406e3a14a3 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.056156 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2415/4835] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:20 2022] PUT /identity/v3/projects/665d64ba17ab4d2aaa27f56517475b82/users/e1ab77e1ec5b41c5b2fe6cef093541a8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:21.057139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.073391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:21.092191 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2421/4836] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/domains => generated 275 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:21.095607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.096004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.096694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.183518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] MFA Rules not processed for user `e1ab77e1ec5b41c5b2fe6cef093541a8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:21.184876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:21.214334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4187e-6e22-4316-b21c-7ef1e6f0b7bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:21.253472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:21.300953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:21.301750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.302059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.302321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.302968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:21.303412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.305299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.325706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2416/4837] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:21.326962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.474217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f807e8-a34f-4c25-b347-4bcb5c5ccdad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:21.480074 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2422/4838] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:21.482094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.487101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:21.488139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.488637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.489134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.506495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2555bf8f1a1b4037b50f4b48ce92282a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.508832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.514582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468de57-4237-4d39-98d9-a53863b1536f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:21.524157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16afb7c-9bf9-4934-8fa5-5e90ed8db7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:21.524801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16afb7c-9bf9-4934-8fa5-5e90ed8db7be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.525079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16afb7c-9bf9-4934-8fa5-5e90ed8db7be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.525349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16afb7c-9bf9-4934-8fa5-5e90ed8db7be admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.526921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16afb7c-9bf9-4934-8fa5-5e90ed8db7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.528879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16afb7c-9bf9-4934-8fa5-5e90ed8db7be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 29 03:09:21.544109 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 29 03:09:21.545229 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:21.548390 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2417/4839] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:21 2022] DELETE /identity/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a => generated 120 bytes in 222 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:21.549505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.565786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c5ba-ad09-4f14-b385-a73fe249a55e tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:21.573960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:21.575054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.575980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.576512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.577371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.579824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.610749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2423/4840] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/projects => generated 397 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:21.610749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.611475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.611766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.645376 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2418/4841] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:21.646814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.675604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:21.676893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:21.731103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c1757-cdd8-481b-953c-09d3c13f64b0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:21.739744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:21.740824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:21.741126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:21.741406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:21.743128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2555bf8f1a1b4037b50f4b48ce92282a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:21.745665 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:21.745665 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:09:21.745665 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:09:21.746640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:21.782115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:21.786896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:21.834237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:21.850360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2424/4842] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:21.855240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.863658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:21.883859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:21.885690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:21.897901 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2419/4843] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:21 2022] PATCH /identity/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a => generated 276 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:21.902147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:21.908523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:22.036569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a2531-2acd-44fd-8cbc-69d65bbb2527 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:22.064972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1972-d333-4592-9df2-38dc485791c4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:22.080295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:22.091511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:22.092051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:22.092340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:22.092620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:22.093269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:22.099982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:22.151770 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2420/4844] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:22.152681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:22.157738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:22.204021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:22.204662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:22.204942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:22.205210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:22.212752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:22.214831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:22.295464 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2425/4845] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:21 2022] POST /identity/v3/users => generated 305 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:22.296817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:22.311812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:22.399083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff499c4-5839-4961-8ee8-aa60b13ba611 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:22.409564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:22.410270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:22.410569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:22.410835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:22.419145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:22.520785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe37df6-2f63-4791-8022-50db2a660ccd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:22.540149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:22.540802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:22.541082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:22.548145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:22.581554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2555bf8f1a1b4037b50f4b48ce92282a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:22.584669 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:22.584669 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:22.584669 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:22.585038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:22.586974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:22.588099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:22.609824 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2421/4846] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:22.616989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:22.644008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.647564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931c0a9-6637-41fb-a24e-71de7bdbe2a1 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:22.663104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:22.663750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:22.664031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:22.664629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:22.665310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:22.668671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:22.671257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.698702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2422/4847] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:22.701560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:22.705623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:22.738033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a', 'request_id': 'req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.739093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd5d1c-af1b-48e0-9041-eb7dece938fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:22.746026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a', 'request_id': 'req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.752912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a', 'request_id': 'req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.779345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:22.785735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] The token cache is being invalidate because project 2555bf8f1a1b4037b50f4b48ce92282a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:22.786363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.793871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.804693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:22.816523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a', 'request_id': 'req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.818528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a', 'request_id': 'req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.845463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2555bf8f1a1b4037b50f4b48ce92282a', 'request_id': 'req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:22.873533 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2426/4848] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:22 2022] DELETE /identity/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:22.880143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:22.888180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:22.951780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:22.952499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:22.952808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:22.953155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:22.955791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:22.960790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:22.992023 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2423/4849] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:22.998157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:23.005632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:23.086992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0af564-c5a9-4aa8-bcc5-372192a76fb4 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:23.120126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:23.120844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.121165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.121478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] PATH_INFO: `/v3/projects/abb333d90d5c425cafe4739b3e16a734/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:23.166227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb333d90d5c425cafe4739b3e16a734, user_id=7236cfd62a4040a688e3024639469c2c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:23.176715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:23.223133 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2427/4850] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:22 2022] PUT /identity/v3/projects/abb333d90d5c425cafe4739b3e16a734/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:23.224099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:23.234163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:23.329516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12825beb-2203-4c1a-b55e-7bd87b9e639a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:23.454593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:23.455315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.455598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.455875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/da8c996aeee34342bd80e5267495ad94` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:23.473536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:09:23.483748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b30d8b-dcbe-4a3f-8aeb-d04d739bfde9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Could not find domain: da8c996aeee34342bd80e5267495ad94.: keystone.exception.DomainNotFound: Could not find domain: da8c996aeee34342bd80e5267495ad94. Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da8c996aeee34342bd80e5267495ad94. Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:23.485074 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:23.486381 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:09:23.487663 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da8c996aeee34342bd80e5267495ad94. Oct 29 03:09:23.488995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:23.493480 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2424/4851] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:22 2022] DELETE /identity/v3/domains/da8c996aeee34342bd80e5267495ad94 => generated 112 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:23.495473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:23.507419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:23.508842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.509347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.510354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] PATH_INFO: `/v3/projects/af665c49794342368a3da936730ab60e/users/e73961571fbd409bbd9d07ded79253d7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:23.521609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b7ad-1a4b-4e23-9044-6f9613f80229 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:23.536535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:23.537101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.537384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.537658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:23.545880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:23.552344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:23.569873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af665c49794342368a3da936730ab60e, user_id=e73961571fbd409bbd9d07ded79253d7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:23.582231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:23.595356 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2425/4852] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:23.595356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:23.634444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859c3f3-f7ae-49ad-a8d0-937aaa5785fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:23.638481 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2428/4853] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:23 2022] PUT /identity/v3/projects/af665c49794342368a3da936730ab60e/users/e73961571fbd409bbd9d07ded79253d7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:23.643063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:23.794954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:23.826016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:23.844319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f32e0-2398-4df1-b9b6-a52b0c157e05 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:23.852329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:23.852773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.853069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.853401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] PATH_INFO: `/v3/projects/abb333d90d5c425cafe4739b3e16a734/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:23.855794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb333d90d5c425cafe4739b3e16a734, user_id=7236cfd62a4040a688e3024639469c2c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:23.859358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:23.877792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b559ab7-b436-4f92-ac69-3207329806fd tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:23.878459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559ab7-b436-4f92-ac69-3207329806fd tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.878742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559ab7-b436-4f92-ac69-3207329806fd tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.882360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2429/4854] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:23 2022] PUT /identity/v3/projects/abb333d90d5c425cafe4739b3e16a734/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:23.884643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:23.888097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b559ab7-b436-4f92-ac69-3207329806fd tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:23.888888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559ab7-b436-4f92-ac69-3207329806fd tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:23.894638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b559ab7-b436-4f92-ac69-3207329806fd tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:23.973621 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2426/4855] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:23 2022] POST /identity/v3/domains => generated 253 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:23.980363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:23.981697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:23.982009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.071384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419bd27-f515-412b-b309-a4381dc82c13 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:24.083902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] MFA Rules not processed for user `7236cfd62a4040a688e3024639469c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:24.095241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:24.250076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:24.250710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:24.250993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:24.251269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.251935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:24.255131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:24.274390 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2430/4856] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:24.275628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:24.318061 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2427/4857] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:24.319264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:24.353421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a142a7-a598-4de6-b99b-eab5887fbb6c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:24.369957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:24.385397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeb440-6722-4f64-ae45-fe4f7da333f8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:24.385998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:24.386730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:24.388022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] PATH_INFO: `/v3/projects/af665c49794342368a3da936730ab60e/users/e73961571fbd409bbd9d07ded79253d7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.392591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:24.393508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:24.396737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:24.397761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.398244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=af665c49794342368a3da936730ab60e, user_id=e73961571fbd409bbd9d07ded79253d7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:24.400336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:24.403702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:24.404256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:24.427279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.sql.core [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2085891158' for key 'project.ixu_project_name_domain_id'") Oct 29 03:09:24.427279 n-d-862964-4 devstack@keystone.service[82080]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 03:09:24.427279 n-d-862964-4 devstack@keystone.service[82080]: [parameters: {'id': '74e92bea2a6a4284bf2b59339fa3acb7', 'name': 'tempest-domain-dup-2085891158', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 03:09:24.427279 n-d-862964-4 devstack@keystone.service[82080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=82080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 03:09:24.453854 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2428/4858] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:24 2022] PUT /identity/v3/projects/af665c49794342368a3da936730ab60e/users/e73961571fbd409bbd9d07ded79253d7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:24.455028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2085891158.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2085891158. Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 03:09:24.471096 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-2085891158' for key 'project.ixu_project_name_domain_id'") Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 29 03:09:24.472466 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application yield resource Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise self.value Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.commit() Oct 29 03:09:24.474105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.flush() Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application compat.raise_( Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 03:09:24.475383 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 29 03:09:24.476821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result = self._query(query) Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application conn.query(q) Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application result.read() Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 29 03:09:24.478105 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-2085891158' for key 'project.ixu_project_name_domain_id'") Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [parameters: {'id': '74e92bea2a6a4284bf2b59339fa3acb7', 'name': 'tempest-domain-dup-2085891158', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.479316 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-2085891158. Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:24.480421 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-2085891158. Oct 29 03:09:24.481753 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:24.495157 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2431/4859] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:24 2022] POST /identity/v3/domains => generated 212 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 03:09:24.496781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:24.530012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af1807-c74a-4468-8901-7a23346d8ff7 tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:24.596200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:24.656213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931c8a8-d5bd-4a94-8492-62febd170a4d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:24.659462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:24.660125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:24.660803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:24.661068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/ef0925a6a5814f13a1638f2eedd7b133` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.673084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb85165-4123-4b49-820d-d5cf86b2c03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:24.673656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85165-4123-4b49-820d-d5cf86b2c03f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:24.673959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85165-4123-4b49-820d-d5cf86b2c03f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:24.674258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb85165-4123-4b49-820d-d5cf86b2c03f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.675009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb85165-4123-4b49-820d-d5cf86b2c03f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:24.681371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb85165-4123-4b49-820d-d5cf86b2c03f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:24.690461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ef0925a6a5814f13a1638f2eedd7b133)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:24.694418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:24.747911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2429/4860] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:24 2022] POST /identity/v3/projects => generated 367 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:24.754480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:24.754777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:24.755058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:24.762116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:24.763434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:24.823152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:24.827776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:24.837352 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2432/4861] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:24 2022] PATCH /identity/v3/domains/ef0925a6a5814f13a1638f2eedd7b133 => generated 254 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:24.837352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:24.844546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] MFA Rules not processed for user `e73961571fbd409bbd9d07ded79253d7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:24.845249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:24.846586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:24.932189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:25.105286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12576aa9-ed58-409c-9af6-0b0d8bf5818d tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:25.120402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:25.121035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:25.129657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:25.129933 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2430/4862] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:25.130738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:25.131440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:25.133308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:25.139477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:25.143505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:25.246234 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2433/4863] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:24 2022] POST /identity/v3/users => generated 284 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:25.252077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:25.256709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:25.300985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087482-51f8-4b24-b666-17e0780b1c9a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:25.321309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:25.322142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:25.322420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:25.323258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:25.323919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:25.326690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:25.401405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb090d-5ca0-40b0-816f-d39d944d451c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:25.418776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:25.419558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:25.419948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:25.420325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/ef0925a6a5814f13a1638f2eedd7b133` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:25.425263 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2434/4864] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:25 2022] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:25.426365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:25.489898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ef0925a6a5814f13a1638f2eedd7b133)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:25.491711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:25.617991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.661554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.706643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:25.740161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a009b-3976-4697-87c8-552e1d22088e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:25.774267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:25.784826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:25.792752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:25.793102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:25.794509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:25.796251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:25.825447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133', 'request_id': 'req-3a04e598-c4db-4704-abd2-088fc30ad8ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.830008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2435/4865] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:25.830008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:25.845928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133', 'request_id': 'req-3a04e598-c4db-4704-abd2-088fc30ad8ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.852450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d46be-6fe9-4656-83f1-77d058dc9a8e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:25.866025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133', 'request_id': 'req-3a04e598-c4db-4704-abd2-088fc30ad8ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.890465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] The token cache is being invalidate because project ef0925a6a5814f13a1638f2eedd7b133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:25.890768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.891587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.918060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133', 'request_id': 'req-3a04e598-c4db-4704-abd2-088fc30ad8ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.921889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133', 'request_id': 'req-3a04e598-c4db-4704-abd2-088fc30ad8ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.924204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ef0925a6a5814f13a1638f2eedd7b133', 'request_id': 'req-3a04e598-c4db-4704-abd2-088fc30ad8ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:25.939726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:25.964873 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2431/4866] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:25 2022] DELETE /identity/v3/domains/ef0925a6a5814f13a1638f2eedd7b133 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:25.971459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:25.972927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:26.049109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.049872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.050252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.050696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.051504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.053630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:26.112239 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2436/4867] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:25 2022] POST /identity/v3/users => generated 300 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:26.114580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:26.126807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:26.130525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04e598-c4db-4704-abd2-088fc30ad8ae tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.145692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.151184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.151796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.152314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.156004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.158342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:26.176968 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2432/4868] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:26.178543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:26.194441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:26.211613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00916-b892-47f1-82a3-82f650aab5f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.217676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.218789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.219292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.219809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.220722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.222752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:26.242091 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2433/4869] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:26.244036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:26.256008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53e5e5-1dd4-43a4-b891-e53b8209c156 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.271265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.276745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.278406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.278955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] PATH_INFO: `/v3/projects/d731509d18174091b98037e6a878a001/users/65e500d9a6cb4e3c8967ef653fedb142/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.327667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d731509d18174091b98037e6a878a001, user_id=65e500d9a6cb4e3c8967ef653fedb142, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.330808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:26.363099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aba4e-2e50-4205-8311-2f371ae512f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.364695 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2434/4870] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:26 2022] PUT /identity/v3/projects/d731509d18174091b98037e6a878a001/users/65e500d9a6cb4e3c8967ef653fedb142/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:26.366088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:26.501782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa1103-b173-4257-93ae-33d96b4f9ea0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.516526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc09b4-4924-4b9f-bf87-f236bbc1d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.517292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc09b4-4924-4b9f-bf87-f236bbc1d933 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.517567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc09b4-4924-4b9f-bf87-f236bbc1d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.517929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc09b4-4924-4b9f-bf87-f236bbc1d933 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.518591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc09b4-4924-4b9f-bf87-f236bbc1d933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.520217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc09b4-4924-4b9f-bf87-f236bbc1d933 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:26.565331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2435/4871] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:26.566951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320403f9-41cf-4767-894c-88ca02320ca1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.567242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320403f9-41cf-4767-894c-88ca02320ca1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.567583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320403f9-41cf-4767-894c-88ca02320ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.571697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58740cdd37594175beab6fdff710c093', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5a884ba63e740ff8ea713691b703cae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.572370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.572650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.572929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] PATH_INFO: `/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.605080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:09:26.618006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-320403f9-41cf-4767-894c-88ca02320ca1 None None] MFA Rules not processed for user `65e500d9a6cb4e3c8967ef653fedb142`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Could not find domain: 2555bf8f1a1b4037b50f4b48ce92282a.: keystone.exception.DomainNotFound: Could not find domain: 2555bf8f1a1b4037b50f4b48ce92282a. Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 2555bf8f1a1b4037b50f4b48ce92282a. Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:26.619831 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:26.621191 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:09:26.622706 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 2555bf8f1a1b4037b50f4b48ce92282a. Oct 29 03:09:26.624382 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:26.624480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-320403f9-41cf-4767-894c-88ca02320ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:26.630352 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2437/4872] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:26 2022] PATCH /identity/v3/domains/2555bf8f1a1b4037b50f4b48ce92282a => generated 112 bytes in 517 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:26.632295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:26.665744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa42a55-7118-4d71-ac1c-41fea4a23c1c tempest-DomainsNegativeTestJSON-1534596889 tempest-DomainsNegativeTestJSON-1534596889-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.678483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.680745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.681712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.681712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] PATH_INFO: `/v3/projects/e250e3bfd8ed4960895582513de8067b/users/500c464fb4484b02b372eed635d02194/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.722807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e250e3bfd8ed4960895582513de8067b, user_id=500c464fb4484b02b372eed635d02194, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.732051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:26.744637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:26.759830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:26.775653 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2438/4873] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:26 2022] PUT /identity/v3/projects/e250e3bfd8ed4960895582513de8067b/users/500c464fb4484b02b372eed635d02194/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:26.777067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:26.782372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:26.836715 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2436/4874] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:26.849845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.849845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.849845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.907807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] MFA Rules not processed for user `500c464fb4484b02b372eed635d02194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:26.909703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:26.971117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cde313-b36c-4104-b73c-6017d97c9434 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:26.986681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:26.987353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:26.987636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:26.987915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] PATH_INFO: `/v3/users/04e5fba57bb542d9998c0de3b90a06a8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:26.995188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e5fba57bb542d9998c0de3b90a06a8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:26.998483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:27.152482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e5fba57bb542d9998c0de3b90a06a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:27.154074 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2437/4875] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:26 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:27.156827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:27.162032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:27.185712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e5fba57bb542d9998c0de3b90a06a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:27.186136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e5fba57bb542d9998c0de3b90a06a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:27.206263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e5fba57bb542d9998c0de3b90a06a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:27.208288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b3af24b-a6e6-42b2-99e1-9f93d0e7b42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e5fba57bb542d9998c0de3b90a06a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:27.254577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2439/4876] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:26 2022] DELETE /identity/v3/users/04e5fba57bb542d9998c0de3b90a06a8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:27.259368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:27.259656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:27.259920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:27.315924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:27.317274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:27.360212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774235a-218a-43a9-92f0-5586634cd032 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:27.522050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2440/4877] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:27.532338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:27.534008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:27.581836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:27.582579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:27.582806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:27.583082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:27.583751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:27.590369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:27.613080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:27.645911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2438/4878] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:27 2022] POST /identity/v3/domains => generated 276 bytes in 491 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:27.650414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:27.655066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:27.709046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:27.751995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622a9ce-3d71-47d2-a03b-2645b1b49e77 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:27.860774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16505b-77f8-43c7-bfe5-230d9f0c9c03 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:27.872968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:27.875606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:27.877116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:27.877408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:27.879719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:27.884572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:27.895425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:27.907537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:27.908169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:27.908896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:27.934652 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2439/4879] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:09:27 2022] POST /identity/v3/roles => generated 239 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:27.938626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:27.969022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaced14-a7c3-4304-a924-716abc5c4fa6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:27.990822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:27.993789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:27.994119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:27.994397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/90c6d1f1ba45430cb734443a2754c9a2/users/65e500d9a6cb4e3c8967ef653fedb142/roles/7bc7cd79c5d74ff386628068c44b0c77` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:28.058839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=90c6d1f1ba45430cb734443a2754c9a2, user_id=65e500d9a6cb4e3c8967ef653fedb142, role_id=7bc7cd79c5d74ff386628068c44b0c77)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.065436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.086348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.093117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.103878 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2440/4880] 10.222.0.16 () {60 vars in 1480 bytes} [Sat Oct 29 03:09:27 2022] PUT /identity/v3/domains/90c6d1f1ba45430cb734443a2754c9a2/users/65e500d9a6cb4e3c8967ef653fedb142/roles/7bc7cd79c5d74ff386628068c44b0c77 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:28.112327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:28.140486 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2441/4881] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:28.233201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9353db8-00ab-46ec-baa2-34c52991dbad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:28.239696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:28.239696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:28.240076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:28.240416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:28.241414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.243780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.269829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2441/4882] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:28 2022] POST /identity/v3/domains => generated 276 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:28.275886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:28.314825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d1ff4-c748-4f80-9ad7-6abf433ef64c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:28.441382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:28.442382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:28.442382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:28.442598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:28.443273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.444977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.485753 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2442/4883] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:09:28 2022] POST /identity/v3/roles => generated 239 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:28.486401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:28.510235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476374a-8cde-4904-aec4-52ee69ab17e8 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:28.517416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:28.518144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:28.518483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:28.518809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:28.519454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.522433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.587069 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2442/4884] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:09:28 2022] POST /identity/v3/groups => generated 325 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:28.591073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:28.607617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fecbe1-229f-4cab-8688-3ba478dd08b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:28.613174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:28.613958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:28.614343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:28.614857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups/53014f23bbbe44de8588e87c157c8d5e/users/65e500d9a6cb4e3c8967ef653fedb142` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:28.625600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=53014f23bbbe44de8588e87c157c8d5e, user_id=65e500d9a6cb4e3c8967ef653fedb142)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.629087 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:28.629087 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:28.629087 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:28.631492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.650603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:28.679292 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2443/4885] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:09:28 2022] PUT /identity/v3/groups/53014f23bbbe44de8588e87c157c8d5e/users/65e500d9a6cb4e3c8967ef653fedb142 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:28.683972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:28.701858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3b4b-3e08-432e-9671-896a1697b47d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:28.831753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:28.844072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:28.844777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:28.845061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:28.845337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/b06d0744ef3841dea88d6ae04591849b/groups/53014f23bbbe44de8588e87c157c8d5e/roles/49411062b12843ca9ddd0010346c1d10` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:28.847617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=b06d0744ef3841dea88d6ae04591849b, group_id=53014f23bbbe44de8588e87c157c8d5e, role_id=49411062b12843ca9ddd0010346c1d10)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:28.850389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:28.878317 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2443/4886] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:28 2022] PUT /identity/v3/domains/b06d0744ef3841dea88d6ae04591849b/groups/53014f23bbbe44de8588e87c157c8d5e/roles/49411062b12843ca9ddd0010346c1d10 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:28.882383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:28.925137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef74315-08fe-4343-ba8c-e8d4edf96e41 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:29.067803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.070024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:29.086656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:29.087296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:29.087576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:29.087849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:29.088585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:29.090235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:29.126350 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2444/4887] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:28 2022] POST /identity/v3/domains => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:29.130431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.321194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a05c3f3-32c3-4d3a-b54e-218acf217cae tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:29.346041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85981-46c1-4de0-9f97-659bf97daf44 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:29.354156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:29.355060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:29.355530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:29.355987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:29.356935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:29.359585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:29.398648 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2445/4888] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:09:29 2022] POST /identity/v3/roles => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:29.402625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.425101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0d2dc-d86e-43d9-b079-1e469a4e84db tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:29.439789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:29.441051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:29.441991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:29.442638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/919a7116ce1a472783c4acac65ed8f81/users/65e500d9a6cb4e3c8967ef653fedb142/roles/65311a9a808d4eeaae5c53db6f83d59c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:29.491115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=919a7116ce1a472783c4acac65ed8f81, user_id=65e500d9a6cb4e3c8967ef653fedb142, role_id=65311a9a808d4eeaae5c53db6f83d59c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:29.494855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:29.518945 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2446/4889] 10.222.0.16 () {60 vars in 1480 bytes} [Sat Oct 29 03:09:29 2022] PUT /identity/v3/domains/919a7116ce1a472783c4acac65ed8f81/users/65e500d9a6cb4e3c8967ef653fedb142/roles/65311a9a808d4eeaae5c53db6f83d59c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:29.522690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.599338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:29.602506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:29.602506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:29.602724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] PATH_INFO: `/v3/projects/87f02b87f281486185807f3254be920e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:29.613739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87f02b87f281486185807f3254be920e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:29.624548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:29.680676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de455e3-403d-4b51-8868-c327d92ed032 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:29.695845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:29.696662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:29.697036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:29.697774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:29.698586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:29.700639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:29.708460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:29.737514 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2447/4890] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:09:29 2022] POST /identity/v3/domains => generated 277 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:29.741184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.760956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87f02b87f281486185807f3254be920e', 'request_id': 'req-776c96b0-bb06-4c06-a98c-2bb68aad03f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:29.783578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87f02b87f281486185807f3254be920e', 'request_id': 'req-776c96b0-bb06-4c06-a98c-2bb68aad03f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:29.798601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87f02b87f281486185807f3254be920e', 'request_id': 'req-776c96b0-bb06-4c06-a98c-2bb68aad03f4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:29.854771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] The token cache is being invalidate because project 87f02b87f281486185807f3254be920e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:29.857347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:29.860185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:29.873055 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2444/4891] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:29 2022] DELETE /identity/v3/projects/87f02b87f281486185807f3254be920e => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:29.874264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.882709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:29.894675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceb397-befa-4a38-b6d5-816304d96a5b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:29.911249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:29.912397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:29.912942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:29.913313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:29.914746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:29.936361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:29.978903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2448/4892] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:09:29 2022] POST /identity/v3/roles => generated 239 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:29.980023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:29.984608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:30.010137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8bf5f-08ee-4222-97d7-7e9262fcb606 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:30.015378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:30.016119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:30.016520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:30.016889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:30.017617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:30.018817 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:30.018817 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:30.018817 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:30.026080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:30.051418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:30.073300 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2449/4893] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:09:29 2022] POST /identity/v3/groups => generated 326 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:30.078093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:30.158570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8b332-1934-4a2e-85d0-fb982a23a6a5 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:30.186861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:30.187682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:30.188056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:30.188439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/users/65e500d9a6cb4e3c8967ef653fedb142` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:30.215694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f69d2c2ab8714ca8bc750183bb6ef6e6, user_id=65e500d9a6cb4e3c8967ef653fedb142)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:30.217865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:30.235316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c96b0-bb06-4c06-a98c-2bb68aad03f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:30.298836 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2450/4894] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:09:30 2022] PUT /identity/v3/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/users/65e500d9a6cb4e3c8967ef653fedb142 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:30.299938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:30.343448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:30.345127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:30.345541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:30.346227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] PATH_INFO: `/v3/users/58740cdd37594175beab6fdff710c093` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:30.348465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58740cdd37594175beab6fdff710c093)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:30.350669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:30.447737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58740cdd37594175beab6fdff710c093'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:30.460412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f782c-37b6-4d73-811e-035ce60cd141 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:30.467697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:30.469176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:30.469676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:30.470206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/f976f3e01b734e9791a715964e3b91fb/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/roles/2b4f57ff407248b1bd9ac1f50438f9f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:30.476147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f976f3e01b734e9791a715964e3b91fb, group_id=f69d2c2ab8714ca8bc750183bb6ef6e6, role_id=2b4f57ff407248b1bd9ac1f50438f9f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:30.479711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:30.499217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58740cdd37594175beab6fdff710c093'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:30.499998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58740cdd37594175beab6fdff710c093'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:30.503118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2451/4895] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:30 2022] PUT /identity/v3/domains/f976f3e01b734e9791a715964e3b91fb/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/roles/2b4f57ff407248b1bd9ac1f50438f9f9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:30.513787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:30.518457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58740cdd37594175beab6fdff710c093'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:30.519195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58740cdd37594175beab6fdff710c093'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:30.520222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:30.539671 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2445/4896] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:29 2022] DELETE /identity/v3/users/58740cdd37594175beab6fdff710c093 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:30.656875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:30.815761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351df35-797c-43ef-96c2-008bec0c204b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:31.006420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65e500d9a6cb4e3c8967ef653fedb142', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd731509d18174091b98037e6a878a001', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:31.007054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.007341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.007626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] PATH_INFO: `/v3/auth/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.008285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:31.009374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:31.124643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:31.127338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:31.213119 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2452/4897] 10.222.0.16 () {58 vars in 1143 bytes} [Sat Oct 29 03:09:30 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 705 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:31.216301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:31.222946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:31.268513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:31.274275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb800e78-f861-41a9-814e-e69fbca73d33 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:31.293100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:31.294113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.294794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.295618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] PATH_INFO: `/v3/projects/f5a884ba63e740ff8ea713691b703cae` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.297907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5a884ba63e740ff8ea713691b703cae)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:31.300526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:31.306203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:31.392162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223cf1f9-116b-4677-9a24-44dd652c70d6 tempest-TokensV3TestJSON-589428656 tempest-TokensV3TestJSON-589428656-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:31.412897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5a884ba63e740ff8ea713691b703cae', 'request_id': 'req-7a2b342b-91c5-43e0-9604-1e202dd72843'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.437733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5a884ba63e740ff8ea713691b703cae', 'request_id': 'req-7a2b342b-91c5-43e0-9604-1e202dd72843'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.462320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5a884ba63e740ff8ea713691b703cae', 'request_id': 'req-7a2b342b-91c5-43e0-9604-1e202dd72843'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.495892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] The token cache is being invalidate because project f5a884ba63e740ff8ea713691b703cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:31.496535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.497386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7a2b342b-91c5-43e0-9604-1e202dd72843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.498928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:31.501520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.501520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.501520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/f976f3e01b734e9791a715964e3b91fb/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/roles/2b4f57ff407248b1bd9ac1f50438f9f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.503230 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2446/4898] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:31 2022] DELETE /identity/v3/projects/f5a884ba63e740ff8ea713691b703cae => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:31.503399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f976f3e01b734e9791a715964e3b91fb, group_id=f69d2c2ab8714ca8bc750183bb6ef6e6, role_id=2b4f57ff407248b1bd9ac1f50438f9f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:31.507793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:31.509317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317226c5-a49b-42c3-807f-4158213b4998 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.510120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317226c5-a49b-42c3-807f-4158213b4998 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.512938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317226c5-a49b-42c3-807f-4158213b4998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.524552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 2b4f57ff407248b1bd9ac1f50438f9f9 was removed from group f69d2c2ab8714ca8bc750183bb6ef6e6 on domain f976f3e01b734e9791a715964e3b91fb. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:31.524958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.525916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.556266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2453/4899] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:09:31 2022] DELETE /identity/v3/domains/f976f3e01b734e9791a715964e3b91fb/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/roles/2b4f57ff407248b1bd9ac1f50438f9f9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:31.557531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:31.559663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:31.563620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-317226c5-a49b-42c3-807f-4158213b4998 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:31.565572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-317226c5-a49b-42c3-807f-4158213b4998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:31.684528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4110538-e10d-4174-9e6c-d2881dd83c34 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:31.700083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:31.702392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.704157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.704676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/users/65e500d9a6cb4e3c8967ef653fedb142` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.707698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f69d2c2ab8714ca8bc750183bb6ef6e6, user_id=65e500d9a6cb4e3c8967ef653fedb142)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:31.709861 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:31.709861 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:09:31.709861 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:09:31.712254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2447/4900] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:31.713407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:31.728220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.729004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.729614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.740488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:31.775092 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2454/4901] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:09:31 2022] DELETE /identity/v3/groups/f69d2c2ab8714ca8bc750183bb6ef6e6/users/65e500d9a6cb4e3c8967ef653fedb142 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:31.776232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:31.777563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:31.778851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:31.894767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:31.905690 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2448/4902] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:31.911609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:31.926273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023da8e-9ece-4cb6-bf66-b8778299ced9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:31.934903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d9f50-3d31-44d5-bbb2-89601e66a639 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:31.937997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:31.938767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.939144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.939576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups/f69d2c2ab8714ca8bc750183bb6ef6e6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.941055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f69d2c2ab8714ca8bc750183bb6ef6e6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:31.943016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:31.944063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:31.944990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:31.945595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:31.946774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:31.947952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:31.948486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:31.950308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:31.969125 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2449/4903] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:31.973219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.001556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebb41c-c17b-4172-ad7e-ff6ff2cbe989 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.010509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:32.011626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.012655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.014420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.016044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:32.019424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:32.046163 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2455/4904] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:09:31 2022] DELETE /identity/v3/groups/f69d2c2ab8714ca8bc750183bb6ef6e6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:32.047249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.052387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.085129 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2450/4905] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:31 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:32.091849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.267161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a24a6f-d2ab-4d1f-86d9-1a43571a6232 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.283044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:32.283798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.284220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.284600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.285368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:32.289631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:32.301490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f8c1d-6431-4d6a-9a04-215297664e9d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.336369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2451/4906] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:32 2022] POST /identity/v3/users => generated 292 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:32.342733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.377775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3118049a-c51b-4bb2-ac9c-2bf42569c705 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.410029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:32.412544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.418472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.420982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.427417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:32.431217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:32.502180 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2452/4907] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:32 2022] GET /identity/v3/roles => generated 2341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:09:32.506333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.540602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454e909-1faa-4d4d-8f14-04452fc1cf6d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.557195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:32.557921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.558294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.558664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.559860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:32.561134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:32.565191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:32.565191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.565191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.565944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles/2b4f57ff407248b1bd9ac1f50438f9f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.577071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2b4f57ff407248b1bd9ac1f50438f9f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:32.578753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:32.606544 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2453/4908] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:32 2022] GET /identity/v3/roles => generated 2341 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:09:32.611459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.656916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02355d3-e3b9-467c-b54a-dd1b42163df2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.674290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc162359-2fea-4acd-b27c-c3485dc0024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:32.675340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162359-2fea-4acd-b27c-c3485dc0024b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.675540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162359-2fea-4acd-b27c-c3485dc0024b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.675907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc162359-2fea-4acd-b27c-c3485dc0024b admin admin] PATH_INFO: `/v3/projects/5859a5c72f564207b479597df244646b/users/5af43aa82d3448698a3d358a9c9795b3/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.696585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 2b4f57ff407248b1bd9ac1f50438f9f9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:32.696886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:32.697638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:32.699913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2456/4909] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:32 2022] DELETE /identity/v3/roles/2b4f57ff407248b1bd9ac1f50438f9f9 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:32.703741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:32.705186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:32.745117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162359-2fea-4acd-b27c-c3485dc0024b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5859a5c72f564207b479597df244646b, user_id=5af43aa82d3448698a3d358a9c9795b3, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:32.756973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc162359-2fea-4acd-b27c-c3485dc0024b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:32.777749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:32.799627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2454/4910] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:32 2022] PUT /identity/v3/projects/5859a5c72f564207b479597df244646b/users/5af43aa82d3448698a3d358a9c9795b3/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:32.812974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:32.813435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:32.813951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:32.891945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e16c4be-895c-4da4-acc2-21fcfa7d01c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:32.937424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] MFA Rules not processed for user `5af43aa82d3448698a3d358a9c9795b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:32.939022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.039224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.041889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.045683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.046077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/f976f3e01b734e9791a715964e3b91fb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.047682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f976f3e01b734e9791a715964e3b91fb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.049721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.106763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.107586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.120194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2455/4911] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:33.127259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.134478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.203343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:33.209023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.262524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.265625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2457/4912] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:32 2022] PATCH /identity/v3/domains/f976f3e01b734e9791a715964e3b91fb => generated 278 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:33.269779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.271664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.283084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f390b-5b3b-412a-8c67-2ad1063cfdb6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:33.412344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.412972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.413245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.413510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.414426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.416348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.423959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa3f9b-fe09-4128-9c93-cc313285acdd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:33.435469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.436138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.436406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.436679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/f976f3e01b734e9791a715964e3b91fb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.455940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f976f3e01b734e9791a715964e3b91fb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.458097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.469860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2456/4913] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:33 2022] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:33.474852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.477107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.505653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.519769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.524883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:33.565297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca0635-c575-4c0d-9df5-05173b7078ce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:33.571897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.572810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.573293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.573729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.574694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.577316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.608287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb', 'request_id': 'req-4e7262f3-10d7-4313-933e-5763bf2f1aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.619694 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2457/4914] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:33 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:33.624014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.629227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb', 'request_id': 'req-4e7262f3-10d7-4313-933e-5763bf2f1aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.640705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb', 'request_id': 'req-4e7262f3-10d7-4313-933e-5763bf2f1aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.647580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270837-b596-4243-ac75-eee9828dc1f8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:33.670422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] The token cache is being invalidate because project f976f3e01b734e9791a715964e3b91fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:33.670706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.671752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.695501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb', 'request_id': 'req-4e7262f3-10d7-4313-933e-5763bf2f1aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.696306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb', 'request_id': 'req-4e7262f3-10d7-4313-933e-5763bf2f1aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.707666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f976f3e01b734e9791a715964e3b91fb', 'request_id': 'req-4e7262f3-10d7-4313-933e-5763bf2f1aad'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.718416 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2458/4915] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:33 2022] DELETE /identity/v3/domains/f976f3e01b734e9791a715964e3b91fb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:33.722135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.725172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.744471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:33.761262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.762238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.762782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.763331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.763985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.765674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.781908 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2458/4916] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:33 2022] GET /identity/v3/roles => generated 2111 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:33.786231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.788308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.806839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc79a39-d91a-4f6f-b68a-1ae0f225196b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:33.812653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.813610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.814068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.815024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] PATH_INFO: `/v3/projects/3981aafacfdc424a9cca64086c3b6e72/users/fd2948106a604fae822b131920136064/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.830923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7262f3-10d7-4313-933e-5763bf2f1aad tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:33.835699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:33.836627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:33.837029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:33.837311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/919a7116ce1a472783c4acac65ed8f81/users/65e500d9a6cb4e3c8967ef653fedb142/roles/65311a9a808d4eeaae5c53db6f83d59c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:33.837735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3981aafacfdc424a9cca64086c3b6e72, user_id=fd2948106a604fae822b131920136064, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.839699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=919a7116ce1a472783c4acac65ed8f81, user_id=65e500d9a6cb4e3c8967ef653fedb142, role_id=65311a9a808d4eeaae5c53db6f83d59c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:33.841085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.842422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:33.850695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 65311a9a808d4eeaae5c53db6f83d59c was removed from user 65e500d9a6cb4e3c8967ef653fedb142 on domain 919a7116ce1a472783c4acac65ed8f81. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:33.851156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.852418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:33.868991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2459/4917] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:33 2022] PUT /identity/v3/projects/3981aafacfdc424a9cca64086c3b6e72/users/fd2948106a604fae822b131920136064/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:33.873454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.875937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:33.881429 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2459/4918] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Oct 29 03:09:33 2022] DELETE /identity/v3/domains/919a7116ce1a472783c4acac65ed8f81/users/65e500d9a6cb4e3c8967ef653fedb142/roles/65311a9a808d4eeaae5c53db6f83d59c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:33.885545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:33.887670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.009872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc13eb-6585-4696-bbcf-754ffb9d5cff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.018281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8dd95e-f54e-44d4-b942-9543e7af0392 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.023896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.024666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.025016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.025358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles/65311a9a808d4eeaae5c53db6f83d59c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.026905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_role(role_id=65311a9a808d4eeaae5c53db6f83d59c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:34.029135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:34.038221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:34.098284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 65311a9a808d4eeaae5c53db6f83d59c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:34.098628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.099476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.103417 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2460/4919] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:33 2022] DELETE /identity/v3/roles/65311a9a808d4eeaae5c53db6f83d59c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:34.107790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:34.109419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.149513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.149513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.149513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.149513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.150102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:34.150102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:34.176706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2460/4920] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:33 2022] GET /identity/v3/roles => generated 1880 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:34.177767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:34.182687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.206274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4872f5-0efb-4081-96ae-12048d3f7976 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.245135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa1dcb-d945-4684-88b3-7b82570b91fd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.257041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.257908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.258334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.258662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/919a7116ce1a472783c4acac65ed8f81` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.260585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=919a7116ce1a472783c4acac65ed8f81)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:34.263879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:34.307122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '919a7116ce1a472783c4acac65ed8f81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.310613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '919a7116ce1a472783c4acac65ed8f81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.329433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.330157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.330157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.330391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] PATH_INFO: `/v3/projects/3981aafacfdc424a9cca64086c3b6e72/users/fd2948106a604fae822b131920136064/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.334572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3981aafacfdc424a9cca64086c3b6e72, user_id=fd2948106a604fae822b131920136064, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:34.340453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:34.353284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:34.366164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '919a7116ce1a472783c4acac65ed8f81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.367646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c1a5fa5-ba55-4812-99ec-f10519245c27 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '919a7116ce1a472783c4acac65ed8f81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.375233 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2461/4921] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:34 2022] PUT /identity/v3/projects/3981aafacfdc424a9cca64086c3b6e72/users/fd2948106a604fae822b131920136064/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:34.386496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:34.387197 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2461/4922] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:34 2022] PATCH /identity/v3/domains/919a7116ce1a472783c4acac65ed8f81 => generated 276 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:34.388969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.393920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.395638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.395987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.467422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] MFA Rules not processed for user `fd2948106a604fae822b131920136064`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:34.471143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.563494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119dc90-7d8a-45f2-8baa-918b97cc59d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.576182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.577127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.577539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.577944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/919a7116ce1a472783c4acac65ed8f81` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.613236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=919a7116ce1a472783c4acac65ed8f81)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:34.622038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:34.628719 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2462/4923] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:34.639195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:34.656611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edecd54d-3749-48d1-8945-9b6a85421cb1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.663524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd2948106a604fae822b131920136064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3981aafacfdc424a9cca64086c3b6e72', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.664351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.665280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.665685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.666496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:34.668601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:34.689620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '919a7116ce1a472783c4acac65ed8f81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.723035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:34.734654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '919a7116ce1a472783c4acac65ed8f81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.754605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2463/4924] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:34 2022] POST /identity/v3/projects => generated 359 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:34.756030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:34.760084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.838152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919a7116ce1a472783c4acac65ed8f81', 'request_id': 'req-a7599b90-785e-4b81-a011-3e31f799267c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.848027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919a7116ce1a472783c4acac65ed8f81', 'request_id': 'req-a7599b90-785e-4b81-a011-3e31f799267c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.859028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919a7116ce1a472783c4acac65ed8f81', 'request_id': 'req-a7599b90-785e-4b81-a011-3e31f799267c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.863386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200722fc-e351-4d03-9cf2-3f178b48b7aa tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:34.882727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] The token cache is being invalidate because project 919a7116ce1a472783c4acac65ed8f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:34.883298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.884547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.904846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '919a7116ce1a472783c4acac65ed8f81', 'request_id': 'req-a7599b90-785e-4b81-a011-3e31f799267c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.905679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '919a7116ce1a472783c4acac65ed8f81', 'request_id': 'req-a7599b90-785e-4b81-a011-3e31f799267c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.906725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '919a7116ce1a472783c4acac65ed8f81', 'request_id': 'req-a7599b90-785e-4b81-a011-3e31f799267c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:34.922450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2462/4925] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:34 2022] DELETE /identity/v3/domains/919a7116ce1a472783c4acac65ed8f81 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:34.923587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:34.925317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.934249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:34.935157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:34.935440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:34.935720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:34.938531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:34.984126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:35.025200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7599b90-785e-4b81-a011-3e31f799267c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:35.031165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5af43aa82d3448698a3d358a9c9795b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5859a5c72f564207b479597df244646b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:35.033183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.033880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.034298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] PATH_INFO: `/v3/projects/f9ae8328f8c743a990e8317b3f7d2399` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.034962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.035717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] RBAC: Authorizing `identity:delete_project(project_id=f9ae8328f8c743a990e8317b3f7d2399)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.036606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 29 03:09:35.050315 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 29 03:09:35.051542 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:35.053199 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2464/4926] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:34 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:35.054051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.058844 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2463/4927] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:34 2022] DELETE /identity/v3/projects/f9ae8328f8c743a990e8317b3f7d2399 => generated 136 bytes in 135 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:35.059314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.060752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.061382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.206428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15091c5-502a-499e-9c0c-564abc9e8517 service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:35.223988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:35.224969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.225259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.225564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/b06d0744ef3841dea88d6ae04591849b/groups/53014f23bbbe44de8588e87c157c8d5e/roles/49411062b12843ca9ddd0010346c1d10` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.230505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=b06d0744ef3841dea88d6ae04591849b, group_id=53014f23bbbe44de8588e87c157c8d5e, role_id=49411062b12843ca9ddd0010346c1d10)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.234468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:35.251399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 49411062b12843ca9ddd0010346c1d10 was removed from group 53014f23bbbe44de8588e87c157c8d5e on domain b06d0744ef3841dea88d6ae04591849b. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:35.251681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.252477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.253348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce6c6-157c-44a0-85e3-6f81b974a302 tempest-ProjectsNegativeTestJSON-752701615 tempest-ProjectsNegativeTestJSON-752701615-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:35.258684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd2948106a604fae822b131920136064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3981aafacfdc424a9cca64086c3b6e72', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:35.259326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:35.261117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.261934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.262446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] PATH_INFO: `/v3/projects/f9ae8328f8c743a990e8317b3f7d2399` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.263948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f9ae8328f8c743a990e8317b3f7d2399)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.267506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:35.277598 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2465/4928] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:09:35 2022] DELETE /identity/v3/domains/b06d0744ef3841dea88d6ae04591849b/groups/53014f23bbbe44de8588e87c157c8d5e/roles/49411062b12843ca9ddd0010346c1d10 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:35.283626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.285556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.374776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ae8328f8c743a990e8317b3f7d2399', 'request_id': 'req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.381400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ae8328f8c743a990e8317b3f7d2399', 'request_id': 'req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.388105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ae8328f8c743a990e8317b3f7d2399', 'request_id': 'req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.410766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] The token cache is being invalidate because project f9ae8328f8c743a990e8317b3f7d2399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:35.412047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.416373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.421845 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2464/4929] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:35 2022] DELETE /identity/v3/projects/f9ae8328f8c743a990e8317b3f7d2399 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:35.430698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.433944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c497f-6e4f-4316-9f51-2f4a33930bbc tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:35.435893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.584143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76705c7-b2a9-4ac5-b86d-d7c9ff95459f tempest-ProjectsNegativeTestJSON-1008605946 tempest-ProjectsNegativeTestJSON-1008605946-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:35.591492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:35.592345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.592768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.593176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] PATH_INFO: `/v3/users/5af43aa82d3448698a3d358a9c9795b3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.594719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af43aa82d3448698a3d358a9c9795b3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.595954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:35.596769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.597071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.597204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:35.597397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups/53014f23bbbe44de8588e87c157c8d5e/users/65e500d9a6cb4e3c8967ef653fedb142` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.599588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=53014f23bbbe44de8588e87c157c8d5e, user_id=65e500d9a6cb4e3c8967ef653fedb142)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.603686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:35.617088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.617684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:35.649683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2466/4930] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:09:35 2022] DELETE /identity/v3/groups/53014f23bbbe44de8588e87c157c8d5e/users/65e500d9a6cb4e3c8967ef653fedb142 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:35.673924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.673924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.768357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af43aa82d3448698a3d358a9c9795b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.788786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af43aa82d3448698a3d358a9c9795b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.789759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af43aa82d3448698a3d358a9c9795b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.798750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e40749-16f9-43f2-9a7f-086491d77d72 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:35.799189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af43aa82d3448698a3d358a9c9795b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.800112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e578329-01da-4035-82c6-2b2b7af06a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af43aa82d3448698a3d358a9c9795b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:35.804206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:35.804979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.805433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.805909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/groups/53014f23bbbe44de8588e87c157c8d5e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.809098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_group(group_id=53014f23bbbe44de8588e87c157c8d5e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:35.811481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:35.832739 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2465/4931] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:35 2022] DELETE /identity/v3/users/5af43aa82d3448698a3d358a9c9795b3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:35.837825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:35.838209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:35.838756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:35.864653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:35.880710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:35.882362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.894249 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2467/4932] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:09:35 2022] DELETE /identity/v3/groups/53014f23bbbe44de8588e87c157c8d5e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:35.895688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.903909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.972555 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2466/4933] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:35.986543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:35.988604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:35.995210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efc13d-ceb2-430f-bf0f-ce62e5cd12c9 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:36.004570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:36.005241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.005522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.005821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles/49411062b12843ca9ddd0010346c1d10` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.007811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_role(role_id=49411062b12843ca9ddd0010346c1d10)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:36.009465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:36.055739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 49411062b12843ca9ddd0010346c1d10 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:36.056121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.056729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.063902 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2468/4934] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:35 2022] DELETE /identity/v3/roles/49411062b12843ca9ddd0010346c1d10 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:36.064890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:36.066349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.070034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5eb79-e8c8-4275-b4be-877189c6d2dc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:36.137694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:36.147564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:36.148397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.148956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.149495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.151882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.186084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4f214-f018-4649-bc4b-924fc4a95a54 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:36.191073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:36.191985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.192248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.192518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] PATH_INFO: `/v3/users/e73961571fbd409bbd9d07ded79253d7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.193705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73961571fbd409bbd9d07ded79253d7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:36.196105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:36.294135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:36.295607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:36.301979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73961571fbd409bbd9d07ded79253d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.306747 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2467/4935] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:36.307652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:36.309117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.324901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:36.333318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73961571fbd409bbd9d07ded79253d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.336242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73961571fbd409bbd9d07ded79253d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.352529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73961571fbd409bbd9d07ded79253d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.354135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fea87494-8f9c-4353-b325-4e8d818f9a5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73961571fbd409bbd9d07ded79253d7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.396143 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2469/4936] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:36 2022] DELETE /identity/v3/users/e73961571fbd409bbd9d07ded79253d7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:36.400545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.401344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.401980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.446668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:36.451440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.457916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd9111-b9e7-487a-ac4c-eda8d831bcc7 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:36.596103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:36.598626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.598941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.599244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/b06d0744ef3841dea88d6ae04591849b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.600939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b06d0744ef3841dea88d6ae04591849b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:36.602680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:36.629002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.629727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.639421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2470/4937] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:36.659181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:36.662604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.692197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.693086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.696357 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2468/4938] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:36 2022] PATCH /identity/v3/domains/b06d0744ef3841dea88d6ae04591849b => generated 277 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:36.700511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:36.702965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.728696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:36.835611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb73f09-8243-4221-80e0-1ad5ce1c353e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:36.852962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894708c-022a-42a7-a62e-7a9cf9583bdf tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:36.883180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:36.884109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.884109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.884368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/b06d0744ef3841dea88d6ae04591849b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.908454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b06d0744ef3841dea88d6ae04591849b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:36.910344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:36.959634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:36.960322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:36.960607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:36.961095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:36.963672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:36.968476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:36.986882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.074536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:37.103554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b', 'request_id': 'req-3eb3052a-53a2-4071-9bca-f355a5a1d32a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.107309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:37.108738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:37.125391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2471/4939] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:09:37.126463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:37.128476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:37.131583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b', 'request_id': 'req-3eb3052a-53a2-4071-9bca-f355a5a1d32a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.146618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d465f-9829-4cf4-bf9b-ed6ab3c11352 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:37.148698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b', 'request_id': 'req-3eb3052a-53a2-4071-9bca-f355a5a1d32a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.178360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] The token cache is being invalidate because project b06d0744ef3841dea88d6ae04591849b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:37.178658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.179552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.201643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b', 'request_id': 'req-3eb3052a-53a2-4071-9bca-f355a5a1d32a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.202617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b', 'request_id': 'req-3eb3052a-53a2-4071-9bca-f355a5a1d32a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.203316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b06d0744ef3841dea88d6ae04591849b', 'request_id': 'req-3eb3052a-53a2-4071-9bca-f355a5a1d32a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.215928 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2469/4940] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:36 2022] DELETE /identity/v3/domains/b06d0744ef3841dea88d6ae04591849b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:37.220253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:37.229281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:37.260643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:37.260643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:37.260643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:37.260643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] PATH_INFO: `/v3/projects/5859a5c72f564207b479597df244646b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:37.262576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5859a5c72f564207b479597df244646b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:37.266716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:37.311219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:37.363936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb3052a-53a2-4071-9bca-f355a5a1d32a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:37.376471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5859a5c72f564207b479597df244646b', 'request_id': 'req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.385463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5859a5c72f564207b479597df244646b', 'request_id': 'req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.392422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5859a5c72f564207b479597df244646b', 'request_id': 'req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.423755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] The token cache is being invalidate because project 5859a5c72f564207b479597df244646b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:37.424128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.425039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.432849 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2472/4941] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:37 2022] DELETE /identity/v3/projects/5859a5c72f564207b479597df244646b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:37.433718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:37.435937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:37.448036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:37.449272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:37.449766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:37.450223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/90c6d1f1ba45430cb734443a2754c9a2/users/65e500d9a6cb4e3c8967ef653fedb142/roles/7bc7cd79c5d74ff386628068c44b0c77` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:37.453819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=90c6d1f1ba45430cb734443a2754c9a2, user_id=65e500d9a6cb4e3c8967ef653fedb142, role_id=7bc7cd79c5d74ff386628068c44b0c77)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:37.457666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:37.467391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 7bc7cd79c5d74ff386628068c44b0c77 was removed from user 65e500d9a6cb4e3c8967ef653fedb142 on domain 90c6d1f1ba45430cb734443a2754c9a2. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:37.468445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.470611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.495906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2470/4942] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Oct 29 03:09:37 2022] DELETE /identity/v3/domains/90c6d1f1ba45430cb734443a2754c9a2/users/65e500d9a6cb4e3c8967ef653fedb142/roles/7bc7cd79c5d74ff386628068c44b0c77 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:37.499164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:37.500755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:37.538429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be09bf9-2ed2-43e4-b482-f464ab3a1d54 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:37.569761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:37.634989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ef13-a96d-483f-a675-53b770a2bdef tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:37.638123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:37.638786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:37.639060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:37.639329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] PATH_INFO: `/v3/users/fd2948106a604fae822b131920136064` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:37.640473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd2948106a604fae822b131920136064)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:37.645293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:37.645614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:37.646714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:37.647221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:37.647802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles/7bc7cd79c5d74ff386628068c44b0c77` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:37.649981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7bc7cd79c5d74ff386628068c44b0c77)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:37.651486 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:09:37.651486 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:09:37.651486 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:09:37.652877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:37.712027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd2948106a604fae822b131920136064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.727280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd2948106a604fae822b131920136064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.728205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd2948106a604fae822b131920136064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.744278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd2948106a604fae822b131920136064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.745167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd2948106a604fae822b131920136064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.751893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 7bc7cd79c5d74ff386628068c44b0c77 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:37.752592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.754201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:37.756849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2471/4943] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:37 2022] DELETE /identity/v3/roles/7bc7cd79c5d74ff386628068c44b0c77 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:37.758203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:37.760103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:37.790007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2473/4944] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:37 2022] DELETE /identity/v3/users/fd2948106a604fae822b131920136064 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:37.791101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:37.803688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:37.846508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:37.908077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5259513-fb2f-44c7-a1b8-e76da2411b5a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:37.972767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3a870-2e83-4c08-a4d1-5b888d0f7255 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:37.980795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:37.982533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:37.983672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:37.985021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/90c6d1f1ba45430cb734443a2754c9a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:37.994984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=90c6d1f1ba45430cb734443a2754c9a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:37.996653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:38.046584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:38.047718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:38.048100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:38.048721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:38.053345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:38.071138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.071891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.137979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:38.139699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:38.141420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:38.143850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.144716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.152665 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2474/4945] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:37 2022] PATCH /identity/v3/domains/90c6d1f1ba45430cb734443a2754c9a2 => generated 277 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:38.154444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2472/4946] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:37 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:38.154846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:38.154983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:38.156302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:38.161028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:38.178028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00186e-43dd-40c2-9307-7d44bc472672 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:38.337518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40d3c7-0a8b-4fab-905f-d0fb3fb56e3d tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:38.362105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:38.362939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:38.363290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:38.363630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] PATH_INFO: `/v3/projects/af665c49794342368a3da936730ab60e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:38.365559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af665c49794342368a3da936730ab60e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:38.370678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:38.409843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:38.410724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:38.411219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:38.411580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/90c6d1f1ba45430cb734443a2754c9a2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:38.469603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=90c6d1f1ba45430cb734443a2754c9a2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:38.475479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:38.551399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:38.574777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.587956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af665c49794342368a3da936730ab60e', 'request_id': 'req-6ab6af80-f1a8-43d6-9b84-002b5f943a78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.599001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.603579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af665c49794342368a3da936730ab60e', 'request_id': 'req-6ab6af80-f1a8-43d6-9b84-002b5f943a78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.618355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af665c49794342368a3da936730ab60e', 'request_id': 'req-6ab6af80-f1a8-43d6-9b84-002b5f943a78'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.652553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] The token cache is being invalidate because project af665c49794342368a3da936730ab60e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:38.652916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.655149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.659278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2475/4947] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:38 2022] DELETE /identity/v3/projects/af665c49794342368a3da936730ab60e => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:38.663871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:38.665461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:38.695545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2', 'request_id': 'req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.710396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2', 'request_id': 'req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.719503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2', 'request_id': 'req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.750145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] The token cache is being invalidate because project 90c6d1f1ba45430cb734443a2754c9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:38.750831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.751748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.755345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6af80-f1a8-43d6-9b84-002b5f943a78 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:38.772381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2', 'request_id': 'req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.773646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2', 'request_id': 'req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.774892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '90c6d1f1ba45430cb734443a2754c9a2', 'request_id': 'req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.794878 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2473/4948] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:09:38 2022] DELETE /identity/v3/domains/90c6d1f1ba45430cb734443a2754c9a2 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:38.796092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:38.801793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:38.802886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:38.844472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:38.845230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:38.845589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:38.846508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] PATH_INFO: `/v3/projects/3981aafacfdc424a9cca64086c3b6e72` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:38.847366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3981aafacfdc424a9cca64086c3b6e72)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:38.849897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:38.902647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2ef8-b2cd-400a-9dd8-361fc2e2c56c tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:38.909751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:38.910464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:38.910743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:38.911042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] PATH_INFO: `/v3/users/500c464fb4484b02b372eed635d02194` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:38.912340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500c464fb4484b02b372eed635d02194)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:38.915178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:38.930011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3981aafacfdc424a9cca64086c3b6e72', 'request_id': 'req-7f2ab8e6-aa75-42c9-9400-36faa0579e49'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.937689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3981aafacfdc424a9cca64086c3b6e72', 'request_id': 'req-7f2ab8e6-aa75-42c9-9400-36faa0579e49'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.945468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3981aafacfdc424a9cca64086c3b6e72', 'request_id': 'req-7f2ab8e6-aa75-42c9-9400-36faa0579e49'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.972583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] The token cache is being invalidate because project 3981aafacfdc424a9cca64086c3b6e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:38.972959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.974039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:38.981954 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2476/4949] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:38 2022] DELETE /identity/v3/projects/3981aafacfdc424a9cca64086c3b6e72 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:38.984100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:38.986240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.002903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500c464fb4484b02b372eed635d02194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.019443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=79,keystone:DELETE=20,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:39.021649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500c464fb4484b02b372eed635d02194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.022839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500c464fb4484b02b372eed635d02194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.037498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500c464fb4484b02b372eed635d02194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.038308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-741e5ffd-224b-44df-9ac0-4f1973f544e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500c464fb4484b02b372eed635d02194'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.061023 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2474/4950] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:38 2022] DELETE /identity/v3/users/500c464fb4484b02b372eed635d02194 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:39.062578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0def45-8aae-4d91-a3cc-3181b1305e2d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.063066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0def45-8aae-4d91-a3cc-3181b1305e2d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.063502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0def45-8aae-4d91-a3cc-3181b1305e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.087667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ab8e6-aa75-42c9-9400-36faa0579e49 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.103198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb0def45-8aae-4d91-a3cc-3181b1305e2d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:39.104270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb0def45-8aae-4d91-a3cc-3181b1305e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.195538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.195797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.196060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.196379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.196978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.198704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.218033 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2477/4951] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:39.219277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.221743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.237329 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2475/4952] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:39.240998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.241473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.242551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.243636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07530444-19c2-465e-8689-f09a3c5ef81e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.249396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.250143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.250424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.250740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/665d64ba17ab4d2aaa27f56517475b82/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.253189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(project_id=665d64ba17ab4d2aaa27f56517475b82, user_id=7236cfd62a4040a688e3024639469c2c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.255876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.262951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:39.271691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:39.283691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.292775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2478/4953] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:39 2022] PUT /identity/v3/projects/665d64ba17ab4d2aaa27f56517475b82/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:39.294420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.393928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce1891-15a7-4ee6-b023-7f4e0117a0e4 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.399612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.400242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.400530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.400805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.401571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.403356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.442226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2476/4954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:39.447239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.460549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032f56b-f70c-4d62-a491-d7775b583a9e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.483105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.484654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.485303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.485764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.486734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:39.487262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.489232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.504164 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2479/4955] 10.222.0.16 () {58 vars in 1146 bytes} [Sat Oct 29 03:09:39 2022] GET /identity/v3/auth/projects => generated 828 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:39.504164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.509855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.517523 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2477/4956] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:39.518985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.531500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a45c-1a5d-43e6-9d0c-76f8b4cc36f7 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.537099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.538329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.538329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.538716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] PATH_INFO: `/v3/projects/e250e3bfd8ed4960895582513de8067b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.541334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e250e3bfd8ed4960895582513de8067b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.543467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.545624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b3649-57b5-468a-8687-655b0b03480d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.551889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.553089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.553530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.554010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/665d64ba17ab4d2aaa27f56517475b82/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.556344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=665d64ba17ab4d2aaa27f56517475b82, user_id=7236cfd62a4040a688e3024639469c2c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.559292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.566769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 7cfb0f87b5f748c9a420873e8002b480 was removed from user 7236cfd62a4040a688e3024639469c2c on project 665d64ba17ab4d2aaa27f56517475b82. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:39.567287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.568195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.603872 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2478/4957] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:09:39 2022] DELETE /identity/v3/projects/665d64ba17ab4d2aaa27f56517475b82/users/7236cfd62a4040a688e3024639469c2c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:39.611307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.616022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.627410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e250e3bfd8ed4960895582513de8067b', 'request_id': 'req-c39167bb-cced-4cb7-a991-407d1d79f908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.650200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e250e3bfd8ed4960895582513de8067b', 'request_id': 'req-c39167bb-cced-4cb7-a991-407d1d79f908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.664125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e250e3bfd8ed4960895582513de8067b', 'request_id': 'req-c39167bb-cced-4cb7-a991-407d1d79f908'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.684542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] The token cache is being invalidate because project e250e3bfd8ed4960895582513de8067b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:39.684912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.685756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:39.687612 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2480/4958] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:39 2022] DELETE /identity/v3/projects/e250e3bfd8ed4960895582513de8067b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:39.692482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.694326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.737004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:39.755782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:39.762566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6955c1-ee40-40d1-a1d1-4a164368b0ec tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.802415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39167bb-cced-4cb7-a991-407d1d79f908 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.814498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9bfe6-0e0c-4a67-96cd-c91bc8714791 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.815314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9bfe6-0e0c-4a67-96cd-c91bc8714791 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.815695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9bfe6-0e0c-4a67-96cd-c91bc8714791 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.816219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9bfe6-0e0c-4a67-96cd-c91bc8714791 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.816977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9bfe6-0e0c-4a67-96cd-c91bc8714791 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.819060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9bfe6-0e0c-4a67-96cd-c91bc8714791 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.846458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53948d9-84c2-4d58-b35b-17d4f7f65f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:39.847128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53948d9-84c2-4d58-b35b-17d4f7f65f0a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.847407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53948d9-84c2-4d58-b35b-17d4f7f65f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.847677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53948d9-84c2-4d58-b35b-17d4f7f65f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.848329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53948d9-84c2-4d58-b35b-17d4f7f65f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:39.850332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53948d9-84c2-4d58-b35b-17d4f7f65f0a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:39.854952 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2481/4959] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/users => generated 321 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:39.854952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.854952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.854952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.880660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:39.883480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:39.901915 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2482/4960] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:39.901915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:39.911845 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2479/4961] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:39.911845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:39.911845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:39.914162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:39.923610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988faa8-2afa-47d8-b5c8-7091155d62e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:39.964778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:39.966207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:40.020526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.021187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.021467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.021737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.022443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.024847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.057228 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2483/4962] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/projects => generated 362 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:40.057732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.059488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:40.076633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2480/4963] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:40.077872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.091435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2385656-633b-4c06-9011-a632f6b04e8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.138239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47c9e4-aae8-4282-a141-eb4302a69ae1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.143703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.144647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.144926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.145198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.145864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.147980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.184137 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2484/4964] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:40 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:40.185223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.196931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6ebbc-af4a-41ec-abee-920ee4e6cf66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.199908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.200402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.200696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.201532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.201941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.202393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.202899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.203352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.203871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.204684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:40.204992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.205514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.206756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.235397 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2485/4965] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:40.236252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.257115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2481/4966] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:40 2022] POST /identity/v3/projects => generated 364 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:40.258500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.272872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9597-53d2-4fdf-bd92-f497ccb2eaed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.273130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:40.298485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:40.348658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7522a23-1e58-4559-80a4-d3b3702161c1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.354252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.354884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.355162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.355432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.356076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.357181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.357978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.358240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.358377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.358674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.359412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.361245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.381587 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2486/4967] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:40.385780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.420869 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2482/4968] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:40 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:40.422466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.489969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8841df-2038-4fb9-867f-0769c51ce4d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.508146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa7ceac-4b5f-4f2f-b43f-d8074611e23d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.513523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.514209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.514489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.514759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.515403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.517007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.534302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2483/4969] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:40.534302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.545308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7b4c2-2488-4d1d-b9e5-7cd32b8694cd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.550127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.550743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.551023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.551293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.552158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.554991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.577401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.578234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.578625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.579003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.579780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.581609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.581735 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2484/4970] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:40 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:40.582720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.594749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9b609-6663-49b6-9c31-2d34fac03952 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.600562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.601386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.601772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.602143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] PATH_INFO: `/v3/projects/ecee976028b04ef1b56316e26bec9c8a/users/9ba419df8df8499c90589a6723a7b1d6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.605862 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2487/4971] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:09:40 2022] POST /identity/v3/roles => generated 240 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:40.605862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.619081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab767981-cdd4-48c8-b09b-45fb0cfd8d70 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.623959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecee976028b04ef1b56316e26bec9c8a, user_id=9ba419df8df8499c90589a6723a7b1d6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.627769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.633990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.634865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.635249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.635789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.636532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.639333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.659973 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2488/4972] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:40 2022] GET /identity/v3/roles => generated 1651 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:40.659973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.660260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2485/4973] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:40 2022] PUT /identity/v3/projects/ecee976028b04ef1b56316e26bec9c8a/users/9ba419df8df8499c90589a6723a7b1d6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:40.661482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.681441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae0c5b-b559-43bb-912e-0eb7311402cd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.730591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:40.767312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba10da7-85e3-4c3b-80f4-ad30f07e51bd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.773738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eadff-14eb-44a3-b412-50665c36efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.774714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eadff-14eb-44a3-b412-50665c36efa5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.775086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eadff-14eb-44a3-b412-50665c36efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.775484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eadff-14eb-44a3-b412-50665c36efa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.776262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eadff-14eb-44a3-b412-50665c36efa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.778531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eadff-14eb-44a3-b412-50665c36efa5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.789307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:40.803480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.804602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.805140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.805575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/d401ad1adbce43479bd2e5df47d18b9f/users/0c122646283745178bf44d800a12cda0/roles/4084cb6a3aef4dd0a1b5de127e10e805` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.807769 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2486/4974] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:40 2022] GET /identity/v3/roles => generated 1651 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:40.809237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.809593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.809955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.828219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d401ad1adbce43479bd2e5df47d18b9f, user_id=0c122646283745178bf44d800a12cda0, role_id=4084cb6a3aef4dd0a1b5de127e10e805)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:40.831811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:40.852284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2489/4975] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:40 2022] PUT /identity/v3/projects/d401ad1adbce43479bd2e5df47d18b9f/users/0c122646283745178bf44d800a12cda0/roles/4084cb6a3aef4dd0a1b5de127e10e805 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:40.855891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:40.872569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:40.873926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:40.982976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ba11f-99ae-4d71-8e51-21da959c6916 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:40.987888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:40.992770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:40.992976 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2487/4976] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:40.993079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:40.993079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] PATH_INFO: `/v3/projects/a952bda7f7214b5c945d9dd80ab2eee7/users/128380c231ff4989aba83d318d28a01a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:40.993235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:41.006475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a952bda7f7214b5c945d9dd80ab2eee7, user_id=128380c231ff4989aba83d318d28a01a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:41.009719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:41.031624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2490/4977] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:40 2022] PUT /identity/v3/projects/a952bda7f7214b5c945d9dd80ab2eee7/users/128380c231ff4989aba83d318d28a01a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:41.032689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:41.104116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b743b8-528c-4519-9db2-5a045f7c6eb2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:41.145986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f3dc2-2b5a-42f2-9841-3a9cc9837cf3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:41.151055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21919c24-5a9e-4e88-a7da-e78b07580ad2 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:41.152017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919c24-5a9e-4e88-a7da-e78b07580ad2 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.152372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919c24-5a9e-4e88-a7da-e78b07580ad2 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.153650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21919c24-5a9e-4e88-a7da-e78b07580ad2 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.210109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21919c24-5a9e-4e88-a7da-e78b07580ad2 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:41.220906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9acd-709f-4b6c-b95e-a6bdb162cf81 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:41.223446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9acd-709f-4b6c-b95e-a6bdb162cf81 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.224497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9acd-709f-4b6c-b95e-a6bdb162cf81 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.225038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9acd-709f-4b6c-b95e-a6bdb162cf81 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/bbf5871f144746078c47e5f7f9c9b045/users/0c122646283745178bf44d800a12cda0/roles/4084cb6a3aef4dd0a1b5de127e10e805` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.229467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9acd-709f-4b6c-b95e-a6bdb162cf81 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bbf5871f144746078c47e5f7f9c9b045, user_id=0c122646283745178bf44d800a12cda0, role_id=4084cb6a3aef4dd0a1b5de127e10e805)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:41.232264 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2491/4978] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:41 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:41.234360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9acd-709f-4b6c-b95e-a6bdb162cf81 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:41.236713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.237276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.237727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.259665 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2488/4979] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:40 2022] PUT /identity/v3/projects/bbf5871f144746078c47e5f7f9c9b045/users/0c122646283745178bf44d800a12cda0/roles/4084cb6a3aef4dd0a1b5de127e10e805 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:41.261297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18162df-b560-411e-b485-075fd93a63aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.261720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18162df-b560-411e-b485-075fd93a63aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.261998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18162df-b560-411e-b485-075fd93a63aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.284859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] MFA Rules not processed for user `128380c231ff4989aba83d318d28a01a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:41.287774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:41.313511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c18162df-b560-411e-b485-075fd93a63aa None None] MFA Rules not processed for user `0c122646283745178bf44d800a12cda0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:41.318789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c18162df-b560-411e-b485-075fd93a63aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:41.328056 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2489/4980] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:41 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:41.331593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.333004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.334213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.340966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:41.353237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:41.364582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] MFA Rules not processed for user `0c122646283745178bf44d800a12cda0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:41.369749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:41.421187 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2492/4981] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:41.431922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:41.436142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:41.554473 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2490/4982] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:41 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Oct 29 03:09:41.559413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:41.609706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a88ba-8737-405f-a4ed-fc2f3d9197e6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:41.625442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780a3f0-a6c1-4e1f-a33b-9f3f36e1c156 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:41.630429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a3f0-a6c1-4e1f-a33b-9f3f36e1c156 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.632150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a3f0-a6c1-4e1f-a33b-9f3f36e1c156 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.633432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780a3f0-a6c1-4e1f-a33b-9f3f36e1c156 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.665411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a3f0-a6c1-4e1f-a33b-9f3f36e1c156 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:41.667340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780a3f0-a6c1-4e1f-a33b-9f3f36e1c156 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:41.689632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb605a29-a709-4cc3-8ffe-ed26aafcec96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:41.690383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2493/4983] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:09:41.705452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:41.706658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.706960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.707487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.718492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:41.721172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:41.771078 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2491/4984] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Oct 29 03:09:41 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:41.776290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.776851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.777157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.791626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] MFA Rules not processed for user `0c122646283745178bf44d800a12cda0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:41.793257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:41.952138 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2494/4985] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:41 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 29 03:09:41.956519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:41.974869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e3df0-e4b3-476d-854e-a906d14fffe6 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:41.982967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:41.984444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:41.984617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:41.984829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/roles/4084cb6a3aef4dd0a1b5de127e10e805` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:41.986785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4084cb6a3aef4dd0a1b5de127e10e805)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:41.988395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:42.059173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invalidating the token cache because role 4084cb6a3aef4dd0a1b5de127e10e805 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:42.059812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.061501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6363ad70-15a1-4a0f-a787-16954507b47b tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.064099 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2492/4986] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:41 2022] DELETE /identity/v3/roles/4084cb6a3aef4dd0a1b5de127e10e805 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:42.068339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:42.090371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d940b-8833-4e04-afe2-91791507a0ef None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:42.145351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609f46e-a6e8-4d63-bb84-452263444b2d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.145556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609f46e-a6e8-4d63-bb84-452263444b2d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.145843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609f46e-a6e8-4d63-bb84-452263444b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.188935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b609f46e-a6e8-4d63-bb84-452263444b2d None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:42.190225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b609f46e-a6e8-4d63-bb84-452263444b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:42.250804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:42.254430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.255804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.256331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/bbf5871f144746078c47e5f7f9c9b045` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.259473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbf5871f144746078c47e5f7f9c9b045)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:42.266300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:42.294350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:42.351077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:42.391848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2493/4987] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:42.393406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.393637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.393974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.416619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf5871f144746078c47e5f7f9c9b045', 'request_id': 'req-f3cdc43c-5621-43f2-b656-3218279d38d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.421290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:42.422881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:42.424073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf5871f144746078c47e5f7f9c9b045', 'request_id': 'req-f3cdc43c-5621-43f2-b656-3218279d38d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.427133 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2494/4988] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:42 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:42.428209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:42.432251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:42.439616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf5871f144746078c47e5f7f9c9b045', 'request_id': 'req-f3cdc43c-5621-43f2-b656-3218279d38d3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.467511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] The token cache is being invalidate because project bbf5871f144746078c47e5f7f9c9b045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:42.468030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.469645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f3cdc43c-5621-43f2-b656-3218279d38d3 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:42.472988 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2495/4989] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:42 2022] DELETE /identity/v3/projects/bbf5871f144746078c47e5f7f9c9b045 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:42.477040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.477396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.478057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.523338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:42.524221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:42.601347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac73ce-f879-4dbb-9f54-3cd5ea7f6be5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:42.615727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:42.616747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.617103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.617780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.619940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:42.648679 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2496/4990] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:42.649885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:42.651511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:42.740937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c4e46-b8d6-4b09-a74c-2fbe64e0371a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:42.747708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:42.748287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.748583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.748841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/bbf5871f144746078c47e5f7f9c9b045` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.761328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bbf5871f144746078c47e5f7f9c9b045)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:42.763411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:42.792715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Could not find project: bbf5871f144746078c47e5f7f9c9b045.: keystone.exception.ProjectNotFound: Could not find project: bbf5871f144746078c47e5f7f9c9b045. Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 29 03:09:42.792958 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: bbf5871f144746078c47e5f7f9c9b045. Oct 29 03:09:42.794672 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:42.795345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:42.800068 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2497/4991] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:42 2022] DELETE /identity/v3/projects/bbf5871f144746078c47e5f7f9c9b045 => generated 113 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:42.801361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:42.805378 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2495/4992] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:42.806327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:42.820085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2d6ae-8d79-4b00-aede-cf81d746d1cf service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:42.824417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f05ca6-08bc-42d6-8188-215548a8c44a tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:42.827780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:42.828645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.828927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.829222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/projects/d401ad1adbce43479bd2e5df47d18b9f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.831148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d401ad1adbce43479bd2e5df47d18b9f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:42.833058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:42.835830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:42.836929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:42.837426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:42.844898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:42.915946 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 29 03:09:42.917275 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:42.923415 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2498/4993] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:42 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 188 bytes in 119 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:09:42.925002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:42.940955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4191ec-f63e-437b-82e9-a6f24c3cd6f9 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:42.975945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:42.984344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd401ad1adbce43479bd2e5df47d18b9f', 'request_id': 'req-418966bc-f265-4388-bce5-8c5892f3882e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.003419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd401ad1adbce43479bd2e5df47d18b9f', 'request_id': 'req-418966bc-f265-4388-bce5-8c5892f3882e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.021897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd401ad1adbce43479bd2e5df47d18b9f', 'request_id': 'req-418966bc-f265-4388-bce5-8c5892f3882e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.065660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] The token cache is being invalidate because project d401ad1adbce43479bd2e5df47d18b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:43.066115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.066886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.073304 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2496/4994] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:42 2022] DELETE /identity/v3/projects/d401ad1adbce43479bd2e5df47d18b9f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:43.075691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.077319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:43.097831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.100003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.100298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.100576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.126298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:43.183570 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 29 03:09:43.184642 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.186584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2499/4995] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:42 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 188 bytes in 262 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 29 03:09:43.190379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.192238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:43.212317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db3d3c-13f0-490a-93c3-45ad36920827 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.216432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418966bc-f265-4388-bce5-8c5892f3882e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.218343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.219224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.219666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.220211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.222632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.223453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.223874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.224207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/users/0c122646283745178bf44d800a12cda0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.227157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0c122646283745178bf44d800a12cda0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:43.229491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:43.301437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.318832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2500/4996] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:43 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:43.320983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c122646283745178bf44d800a12cda0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.338980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c122646283745178bf44d800a12cda0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.340289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c122646283745178bf44d800a12cda0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.348499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c122646283745178bf44d800a12cda0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.349394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31c7d69a-7d61-4fab-8dc6-7c2b333e86b1 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c122646283745178bf44d800a12cda0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.372740 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2497/4997] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:43 2022] DELETE /identity/v3/users/0c122646283745178bf44d800a12cda0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:43.377981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.381534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:43.401139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cacea-8bb4-46f7-8346-a36318986f3a tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.436064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe692ad-b124-4039-8248-3e791908601f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.436349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe692ad-b124-4039-8248-3e791908601f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.436620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe692ad-b124-4039-8248-3e791908601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.466218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-efe692ad-b124-4039-8248-3e791908601f None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:43.468066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-efe692ad-b124-4039-8248-3e791908601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:43.471823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.472625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.472921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.473198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/f976f3e01b734e9791a715964e3b91fb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.481705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Could not find domain: f976f3e01b734e9791a715964e3b91fb.: keystone.exception.DomainNotFound: Could not find domain: f976f3e01b734e9791a715964e3b91fb. Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: f976f3e01b734e9791a715964e3b91fb. Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:43.487362 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:43.488556 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: f976f3e01b734e9791a715964e3b91fb. Oct 29 03:09:43.490272 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.491717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2501/4998] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:43 2022] PATCH /identity/v3/domains/f976f3e01b734e9791a715964e3b91fb => generated 112 bytes in 111 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:43.493223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.505457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca9054-1dbd-4603-9792-0ff8a15f68dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.511371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.512457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.512845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.513363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/919a7116ce1a472783c4acac65ed8f81` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.522779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Could not find domain: 919a7116ce1a472783c4acac65ed8f81.: keystone.exception.DomainNotFound: Could not find domain: 919a7116ce1a472783c4acac65ed8f81. Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 919a7116ce1a472783c4acac65ed8f81. Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:43.528811 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:43.530279 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 919a7116ce1a472783c4acac65ed8f81. Oct 29 03:09:43.531553 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.534449 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2502/4999] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:43 2022] PATCH /identity/v3/domains/919a7116ce1a472783c4acac65ed8f81 => generated 112 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:43.538570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.556565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed6cf9-b596-4b0e-a3a2-52d66e6374dd tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.566119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.567069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.567450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.567824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/b06d0744ef3841dea88d6ae04591849b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.576635 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2498/5000] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:43.578866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Could not find domain: b06d0744ef3841dea88d6ae04591849b.: keystone.exception.DomainNotFound: Could not find domain: b06d0744ef3841dea88d6ae04591849b. Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b06d0744ef3841dea88d6ae04591849b. Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:43.585244 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:43.586777 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b06d0744ef3841dea88d6ae04591849b. Oct 29 03:09:43.588040 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:09:43.589650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2503/5001] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:43 2022] PATCH /identity/v3/domains/b06d0744ef3841dea88d6ae04591849b => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:43.591667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe692ad-b124-4039-8248-3e791908601f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.599253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.607386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe692ad-b124-4039-8248-3e791908601f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.608366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:43.613492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7236cfd62a4040a688e3024639469c2c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'abb333d90d5c425cafe4739b3e16a734', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.614115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.614495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.614878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] PATH_INFO: `/v3/domains/90c6d1f1ba45430cb734443a2754c9a2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.628150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Could not find domain: 90c6d1f1ba45430cb734443a2754c9a2.: keystone.exception.DomainNotFound: Could not find domain: 90c6d1f1ba45430cb734443a2754c9a2. Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 90c6d1f1ba45430cb734443a2754c9a2. Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:09:43.636299 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:09:43.637675 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 90c6d1f1ba45430cb734443a2754c9a2. Oct 29 03:09:43.638944 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:09:43.643200 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2499/5002] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:09:43 2022] PATCH /identity/v3/domains/90c6d1f1ba45430cb734443a2754c9a2 => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:09:43.644058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:43.650460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:43.702781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:43.710115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:43.739087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51ab35-87bb-4dce-a9c1-70465b7b4259 tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.746073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c75f9-75f1-4430-a1c8-52791e079a8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.746824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c75f9-75f1-4430-a1c8-52791e079a8b service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.747130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c75f9-75f1-4430-a1c8-52791e079a8b service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.747391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c75f9-75f1-4430-a1c8-52791e079a8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.760177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c75f9-75f1-4430-a1c8-52791e079a8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:43.762478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c75f9-75f1-4430-a1c8-52791e079a8b service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:43.772810 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2504/5003] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:43.777342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9798958-6021-4c7e-b166-36be10ae957e tempest-TokensV3TestJSON-1401524512 tempest-TokensV3TestJSON-1401524512-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:43.784222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:43.785069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.785509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.786003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] PATH_INFO: `/v3/users/e1ab77e1ec5b41c5b2fe6cef093541a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.787968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ab77e1ec5b41c5b2fe6cef093541a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:43.791556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:43.873045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ab77e1ec5b41c5b2fe6cef093541a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.887787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ab77e1ec5b41c5b2fe6cef093541a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.888844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ab77e1ec5b41c5b2fe6cef093541a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.897260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ab77e1ec5b41c5b2fe6cef093541a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.898365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ab77e1ec5b41c5b2fe6cef093541a8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:43.928670 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2500/5004] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:43 2022] DELETE /identity/v3/users/e1ab77e1ec5b41c5b2fe6cef093541a8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:43.931351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508920a1-3ab8-4e22-b090-c47c7d30b667 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:43.931911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508920a1-3ab8-4e22-b090-c47c7d30b667 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:43.935558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508920a1-3ab8-4e22-b090-c47c7d30b667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:43.966716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-508920a1-3ab8-4e22-b090-c47c7d30b667 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:43.968321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-508920a1-3ab8-4e22-b090-c47c7d30b667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.083546 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2505/5005] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:44.093541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:44.095017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.289676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791603a-3876-42d7-b182-f413da2f5558 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:44.300206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577cf39-b14c-41b0-905f-544108d2c157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:44.300854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577cf39-b14c-41b0-905f-544108d2c157 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.301134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577cf39-b14c-41b0-905f-544108d2c157 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.303332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577cf39-b14c-41b0-905f-544108d2c157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.325143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ca7f-23b9-4581-8d28-16c3ad471295 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.325595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ca7f-23b9-4581-8d28-16c3ad471295 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.325902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33ca7f-23b9-4581-8d28-16c3ad471295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.326193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577cf39-b14c-41b0-905f-544108d2c157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:44.332048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577cf39-b14c-41b0-905f-544108d2c157 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:44.358245 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2501/5006] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:44.366737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9c33ca7f-23b9-4581-8d28-16c3ad471295 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:44.368854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c33ca7f-23b9-4581-8d28-16c3ad471295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.373499 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2506/5007] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:44 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:44.378107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.379209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.380427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.391167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.392182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.394066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.414204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:44.415454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.417290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:44.418581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.521733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:44.547447 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2502/5008] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:44.552765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:44.563617 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2507/5009] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:44.565968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21637b69-b675-46c1-b614-07b3280ce2a5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:44.572167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:44.573931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.574052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.574557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.581606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:44.583216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.744591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:44.759978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2503/5010] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:44 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:44.792954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73796c8c-85a4-40f3-a41e-fd52b15791a8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:44.803304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:44.803610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.803818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.804117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.831324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:44.833364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:44.845992 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2508/5011] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:44.898982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:44.900808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:44.921362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d778ca-624d-4d41-a058-22e600a738e1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:44.926083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:44.926733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:44.927011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:44.927299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] PATH_INFO: `/v3/projects/665d64ba17ab4d2aaa27f56517475b82` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:44.929430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=665d64ba17ab4d2aaa27f56517475b82)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:44.931461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:45.000737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665d64ba17ab4d2aaa27f56517475b82', 'request_id': 'req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.008097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665d64ba17ab4d2aaa27f56517475b82', 'request_id': 'req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.014831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665d64ba17ab4d2aaa27f56517475b82', 'request_id': 'req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.032596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] The token cache is being invalidate because project 665d64ba17ab4d2aaa27f56517475b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:45.032891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.033855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cc24b1d8-71d9-4e3a-badd-409e3206ed6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.035626 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2504/5012] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:44 2022] DELETE /identity/v3/projects/665d64ba17ab4d2aaa27f56517475b82 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:45.039775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:45.050646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b4b5a-b556-4b90-8e39-9435805c2a60 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:45.052823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.053297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.053748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.060878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:45.075541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:45.076758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.115128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:45.115807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.116083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.116351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] PATH_INFO: `/v3/users/7236cfd62a4040a688e3024639469c2c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.118088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7236cfd62a4040a688e3024639469c2c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:45.120033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:45.140828 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2505/5013] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:45.154252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:45.156091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.172642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7236cfd62a4040a688e3024639469c2c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.189248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7236cfd62a4040a688e3024639469c2c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.190058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7236cfd62a4040a688e3024639469c2c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.198401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7236cfd62a4040a688e3024639469c2c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.199246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7236cfd62a4040a688e3024639469c2c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.225785 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2509/5014] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:45 2022] DELETE /identity/v3/users/7236cfd62a4040a688e3024639469c2c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:45.234360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:45.265333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe5ef5-9abd-48ee-86b7-e69b8d3debdd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:45.360148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:45.360951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.361229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.361502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.369040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.450138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:45.451935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:45.460205 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2506/5015] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:09:45.550156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:45.559127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.626519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2106d8-2319-4211-b7b9-d437d3291645 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:45.631149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:45.631915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.632192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.632490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] PATH_INFO: `/v3/projects/abb333d90d5c425cafe4739b3e16a734` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.633724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb333d90d5c425cafe4739b3e16a734)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:45.635654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:45.676669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:45.693036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb333d90d5c425cafe4739b3e16a734', 'request_id': 'req-9d564c92-2c8b-4dd1-8585-f0418fceafeb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.703738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb333d90d5c425cafe4739b3e16a734', 'request_id': 'req-9d564c92-2c8b-4dd1-8585-f0418fceafeb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.712455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb333d90d5c425cafe4739b3e16a734', 'request_id': 'req-9d564c92-2c8b-4dd1-8585-f0418fceafeb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.728884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] The token cache is being invalidate because project abb333d90d5c425cafe4739b3e16a734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:45.729102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.734052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9d564c92-2c8b-4dd1-8585-f0418fceafeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.738053 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2510/5016] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:45 2022] DELETE /identity/v3/projects/abb333d90d5c425cafe4739b3e16a734 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:45.739642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:45.757890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d39657a-de07-4bc2-99b1-2b73da2ea519 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:45.765447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985f124-c262-4e42-b070-44d49f06a591 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.766371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985f124-c262-4e42-b070-44d49f06a591 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.767187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985f124-c262-4e42-b070-44d49f06a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.792468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8985f124-c262-4e42-b070-44d49f06a591 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:45.794824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8985f124-c262-4e42-b070-44d49f06a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.800180 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2511/5017] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:45 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 03:09:45.805126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7b689-f4bd-4c59-96ae-e2ada495ef81 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.807021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7b689-f4bd-4c59-96ae-e2ada495ef81 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.807311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7b689-f4bd-4c59-96ae-e2ada495ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.834987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:45.835940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.836841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.836841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] PATH_INFO: `/v3/users/65e500d9a6cb4e3c8967ef653fedb142` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.838032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e500d9a6cb4e3c8967ef653fedb142)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:45.840607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a2d7b689-f4bd-4c59-96ae-e2ada495ef81 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:45.840750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:45.842494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2d7b689-f4bd-4c59-96ae-e2ada495ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.899089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:45.914297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.932628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.933583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.941181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2512/5018] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:45.943209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:45.943564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:45.943962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:45.944938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.945974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e500d9a6cb4e3c8967ef653fedb142'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:45.968815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:45.970212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:45.984867 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2507/5019] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:45 2022] DELETE /identity/v3/users/65e500d9a6cb4e3c8967ef653fedb142 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:45.986350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:45.989524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.068312 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2513/5020] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:09:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:46.076864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e161ba9-8907-43c4-b0dd-cfc5a8ffc6cd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.083573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.084713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.085202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.085832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.088439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.091927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.141831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:46.157790 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2508/5021] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:45 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:46.186638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a108048-2f0e-45e1-aba0-3bf10c521a5a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.192089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:46.300425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ff3fc-e4aa-434f-bffc-f30ec56ba300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.301505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff3fc-e4aa-434f-bffc-f30ec56ba300 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.302045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff3fc-e4aa-434f-bffc-f30ec56ba300 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.302504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff3fc-e4aa-434f-bffc-f30ec56ba300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.362944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ff3fc-e4aa-434f-bffc-f30ec56ba300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.364559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ff3fc-e4aa-434f-bffc-f30ec56ba300 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.369022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.370875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.375631 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2514/5022] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:46.453863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbe6e3-1149-4ec4-bef8-2c6593e69ad1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.460539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.461841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.461841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.462103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] PATH_INFO: `/v3/projects/d731509d18174091b98037e6a878a001` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.463229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d731509d18174091b98037e6a878a001)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.465168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.508216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:46.525264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd731509d18174091b98037e6a878a001', 'request_id': 'req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:46.535869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd731509d18174091b98037e6a878a001', 'request_id': 'req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:46.545854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd731509d18174091b98037e6a878a001', 'request_id': 'req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:46.568913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] The token cache is being invalidate because project d731509d18174091b98037e6a878a001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:46.569203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:46.570023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc2b7a47-d8b2-4c99-bd50-bf15a4b2a713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:46.571903 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2509/5023] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:46 2022] DELETE /identity/v3/projects/d731509d18174091b98037e6a878a001 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:46.582178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9b98-4a5f-4957-be74-1b82c4623438 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.582490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9b98-4a5f-4957-be74-1b82c4623438 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.582761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b9b98-4a5f-4957-be74-1b82c4623438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.598892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.599185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.599603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.613175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-773b9b98-4a5f-4957-be74-1b82c4623438 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:46.614456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-773b9b98-4a5f-4957-be74-1b82c4623438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.622783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:46.624502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.679686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2515/5024] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:46.686269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2510/5025] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:09:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:46.688093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.688561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.689032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.698699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.700275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.710658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:46.712277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.720684 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2516/5026] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:46.724810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.736460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1774200-5da2-4ef1-b024-170b77e8d2d3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.741757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.742768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.743085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.743390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.744143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:46.744447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.746161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.759815 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2517/5027] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:09:46.764208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.775579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f065bc-c9bf-4af5-9467-5ef8ffbf5cf0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.780344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.780908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.781181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.781449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.782184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.784081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.788720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adcd792-b8e4-40d7-8982-40b8fe06386a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.796816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.798530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.798928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.799301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.811239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.812971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.817591 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2518/5028] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:46 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:46.818585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.823176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2511/5029] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:09:46.833356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:46.909253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8187d468-5b01-403d-a933-7a0506cba3de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.920130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.920901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.921278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.921616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.922389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.924568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.950232 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2519/5030] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:46 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:46.955188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.967206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de886b5f-ffe5-49a4-9c36-3374098a6226 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.973050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.974468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.974840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:46.975306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.975693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.976147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.977471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.979230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:46.988833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d58e5c-73da-4d12-b9a9-a2ea8e538aee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:46.993836 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2512/5031] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:46.994348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:46.995082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:46.995365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:46.995642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] PATH_INFO: `/v3/users/128380c231ff4989aba83d318d28a01a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:46.996278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:46.996793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=128380c231ff4989aba83d318d28a01a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:46.998775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.008043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7499f-eda7-48fa-9492-55d83054e144 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.013520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.014381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.014764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.015184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.016056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.017724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.029592 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2513/5032] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:47.033656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.052504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06534b0-f4ca-47ae-afcb-f4faebbe6dd4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.066075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b3d7c-d574-4654-9551-6a0c3be3e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.066825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3d7c-d574-4654-9551-6a0c3be3e1a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.067109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3d7c-d574-4654-9551-6a0c3be3e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.067388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b3d7c-d574-4654-9551-6a0c3be3e1a8 admin admin] PATH_INFO: `/v3/projects/cdab3a483f134216ab30c2b303321a9f/users/a5836afe2b794a4d97555da3ea08ec2c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.068026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128380c231ff4989aba83d318d28a01a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.082121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128380c231ff4989aba83d318d28a01a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.086479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128380c231ff4989aba83d318d28a01a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.090917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3d7c-d574-4654-9551-6a0c3be3e1a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdab3a483f134216ab30c2b303321a9f, user_id=a5836afe2b794a4d97555da3ea08ec2c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.094154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b3d7c-d574-4654-9551-6a0c3be3e1a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.097209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128380c231ff4989aba83d318d28a01a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.098482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b424778-20e2-45ce-a87e-b9a7c6df5b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128380c231ff4989aba83d318d28a01a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.110558 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2514/5033] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:47 2022] PUT /identity/v3/projects/cdab3a483f134216ab30c2b303321a9f/users/a5836afe2b794a4d97555da3ea08ec2c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:47.122532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.122862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.123140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.124909 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2520/5034] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:46 2022] DELETE /identity/v3/users/128380c231ff4989aba83d318d28a01a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:47.129461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2035f-3273-4c59-8b2a-7d75f4bd1c9c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.129836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2035f-3273-4c59-8b2a-7d75f4bd1c9c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.130078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2035f-3273-4c59-8b2a-7d75f4bd1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.141217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:47.152291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e6c2035f-3273-4c59-8b2a-7d75f4bd1c9c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:47.153560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6c2035f-3273-4c59-8b2a-7d75f4bd1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.162955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] MFA Rules not processed for user `a5836afe2b794a4d97555da3ea08ec2c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:47.164177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.225870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2521/5035] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:47.227546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259626-0519-426c-a461-3a8284633d78 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.228019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259626-0519-426c-a461-3a8284633d78 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.228301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3259626-0519-426c-a461-3a8284633d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.239937 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2515/5036] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:47.241783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.243868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.252835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c3259626-0519-426c-a461-3a8284633d78 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:47.254061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3259626-0519-426c-a461-3a8284633d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.257777 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2522/5037] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:47.258426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3259626-0519-426c-a461-3a8284633d78 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.259657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3259626-0519-426c-a461-3a8284633d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.270397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:47.275260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3259626-0519-426c-a461-3a8284633d78 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.287894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00484e0-f7be-4e93-9421-289941e0fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.289528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484e0-f7be-4e93-9421-289941e0fb94 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.289827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484e0-f7be-4e93-9421-289941e0fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.290209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00484e0-f7be-4e93-9421-289941e0fb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.290766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00484e0-f7be-4e93-9421-289941e0fb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.293426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00484e0-f7be-4e93-9421-289941e0fb94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.318488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec9d27-c42e-40f6-b4ee-ab89bfa4de16 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.322510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.323120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.323433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.323713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.329721 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2523/5038] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:47.329721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.330042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.330130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.333327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.334889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.345506 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2516/5039] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:47.346290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.351740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:47.353394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.357974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510772f2-8cd7-4128-a696-450a16bffbca service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.424337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2524/5040] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:47.428388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.436325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.437256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.437741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.438259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.439073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.441462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.441693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38874c46-5276-4233-9d8e-d4e6b43817de None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.449041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.450204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.450204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.450689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.477163 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2517/5041] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:47.480248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.493747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91714d00-7115-4cc6-9834-b4aecd8d9a0f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.499237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.500099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.500496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.501297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.501587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.503570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.516296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.517848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2518/5042] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:47.521989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.538500 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2525/5043] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:47.539063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ff07a-5239-42ce-a68c-c8ee72b4ed71 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.548078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce70d3-979d-444f-9b0c-86b89bf80c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.549273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce70d3-979d-444f-9b0c-86b89bf80c79 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.549836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce70d3-979d-444f-9b0c-86b89bf80c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.550266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce70d3-979d-444f-9b0c-86b89bf80c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.551166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce70d3-979d-444f-9b0c-86b89bf80c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.554131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce70d3-979d-444f-9b0c-86b89bf80c79 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.567275 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2519/5044] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:47.571547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.585587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07af518-e1f5-494b-84a0-0e45da5b4c19 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.590783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.591467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.591741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.592017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] PATH_INFO: `/v3/projects/3a729ad7b63e47e39f2ee69874d305c1/users/dae23da2a56642a9a08e622ac3b7069d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.608434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a729ad7b63e47e39f2ee69874d305c1, user_id=dae23da2a56642a9a08e622ac3b7069d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.611301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.629869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2526/5045] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:47 2022] PUT /identity/v3/projects/3a729ad7b63e47e39f2ee69874d305c1/users/dae23da2a56642a9a08e622ac3b7069d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:47.641883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823005-dfde-4616-a856-f022685afaee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.642421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823005-dfde-4616-a856-f022685afaee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.642895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823005-dfde-4616-a856-f022685afaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.658138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:47.677284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-81823005-dfde-4616-a856-f022685afaee None None] MFA Rules not processed for user `dae23da2a56642a9a08e622ac3b7069d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:47.678839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-81823005-dfde-4616-a856-f022685afaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.747429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.750614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.764947 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2520/5046] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:47.779687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823005-dfde-4616-a856-f022685afaee None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:47.781404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-81823005-dfde-4616-a856-f022685afaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:47.839795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6225e-b7b7-48b6-8f39-b955fa4ba4e5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.846514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.847567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.847567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.847918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] PATH_INFO: `/v3/projects/a952bda7f7214b5c945d9dd80ab2eee7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.849377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a952bda7f7214b5c945d9dd80ab2eee7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.850958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823005-dfde-4616-a856-f022685afaee None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:47.852398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.855948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c498cc-e5e2-4442-82d0-35e3f2fcd66a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:47.856572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c498cc-e5e2-4442-82d0-35e3f2fcd66a service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.856855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c498cc-e5e2-4442-82d0-35e3f2fcd66a service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.857130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c498cc-e5e2-4442-82d0-35e3f2fcd66a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.894026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:47.914301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a952bda7f7214b5c945d9dd80ab2eee7', 'request_id': 'req-ccc6f374-e01a-402a-adbb-0d015ab211e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.921130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a952bda7f7214b5c945d9dd80ab2eee7', 'request_id': 'req-ccc6f374-e01a-402a-adbb-0d015ab211e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.925000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c498cc-e5e2-4442-82d0-35e3f2fcd66a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:47.926592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c498cc-e5e2-4442-82d0-35e3f2fcd66a service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:47.927388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a952bda7f7214b5c945d9dd80ab2eee7', 'request_id': 'req-ccc6f374-e01a-402a-adbb-0d015ab211e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.940212 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2521/5047] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:09:47.943822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] The token cache is being invalidate because project a952bda7f7214b5c945d9dd80ab2eee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:47.944191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.945029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ccc6f374-e01a-402a-adbb-0d015ab211e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:47.949867 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2527/5048] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:47 2022] DELETE /identity/v3/projects/a952bda7f7214b5c945d9dd80ab2eee7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:47.952138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:47.953075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:47.953075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:47.974232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:47.975725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:48.030693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:48.051172 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2522/5049] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:48.059770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.060328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.060688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.098593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:48.101329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:48.115614 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2528/5050] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:48.121463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.131233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.132570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:48.136333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744f5ed-a9fb-4370-96fc-2260868e587c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.142000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.142764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.143147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.143978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.144409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:48.144777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.147309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.172298 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2523/5051] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:48.178899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.194578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec4df85-db98-42e9-8edd-32da341e05eb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.200445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.201506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.201998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.202453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.203257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.206156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.262731 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2524/5052] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:48 2022] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:48.263854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.264604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ff3bd-c293-4da2-832c-600f738e65e3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.411532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.414631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.415033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.416058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.419632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:48.446875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e4638-2c69-4d99-884d-68a8d377c399 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.456002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.458296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.458921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.459210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.459859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.463833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.498014 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2525/5053] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:48 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:48.502936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.509710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.511998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af165af2-1717-4336-9873-2b87af8e445e service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.517398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710d73-fea9-4fcf-901c-256394445acc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.523838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.525513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.525825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.526113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.527001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.528628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.529541 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2529/5054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:09:48.545756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038591d-eba0-450f-8291-ee645c208807 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.546097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038591d-eba0-450f-8291-ee645c208807 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.546330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038591d-eba0-450f-8291-ee645c208807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.551321 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2526/5055] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:48.553345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.574828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776d00f-a920-44a9-9291-144725ce3c33 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.591253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8038591d-eba0-450f-8291-ee645c208807 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:48.593076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8038591d-eba0-450f-8291-ee645c208807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:48.595747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc0fcb-dd9d-4ee3-94bb-79a495ff3622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.597333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0fcb-dd9d-4ee3-94bb-79a495ff3622 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.598048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0fcb-dd9d-4ee3-94bb-79a495ff3622 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.599383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0fcb-dd9d-4ee3-94bb-79a495ff3622 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.600283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc0fcb-dd9d-4ee3-94bb-79a495ff3622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.602971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc0fcb-dd9d-4ee3-94bb-79a495ff3622 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.608104 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2530/5056] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:48 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 03:09:48.630987 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2527/5057] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:48.631574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038591d-eba0-450f-8291-ee645c208807 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:48.646202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038591d-eba0-450f-8291-ee645c208807 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:48.652904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:48.653606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.653934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.654287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] PATH_INFO: `/v3/projects/95063d767e504841a0c13a436c31c0da/users/a43014422b59488dafc7037e9247bce8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.670507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:48.685990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=95063d767e504841a0c13a436c31c0da, user_id=a43014422b59488dafc7037e9247bce8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:48.692768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:48.730594 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2531/5058] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:48 2022] PUT /identity/v3/projects/95063d767e504841a0c13a436c31c0da/users/a43014422b59488dafc7037e9247bce8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:09:48.741686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:48.743375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:48.743806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:48.795663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] MFA Rules not processed for user `a43014422b59488dafc7037e9247bce8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:48.797017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:48.932867 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2528/5059] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:48.933546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:49.133330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd597b-a6be-4bfd-8f03-7afc17971c2a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:49.142597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3779cf75-fcf1-4261-af1d-bb6bdfb0b84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:49.145650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779cf75-fcf1-4261-af1d-bb6bdfb0b84e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.146823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779cf75-fcf1-4261-af1d-bb6bdfb0b84e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.146823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3779cf75-fcf1-4261-af1d-bb6bdfb0b84e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.147582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779cf75-fcf1-4261-af1d-bb6bdfb0b84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:49.151666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3779cf75-fcf1-4261-af1d-bb6bdfb0b84e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:49.239261 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2532/5060] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:48 2022] POST /identity/v3/projects => generated 391 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:49.246766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:49.266918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d794bc-28bf-45f7-99ef-9d34c6d09f5a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:49.302161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:49.346008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.346649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.347655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.386480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:49.387787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:49.426862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:49.428047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.428423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.428790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.429625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:49.433251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:49.479953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2529/5061] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:49 2022] POST /identity/v3/users => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:49.481110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:49.484375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:49.509287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b600412-2c86-4f31-9ef2-081da0b8518f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:49.522295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:49.523360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.523820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.524259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] PATH_INFO: `/v3/users/a5836afe2b794a4d97555da3ea08ec2c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.524713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2533/5062] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:09:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:49.526544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:49.526895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5836afe2b794a4d97555da3ea08ec2c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:49.529144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:49.552046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8cc81-22df-4aa6-8927-755ad66d01b9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:49.587536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:49.588195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.588480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.588751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.589417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:49.591136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:49.604503 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2534/5063] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:49.605388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:49.612481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:49.678068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5836afe2b794a4d97555da3ea08ec2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:49.705573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5836afe2b794a4d97555da3ea08ec2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:49.708385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5836afe2b794a4d97555da3ea08ec2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:49.723264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5836afe2b794a4d97555da3ea08ec2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:49.724767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5836afe2b794a4d97555da3ea08ec2c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:49.755391 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2530/5064] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:49 2022] DELETE /identity/v3/users/a5836afe2b794a4d97555da3ea08ec2c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:49.757949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:49.760291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:49.790622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86340a24-f0f9-4bb0-8740-700013751fb6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:49.813856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:49.911605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786ff49-a939-46b6-83a2-dd4c96abd802 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:49.918928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4a541-c4aa-41a6-a05e-2aece09da486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:49.919777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4a541-c4aa-41a6-a05e-2aece09da486 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.920064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4a541-c4aa-41a6-a05e-2aece09da486 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.921418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4a541-c4aa-41a6-a05e-2aece09da486 admin admin] PATH_INFO: `/v3/projects/51811555679241beb1491982170b2f46/users/7c3ac2f4357a45969c2aba509b5172af/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.924489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:49.925115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:49.925390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:49.925665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:49.927598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:49.958896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4a541-c4aa-41a6-a05e-2aece09da486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51811555679241beb1491982170b2f46, user_id=7c3ac2f4357a45969c2aba509b5172af, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:49.966313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4a541-c4aa-41a6-a05e-2aece09da486 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:49.980952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:49.991251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2531/5065] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:49 2022] PUT /identity/v3/projects/51811555679241beb1491982170b2f46/users/7c3ac2f4357a45969c2aba509b5172af/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:49.993534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.001330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.001330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.009725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:50.011373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27096f1-ed4e-4651-8aa1-7450f31e3189 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:50.021208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2535/5066] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:09:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:09:50.022593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5b22-8f0e-475d-88cb-b66278c2f656 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.023318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5b22-8f0e-475d-88cb-b66278c2f656 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.023874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d5b22-8f0e-475d-88cb-b66278c2f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.038404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:50.039450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:50.064895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-728d5b22-8f0e-475d-88cb-b66278c2f656 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:50.066961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-728d5b22-8f0e-475d-88cb-b66278c2f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:50.208996 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2532/5067] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:50.210557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:50.222604 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2536/5068] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:50.224044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.224459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.224826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.251529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df6471-877b-46af-bfdf-467eb6cd577f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:50.254554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:50.256066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:50.259955 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2537/5069] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:50 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:09:50.261009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846d1e0-3917-4242-af74-b5a47035ca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:50.261161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:50.262114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d1e0-3917-4242-af74-b5a47035ca14 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.262553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d1e0-3917-4242-af74-b5a47035ca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.263003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846d1e0-3917-4242-af74-b5a47035ca14 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.263289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:50.264558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d1e0-3917-4242-af74-b5a47035ca14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:50.266668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846d1e0-3917-4242-af74-b5a47035ca14 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:50.289757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2533/5070] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:50.291489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60fb22-5ebf-420c-b520-d0425247f09a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.292145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60fb22-5ebf-420c-b520-d0425247f09a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.292627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf60fb22-5ebf-420c-b520-d0425247f09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.335131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:50.342433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767c9a2-a3ff-4364-89c4-7cf395ed7c7b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:50.347964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c1bfb-995f-41a6-a3d2-7a3e48e00f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:50.348858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c1bfb-995f-41a6-a3d2-7a3e48e00f7d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.349208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c1bfb-995f-41a6-a3d2-7a3e48e00f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.349624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c1bfb-995f-41a6-a3d2-7a3e48e00f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.375746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c1bfb-995f-41a6-a3d2-7a3e48e00f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:50.377708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c1bfb-995f-41a6-a3d2-7a3e48e00f7d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:50.400790 n-d-862964-4 devstack@keystone.service[82079]: WARNING keystone.server.flask.application [None req-cf60fb22-5ebf-420c-b520-d0425247f09a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 29 03:09:50.403150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2534/5072] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 112 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 29 03:09:50.403360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2538/5072] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:50.404326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60fb22-5ebf-420c-b520-d0425247f09a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:50.408216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e9a67-4691-4b1d-a19f-40502f7edbba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.408664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e9a67-4691-4b1d-a19f-40502f7edbba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.409041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e9a67-4691-4b1d-a19f-40502f7edbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.430821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf60fb22-5ebf-420c-b520-d0425247f09a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:50.442601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d8826-4b7d-4490-93bd-078ded8255c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:50.444176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d8826-4b7d-4490-93bd-078ded8255c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.444611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d8826-4b7d-4490-93bd-078ded8255c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.445866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d8826-4b7d-4490-93bd-078ded8255c9 admin admin] PATH_INFO: `/v3/projects/51811555679241beb1491982170b2f46/users/7c3ac2f4357a45969c2aba509b5172af/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.448668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d8826-4b7d-4490-93bd-078ded8255c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51811555679241beb1491982170b2f46, user_id=7c3ac2f4357a45969c2aba509b5172af, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:50.455014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d8826-4b7d-4490-93bd-078ded8255c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:50.484678 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2535/5073] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:50 2022] PUT /identity/v3/projects/51811555679241beb1491982170b2f46/users/7c3ac2f4357a45969c2aba509b5172af/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:50.498902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.499272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.499481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.532925 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-473e9a67-4691-4b1d-a19f-40502f7edbba None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 29 03:09:50.535019 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2539/5074] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 128 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 29 03:09:50.541702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f51f1-10f3-41a7-8173-945a2a3d7081 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.542232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f51f1-10f3-41a7-8173-945a2a3d7081 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.542673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f51f1-10f3-41a7-8173-945a2a3d7081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.571962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] MFA Rules not processed for user `7c3ac2f4357a45969c2aba509b5172af`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:50.575253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:50.601048 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-612f51f1-10f3-41a7-8173-945a2a3d7081 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 29 03:09:50.604896 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2540/5075] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 63 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 29 03:09:50.738287 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2536/5076] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:50.754015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f51f1-10f3-41a7-8173-945a2a3d7081 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:50.860160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f51f1-10f3-41a7-8173-945a2a3d7081 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:50.867713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:50.869614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:50.869771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:50.871774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:50.877599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:51.018380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:51.019939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:51.032182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2541/5077] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:51.337244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:51.339055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:51.469593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:51.513471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa3b7-a2bd-4da1-9ad2-dafa421f5c21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:51.520884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:51.521615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:51.521927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:51.522346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] PATH_INFO: `/v3/projects/cdab3a483f134216ab30c2b303321a9f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:51.523618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdab3a483f134216ab30c2b303321a9f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:51.526638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:51.645488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdab3a483f134216ab30c2b303321a9f', 'request_id': 'req-03ed1da0-b733-43ae-95af-94151f26cfd4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.656395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdab3a483f134216ab30c2b303321a9f', 'request_id': 'req-03ed1da0-b733-43ae-95af-94151f26cfd4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.665431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdab3a483f134216ab30c2b303321a9f', 'request_id': 'req-03ed1da0-b733-43ae-95af-94151f26cfd4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.691611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] The token cache is being invalidate because project cdab3a483f134216ab30c2b303321a9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:51.695191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.697268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.704362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:51.705984 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2537/5078] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:51 2022] DELETE /identity/v3/projects/cdab3a483f134216ab30c2b303321a9f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:51.723417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e31eb-2eb0-44f4-91a3-e658efe0a585 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:51.871447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:51.872116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:51.872393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:51.872662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] PATH_INFO: `/v3/users/dae23da2a56642a9a08e622ac3b7069d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:51.878687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=dae23da2a56642a9a08e622ac3b7069d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:51.880643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:51.916923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:51.975496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dae23da2a56642a9a08e622ac3b7069d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.990210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dae23da2a56642a9a08e622ac3b7069d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:51.991196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dae23da2a56642a9a08e622ac3b7069d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:52.003228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dae23da2a56642a9a08e622ac3b7069d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:52.004473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8483afda-2dbb-434e-93dc-3300e48e90ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dae23da2a56642a9a08e622ac3b7069d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:52.044124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2542/5079] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:51 2022] DELETE /identity/v3/users/dae23da2a56642a9a08e622ac3b7069d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:52.994722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:52.996982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:53.015995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1da0-b733-43ae-95af-94151f26cfd4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:53.157336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:53.158273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.158719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.159087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] PATH_INFO: `/v3/projects/3a729ad7b63e47e39f2ee69874d305c1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.165203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a729ad7b63e47e39f2ee69874d305c1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:53.168366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:53.237921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a729ad7b63e47e39f2ee69874d305c1', 'request_id': 'req-42f3445d-b825-4ccc-91ab-623db4ff7679'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:53.252949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a729ad7b63e47e39f2ee69874d305c1', 'request_id': 'req-42f3445d-b825-4ccc-91ab-623db4ff7679'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:53.262789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a729ad7b63e47e39f2ee69874d305c1', 'request_id': 'req-42f3445d-b825-4ccc-91ab-623db4ff7679'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:53.281344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] The token cache is being invalidate because project 3a729ad7b63e47e39f2ee69874d305c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:53.292615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:53.294242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-42f3445d-b825-4ccc-91ab-623db4ff7679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:53.300524 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2538/5080] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:52 2022] DELETE /identity/v3/projects/3a729ad7b63e47e39f2ee69874d305c1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:53.308076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.309426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.310574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.334866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:53.337074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:53.426178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2543/5081] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:53.430930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.431299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.431679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.441788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:53.481429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:53.481429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:53.629900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:53.678242 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2539/5082] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:09:53.678370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed1320-76ba-47be-85e5-376c91716d95 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:53.678370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:53.678370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.678370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.678728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.678728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:53.678728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:53.678728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:53.696811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:53.706729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b53e94-d760-4bfd-b671-bab2766a1d49 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:53.716832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2544/5083] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:53.725206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:53.725888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.726216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.726610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.727486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:53.729158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:53.778245 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2540/5084] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:53 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:53.782575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:53.794872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33520418-845d-4ad0-8193-cb48ee14cd71 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:53.902203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:53.903252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.903639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.904004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.904976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:53.907479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:53.963976 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2545/5085] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:53 2022] POST /identity/v3/users => generated 283 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:53.968112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:53.981229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff6bd-9359-4f52-b097-e634d861b02f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:53.991503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:53.992940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:53.993917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:53.993917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:53.994510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:53.996878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:54.022015 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2541/5086] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:09:54.023063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:54.036975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8a58b-a0d0-4033-b8d4-542d69cacbf7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:54.042970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc01f27f-207d-462f-86a4-87f2cd4e30ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:54.043848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f27f-207d-462f-86a4-87f2cd4e30ab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:54.044368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f27f-207d-462f-86a4-87f2cd4e30ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:54.044825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc01f27f-207d-462f-86a4-87f2cd4e30ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:54.045645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01f27f-207d-462f-86a4-87f2cd4e30ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:54.047723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc01f27f-207d-462f-86a4-87f2cd4e30ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:54.056351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:54.069140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:54.070082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2546/5087] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:09:54.109408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728ba8e-abaf-4486-b8ea-457903fd3c43 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:54.130836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:54.131845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:54.132332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:54.132817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] PATH_INFO: `/v3/projects/6d5728b69a354912a1f3669706936093/users/10df0225ae7940e2b4eaa6d717cbee95/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:54.178125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5728b69a354912a1f3669706936093, user_id=10df0225ae7940e2b4eaa6d717cbee95, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:54.182085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:54.213037 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2542/5088] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:54 2022] PUT /identity/v3/projects/6d5728b69a354912a1f3669706936093/users/10df0225ae7940e2b4eaa6d717cbee95/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:54.225265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:54.225548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:54.225841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:54.274804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] MFA Rules not processed for user `10df0225ae7940e2b4eaa6d717cbee95`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:54.276160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:54.424048 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2547/5089] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:54.435395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:54.437232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:54.583298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c43259-ca91-479f-925a-c2b26bfc934e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:54.591830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e1b95-81a6-4347-bf88-138c9f067097 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:54.594254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1b95-81a6-4347-bf88-138c9f067097 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:54.594811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1b95-81a6-4347-bf88-138c9f067097 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:54.596965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e1b95-81a6-4347-bf88-138c9f067097 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:54.625334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e1b95-81a6-4347-bf88-138c9f067097 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:54.628896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e1b95-81a6-4347-bf88-138c9f067097 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:54.669351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2543/5090] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:55.374866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:55.574289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b624e8-a8cf-48de-9a9d-f9d0da7e811e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:55.595370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:55.596067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:55.596347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:55.596624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] PATH_INFO: `/v3/users/10df0225ae7940e2b4eaa6d717cbee95` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:55.597937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10df0225ae7940e2b4eaa6d717cbee95)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:55.600042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:55.705271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10df0225ae7940e2b4eaa6d717cbee95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:55.723385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10df0225ae7940e2b4eaa6d717cbee95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:55.725240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10df0225ae7940e2b4eaa6d717cbee95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:55.741844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10df0225ae7940e2b4eaa6d717cbee95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:55.744376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10df0225ae7940e2b4eaa6d717cbee95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:55.791957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2548/5091] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:09:55 2022] DELETE /identity/v3/users/10df0225ae7940e2b4eaa6d717cbee95 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:55.798169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:55.798733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:55.798733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:55.831083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:55.841677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:56.041660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2544/5092] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:56.058398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:56.059881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:56.078181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:56.207250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb5af3-6ff9-42eb-b1fa-c85abd46f30e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:56.220156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:56.222943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:56.223348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:56.223728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:56.251304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:56.264474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:56.288068 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2549/5093] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:56.704824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:56.706307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:56.748770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd59d7-f939-4043-86ef-f173612c4584 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:56.772489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:56.773239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:56.773569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:56.773942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:56.775810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:56.980666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:09:57.023692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:57.026660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4193c-1c46-4f9d-80e8-a0f9138e2c86 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:57.073013 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2545/5094] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:09:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:09:58.275398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:58.278054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:58.315041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49637fc5-327c-490e-88eb-ef43f273614c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:58.337290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:58.339347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:58.340639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:58.341162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] PATH_INFO: `/v3/projects/6d5728b69a354912a1f3669706936093` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:58.347679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5728b69a354912a1f3669706936093)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:58.350314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:58.525160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5728b69a354912a1f3669706936093', 'request_id': 'req-cd934ac0-b0ae-455a-8855-27be33305195'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:58.589484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5728b69a354912a1f3669706936093', 'request_id': 'req-cd934ac0-b0ae-455a-8855-27be33305195'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:58.612268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5728b69a354912a1f3669706936093', 'request_id': 'req-cd934ac0-b0ae-455a-8855-27be33305195'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:58.672338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] The token cache is being invalidate because project 6d5728b69a354912a1f3669706936093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:09:58.673188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:58.682283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd934ac0-b0ae-455a-8855-27be33305195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:09:58.688301 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2550/5095] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:09:58 2022] DELETE /identity/v3/projects/6d5728b69a354912a1f3669706936093 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:58.699507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:58.701977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:58.702607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:58.749894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:58.755292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:58.925673 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2546/5096] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:58.933208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:58.933585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:58.934003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:58.994925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:09:58.996322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:09:59.008659 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2551/5097] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:09:59.012640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:59.032976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457c089-f18f-4a9f-a2f3-e8e933fc70c2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:59.047584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:59.050136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.050805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.053399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:59.054451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:09:59.058282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:59.061857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:59.099346 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2547/5098] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:09:59.104180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:59.115707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dac039-ca1f-49d7-bb4a-a2fc3bbcf703 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:59.133127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:59.134405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.134998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.135458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:59.136304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:59.138471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:59.224860 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2552/5099] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:09:59 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:09:59.229239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:59.245129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26f396-f6ea-4e06-9256-297a0027e5e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:59.523687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:59.524325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.524612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.524889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:59.525547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:59.527512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:59.648826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2548/5100] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:09:59 2022] POST /identity/v3/users => generated 288 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:09:59.652744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:59.674902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f079b5-331f-40c2-acc2-d3cef37f730a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:59.689890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:59.692901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.693560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.694171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:59.697057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:59.699748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:59.742079 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2553/5101] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:09:59.745910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:59.763134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0e5b0-4fa7-4e9d-8bc5-9100ea489edd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:59.781772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4ff79-4140-4af7-966b-9e06c6d7e8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:59.782955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ff79-4140-4af7-966b-9e06c6d7e8ac admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.784186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ff79-4140-4af7-966b-9e06c6d7e8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.784720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4ff79-4140-4af7-966b-9e06c6d7e8ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:59.787009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4ff79-4140-4af7-966b-9e06c6d7e8ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:59.792121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4ff79-4140-4af7-966b-9e06c6d7e8ac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:59.842950 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2549/5102] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:09:59.850985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:09:59.871223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee8ec5-f86a-4a37-9828-1a57fe2ddf77 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:09:59.893254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:09:59.894331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.894851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.895470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] PATH_INFO: `/v3/projects/be6dc419af0e42ebbc0033db3b0c0435/users/3987f2616f154f9eb08d6fcc29453975/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:09:59.932740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6dc419af0e42ebbc0033db3b0c0435, user_id=3987f2616f154f9eb08d6fcc29453975, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:09:59.941424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:09:59.966228 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2554/5103] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:09:59 2022] PUT /identity/v3/projects/be6dc419af0e42ebbc0033db3b0c0435/users/3987f2616f154f9eb08d6fcc29453975/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:09:59.977204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:09:59.978766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:09:59.979054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:00.076315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] MFA Rules not processed for user `3987f2616f154f9eb08d6fcc29453975`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:00.083031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:00.218272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:00.325384 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2550/5104] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:09:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:00.325893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:00.416286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:00.498399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d2c66-a6bb-4f3e-80c1-be3e7a899fe5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:00.518776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:00.519424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:00.519828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:00.520112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:00.520763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:00.522797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:00.610244 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2555/5105] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:00 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:00.612198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:00.633788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b84f6d-2fcc-43b7-9b6e-0384aa4bc1da None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:00.791100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:00.792681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:00.793270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:00.793760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:00.800775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:00.803394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:00.874262 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2551/5106] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:00 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:00.878053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:00.899192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a878d5-0f92-45d8-b1ea-fd3936ebd497 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:00.914533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:00.915309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:00.917898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:00.918749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:00.919583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:00.930445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:00.970830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:00.972086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2556/5107] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:00.989232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915c515-4f4a-44d6-b8a4-d70cdf9fa8d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:01.005535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:01.006680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.007262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.008242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] PATH_INFO: `/v3/projects/28306c1339f74db5b2feaad882ecb9c7/users/84366928b15c4bbc8275b049e32ff660/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.061070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28306c1339f74db5b2feaad882ecb9c7, user_id=84366928b15c4bbc8275b049e32ff660, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:01.065392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:01.107946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:01.113607 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2552/5108] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:00 2022] PUT /identity/v3/projects/28306c1339f74db5b2feaad882ecb9c7/users/84366928b15c4bbc8275b049e32ff660/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:01.123780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8000d2e-c093-41ea-abf4-f0fb7d60c94a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:01.274075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a372bc-04e0-4572-9f43-4a6608a2fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:01.275012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a372bc-04e0-4572-9f43-4a6608a2fc37 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.275394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a372bc-04e0-4572-9f43-4a6608a2fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.275771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a372bc-04e0-4572-9f43-4a6608a2fc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.276524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a372bc-04e0-4572-9f43-4a6608a2fc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:01.278293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a372bc-04e0-4572-9f43-4a6608a2fc37 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:01.308134 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2557/5109] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:01.311777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:01.330107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7887e-f2b3-4806-9f1d-1f4a4bc17f85 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:01.336916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5319f42-978e-4498-978d-678f5d42e6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:01.337952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5319f42-978e-4498-978d-678f5d42e6eb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.338401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5319f42-978e-4498-978d-678f5d42e6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.339846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5319f42-978e-4498-978d-678f5d42e6eb admin admin] PATH_INFO: `/v3/projects/28306c1339f74db5b2feaad882ecb9c7/users/84366928b15c4bbc8275b049e32ff660/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.343048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5319f42-978e-4498-978d-678f5d42e6eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=28306c1339f74db5b2feaad882ecb9c7, user_id=84366928b15c4bbc8275b049e32ff660, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:01.347071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5319f42-978e-4498-978d-678f5d42e6eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:01.377866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2553/5110] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:01 2022] PUT /identity/v3/projects/28306c1339f74db5b2feaad882ecb9c7/users/84366928b15c4bbc8275b049e32ff660/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:01.391343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.391955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.392414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.470969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] MFA Rules not processed for user `84366928b15c4bbc8275b049e32ff660`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:01.472364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:01.616889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.619159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.619666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.639861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2558/5111] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:01.653192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:01.654680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:01.729530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:01.786655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:01.789615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:01.791481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab069f87-01bb-4a11-af74-00a4f6924d07 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:01.796565 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2554/5112] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:01 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 03:10:01.802015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:01.803720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:01.806352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:01.806352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.806669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.806913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.836600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:01.838672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:01.862604 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2559/5113] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:01.937967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebaf6-473e-4c0c-9d13-4e8718184ec9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:01.942333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c041b-7919-4dda-bd7e-487bf155724b tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:01.943087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c041b-7919-4dda-bd7e-487bf155724b tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:01.943442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c041b-7919-4dda-bd7e-487bf155724b tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:01.943796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c041b-7919-4dda-bd7e-487bf155724b tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:01.976613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:02.046594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-353c041b-7919-4dda-bd7e-487bf155724b tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:02.071362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2555/5114] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:10:01 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:02.361173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:02.363284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:02.621064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72455f3-d3de-4ac6-8dc8-c649dcfa8ad8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:02.659671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:02.660824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:02.661338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:02.661874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] PATH_INFO: `/v3/users/575da00069cc4e7bbeeeb78925b9beba` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:02.664979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=575da00069cc4e7bbeeeb78925b9beba)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:02.668017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:02.783859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575da00069cc4e7bbeeeb78925b9beba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:02.797864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575da00069cc4e7bbeeeb78925b9beba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:02.798477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575da00069cc4e7bbeeeb78925b9beba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:02.808989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575da00069cc4e7bbeeeb78925b9beba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:02.811998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8083b7d-29b9-4e46-afee-440401c6a649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575da00069cc4e7bbeeeb78925b9beba'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:02.837858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2560/5115] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:02 2022] DELETE /identity/v3/users/575da00069cc4e7bbeeeb78925b9beba => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:03.077262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f1d1-eb46-4ab0-9565-1c3fd9c22985 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:03.077947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f1d1-eb46-4ab0-9565-1c3fd9c22985 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:03.078748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5f1d1-eb46-4ab0-9565-1c3fd9c22985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:03.146814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d2c5f1d1-eb46-4ab0-9565-1c3fd9c22985 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:03.167963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2c5f1d1-eb46-4ab0-9565-1c3fd9c22985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:03.190317 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2556/5116] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:03 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:03.192023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d220f-09d7-412b-ab9f-155c509e9e6b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:03.192266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d220f-09d7-412b-ab9f-155c509e9e6b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:03.192543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d220f-09d7-412b-ab9f-155c509e9e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:03.197230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c86d220f-09d7-412b-ab9f-155c509e9e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:03.358445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-c86d220f-09d7-412b-ab9f-155c509e9e6b None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 29 03:10:03.463394 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:03.465483 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 29 03:10:03.466950 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:03.474605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2561/5117] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:03 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 03:10:03.474952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:03.474952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:03.474952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:03.580876 n-d-862964-4 devstack@keystone.service[82079]: WARNING keystone.server.flask.application [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 29 03:10:03.586134 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2557/5118] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:03 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 112 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 29 03:10:03.588572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:03.588857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:03.589139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:03.604888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:03.607752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:03.686723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:03.688283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:03.720483 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2562/5119] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:03.724804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:03.745717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692ae46-18cf-4446-b0d5-be34295f993f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:03.764373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:03.765045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:03.765326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:03.773889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:03.850000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d24f4c-3d02-483f-8d1e-960db975d38c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:03.873695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:03.874464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:03.875231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:03.879903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] PATH_INFO: `/v3/projects/6f3b3b4572cb4ca0a03dee7dc0da988b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:03.881945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f3b3b4572cb4ca0a03dee7dc0da988b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:03.884212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:03.916932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:03.934933 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2563/5120] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:10:03 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:03.991128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'request_id': 'req-c6c37a34-5a80-45b5-827c-2c16923365dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.001665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'request_id': 'req-c6c37a34-5a80-45b5-827c-2c16923365dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.019459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f3b3b4572cb4ca0a03dee7dc0da988b', 'request_id': 'req-c6c37a34-5a80-45b5-827c-2c16923365dc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.050459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] The token cache is being invalidate because project 6f3b3b4572cb4ca0a03dee7dc0da988b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:04.050823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.054259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.067610 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2558/5121] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:03 2022] DELETE /identity/v3/projects/6f3b3b4572cb4ca0a03dee7dc0da988b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:04.072138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:04.074942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:04.109900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1003da2-13ba-4b6f-9f75-e88a4cc624f8 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:04.194958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:04.195609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:04.195887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:04.196157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] PATH_INFO: `/v3/users/c0b9cd5c1cd349f3b1e6af834f5cc35a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:04.197307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0b9cd5c1cd349f3b1e6af834f5cc35a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:04.200165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:04.254393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0b9cd5c1cd349f3b1e6af834f5cc35a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.266172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0b9cd5c1cd349f3b1e6af834f5cc35a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.266826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0b9cd5c1cd349f3b1e6af834f5cc35a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.287946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0b9cd5c1cd349f3b1e6af834f5cc35a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.287946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-373ed3ae-e9e5-4b33-becd-8f8bb173ac70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0b9cd5c1cd349f3b1e6af834f5cc35a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:04.306050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2564/5122] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:04 2022] DELETE /identity/v3/users/c0b9cd5c1cd349f3b1e6af834f5cc35a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:04.853272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:04.855476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:04.878738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c37a34-5a80-45b5-827c-2c16923365dc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:04.942569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285150fa-2a35-4fac-ab1d-f2c264a540c4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:04.943031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285150fa-2a35-4fac-ab1d-f2c264a540c4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:04.943031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285150fa-2a35-4fac-ab1d-f2c264a540c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:04.970603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-285150fa-2a35-4fac-ab1d-f2c264a540c4 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:04.971928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-285150fa-2a35-4fac-ab1d-f2c264a540c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:04.981989 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2565/5123] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:04 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:04.993636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:04.993636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:04.993914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:04.994633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:05.025244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:05.026133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:05.026516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:05.026896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] PATH_INFO: `/v3/users/a43014422b59488dafc7037e9247bce8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:05.028220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43014422b59488dafc7037e9247bce8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:05.046804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:05.070356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:05.074124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:05.100797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:05.147025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43014422b59488dafc7037e9247bce8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.192653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43014422b59488dafc7037e9247bce8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.195709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43014422b59488dafc7037e9247bce8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.208857 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2566/5124] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:05.219253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43014422b59488dafc7037e9247bce8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.220027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43014422b59488dafc7037e9247bce8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.220768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:05.222930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:05.242847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892eeb6-96b9-4c99-888a-1b26e4e80186 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:05.246791 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2559/5125] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:04 2022] DELETE /identity/v3/users/a43014422b59488dafc7037e9247bce8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:05.247725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:05.386225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:05.387202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:05.387574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:05.387943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] PATH_INFO: `/v3/projects/5a73f6a2f07c484eafb35e4d55bf493e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:05.390558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a73f6a2f07c484eafb35e4d55bf493e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:05.392740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:05.535355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18027c9f-b04e-4317-9822-0d74033faf0d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:05.592786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a73f6a2f07c484eafb35e4d55bf493e', 'request_id': 'req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.632181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a73f6a2f07c484eafb35e4d55bf493e', 'request_id': 'req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.650455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a73f6a2f07c484eafb35e4d55bf493e', 'request_id': 'req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.681348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] The token cache is being invalidate because project 5a73f6a2f07c484eafb35e4d55bf493e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:05.681691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.683500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-52c2b2c8-e71a-4504-b087-e7a26c8b0fa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.687493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2567/5126] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:05 2022] DELETE /identity/v3/projects/5a73f6a2f07c484eafb35e4d55bf493e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:05.689001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:05.689290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:05.689571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:05.702364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdbd01-48fc-470a-b40d-1f71d0cea7b1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:05.703223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbd01-48fc-470a-b40d-1f71d0cea7b1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:05.703616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbd01-48fc-470a-b40d-1f71d0cea7b1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:05.704002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdbd01-48fc-470a-b40d-1f71d0cea7b1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:05.742708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:05.744903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:05.826007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:05.833244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7cdbd01-48fc-470a-b40d-1f71d0cea7b1 tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:05.852148 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2560/5127] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:10:05 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:05.853788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275389a-0a42-41b7-973c-dd29b20468e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:05.854952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275389a-0a42-41b7-973c-dd29b20468e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:05.855770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275389a-0a42-41b7-973c-dd29b20468e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:05.898557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6275389a-0a42-41b7-973c-dd29b20468e1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:05.899767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6275389a-0a42-41b7-973c-dd29b20468e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:05.917864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:05.956907 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2568/5128] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:06.036332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.038025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.040572 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2561/5129] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:06.042976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.043265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.043577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.094103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:06.095334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.132155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2562/5130] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:06.133302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.173016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb301b61-561d-49db-bd82-1832162b1b1c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.179496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc902705-4fcd-4410-b90a-0e6ac6336f12 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.188456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:06.189141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.189422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.189696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.199500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:06.201846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.203962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.204454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.206421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:06.207258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:06.209421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:06.212327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:06.220494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:06.233009 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2569/5131] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:06.233964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.235981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.249976 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2563/5132] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:06.254441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f648ee-be60-4492-a6f9-8d68c1e1bfb4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.255847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.260376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:06.261147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.261424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.261696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] PATH_INFO: `/v3/users/3987f2616f154f9eb08d6fcc29453975` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.263085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3987f2616f154f9eb08d6fcc29453975)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:06.265541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:06.292344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9993-6f75-41e4-bbea-563e812e35d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.310415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:06.311028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.311313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.311623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.312254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:06.314895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:06.347123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3987f2616f154f9eb08d6fcc29453975'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.363936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3987f2616f154f9eb08d6fcc29453975'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.364599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3987f2616f154f9eb08d6fcc29453975'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.382042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3987f2616f154f9eb08d6fcc29453975'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.384248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b3d369a-0880-4543-8ad2-d258f813e95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3987f2616f154f9eb08d6fcc29453975'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.394689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2564/5133] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:06 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:06.395692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.400638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.431173 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2570/5134] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:06 2022] DELETE /identity/v3/users/3987f2616f154f9eb08d6fcc29453975 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:06.441223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.441517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.441795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.491948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:06.493502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.527344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2cca-1ed1-476f-84f7-6c6b990d29bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.672821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:06.683138 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2571/5135] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:06.685248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.688004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.691134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:06.691993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.692341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.692712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.693487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:06.701256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:06.726721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e5f78-bc4c-4253-9251-aa47a12b41e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.748501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:06.749731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:06.750107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:06.751261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] PATH_INFO: `/v3/projects/95063d767e504841a0c13a436c31c0da` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:06.754172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95063d767e504841a0c13a436c31c0da)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:06.758806 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2565/5136] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:06 2022] POST /identity/v3/users => generated 283 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:06.763369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:06.766178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.767392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:06.773026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:06.881332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95063d767e504841a0c13a436c31c0da', 'request_id': 'req-a85b302c-e538-4453-a936-17f09242adc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.894411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95063d767e504841a0c13a436c31c0da', 'request_id': 'req-a85b302c-e538-4453-a936-17f09242adc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.906974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95063d767e504841a0c13a436c31c0da', 'request_id': 'req-a85b302c-e538-4453-a936-17f09242adc7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.938248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd298a6-712f-4c93-9192-561b27212197 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:06.940939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] The token cache is being invalidate because project 95063d767e504841a0c13a436c31c0da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:06.941269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.942260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:06.946042 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2572/5137] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:06 2022] DELETE /identity/v3/projects/95063d767e504841a0c13a436c31c0da => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:06.947408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:06.949065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.023019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:07.024048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.024334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.024610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.026472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.074944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b302c-e538-4453-a936-17f09242adc7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:07.085168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4517ecb-33d1-4e53-a897-92575942ebe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:07.086116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517ecb-33d1-4e53-a897-92575942ebe2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.086506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517ecb-33d1-4e53-a897-92575942ebe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.087082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4517ecb-33d1-4e53-a897-92575942ebe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.087683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4517ecb-33d1-4e53-a897-92575942ebe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:07.097677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4517ecb-33d1-4e53-a897-92575942ebe2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:07.115668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:07.118009 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2573/5138] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:07.118296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:07.119551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.119962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.120319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.132370 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2566/5139] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:07.133536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:07.135643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.142727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:07.144028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.148233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2574/5140] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:07 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:07.148906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:07.153886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291aee9f-729f-455c-84c3-26961ca0990d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:07.159411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:07.160062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.160342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.160881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] PATH_INFO: `/v3/users/7c3ac2f4357a45969c2aba509b5172af` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.162556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c3ac2f4357a45969c2aba509b5172af)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:07.164820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:07.168464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c05d3-bb15-4f82-924d-d5b92dbc684c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:07.174280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0467a-9038-4f65-ae1d-2759587edeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:07.175018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0467a-9038-4f65-ae1d-2759587edeef admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.175387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0467a-9038-4f65-ae1d-2759587edeef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.175747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0467a-9038-4f65-ae1d-2759587edeef admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.176581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0467a-9038-4f65-ae1d-2759587edeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:07.178717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c0467a-9038-4f65-ae1d-2759587edeef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:07.190630 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2575/5141] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:07.195434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.196026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.196406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.221360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:07.223344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.249184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c3ac2f4357a45969c2aba509b5172af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:07.251087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:07.269695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c3ac2f4357a45969c2aba509b5172af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:07.271383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c3ac2f4357a45969c2aba509b5172af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:07.281354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c3ac2f4357a45969c2aba509b5172af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:07.282859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c3ac2f4357a45969c2aba509b5172af'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:07.303763 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2576/5142] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:07.305107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:07.306247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2567/5143] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:07 2022] DELETE /identity/v3/users/7c3ac2f4357a45969c2aba509b5172af => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:07.306967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:07.307161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.322427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352539cf-4aa3-4de8-afe5-87879da523b3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:07.340719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:07.472767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a657a45-1aef-4050-9b6a-9c5265e22f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:07.473643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657a45-1aef-4050-9b6a-9c5265e22f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.474055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657a45-1aef-4050-9b6a-9c5265e22f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.475181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a657a45-1aef-4050-9b6a-9c5265e22f0c admin admin] PATH_INFO: `/v3/projects/f9270ecf39784352a04606d6ca17cf69/users/7dd5959cb5194624accc02a5047e1fdb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.507228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f5201-03a0-4eee-bf87-d4ff3d04abc5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:07.512984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a657a45-1aef-4050-9b6a-9c5265e22f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9270ecf39784352a04606d6ca17cf69, user_id=7dd5959cb5194624accc02a5047e1fdb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:07.516362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a657a45-1aef-4050-9b6a-9c5265e22f0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:07.531827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ba419df8df8499c90589a6723a7b1d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecee976028b04ef1b56316e26bec9c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:07.532507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.532791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.533065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.537188 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2577/5144] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:07 2022] PUT /identity/v3/projects/f9270ecf39784352a04606d6ca17cf69/users/7dd5959cb5194624accc02a5047e1fdb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:07.555726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:07.556306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:07.556733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:07.630187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:07.637953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] MFA Rules not processed for user `7dd5959cb5194624accc02a5047e1fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:07.641098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:07.652728 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2568/5145] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:10:07 2022] POST /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6/password => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:07.848365 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2578/5146] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:07.868234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:07.876769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.030028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:08.031476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.075438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f04013-a6b6-4563-8170-435bbd3dcbcd tempest-IdentityV3UsersTest-1587633308 tempest-IdentityV3UsersTest-1587633308-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:08.135000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:08.204482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:08.205274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.205561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.206679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.212608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a55705-73b7-469a-a531-1eb1fe00f3aa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:08.217060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:08.218892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:08.226910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:08.227862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.228193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.228529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] PATH_INFO: `/v3/projects/51811555679241beb1491982170b2f46` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.230894 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2569/5147] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:08.232044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:08.233945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.236714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51811555679241beb1491982170b2f46)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:08.238774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:08.276717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445f3ae-10ce-4334-8d16-493db4b40091 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:08.296048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:08.297682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.298008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.298286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] PATH_INFO: `/v3/projects/be6dc419af0e42ebbc0033db3b0c0435` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.299483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6dc419af0e42ebbc0033db3b0c0435)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:08.303313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:08.342361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:08.365344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51811555679241beb1491982170b2f46', 'request_id': 'req-a425fcfc-c40c-42a5-bc71-326d9f26595c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.377455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51811555679241beb1491982170b2f46', 'request_id': 'req-a425fcfc-c40c-42a5-bc71-326d9f26595c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.386696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51811555679241beb1491982170b2f46', 'request_id': 'req-a425fcfc-c40c-42a5-bc71-326d9f26595c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.395490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6dc419af0e42ebbc0033db3b0c0435', 'request_id': 'req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.408462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6dc419af0e42ebbc0033db3b0c0435', 'request_id': 'req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.411187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] The token cache is being invalidate because project 51811555679241beb1491982170b2f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:08.412718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.414498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.418067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6dc419af0e42ebbc0033db3b0c0435', 'request_id': 'req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.423074 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2579/5148] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:08 2022] DELETE /identity/v3/projects/51811555679241beb1491982170b2f46 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:08.424693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:08.428247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.440995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] The token cache is being invalidate because project be6dc419af0e42ebbc0033db3b0c0435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:08.441555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.443065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a98c7a9e-5b44-49f0-8c2a-4cfcc0f33e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.445598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2570/5149] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:08 2022] DELETE /identity/v3/projects/be6dc419af0e42ebbc0033db3b0c0435 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:08.450505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.450981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.451417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.478103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:08.480172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.527205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a425fcfc-c40c-42a5-bc71-326d9f26595c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:08.597106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:08.597754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.598082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.598351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] PATH_INFO: `/v3/users/7dd5959cb5194624accc02a5047e1fdb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.599507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd5959cb5194624accc02a5047e1fdb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:08.601677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:08.629364 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2571/5150] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:08.630972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:08.633754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.656758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e3760-839f-406a-a42a-11cc1697eed0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:08.664619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:08.666532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.666992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.667678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] PATH_INFO: `/v3/users/84366928b15c4bbc8275b049e32ff660` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.669586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84366928b15c4bbc8275b049e32ff660)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:08.673223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:08.678576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd5959cb5194624accc02a5047e1fdb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.712237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd5959cb5194624accc02a5047e1fdb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.714047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd5959cb5194624accc02a5047e1fdb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.724100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd5959cb5194624accc02a5047e1fdb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.725021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-65a17678-3782-4422-a454-20faf7dda9f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd5959cb5194624accc02a5047e1fdb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.733406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:08.760174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:08.763299 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2580/5151] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:08 2022] DELETE /identity/v3/users/7dd5959cb5194624accc02a5047e1fdb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:08.764950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.765265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.765517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.773102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84366928b15c4bbc8275b049e32ff660'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.787947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84366928b15c4bbc8275b049e32ff660'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.788982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84366928b15c4bbc8275b049e32ff660'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.797948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84366928b15c4bbc8275b049e32ff660'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.798689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2cc20a1f-6b8c-4b2a-b89d-eb1db22a88f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84366928b15c4bbc8275b049e32ff660'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:08.799872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:08.801584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.821964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2572/5152] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:08 2022] DELETE /identity/v3/users/84366928b15c4bbc8275b049e32ff660 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:08.824007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4943b-6a54-4f4c-b98a-afdf29702804 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.824711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4943b-6a54-4f4c-b98a-afdf29702804 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.825843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4943b-6a54-4f4c-b98a-afdf29702804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.852585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c6f4943b-6a54-4f4c-b98a-afdf29702804 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:08.854602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6f4943b-6a54-4f4c-b98a-afdf29702804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.860828 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2573/5153] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:10:08.862247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:08.862638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:08.863013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:08.889606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:08.891660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:08.957221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2581/5154] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:08.964020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:08.977128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4c7863-51c6-45b1-9fec-38d36afd23fa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.185185 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2574/5155] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:09.211482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.212568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:09.264567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.266126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.266767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.269739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.270799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:09.271327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.273469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.306150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2582/5156] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:09.310961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.358568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc909ea-2cfd-47b6-b6e4-6f6295a74c4f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.364103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.364809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.365406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.365758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.388302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a561f25-9b07-4fcd-9c06-ab4be5059f1d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.399575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.403386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.420956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.422009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.422386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.422996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.423965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.426334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.426663 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2575/5157] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:09.490623 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2583/5158] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:09 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:09.492620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.527332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdab32-88d3-4395-9bd1-b3c1b4ab58af service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.629443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:09.637275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.638094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.638469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.639088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.639851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.642756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.679962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.681987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:09.690372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2576/5159] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:09 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:09.693749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.706194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e9dd9-7417-47c8-9a78-a1144fc7862b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.714517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793ad2-1c6b-4140-a479-ff778980d801 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.717932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.718590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.718868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.719526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] PATH_INFO: `/v3/projects/28306c1339f74db5b2feaad882ecb9c7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.720963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28306c1339f74db5b2feaad882ecb9c7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.722919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.729664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.730336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.730617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.730892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.734186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.735816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.763084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2577/5160] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:09.763963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.783876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b740c-d104-45db-8ab1-12224401e4fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.795542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.796888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.797164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.797442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.798939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.800514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:09.826953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2578/5161] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:09.830826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28306c1339f74db5b2feaad882ecb9c7', 'request_id': 'req-e608d6e7-86a5-47a3-90fd-d53c37efe702'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:09.833561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:09.835418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:09.844590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28306c1339f74db5b2feaad882ecb9c7', 'request_id': 'req-e608d6e7-86a5-47a3-90fd-d53c37efe702'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:09.852116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb17390-d18f-4235-8275-3c1fd1242b50 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:09.857420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28306c1339f74db5b2feaad882ecb9c7', 'request_id': 'req-e608d6e7-86a5-47a3-90fd-d53c37efe702'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:09.895422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] The token cache is being invalidate because project 28306c1339f74db5b2feaad882ecb9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:09.900227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:09.902371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e608d6e7-86a5-47a3-90fd-d53c37efe702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:09.905611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2584/5162] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:09 2022] DELETE /identity/v3/projects/28306c1339f74db5b2feaad882ecb9c7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:09.907037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acc82-e58a-494b-b253-63943c6783e1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.907440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acc82-e58a-494b-b253-63943c6783e1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.907723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2acc82-e58a-494b-b253-63943c6783e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.939019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e2acc82-e58a-494b-b253-63943c6783e1 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:09.940246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e2acc82-e58a-494b-b253-63943c6783e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:09.957912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83cc13-61fa-401d-b8bd-abd6809474f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:09.959477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cc13-61fa-401d-b8bd-abd6809474f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:09.959945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cc13-61fa-401d-b8bd-abd6809474f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:09.960381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cc13-61fa-401d-b8bd-abd6809474f5 admin admin] PATH_INFO: `/v3/projects/517f9d77809a436fb673cc9d70342053/users/e3a8404ef81d4bc19428fa21aab47dfa/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:09.982071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83cc13-61fa-401d-b8bd-abd6809474f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517f9d77809a436fb673cc9d70342053, user_id=e3a8404ef81d4bc19428fa21aab47dfa, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:09.985406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83cc13-61fa-401d-b8bd-abd6809474f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:10.013909 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2579/5163] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:09 2022] PUT /identity/v3/projects/517f9d77809a436fb673cc9d70342053/users/e3a8404ef81d4bc19428fa21aab47dfa/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:10.015546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df7a92-bd95-417f-8029-d7ec194238d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.015957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df7a92-bd95-417f-8029-d7ec194238d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.016223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df7a92-bd95-417f-8029-d7ec194238d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.051171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a0df7a92-bd95-417f-8029-d7ec194238d8 None None] MFA Rules not processed for user `9ba419df8df8499c90589a6723a7b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.053645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0df7a92-bd95-417f-8029-d7ec194238d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.060557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2585/5164] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.061840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.062113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.063090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.094042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.095392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.176081 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2580/5165] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.177655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.179099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.179905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.186762 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2586/5166] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.186762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.188921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.230653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] MFA Rules not processed for user `e3a8404ef81d4bc19428fa21aab47dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.230653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.282871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ce1ae-afd3-4723-87ce-876b5841c58b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:10.289012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:10.290152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.290567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.290846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.293606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:10.326511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2581/5167] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.327730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.327860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:10.329628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.347351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786113bc-ce45-4df8-983b-de0ef566d3dd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:10.353934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:10.355033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.355323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.355589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] PATH_INFO: `/v3/projects/f9270ecf39784352a04606d6ca17cf69` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.356753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9270ecf39784352a04606d6ca17cf69)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:10.358807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:10.394267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:10.396313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:10.409299 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2587/5168] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:10.410624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.412335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.421762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9270ecf39784352a04606d6ca17cf69', 'request_id': 'req-6a9f19ae-e5b6-4585-8338-d36c09802749'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.430284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9270ecf39784352a04606d6ca17cf69', 'request_id': 'req-6a9f19ae-e5b6-4585-8338-d36c09802749'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.430526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a3c6c-1bde-4034-b473-53706b80350e service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:10.437089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9270ecf39784352a04606d6ca17cf69', 'request_id': 'req-6a9f19ae-e5b6-4585-8338-d36c09802749'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.457366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] The token cache is being invalidate because project f9270ecf39784352a04606d6ca17cf69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:10.457636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.460908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6a9f19ae-e5b6-4585-8338-d36c09802749 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.466494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2582/5169] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:10 2022] DELETE /identity/v3/projects/f9270ecf39784352a04606d6ca17cf69 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:10.472864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.473335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.473790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.507604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.509357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.509684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:10.510503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.510788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.511063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] PATH_INFO: `/v3/users/9ba419df8df8499c90589a6723a7b1d6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.512845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba419df8df8499c90589a6723a7b1d6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:10.514647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:10.525710 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2583/5170] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.526742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.528237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.634023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.634198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe2ccd-f689-4ec8-b4d1-b0409eb3ab65 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:10.642633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:10.643054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.643335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.643636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.648592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.649965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.650664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.661297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.662074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37aab691-7bcb-4db4-9b2f-a2cdd3791c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba419df8df8499c90589a6723a7b1d6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:10.683045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2588/5171] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:10 2022] DELETE /identity/v3/users/9ba419df8df8499c90589a6723a7b1d6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:10.684406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee501-35a7-47d8-bd8a-50cdfb477bb6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.684691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee501-35a7-47d8-bd8a-50cdfb477bb6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.684960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ee501-35a7-47d8-bd8a-50cdfb477bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.714341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc0ee501-35a7-47d8-bd8a-50cdfb477bb6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.715610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc0ee501-35a7-47d8-bd8a-50cdfb477bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.725424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:10.727661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:10.738412 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2584/5172] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:10.739268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.757924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7711af1-58ff-440e-9c12-5f87cbd94c19 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:10.771924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:10.773514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:10.805233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2589/5173] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.806672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e6e56-d18e-4025-91cd-fefded0a7854 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.809209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e6e56-d18e-4025-91cd-fefded0a7854 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.809505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e6e56-d18e-4025-91cd-fefded0a7854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.840673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a19e6e56-d18e-4025-91cd-fefded0a7854 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.842575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a19e6e56-d18e-4025-91cd-fefded0a7854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.857955 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2590/5174] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.859700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.862394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.863312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.888819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:10.889768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.890256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.891146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.892177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:10.892979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:10.900740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:10.917469 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2585/5175] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:10.918658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.920743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.936817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:10.938079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.953873 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2591/5176] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:10.954512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:10.955794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:10.972120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c9c93-0c31-4d40-8336-100421309c13 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:10.978100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:10.978729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:10.979134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:10.979640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:10.980905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:10.983338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.005698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec0bfba-3420-410b-a4f0-c72aa57c0a15 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.023351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.025667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.026040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.027446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.039153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.041406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.043501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2592/5177] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:10 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:11.044450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.055611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2586/5178] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:11.057240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.069502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2cd65-36c4-4781-8be0-cd7b12bc9477 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.167226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045740d-2c9b-45d6-9f64-3825d0e783fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.173354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.176242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.177004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.177287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.177557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.178448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.181753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.184565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.184865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.186871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.188206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:11.188526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.193157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.229731 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2593/5179] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:11.232719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.234055 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2587/5180] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:11.253056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.282055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a68ba-d966-4fa6-93e5-f166872107ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.291898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8594af-abe2-4a84-8f55-bc9e6491401a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.292661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.293396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.293935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.294327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.295178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.304477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.305159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.305441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.305713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.306052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.308505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.312912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.325398 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2588/5181] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:11.329561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.356925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3617-1fe0-448a-9f98-0c825eea294f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.373470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.377954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.380420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.380702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.381520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.383944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.393109 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2594/5182] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:11.397022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.397685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2589/5183] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:11.401626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.413155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f054608-ecd6-46fb-9482-af950191bbe2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.436593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:11.485719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6098f7-6742-4ca9-8a24-9fa5fc218b6c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.489397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca73fd8d-211c-46f8-9b97-250b5037d0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.490462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73fd8d-211c-46f8-9b97-250b5037d0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.490462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73fd8d-211c-46f8-9b97-250b5037d0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.490829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca73fd8d-211c-46f8-9b97-250b5037d0c4 admin admin] PATH_INFO: `/v3/projects/810f58b3c977440887757041492bcd06/users/b6e0707a52b84a00931ed64619e9996a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.492746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.493472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.493874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.494274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.495419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.497894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.510013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73fd8d-211c-46f8-9b97-250b5037d0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=810f58b3c977440887757041492bcd06, user_id=b6e0707a52b84a00931ed64619e9996a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.512832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca73fd8d-211c-46f8-9b97-250b5037d0c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.525890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2595/5184] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/users => generated 284 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:11.528553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.528811 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2590/5185] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:11 2022] PUT /identity/v3/projects/810f58b3c977440887757041492bcd06/users/b6e0707a52b84a00931ed64619e9996a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:11.539257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.539542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.539817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.547891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132727ce-7c49-4a54-ac48-188383d59c5f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.566780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:11.582161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] MFA Rules not processed for user `b6e0707a52b84a00931ed64619e9996a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:11.583983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:11.630258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.630998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.631240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.631418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.632100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.633868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.654401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2596/5186] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:11.666921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.682022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37d55c-8483-4229-b76e-25a538d14db7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.689486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.690153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.690619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.690895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.691536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.693141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.707939 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2597/5187] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:11.708528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.710416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:11.710850 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2591/5188] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:11.715244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.725844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a822a-ec73-4f1f-bb37-ac2bd369a74f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.730185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70db58e-a2ac-4173-a04d-5032d66f041d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.732008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.734740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.734740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.734740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] PATH_INFO: `/v3/projects/ecee976028b04ef1b56316e26bec9c8a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.735559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecee976028b04ef1b56316e26bec9c8a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.736099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.736729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.737009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.737277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.737953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.738083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.739855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.768671 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2592/5189] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:11.771205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.790996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecee976028b04ef1b56316e26bec9c8a', 'request_id': 'req-e6ac623b-a3a9-4182-afbc-1e051950de4a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:11.798681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecee976028b04ef1b56316e26bec9c8a', 'request_id': 'req-e6ac623b-a3a9-4182-afbc-1e051950de4a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:11.804491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecee976028b04ef1b56316e26bec9c8a', 'request_id': 'req-e6ac623b-a3a9-4182-afbc-1e051950de4a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:11.819649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] The token cache is being invalidate because project ecee976028b04ef1b56316e26bec9c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:11.820417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:11.821073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:11.823794 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2598/5190] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:11 2022] DELETE /identity/v3/projects/ecee976028b04ef1b56316e26bec9c8a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:11.827395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.830072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:11.843017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875adfb-2e31-46ad-b777-c46fd9476074 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.856277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:11.912013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac623b-a3a9-4182-afbc-1e051950de4a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:11.917684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9a078-35eb-49d2-a199-a094c63325ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.918338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a078-35eb-49d2-a199-a094c63325ee admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.918573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:11.918738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a078-35eb-49d2-a199-a094c63325ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.919017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9a078-35eb-49d2-a199-a094c63325ee admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.919477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.919982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9a078-35eb-49d2-a199-a094c63325ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.920144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.920248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] PATH_INFO: `/v3/projects/060156fe2a924091a1feee012c4a3727/users/b7457997e7b1444e8f3d034c2a326587/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.922474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9a078-35eb-49d2-a199-a094c63325ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.938051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=060156fe2a924091a1feee012c4a3727, user_id=b7457997e7b1444e8f3d034c2a326587, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:11.940837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:11.949172 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2599/5191] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:11.950433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:11.950826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:11.950992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:11.956870 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2593/5192] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:11 2022] PUT /identity/v3/projects/060156fe2a924091a1feee012c4a3727/users/b7457997e7b1444e8f3d034c2a326587/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:11.957655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:11.976589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:11.978630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:11.985402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:12.025861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acffdaa-614a-4962-9a32-98da19867ccd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.030949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da49413-5a72-4525-9bb3-b8781b46ac89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.031583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49413-5a72-4525-9bb3-b8781b46ac89 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.031855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49413-5a72-4525-9bb3-b8781b46ac89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.032122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da49413-5a72-4525-9bb3-b8781b46ac89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.032763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da49413-5a72-4525-9bb3-b8781b46ac89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.034407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da49413-5a72-4525-9bb3-b8781b46ac89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.046049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2594/5193] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:12.048839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.049349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.049748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.053311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2600/5194] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:12.054128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.068982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21ef47-2c99-4ce8-b9cd-2f0cd22438d1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.074349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b3fb1-546e-4fbf-815e-84ab1c432106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.075245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fb1-546e-4fbf-815e-84ab1c432106 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.075670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fb1-546e-4fbf-815e-84ab1c432106 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.076264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b3fb1-546e-4fbf-815e-84ab1c432106 admin admin] PATH_INFO: `/v3/projects/5c9caa0416a6457aae239669ad99887d/users/cac8de1904dd4237b299044f7c5abb0c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.092164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] MFA Rules not processed for user `b7457997e7b1444e8f3d034c2a326587`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:12.093449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:12.098508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3fb1-546e-4fbf-815e-84ab1c432106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9caa0416a6457aae239669ad99887d, user_id=cac8de1904dd4237b299044f7c5abb0c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.102367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b3fb1-546e-4fbf-815e-84ab1c432106 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.129463 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2601/5195] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:12 2022] PUT /identity/v3/projects/5c9caa0416a6457aae239669ad99887d/users/cac8de1904dd4237b299044f7c5abb0c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:12.129463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.129463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.129463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.156992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:12.158602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:12.197605 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2595/5196] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:12.198612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.216445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6b6b8-e0e2-4780-85f8-64488fba1015 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.242680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:12.289315 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2602/5197] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:12.294689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.298179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:12.304835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.305569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.305988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.306338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.307054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.309187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.322135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2596/5198] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:12.323027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.332122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458c807-7c9b-471e-8c0d-83270c17a57f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.335938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6b6ce-5614-46f3-9bb7-96a320cc9f9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.341038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.341772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.342039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.342189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.342337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.342712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.342992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.343138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.343261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.343908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:12.344210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.344936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.345786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.361396 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2597/5199] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:12.362205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.374438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07af671-478f-4bb9-950e-28fc23f91650 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.379941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.380591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.380758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.381087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] PATH_INFO: `/v3/projects/5c9caa0416a6457aae239669ad99887d/users/cac8de1904dd4237b299044f7c5abb0c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.383904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9caa0416a6457aae239669ad99887d, user_id=cac8de1904dd4237b299044f7c5abb0c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.394874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2603/5200] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:12.394874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.397976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.423991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2598/5201] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:12 2022] PUT /identity/v3/projects/5c9caa0416a6457aae239669ad99887d/users/cac8de1904dd4237b299044f7c5abb0c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:12.435923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.507379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345dc570-41c8-4f2b-b041-4503ebde5f7d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.518724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:12.540382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4c061-43b4-4feb-9581-a85b005c1018 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.547803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70540dc-c1fa-4b79-8c06-42b11bcadb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.548602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70540dc-c1fa-4b79-8c06-42b11bcadb54 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.549004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70540dc-c1fa-4b79-8c06-42b11bcadb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.549341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70540dc-c1fa-4b79-8c06-42b11bcadb54 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.550423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70540dc-c1fa-4b79-8c06-42b11bcadb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.553318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70540dc-c1fa-4b79-8c06-42b11bcadb54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.585973 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2599/5202] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:12.587796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1746786-398d-436b-afe2-f3312781047f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.588516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1746786-398d-436b-afe2-f3312781047f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.588884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1746786-398d-436b-afe2-f3312781047f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.605082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.606075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.607221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.607710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.608601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.612476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.630441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f1746786-398d-436b-afe2-f3312781047f None None] MFA Rules not processed for user `cac8de1904dd4237b299044f7c5abb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:12.633248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1746786-398d-436b-afe2-f3312781047f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:12.655957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2604/5203] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:12.657163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.795259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6743b7b-da57-46a5-a19b-30caa42aedc9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.810309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.813910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.814198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.814566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.817990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.824919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.847814 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2605/5204] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:12.849042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.850919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2600/5205] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:12.851896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1746786-398d-436b-afe2-f3312781047f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.880810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd907-534f-450c-91bd-ca676d18afcf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.890228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1746786-398d-436b-afe2-f3312781047f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:12.906526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.907355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.908174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:12.908644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.909231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:12.909614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] PATH_INFO: `/v3/projects/dbda1fce4b0a4a58892a319d9afdd54d/users/38e2e8908b794d23b6f7960da6e592e7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.909989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:12.910470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:12.911404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.919677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:12.931055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.953542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbda1fce4b0a4a58892a319d9afdd54d, user_id=38e2e8908b794d23b6f7960da6e592e7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:12.956283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:12.986548 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2601/5206] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:12 2022] PUT /identity/v3/projects/dbda1fce4b0a4a58892a319d9afdd54d/users/38e2e8908b794d23b6f7960da6e592e7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:12.987360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:12.992840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:13.005913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2606/5207] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:12 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:13.007283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.034574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd0057-ec06-465e-8b8d-53217c4084bb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.149475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2859bdc-4c7b-4164-bf90-4c02c4027642 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.161468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.162297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.162580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.168527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.253712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.254517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.254871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.255321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.256110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.257961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.275604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.277539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.279476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2607/5208] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:13.280406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.289951 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2602/5209] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:13.313005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.314302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76766f7c-5170-4edd-8287-b5a567e6524f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.319792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:13.320558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.321316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.322041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.322168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.322890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.324657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.336733 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2608/5210] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:13.337910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.343246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:13.351682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef614111-d891-45e5-8a01-a22384813caf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.359218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.360137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.360574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.361309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] PATH_INFO: `/v3/projects/dbda1fce4b0a4a58892a319d9afdd54d/users/38e2e8908b794d23b6f7960da6e592e7/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.363646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbda1fce4b0a4a58892a319d9afdd54d, user_id=38e2e8908b794d23b6f7960da6e592e7, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.366926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.389328 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2609/5211] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:13 2022] PUT /identity/v3/projects/dbda1fce4b0a4a58892a319d9afdd54d/users/38e2e8908b794d23b6f7960da6e592e7/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:13.389328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.455577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbe40b-5fd9-4221-ae47-dce87a55d7dd service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.469733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c564-6144-4c0f-b575-8003e3683ce4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.476385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030cb72-13d2-4253-917a-3e1f40c692ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.477074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030cb72-13d2-4253-917a-3e1f40c692ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.477350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030cb72-13d2-4253-917a-3e1f40c692ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.477619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030cb72-13d2-4253-917a-3e1f40c692ef admin admin] PATH_INFO: `/v3/projects/e43922e05c4340f98e3cfb8d3beeb517/users/7cf5d085b91f4cc1ae64fcfe27511594/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.498684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030cb72-13d2-4253-917a-3e1f40c692ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43922e05c4340f98e3cfb8d3beeb517, user_id=7cf5d085b91f4cc1ae64fcfe27511594, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.501611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030cb72-13d2-4253-917a-3e1f40c692ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.509221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:13.528277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2610/5212] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:13 2022] PUT /identity/v3/projects/e43922e05c4340f98e3cfb8d3beeb517/users/7cf5d085b91f4cc1ae64fcfe27511594/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:13.534381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.535831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.536124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.565372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.566234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.566584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.566928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.569889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:13.588792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.592099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.634500 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2603/5213] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:13.635392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] MFA Rules not processed for user `38e2e8908b794d23b6f7960da6e592e7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:13.636392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.639451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:13.660315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfccbdb-b8f6-4857-a9a1-ccc8691c6cb4 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.787635 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2611/5214] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:13.791357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.827801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcdc64-454b-4422-96b6-dd359a60f775 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:13.843081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.846953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.847832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:13.848298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.848760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.849543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:13.850394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.850922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:13.851350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:13.853137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.854076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:13.856335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:13.883789 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2604/5215] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:13.887074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.892870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2612/5216] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:10:13 2022] POST /identity/v3/domains => generated 276 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:13.895486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:13.935039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08ddb2-150f-4cd5-a088-7590dd08a16a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.083656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:14.131979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941983bc-468e-4aa4-a477-2fe0e528e7d0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.137486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.137688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a37b3-79db-44c7-bef0-8c3694101ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.138288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a37b3-79db-44c7-bef0-8c3694101ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.138561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a37b3-79db-44c7-bef0-8c3694101ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.138685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.138881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a37b3-79db-44c7-bef0-8c3694101ca8 admin admin] PATH_INFO: `/v3/projects/e43922e05c4340f98e3cfb8d3beeb517/users/7cf5d085b91f4cc1ae64fcfe27511594/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.139159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.139526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.140256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.142261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a37b3-79db-44c7-bef0-8c3694101ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e43922e05c4340f98e3cfb8d3beeb517, user_id=7cf5d085b91f4cc1ae64fcfe27511594, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.142759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.144915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a37b3-79db-44c7-bef0-8c3694101ca8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.176415 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2605/5217] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:13 2022] PUT /identity/v3/projects/e43922e05c4340f98e3cfb8d3beeb517/users/7cf5d085b91f4cc1ae64fcfe27511594/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:14.186946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.187177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.187467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.241470 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2613/5218] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:13 2022] POST /identity/v3/groups => generated 280 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:14.244216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.269694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f67a09-467d-4448-a3a3-e2761255a0c0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.282834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] MFA Rules not processed for user `7cf5d085b91f4cc1ae64fcfe27511594`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:14.287353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:14.396516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.397873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.398301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.398578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/99a241d0c9214c779992492bc2637b85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.413076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:update_group(group_id=99a241d0c9214c779992492bc2637b85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.414152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:14.415493 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:14.415493 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:14.415493 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:14.418815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.472518 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2614/5219] 10.222.0.16 () {60 vars in 1247 bytes} [Sat Oct 29 03:10:14 2022] PATCH /identity/v3/groups/99a241d0c9214c779992492bc2637b85 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:14.478454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.485517 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2606/5220] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:14.486540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.508989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f5d79-03c5-4dd5-b5b3-24ec23b4292d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.525060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.528837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.528837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.528837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/99a241d0c9214c779992492bc2637b85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.559175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:get_group(group_id=99a241d0c9214c779992492bc2637b85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.562872 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:14.562872 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:14.562872 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:14.575067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.580231 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2615/5221] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:14 2022] GET /identity/v3/groups/99a241d0c9214c779992492bc2637b85 => generated 293 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:14.581281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.599487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ba762-0509-4718-8915-9e6e3a8fb7a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.605517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.606591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.607066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.607497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.608351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.610718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.613881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6ce6-b20e-4c1d-85c8-e5f5c117857d tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.640327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.641106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.641451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.641829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/99a241d0c9214c779992492bc2637b85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.643405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:update_group(group_id=99a241d0c9214c779992492bc2637b85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.651784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.693592 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2607/5222] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:14 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:14.695918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.698930 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2616/5223] 10.222.0.16 () {60 vars in 1246 bytes} [Sat Oct 29 03:10:14 2022] PATCH /identity/v3/groups/99a241d0c9214c779992492bc2637b85 => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:14.706741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.747276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6230c5d-8118-45da-b6e9-f2a5647c28d8 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.883517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.884528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.885711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.886029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/99a241d0c9214c779992492bc2637b85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.888463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a24dd9-f538-4bf6-b4b0-7cfcd56be29e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:14.901537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=99a241d0c9214c779992492bc2637b85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.903845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.914751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:14.915675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:14.916185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:14.916663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:14.920684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:14.923171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:14.982259 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2608/5224] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:14 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:14.983744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:14.994195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:UPDATE=2,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:15.013964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adfa2d-54a8-4ac0-b8f1-b1924b15f354 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.041331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.041991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.042271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.042544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.043195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.045133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.055153 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2617/5225] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:14 2022] DELETE /identity/v3/groups/99a241d0c9214c779992492bc2637b85 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:15.056195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.068221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2609/5226] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:15.072480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.095730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b0b38-e85d-4866-bbe1-945f8ce2a1c9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.200969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:15.217125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.218588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.218876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.219147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.222005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.225969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.253281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce438b-ef26-4c65-b1c0-411371766e48 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.255746 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2610/5227] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:15.259795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.260417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.260795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.261259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.262124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.262945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.265885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.285446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec0d65-15c2-436e-969a-2ecb71fb8e17 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.304017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2618/5228] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:15 2022] POST /identity/v3/groups => generated 325 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:15.305120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.308685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f77c10-7e49-4049-8ca1-79213b57475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.309398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f77c10-7e49-4049-8ca1-79213b57475e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.310273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f77c10-7e49-4049-8ca1-79213b57475e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.310559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f77c10-7e49-4049-8ca1-79213b57475e admin admin] PATH_INFO: `/v3/projects/f4371fd937cd47b382ee840dd74a1236/users/44528ef893b94a1096e4a697b6ad0f57/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.342090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ba149-e9aa-4cf8-8bd4-fe0ab3ffbc29 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.356817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.358061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.358344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.358617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.358925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f77c10-7e49-4049-8ca1-79213b57475e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4371fd937cd47b382ee840dd74a1236, user_id=44528ef893b94a1096e4a697b6ad0f57, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.359251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.361115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.362416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f77c10-7e49-4049-8ca1-79213b57475e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.401461 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2611/5229] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:15 2022] PUT /identity/v3/projects/f4371fd937cd47b382ee840dd74a1236/users/44528ef893b94a1096e4a697b6ad0f57/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:15.403594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.403972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.404255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.444990 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2619/5230] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:15 2022] POST /identity/v3/users => generated 321 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:15.446994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.449162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] MFA Rules not processed for user `44528ef893b94a1096e4a697b6ad0f57`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:15.450772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:15.487490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8ece3-b78e-4340-b323-40acfa8be2fb tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.585590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.586262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.586542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.586899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/eb813a9f257542a0b87bc36a744e3931` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.612031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=eb813a9f257542a0b87bc36a744e3931)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.616536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.671113 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2620/5231] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:10:15 2022] PUT /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/eb813a9f257542a0b87bc36a744e3931 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:15.675267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.684112 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2612/5232] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:15.695780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:15.697378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:15.786581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:15.820299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a3be6-7619-4163-8e70-3ec54dd129aa tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.825483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d22605-85f9-4d0b-a365-bab3e87a6086 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.826142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d22605-85f9-4d0b-a365-bab3e87a6086 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.826471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d22605-85f9-4d0b-a365-bab3e87a6086 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.826752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d22605-85f9-4d0b-a365-bab3e87a6086 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.827431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d22605-85f9-4d0b-a365-bab3e87a6086 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:15.829303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d22605-85f9-4d0b-a365-bab3e87a6086 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:15.847828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a991b3-86e3-45ca-b703-ab176e32acae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:15.900482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2621/5233] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:15 2022] POST /identity/v3/users => generated 321 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:15.905323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.905607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.905905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:15.928356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:15.930374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:15.984702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:15.985673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:15.986077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:15.986449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.034615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:16.045318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2622/5234] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:16.048673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.076055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20e79-64ec-4079-8623-c8f2bbc7489a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.092877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.094017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.094461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.095434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/978c46e69dd240618669b21f8cd22a94` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.136890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=978c46e69dd240618669b21f8cd22a94)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.140584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.162240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.165716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.182932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2623/5235] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:10:16 2022] PUT /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/978c46e69dd240618669b21f8cd22a94 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:16.183959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.189494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:16.195109 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2613/5236] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:16.198085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.239321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9fcd2-ba7c-499f-9b70-cb5b6a85fe56 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.424379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.425073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.425290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.425569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.426974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.427239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3b2ff-a193-44f2-986a-fa03af05453c tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.428936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.436328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.437136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.437463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.437736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.504993 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2614/5237] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:16 2022] POST /identity/v3/users => generated 323 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:16.511604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.540493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260cbc0f-e976-4c74-8221-7ac4ce631ae1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.547728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.548410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.553960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.555213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/c5afc5a47a7e48898237b5e3827c7994` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.565358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:16.603758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=c5afc5a47a7e48898237b5e3827c7994)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.609211 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:16.609211 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:10:16.609211 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:10:16.610495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.636770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.639323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.660642 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2624/5238] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:16.684381 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2615/5239] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:10:16 2022] PUT /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/c5afc5a47a7e48898237b5e3827c7994 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:16.689004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.709042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f855978-8b5c-4180-ad70-5e863efa5ff3 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.729017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.810883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.813017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.813432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.814433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.820743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.822628 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:16.822628 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:16.822628 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:16.824951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.865706 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2625/5240] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:10:16 2022] GET /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users => generated 1081 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:16.867832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.884725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7c894-d3c7-4644-92f3-2fb9e4468aa5 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.891772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.895451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.896749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.898158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/eb813a9f257542a0b87bc36a744e3931` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.906788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=eb813a9f257542a0b87bc36a744e3931)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.912014 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:16.912014 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:16.912014 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:16.913383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.932303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936384b-a0f1-49e1-a616-391714333dc6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.947018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:16.949179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:16.949499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:16.949737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] PATH_INFO: `/v3/users/7cf5d085b91f4cc1ae64fcfe27511594` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:16.952824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf5d085b91f4cc1ae64fcfe27511594)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:16.954835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:16.956337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2626/5241] 10.222.0.16 () {58 vars in 1342 bytes} [Sat Oct 29 03:10:16 2022] HEAD /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/eb813a9f257542a0b87bc36a744e3931 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:16.961050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:16.984437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6422f-32e7-4b6f-b123-6b80646081c6 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:16.989542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:16.999643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:17.000445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:17.000734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:17.001012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/eb813a9f257542a0b87bc36a744e3931` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:17.004729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=eb813a9f257542a0b87bc36a744e3931)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:17.010143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:17.028501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'eb813a9f257542a0b87bc36a744e3931'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.074682 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2627/5242] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:10:16 2022] DELETE /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/eb813a9f257542a0b87bc36a744e3931 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:17.076550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:17.081278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf5d085b91f4cc1ae64fcfe27511594'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.129953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf5d085b91f4cc1ae64fcfe27511594'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.131749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf5d085b91f4cc1ae64fcfe27511594'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.157147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf5d085b91f4cc1ae64fcfe27511594'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.160937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3e51c48b-de96-4cd4-bd8b-7023772ff2d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf5d085b91f4cc1ae64fcfe27511594'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.210815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2616/5243] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:16 2022] DELETE /identity/v3/users/7cf5d085b91f4cc1ae64fcfe27511594 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:17.212575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd92f3-ab9c-4f53-aec9-1ad041057321 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:17.212966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd92f3-ab9c-4f53-aec9-1ad041057321 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:17.214622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd92f3-ab9c-4f53-aec9-1ad041057321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:17.272181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a8fd92f3-ab9c-4f53-aec9-1ad041057321 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:17.277664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8fd92f3-ab9c-4f53-aec9-1ad041057321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:17.308082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b5ed-7f85-4973-a08b-407f982f6b3e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:17.416881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:17.467841 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2617/5244] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:17.472535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:17.473615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:17.474119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:17.474403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/978c46e69dd240618669b21f8cd22a94` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:17.481580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=978c46e69dd240618669b21f8cd22a94)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:17.486425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:17.532917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:17.533856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:17.534248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:17.535182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2628/5245] 10.222.0.16 () {58 vars in 1342 bytes} [Sat Oct 29 03:10:17 2022] HEAD /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/978c46e69dd240618669b21f8cd22a94 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:17.539245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:17.543965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:17.578180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddb458-02d2-4137-848e-7ba8a399a2b3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:17.579886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:17.582749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:17.586768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:17.587457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:17.587734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:17.588007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/978c46e69dd240618669b21f8cd22a94` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:17.591081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=978c46e69dd240618669b21f8cd22a94)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:17.596746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:17.615286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '978c46e69dd240618669b21f8cd22a94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:17.648024 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2629/5246] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:10:17 2022] DELETE /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/978c46e69dd240618669b21f8cd22a94 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:17.652403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:17.736662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2618/5247] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:17.752720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:17.765885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:17.884027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:17.941884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9bf6f-9b8f-41ae-adf8-063c5ea53d8c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.052191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254f23-2d26-4a21-a0ee-ece05594bd60 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.058209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.058875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.059344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.059521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/c5afc5a47a7e48898237b5e3827c7994` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.061201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=c5afc5a47a7e48898237b5e3827c7994)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.063155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.080255 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2630/5248] 10.222.0.16 () {58 vars in 1342 bytes} [Sat Oct 29 03:10:17 2022] HEAD /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/c5afc5a47a7e48898237b5e3827c7994 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:18.081132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:18.083123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:18.090925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.091732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.092113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.093174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.169934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd440be-4f2f-4b58-8705-d84f6d0e50ec tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.182584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.183248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.183486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.183755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.195792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.197523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.218154 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2619/5249] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:10:18.218831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:18.232439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec248f21-11c9-4a6e-a1cc-a991b29063a4 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.239055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.239821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.241504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.241866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/c5afc5a47a7e48898237b5e3827c7994` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.247149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5, user_id=c5afc5a47a7e48898237b5e3827c7994)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.248445 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:18.248445 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:10:18.248445 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:10:18.250023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.271920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c5afc5a47a7e48898237b5e3827c7994'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:18.290866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:18.296110 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2620/5250] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:10:18 2022] DELETE /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users/c5afc5a47a7e48898237b5e3827c7994 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:18.300670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:18.322799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.324796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.352061 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2631/5251] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:18.413703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:18.437254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca1948-3b73-4086-80f7-0e36a5e13b70 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.448828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.449466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.449747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.450046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.453026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.454157 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:18.454157 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:10:18.454157 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:10:18.458753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.508965 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2621/5252] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:10:18 2022] GET /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5/users => generated 145 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:18.512669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:18.526134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7594b-cca7-4e97-a011-7ed8432542f8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.531776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.532845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.533282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.533786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users/c5afc5a47a7e48898237b5e3827c7994` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.535227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c5afc5a47a7e48898237b5e3827c7994)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.537400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.640796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5afc5a47a7e48898237b5e3827c7994'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:18.659674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5afc5a47a7e48898237b5e3827c7994'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:18.660533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5afc5a47a7e48898237b5e3827c7994'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:18.676658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5afc5a47a7e48898237b5e3827c7994'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:18.677683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9b7c8c4a-aef1-46a7-81b7-16a7686fe192 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5afc5a47a7e48898237b5e3827c7994'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:18.721108 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2632/5253] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:18 2022] DELETE /identity/v3/users/c5afc5a47a7e48898237b5e3827c7994 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:18.727435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:18.732624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:18.762517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32aa905-e2b1-46dd-910e-24b7294c2fef tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:18.826035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.826446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.826796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.849514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:18.850209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:18.850546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:18.850823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users/978c46e69dd240618669b21f8cd22a94` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:18.852191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_user(user_id=978c46e69dd240618669b21f8cd22a94)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:18.854551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:18.877030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:18.883024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:18.997010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '978c46e69dd240618669b21f8cd22a94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.088376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '978c46e69dd240618669b21f8cd22a94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.094213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '978c46e69dd240618669b21f8cd22a94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.108646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2633/5254] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:19.111711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:19.116885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:19.129066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '978c46e69dd240618669b21f8cd22a94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.131078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '978c46e69dd240618669b21f8cd22a94'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.155541 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2622/5255] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:18 2022] DELETE /identity/v3/users/978c46e69dd240618669b21f8cd22a94 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:19.161206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:19.165983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:19.293509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef65b1-c3e7-482c-9494-a01e23f2d2b0 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:19.294911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aec622-715d-4cfc-b2db-3565c6ec9550 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:19.307668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:19.309178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:19.310054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:19.312024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:19.312365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users/eb813a9f257542a0b87bc36a744e3931` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:19.318251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_user(user_id=eb813a9f257542a0b87bc36a744e3931)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:19.333933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:19.353417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:19.418960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb813a9f257542a0b87bc36a744e3931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.432745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:19.433456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:19.433733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:19.434973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:19.439123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:19.445399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb813a9f257542a0b87bc36a744e3931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.446253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb813a9f257542a0b87bc36a744e3931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.462741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb813a9f257542a0b87bc36a744e3931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.463489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb813a9f257542a0b87bc36a744e3931'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:19.485900 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2623/5256] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:19 2022] DELETE /identity/v3/users/eb813a9f257542a0b87bc36a744e3931 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:19.494223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:19.496133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:19.567718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:19.570233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:19.586375 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2634/5257] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:19.675062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238de05-f307-42a6-9fc3-6e49675495dd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:19.682870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:19.683950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:19.684499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:19.685036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:19.686584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7fd75f5686ef48f1ab2fc45babd4a2f5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:19.688538 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:19.688538 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:10:19.688538 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:10:19.690309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:19.805028 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2624/5258] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:19 2022] DELETE /identity/v3/groups/7fd75f5686ef48f1ab2fc45babd4a2f5 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:19.808468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:19.829244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57f04b-13e1-4503-86d8-2495d9654c37 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:19.863745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:19.866502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:19.987423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:19.997213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:19.997876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:19.998159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:19.998425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.000889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.008543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.038629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04786f1e-18bb-4703-939f-b994aba8ebb4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.046393 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2635/5259] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:19 2022] POST /identity/v3/groups => generated 327 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:20.051463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.058257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.059171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.059735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.060106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] PATH_INFO: `/v3/projects/e43922e05c4340f98e3cfb8d3beeb517` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.062235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e43922e05c4340f98e3cfb8d3beeb517)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.067092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.076159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be03ff-5df5-4060-a759-9321dde646d7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.086860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.087624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.087817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.088175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.090129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.093757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.118279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2636/5260] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:20 2022] POST /identity/v3/groups => generated 325 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:20.121939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.133927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82371-2493-4c1a-9955-414154ac2ba9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.150749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.151624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.151930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.152202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.152932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.155640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.182356 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2637/5261] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:20 2022] POST /identity/v3/groups => generated 327 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:10:20.186633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.207503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1233c73-3e13-4b87-a904-e4e49fe2adb7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.224454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e43922e05c4340f98e3cfb8d3beeb517', 'request_id': 'req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.230279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:20.236964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e43922e05c4340f98e3cfb8d3beeb517', 'request_id': 'req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.264265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e43922e05c4340f98e3cfb8d3beeb517', 'request_id': 'req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.284300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] The token cache is being invalidate because project e43922e05c4340f98e3cfb8d3beeb517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:20.284656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.285372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.287615 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2625/5262] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:19 2022] DELETE /identity/v3/projects/e43922e05c4340f98e3cfb8d3beeb517 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:20.291847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.294398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:20.358341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.358985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.359264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.359533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.360170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.361197 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:20.361197 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:20.361197 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:20.362381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.406507 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2638/5263] 10.222.0.16 () {58 vars in 1125 bytes} [Sat Oct 29 03:10:20 2022] GET /identity/v3/groups => generated 1489 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:20.408732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.417461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:20.447337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4257af-df5f-4c60-95b9-ff0a5fb35daa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.451655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ed1960-3ce5-4153-9e3e-89720090fc1e tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.464537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.465199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.465478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.465749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/cfa6546901074e979990692c10b6638e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.468731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.469401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.469678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.470078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] PATH_INFO: `/v3/users/44528ef893b94a1096e4a697b6ad0f57` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.472526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=44528ef893b94a1096e4a697b6ad0f57)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.474520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.481110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=cfa6546901074e979990692c10b6638e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.483821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.586224 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2639/5264] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:20 2022] DELETE /identity/v3/groups/cfa6546901074e979990692c10b6638e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:20.587359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44528ef893b94a1096e4a697b6ad0f57'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.591905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.614185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44528ef893b94a1096e4a697b6ad0f57'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.616679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44528ef893b94a1096e4a697b6ad0f57'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.630065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44528ef893b94a1096e4a697b6ad0f57'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.631160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44528ef893b94a1096e4a697b6ad0f57'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:20.652608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:20.658071 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2626/5265] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:20 2022] DELETE /identity/v3/users/44528ef893b94a1096e4a697b6ad0f57 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:20.696019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84600d8e-b654-44c5-b6ea-12ec2c251706 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.775186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.775848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.776127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.776440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/f3c3a64da7bf4299aa3a19b421faf5e7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.782245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f3c3a64da7bf4299aa3a19b421faf5e7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.784408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:20.799888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:20.868476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2640/5266] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:20 2022] DELETE /identity/v3/groups/f3c3a64da7bf4299aa3a19b421faf5e7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:20.872882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:20.875289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:20.890958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff289a00-beee-47b1-8b11-c26cb75db1da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:20.954329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:20.955191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:20.955320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:20.955594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/680163c8fc9646f8946d545e1394b978` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:20.962289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=680163c8fc9646f8946d545e1394b978)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:20.964223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.033533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.034011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2627/5267] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:20 2022] DELETE /identity/v3/groups/680163c8fc9646f8946d545e1394b978 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:21.046414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661415c2-4d13-4a4c-96e3-43541a230285 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.118654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.119299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.119585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.120483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.120652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.122955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.151903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2641/5268] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:21 2022] POST /identity/v3/users => generated 321 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:21.157200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.167493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e74ac7-060a-4bc6-a78f-1a605cf023c4 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.173441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.173709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.174111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.174511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.175337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.178447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.206573 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2628/5269] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:21 2022] POST /identity/v3/groups => generated 327 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:21.207886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.239652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53de24-3936-4b32-91ee-cfee16529ca1 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.246763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.247875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.248445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.248998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/2725de5aaaf344d4a63b8072600b8e3e/users/af625c4d515e4c8f86ef3b0006278379` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.274502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2725de5aaaf344d4a63b8072600b8e3e, user_id=af625c4d515e4c8f86ef3b0006278379)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.277032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.311090 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2642/5270] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:10:21 2022] PUT /identity/v3/groups/2725de5aaaf344d4a63b8072600b8e3e/users/af625c4d515e4c8f86ef3b0006278379 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:21.315433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.327509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54322873-e7df-473c-bf43-82f65a0ddf96 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.396906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.397587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.398272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.398272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.398846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.400897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.437482 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2629/5271] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:10:21 2022] POST /identity/v3/groups => generated 326 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:21.442904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.456341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d14117-373c-49ea-884f-c1ba1c519afd tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.464252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.464923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.465197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.465469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/f8265b7d12ac4187bc867fe307374765/users/af625c4d515e4c8f86ef3b0006278379` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.471689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f8265b7d12ac4187bc867fe307374765, user_id=af625c4d515e4c8f86ef3b0006278379)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.473669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.508066 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2643/5272] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:10:21 2022] PUT /identity/v3/groups/f8265b7d12ac4187bc867fe307374765/users/af625c4d515e4c8f86ef3b0006278379 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:21.510053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.512660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.518346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:21.521483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ee907-d9a4-4728-9120-9c0cb875e6f7 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.586716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:21.589691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:21.605055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c03041-727f-43d0-8810-756ece3991e9 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.613419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.614753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.615609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.616269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] PATH_INFO: `/v3/projects/f4371fd937cd47b382ee840dd74a1236` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.618310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4371fd937cd47b382ee840dd74a1236)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.620740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.642814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.643720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.644369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.644764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users/af625c4d515e4c8f86ef3b0006278379/groups` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.647627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=af625c4d515e4c8f86ef3b0006278379)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.650113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.676913 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2630/5273] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:10:21 2022] GET /identity/v3/users/af625c4d515e4c8f86ef3b0006278379/groups => generated 839 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:21.678915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.691627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4371fd937cd47b382ee840dd74a1236', 'request_id': 'req-e5453a0e-9714-4807-a977-0698ab7460fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:21.697416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23612e-d691-4b4f-bb91-be23d374efbe tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:21.703104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4371fd937cd47b382ee840dd74a1236', 'request_id': 'req-e5453a0e-9714-4807-a977-0698ab7460fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:21.721449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4371fd937cd47b382ee840dd74a1236', 'request_id': 'req-e5453a0e-9714-4807-a977-0698ab7460fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:21.748535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] The token cache is being invalidate because project f4371fd937cd47b382ee840dd74a1236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:21.748809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:21.751315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5453a0e-9714-4807-a977-0698ab7460fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:21.755073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2644/5274] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:21 2022] DELETE /identity/v3/projects/f4371fd937cd47b382ee840dd74a1236 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:21.759704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8839-f42b-42b3-8f6a-6089dc1f27aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.759977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8839-f42b-42b3-8f6a-6089dc1f27aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.760325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa8839-f42b-42b3-8f6a-6089dc1f27aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.777605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:21.778363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.778793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.779076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/f8265b7d12ac4187bc867fe307374765` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:21.780573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f8265b7d12ac4187bc867fe307374765)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:21.785410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:21.811808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4daa8839-f42b-42b3-8f6a-6089dc1f27aa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:21.818011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4daa8839-f42b-42b3-8f6a-6089dc1f27aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:21.860735 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2631/5275] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:21 2022] DELETE /identity/v3/groups/f8265b7d12ac4187bc867fe307374765 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:21.865591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:21.883280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:21.971740 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2645/5276] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:21.980337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:21.980678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:21.981041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.008715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:22.010738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:22.026482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf053b-2f41-4fab-a92d-89a4a31277d3 tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.040220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.040891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.041168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.041437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/groups/2725de5aaaf344d4a63b8072600b8e3e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.044091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2725de5aaaf344d4a63b8072600b8e3e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.048439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.106560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:22.132639 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2646/5277] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:22.137572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.153992 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2632/5278] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:21 2022] DELETE /identity/v3/groups/2725de5aaaf344d4a63b8072600b8e3e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:22.167012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.172454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05a9ce-a267-467b-9002-82d240f15d91 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.213943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:22.294044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bda6e-1d95-4ade-9e15-b35c5ddeacff tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.300810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.301533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.302947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.302947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.303157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:22.303598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.306980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.324330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.325522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.326052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.326523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/users/af625c4d515e4c8f86ef3b0006278379` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.328611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_user(user_id=af625c4d515e4c8f86ef3b0006278379)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.332870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.338472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2647/5279] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:22.339424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.361854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15205b-90ee-4763-bce4-bbf32f8f49e6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.378123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.378970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.379274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.379548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.380259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.385573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.443530 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2648/5280] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:22 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:22.445343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.480228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af625c4d515e4c8f86ef3b0006278379'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.567448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af625c4d515e4c8f86ef3b0006278379'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.568434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af625c4d515e4c8f86ef3b0006278379'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.568558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9404e-0380-48b2-81a9-7ac355765582 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.573932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.575657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.575657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.576154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.576876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.578973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.591051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af625c4d515e4c8f86ef3b0006278379'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.595554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af625c4d515e4c8f86ef3b0006278379'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.613664 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2649/5281] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:22 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:22.618301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.620969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:22.637336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c577ba-2bd3-4649-af0f-c9a55f137515 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.645374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2633/5282] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:22 2022] DELETE /identity/v3/users/af625c4d515e4c8f86ef3b0006278379 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:22.651234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.656223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:22.753815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.756149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.756436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.756774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.762311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.764255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.789349 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2650/5283] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:22.791245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.811007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0e77e-a7a5-40d9-9e3a-b83c7faee1d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.818115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.818444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.818706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.819012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.820413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.822157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.823870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501a95f-3ee7-46a4-a4ea-c38392a2fd6a tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.830486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.832102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.832613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.833340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/domains/c59170181a084b29b03270d75ea3bbb9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.835077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c59170181a084b29b03270d75ea3bbb9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.839854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2651/5284] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:22.840409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.842191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.845189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:22.857182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2699e88-b06f-4ec9-933c-3434a4f98131 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:22.864256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a8639-d041-49e3-9361-d98be0350008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:22.864952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8639-d041-49e3-9361-d98be0350008 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.865236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8639-d041-49e3-9361-d98be0350008 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.865515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a8639-d041-49e3-9361-d98be0350008 admin admin] PATH_INFO: `/v3/projects/74cea2a72c91484ba92ece7d19db08b8/users/12d1ae37a6b645c8a115e33a19e892d6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.875041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.876135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.878491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:22.894532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8639-d041-49e3-9361-d98be0350008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cea2a72c91484ba92ece7d19db08b8, user_id=12d1ae37a6b645c8a115e33a19e892d6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:22.897690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a8639-d041-49e3-9361-d98be0350008 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:22.919750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.921087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:22.923665 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2634/5286] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:10:22 2022] PATCH /identity/v3/domains/c59170181a084b29b03270d75ea3bbb9 => generated 277 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:22.929321 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2652/5286] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:22 2022] PUT /identity/v3/projects/74cea2a72c91484ba92ece7d19db08b8/users/12d1ae37a6b645c8a115e33a19e892d6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:22.930732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:22.932642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:22.934721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:22.935213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:22.935858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:22.971550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] MFA Rules not processed for user `12d1ae37a6b645c8a115e33a19e892d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:22.973037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:23.036615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a9575-4a53-422a-a920-3e2ffc6a46ca tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.068942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2653/5287] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:23.072536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.074270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:23.127209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38e2e8908b794d23b6f7960da6e592e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dbda1fce4b0a4a58892a319d9afdd54d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.128273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.128630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.128976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] PATH_INFO: `/v3/domains/c59170181a084b29b03270d75ea3bbb9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.141469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c59170181a084b29b03270d75ea3bbb9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.143415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.183419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884c970-bd90-4e30-bc51-463878fce60d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.188819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.189628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.190006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.190353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.191467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.193738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.202077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.221789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.230994 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2654/5288] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:23 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:10:23.236598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.273563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:23.283086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9', 'request_id': 'req-755de4f1-3ac4-469a-82d0-8132f154a96f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.293513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9', 'request_id': 'req-755de4f1-3ac4-469a-82d0-8132f154a96f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.301820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9', 'request_id': 'req-755de4f1-3ac4-469a-82d0-8132f154a96f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.322502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] The token cache is being invalidate because project c59170181a084b29b03270d75ea3bbb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:23.322963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.323800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.335231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9', 'request_id': 'req-755de4f1-3ac4-469a-82d0-8132f154a96f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.336033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9', 'request_id': 'req-755de4f1-3ac4-469a-82d0-8132f154a96f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.336665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c59170181a084b29b03270d75ea3bbb9', 'request_id': 'req-755de4f1-3ac4-469a-82d0-8132f154a96f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.357266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2635/5289] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:22 2022] DELETE /identity/v3/domains/c59170181a084b29b03270d75ea3bbb9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:23.362344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.364883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:23.385992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a554fb-aa6b-4bb0-8f3c-b99f5c127e1d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.396017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:23.523339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.524300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.524746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.528750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755de4f1-3ac4-469a-82d0-8132f154a96f tempest-GroupsV3TestJSON-2100518017 tempest-GroupsV3TestJSON-2100518017-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.532631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.536581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.536581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.536581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.536581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] PATH_INFO: `/v3/users/b7457997e7b1444e8f3d034c2a326587` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.537429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7457997e7b1444e8f3d034c2a326587)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.539280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.540349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.563911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.639791 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2655/5290] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:23 2022] POST /identity/v3/users => generated 289 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:23.644304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.648068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:23.660587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7457997e7b1444e8f3d034c2a326587'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.666280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8239e-3d8a-4ef5-8468-55b2440a8d8f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.674358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.675995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.676340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.676681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.677451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.679633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.685207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7457997e7b1444e8f3d034c2a326587'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.687473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7457997e7b1444e8f3d034c2a326587'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.696133 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2656/5291] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:23.700034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7457997e7b1444e8f3d034c2a326587'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.700885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-035c6c98-8a3c-4ca4-9a26-eb8844e4db65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7457997e7b1444e8f3d034c2a326587'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:23.701194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.714690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:23.722987 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2636/5292] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:23 2022] DELETE /identity/v3/users/b7457997e7b1444e8f3d034c2a326587 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:23.727817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.728120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.728538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.748526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bbb2-a4e9-4d21-8094-f48773f205fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.752084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:23.753735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:23.783782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:23.877260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.878548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.878548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.878783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.879278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.883401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.885297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2637/5293] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:23.899029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2657/5294] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:23.900296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.916459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577d063-7b8b-4e1b-973b-0406da6279bb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:23.922113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc4777-06af-4df5-b5f2-fa309c245108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:23.923031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4777-06af-4df5-b5f2-fa309c245108 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:23.923379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4777-06af-4df5-b5f2-fa309c245108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:23.923826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc4777-06af-4df5-b5f2-fa309c245108 admin admin] PATH_INFO: `/v3/projects/be5df3082d814d2bb573ca25100ad4e2/users/ca4c210ae0404666b3552309b3343fd7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:23.946646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4777-06af-4df5-b5f2-fa309c245108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be5df3082d814d2bb573ca25100ad4e2, user_id=ca4c210ae0404666b3552309b3343fd7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:23.950536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc4777-06af-4df5-b5f2-fa309c245108 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:23.979561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:23.980220 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2638/5295] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:23 2022] PUT /identity/v3/projects/be5df3082d814d2bb573ca25100ad4e2/users/ca4c210ae0404666b3552309b3343fd7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:23.989143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:24.077561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:24.078296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:24.078595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:24.109260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] MFA Rules not processed for user `ca4c210ae0404666b3552309b3343fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:24.110446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:24.141621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49494d-2186-4788-b4ac-0699b64a9d90 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:24.213336 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2639/5296] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:24.218974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:24.221489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:24.226951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:24.248043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:24.248759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:24.248982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:24.249262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:24.411620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff79f4-1621-4c5f-a3a3-71017f21f128 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:24.419738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:24.421225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:24.430341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:24.431001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:24.431265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:24.431723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:24.435646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:24.451871 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2658/5297] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:24.534067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:24.556191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:24.566800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34b736-46a7-4b25-a31e-ff50af6dfd04 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:24.583413 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2640/5298] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:24.674176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:24.675768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:24.816614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea7e6a-d902-4c57-a711-f3aaab24181f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:24.829496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac8de1904dd4237b299044f7c5abb0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c9caa0416a6457aae239669ad99887d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:24.832523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:24.833979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:24.834334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:24.835045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:24.835712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:24.838868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:24.861886 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2659/5299] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:24.862108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:24.862108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:24.862108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:24.863484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:24.885946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:24.887208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:24.901425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e0f55c-6d43-4f75-920b-4b7fec17f51a tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:24.913560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac8de1904dd4237b299044f7c5abb0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c9caa0416a6457aae239669ad99887d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:24.914343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:24.914529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:24.914784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:24.915439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:24.917516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:24.994861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2660/5300] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:24 2022] POST /identity/v3/projects => generated 348 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:24.996867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:25.028456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2641/5301] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:10:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:25.043610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:25.045371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:25.140844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7df16c-9c9b-4d4f-983b-792d17d74c91 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:25.160234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac8de1904dd4237b299044f7c5abb0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c9caa0416a6457aae239669ad99887d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:25.162267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:25.163544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:25.166327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:25.167213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:25.167634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:25.173278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:25.180946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:25.207499 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2661/5302] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:25.236617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdb66b-85da-4a64-95cd-85ccb1cd8637 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:25.363847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:25.366208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:25.404567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:25.405668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:25.407424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:25.407424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:25.557198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:25.596593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ce98e-2e9b-4a9b-845b-8466cbfe9f5c tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:25.612873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:25.614479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:25.615132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:25.616496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:25.621113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] PATH_INFO: `/v3/projects/060156fe2a924091a1feee012c4a3727` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:25.622651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:25.623621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=060156fe2a924091a1feee012c4a3727)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:25.626175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:25.646767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2642/5303] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:25.738647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060156fe2a924091a1feee012c4a3727', 'request_id': 'req-2038074f-e98b-4102-9b03-9aeb283419fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:25.752851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060156fe2a924091a1feee012c4a3727', 'request_id': 'req-2038074f-e98b-4102-9b03-9aeb283419fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:25.766319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060156fe2a924091a1feee012c4a3727', 'request_id': 'req-2038074f-e98b-4102-9b03-9aeb283419fd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:25.787119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] The token cache is being invalidate because project 060156fe2a924091a1feee012c4a3727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:25.787870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:25.791398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:25.796617 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2662/5304] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:25 2022] DELETE /identity/v3/projects/060156fe2a924091a1feee012c4a3727 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:25.797630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:25.817682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f654b7-5136-4087-9762-39b8cfcb6cf4 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:25.970715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:25.971819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:25.972294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:25.972725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] PATH_INFO: `/v3/users/38e2e8908b794d23b6f7960da6e592e7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:25.974938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e2e8908b794d23b6f7960da6e592e7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:25.977626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:25.990870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:25.993134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.128572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e2e8908b794d23b6f7960da6e592e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.142404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038074f-e98b-4102-9b03-9aeb283419fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:26.153826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:26.154459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:26.154741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:26.155119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:26.160339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.167737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e2e8908b794d23b6f7960da6e592e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.170780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e2e8908b794d23b6f7960da6e592e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.192116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e2e8908b794d23b6f7960da6e592e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.193042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e2e8908b794d23b6f7960da6e592e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.218925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2643/5305] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:25 2022] DELETE /identity/v3/users/38e2e8908b794d23b6f7960da6e592e7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:26.244156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:26.275635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:26.278198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a871f2-00f7-40f2-8e60-62dee44f106a service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:26.289544 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2663/5306] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:26.330442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:26.332521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.456358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:26.457984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:26.458555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:26.459212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:26.459835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdcac8-4742-436a-8029-20e26e17e228 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:26.465674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cac8de1904dd4237b299044f7c5abb0c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c9caa0416a6457aae239669ad99887d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:26.466552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:26.466935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:26.468915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] PATH_INFO: `/v3/projects/3055cfa04c244be2bd48eee2946f52ac` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:26.470709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3055cfa04c244be2bd48eee2946f52ac)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:26.473022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:26.499360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:26.504951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.568029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3055cfa04c244be2bd48eee2946f52ac', 'request_id': 'req-71dbfe91-1452-48c4-b1a2-1a71373056b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.578104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3055cfa04c244be2bd48eee2946f52ac', 'request_id': 'req-71dbfe91-1452-48c4-b1a2-1a71373056b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.588585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3055cfa04c244be2bd48eee2946f52ac', 'request_id': 'req-71dbfe91-1452-48c4-b1a2-1a71373056b3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.598150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2664/5307] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:26.617852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:26.619781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.654486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] The token cache is being invalidate because project 3055cfa04c244be2bd48eee2946f52ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:26.655945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.657486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.659835 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2644/5308] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:26 2022] DELETE /identity/v3/projects/3055cfa04c244be2bd48eee2946f52ac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:26.660791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:26.665463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.747874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f8f29-6a0f-45cc-bdc0-d4ffaab6898b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:26.786873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbfe91-1452-48c4-b1a2-1a71373056b3 tempest-RoutersIpV6AdminTest-474218536 tempest-RoutersIpV6AdminTest-474218536-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:26.792876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:26.794352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:26.794535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:26.794775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] PATH_INFO: `/v3/projects/dbda1fce4b0a4a58892a319d9afdd54d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:26.796255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbda1fce4b0a4a58892a319d9afdd54d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:26.799226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:26.898883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbda1fce4b0a4a58892a319d9afdd54d', 'request_id': 'req-50778397-8d40-40c4-8056-8d01c2a802fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.914182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbda1fce4b0a4a58892a319d9afdd54d', 'request_id': 'req-50778397-8d40-40c4-8056-8d01c2a802fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.921746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:26.933585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbda1fce4b0a4a58892a319d9afdd54d', 'request_id': 'req-50778397-8d40-40c4-8056-8d01c2a802fe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.938391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:26.938698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:26.938951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:26.943396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.957250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] The token cache is being invalidate because project dbda1fce4b0a4a58892a319d9afdd54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:26.957250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.958526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:26.961406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2645/5309] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:26 2022] DELETE /identity/v3/projects/dbda1fce4b0a4a58892a319d9afdd54d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:26.962044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:26.967913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:26.998603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:27.008247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:27.070191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.072891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7ba80-2967-42f0-8816-215694159125 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.086807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50778397-8d40-40c4-8056-8d01c2a802fe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.096027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.096027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.096027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.096027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.107212 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2665/5310] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:10:27.109686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428006-b700-4106-a232-f1df870c05b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.110073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428006-b700-4106-a232-f1df870c05b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.110202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36428006-b700-4106-a232-f1df870c05b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.114901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.156162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-36428006-b700-4106-a232-f1df870c05b6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:27.159227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36428006-b700-4106-a232-f1df870c05b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.245706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.248999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.274193 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2666/5311] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:27.283719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.283964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.284616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.296773 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2646/5312] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:27.317592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.321896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.332354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:27.333725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.350378 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2667/5313] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:27.354733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.361867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e66bd1-646e-460a-8da2-e1fd084f57c0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.374477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.375184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.375545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.375793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] PATH_INFO: `/v3/users/12d1ae37a6b645c8a115e33a19e892d6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.376799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05f9c6-0077-4e4d-adf0-04cef215ccaf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.378048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d1ae37a6b645c8a115e33a19e892d6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.383967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.388549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.389979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.389979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.389979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.390640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:27.390938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.392820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.420988 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2668/5314] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:27.421946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.437154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6500e3-6cba-49ac-aa2b-6d3c430c2c37 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.448932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.449777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.450193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.450570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.451304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.454179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.507314 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2669/5315] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:27 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:27.509622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.521698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d1ae37a6b645c8a115e33a19e892d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:27.564464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d1ae37a6b645c8a115e33a19e892d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:27.567374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d1ae37a6b645c8a115e33a19e892d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:27.579894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d1ae37a6b645c8a115e33a19e892d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:27.581282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79382546-6438-440b-a6dc-20d10b4d817b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d1ae37a6b645c8a115e33a19e892d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:27.610325 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2647/5316] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:27 2022] DELETE /identity/v3/users/12d1ae37a6b645c8a115e33a19e892d6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:27.612780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.614095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.614676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.629887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da2dd3-c048-49cc-9d8e-3340e5405a60 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.656490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:27.658582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.679458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:27.730441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:27.731098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.731934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.732162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.732439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.733076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.735071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.759684 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2648/5317] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:27.766697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2670/5318] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:27 2022] POST /identity/v3/users => generated 284 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:27.771017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.772758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.774144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.775962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:27.786893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c0c2a-5455-40c5-8cc3-281f76249bef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.793353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.795205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.795754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.796036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.796695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.798363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.811329 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2649/5319] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:27.820079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.833842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5299b8-80b9-4a37-97dc-fb439c2d5670 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.839530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.840380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.840667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.841357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.842033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.845296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.851358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca2c94-4367-4b9c-9aba-1cce37a1a267 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.856818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69660758-e86c-4546-a1da-23ca5d1292ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.857453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660758-e86c-4546-a1da-23ca5d1292ce service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.857730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660758-e86c-4546-a1da-23ca5d1292ce service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.858061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69660758-e86c-4546-a1da-23ca5d1292ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.861519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2650/5320] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:27.862906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:27.869625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69660758-e86c-4546-a1da-23ca5d1292ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.871325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69660758-e86c-4546-a1da-23ca5d1292ce service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.878405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a355a1-dc64-4dbe-a251-447264bb43fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:27.882899 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2671/5321] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:27.885164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:27.885891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.886169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.886442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] PATH_INFO: `/v3/projects/be071bfdc7904032b658821cb91da6b6/users/920b0d80be364808978436af4b8b1d01/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.904941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be071bfdc7904032b658821cb91da6b6, user_id=920b0d80be364808978436af4b8b1d01, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:27.907781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:27.936600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2651/5322] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:27 2022] PUT /identity/v3/projects/be071bfdc7904032b658821cb91da6b6/users/920b0d80be364808978436af4b8b1d01/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:27.938309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:27.938604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:27.938860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:27.972938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] MFA Rules not processed for user `920b0d80be364808978436af4b8b1d01`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:27.974887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:28.105510 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2672/5323] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:28.111548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.257004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03f539-8f26-469c-9991-f734df1a9353 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.272496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.274136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.278397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.278397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.278896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.281035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.327784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.329205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:28.331911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2652/5324] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:28 2022] POST /identity/v3/projects => generated 367 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:28.334418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.353393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82242336-6ada-43be-a6fd-9b9dac806f32 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.420001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb46b86-cfbe-407e-87c8-3a1fc21f379c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.426493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.427377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.427844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.428193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.429136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.431192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.463413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:28.472678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.473978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.474604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.474874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] PATH_INFO: `/v3/projects/74cea2a72c91484ba92ece7d19db08b8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.476761 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2653/5325] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:28 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:28.480502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cea2a72c91484ba92ece7d19db08b8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.484258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.495006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.520093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf294f6-c64e-4835-8f09-69657320387d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.525127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.525742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.526053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.526326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.526974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.528571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.538765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cea2a72c91484ba92ece7d19db08b8', 'request_id': 'req-128d51f3-b171-416a-b178-b551070f8e3d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.541432 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2654/5326] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:28.544941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.549988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cea2a72c91484ba92ece7d19db08b8', 'request_id': 'req-128d51f3-b171-416a-b178-b551070f8e3d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.553044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:28.563190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cea2a72c91484ba92ece7d19db08b8', 'request_id': 'req-128d51f3-b171-416a-b178-b551070f8e3d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.567905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f155-887a-4247-9897-584a87db0896 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.579202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] The token cache is being invalidate because project 74cea2a72c91484ba92ece7d19db08b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:28.579494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.580162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.582108 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2673/5327] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:28 2022] DELETE /identity/v3/projects/74cea2a72c91484ba92ece7d19db08b8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:28.586668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.588540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:28.644395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.645113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.645539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.645845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] PATH_INFO: `/v3/projects/cff31acc927a45169552c8aec0f3eabc/users/c604523e54504062a6518876d4df888f/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.663915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff31acc927a45169552c8aec0f3eabc, user_id=c604523e54504062a6518876d4df888f, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.666646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.673757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d51f3-b171-416a-b178-b551070f8e3d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.679132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.679786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.680070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.680343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] PATH_INFO: `/v3/users/ca4c210ae0404666b3552309b3343fd7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.681500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4c210ae0404666b3552309b3343fd7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.683485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.694276 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2655/5328] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:28 2022] PUT /identity/v3/projects/cff31acc927a45169552c8aec0f3eabc/users/c604523e54504062a6518876d4df888f/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:28.700927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.703047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:28.772804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4c210ae0404666b3552309b3343fd7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.788026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4c210ae0404666b3552309b3343fd7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.789270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4c210ae0404666b3552309b3343fd7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.800280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4c210ae0404666b3552309b3343fd7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.801406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4c210ae0404666b3552309b3343fd7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:28.806960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ca91-e7f9-47cf-b305-3c646e4a85e2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.814347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae63084-719c-46ba-9d44-de5b9545b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.814994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae63084-719c-46ba-9d44-de5b9545b3af admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.815276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae63084-719c-46ba-9d44-de5b9545b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.815552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae63084-719c-46ba-9d44-de5b9545b3af admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.816967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae63084-719c-46ba-9d44-de5b9545b3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.818833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae63084-719c-46ba-9d44-de5b9545b3af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.828124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2674/5329] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:28 2022] DELETE /identity/v3/users/ca4c210ae0404666b3552309b3343fd7 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:28.832025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2656/5330] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:28.836469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:28.837957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:28.848578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:28.925320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9314-7aa3-49ca-a1c9-21b4d5f3a4ee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:28.932903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:28.933696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.933924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.934202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] PATH_INFO: `/v3/projects/cff31acc927a45169552c8aec0f3eabc/users/c604523e54504062a6518876d4df888f/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:28.936297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff31acc927a45169552c8aec0f3eabc, user_id=c604523e54504062a6518876d4df888f, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:28.939126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:28.953883 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2675/5331] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:28 2022] PUT /identity/v3/projects/cff31acc927a45169552c8aec0f3eabc/users/c604523e54504062a6518876d4df888f/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:28.966497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:28.966829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:28.967013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.003803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] MFA Rules not processed for user `c604523e54504062a6518876d4df888f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:29.005068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:29.090762 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2657/5332] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:29.095826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.107943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0773fb-f230-4f31-a115-8c849cfe314d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.112672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.113385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.113745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.114140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.114966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.117147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.138181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2676/5333] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:10:29 2022] POST /identity/v3/domains => generated 277 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:29.142791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.162490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f287e-b30a-468b-97cb-b8ce9a2a010e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.183593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:29.280783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.281514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.281749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.282062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.282710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.284797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.322472 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2658/5334] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:29 2022] POST /identity/v3/users => generated 348 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:29.326529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.345365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9588bb-fe79-43d4-861a-bd02b5e9dbd4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.353152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.353975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.354810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.355173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.356316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.358370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.405262 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2677/5335] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:29 2022] POST /identity/v3/users => generated 323 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:29.408822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.423677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e4f53-9438-432f-9a8f-ea19175d83ab tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.434807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.435468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.435855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.436241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users/5189cf21d35442b68af773ccb76f5627` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.459615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:get_user(user_id=5189cf21d35442b68af773ccb76f5627)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.463385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.470687 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2659/5336] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:10:29 2022] GET /identity/v3/users/5189cf21d35442b68af773ccb76f5627 => generated 348 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:29.471378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.490766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7b80-6989-4b3b-bf55-075920c88f34 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.500094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.501473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.502272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.502845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.506300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Adding query filter params (domain_id=01afcd6eaace49c6abf337e0d6d9a0fa) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:29.507195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.508858 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:29.508858 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:29.508858 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:29.510592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.532493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.534987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:29.569467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2678/5337] 10.222.0.16 () {58 vars in 1207 bytes} [Sat Oct 29 03:10:29 2022] GET /identity/v3/users?domain_id=01afcd6eaace49c6abf337e0d6d9a0fa => generated 485 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:10:29.570438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.601699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce260-bf50-4daf-94cf-4d42df7500d4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.618118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.618756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.619121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.619401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.619973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.626383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.671541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1950131-0a92-43ea-8ef0-51bbe52a6aaa tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.677952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.678733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.679014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.679385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] PATH_INFO: `/v3/projects/be5df3082d814d2bb573ca25100ad4e2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.680566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be5df3082d814d2bb573ca25100ad4e2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.682663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.712234 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2679/5338] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:29 2022] GET /identity/v3/users => generated 8009 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:29.719408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.749400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8263-64ff-410b-9639-2aefe16fdfc2 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.762733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be5df3082d814d2bb573ca25100ad4e2', 'request_id': 'req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:29.771512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be5df3082d814d2bb573ca25100ad4e2', 'request_id': 'req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:29.785116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be5df3082d814d2bb573ca25100ad4e2', 'request_id': 'req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:29.805840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] The token cache is being invalidate because project be5df3082d814d2bb573ca25100ad4e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:29.806206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:29.808025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69a1f367-3836-4d6c-bfa7-d4349c4ffea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:29.809925 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2660/5339] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:29 2022] DELETE /identity/v3/projects/be5df3082d814d2bb573ca25100ad4e2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:29.817494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc049-ae5e-4fc3-9a64-e9f0fc36707b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.817780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc049-ae5e-4fc3-9a64-e9f0fc36707b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.818107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fc049-ae5e-4fc3-9a64-e9f0fc36707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.827636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:29.851443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e61fc049-ae5e-4fc3-9a64-e9f0fc36707b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:29.852845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e61fc049-ae5e-4fc3-9a64-e9f0fc36707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:29.911660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.912377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.912787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.913178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.914024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1030664987) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:29.914402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.916692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.929849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2661/5340] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:29.937879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.938163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.938432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.959270 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2680/5341] 10.222.0.16 () {58 vars in 1189 bytes} [Sat Oct 29 03:10:29 2022] GET /identity/v3/users?name=tempest-test_user-1030664987 => generated 476 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:10:29.960720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.961340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:29.962659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:29.962813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:29.970733 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2662/5342] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:29.974904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:29.976794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896efe1-cbed-4608-893e-745af7a3549f tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.983381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.984196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.984578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.985336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.985823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:29.986341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c09e17-8476-4975-93bd-c401dccd1812 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:29.986505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.988311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:29.991715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:29.992921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:29.993074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:29.993207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:29.993916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:29.994212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:29.995854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.008454 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2663/5343] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:10:30.012940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.018472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2681/5344] 10.222.0.16 () {58 vars in 1149 bytes} [Sat Oct 29 03:10:29 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:30.019717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.024831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0b03-bb3f-4ca0-8ff7-3fe6e71818af admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.030680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.030868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bebd6-196d-4f51-b735-f40ec6413bda tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.031386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.031670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.032016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.032768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.035071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.036816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.037526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.038894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.038894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users/5c2d57efeb284d2c857e3401bb218c53` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.060232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5c2d57efeb284d2c857e3401bb218c53)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.062681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.072768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2664/5345] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:30 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:10:30.073457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.080460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:30.133361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2d57efeb284d2c857e3401bb218c53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.147593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2d57efeb284d2c857e3401bb218c53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.148632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2d57efeb284d2c857e3401bb218c53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.158309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2d57efeb284d2c857e3401bb218c53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.158907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2d57efeb284d2c857e3401bb218c53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.179495 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2682/5346] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:30 2022] DELETE /identity/v3/users/5c2d57efeb284d2c857e3401bb218c53 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:30.183992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.184571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b2429-106f-4e17-93ce-632e8e75aeb7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.187355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.300547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.301209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.301864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.301864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.302789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.305463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.308877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9637a-bd71-4ebe-9d1f-ba206a02f0a4 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.315434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.316085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.316368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.316661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/users/5189cf21d35442b68af773ccb76f5627` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.326911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5189cf21d35442b68af773ccb76f5627)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.328726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.337328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:30.353180 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2665/5347] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:30 2022] POST /identity/v3/users => generated 292 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:30.355766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.360558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.384188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a14e7d-e357-436a-992a-f1c4180555da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.390885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.391692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.392219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.392652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.393401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.395477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.413923 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2666/5348] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:30.417788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.431654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cb19f-df5f-4be1-bfc1-50b2d9c84f46 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.435379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5189cf21d35442b68af773ccb76f5627'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.444262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.444687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5189cf21d35442b68af773ccb76f5627'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.445024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.445339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.445622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.445874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5189cf21d35442b68af773ccb76f5627'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.446407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.448328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.464834 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2667/5349] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:30.465046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5189cf21d35442b68af773ccb76f5627'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.465046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5189cf21d35442b68af773ccb76f5627'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.466089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.468011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.482765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec2778-90e1-40e3-97bd-839ff4c9bb08 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.487798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6bc4b-90d1-4fd7-b8ae-452307b7ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.488563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6bc4b-90d1-4fd7-b8ae-452307b7ced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.488907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6bc4b-90d1-4fd7-b8ae-452307b7ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.489267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6bc4b-90d1-4fd7-b8ae-452307b7ced4 admin admin] PATH_INFO: `/v3/projects/aeee3855dfd344a9acb244e2696e38c0/users/65f8413f34ee449db5ab1f9e43c90d16/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.497043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2683/5350] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:30 2022] DELETE /identity/v3/users/5189cf21d35442b68af773ccb76f5627 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:30.498994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.500629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.507832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6bc4b-90d1-4fd7-b8ae-452307b7ced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeee3855dfd344a9acb244e2696e38c0, user_id=65f8413f34ee449db5ab1f9e43c90d16, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.512709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6bc4b-90d1-4fd7-b8ae-452307b7ced4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.519113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:30.545961 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2668/5351] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:30 2022] PUT /identity/v3/projects/aeee3855dfd344a9acb244e2696e38c0/users/65f8413f34ee449db5ab1f9e43c90d16/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:30.559754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.560078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.560360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.595084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] MFA Rules not processed for user `65f8413f34ee449db5ab1f9e43c90d16`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:30.596318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.605998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82f18c-b23c-4189-b81b-e456bbc4ec67 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.676815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2669/5352] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:30.681391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.687664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.688340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.688627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.689296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/domains/01afcd6eaace49c6abf337e0d6d9a0fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.690352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=01afcd6eaace49c6abf337e0d6d9a0fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.692053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.718655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.719468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.752632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.754388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.757017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2684/5353] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:10:30 2022] PATCH /identity/v3/domains/01afcd6eaace49c6abf337e0d6d9a0fa => generated 278 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:30.761677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.764182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.781913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d41c24-4d60-46e3-9cf0-2a12d2c3c756 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.871120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:30.883551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13676e-8349-4ceb-96d6-758ef06f0113 tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:30.893475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.893475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.893687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.894873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.896025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.898825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.902193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c604523e54504062a6518876d4df888f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cff31acc927a45169552c8aec0f3eabc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:30.903092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:30.903561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:30.904127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] PATH_INFO: `/v3/domains/01afcd6eaace49c6abf337e0d6d9a0fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:30.919765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=01afcd6eaace49c6abf337e0d6d9a0fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:30.922344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:30.944535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:30.952761 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2670/5354] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:30 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:10:30.953694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:30.955602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:30.956807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:30.970558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.025735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa', 'request_id': 'req-741a12a5-6412-443b-9af4-a23c8d360d4b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.035546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa', 'request_id': 'req-741a12a5-6412-443b-9af4-a23c8d360d4b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.043525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa', 'request_id': 'req-741a12a5-6412-443b-9af4-a23c8d360d4b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.071164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] The token cache is being invalidate because project 01afcd6eaace49c6abf337e0d6d9a0fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:31.071620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.072533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.092535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa', 'request_id': 'req-741a12a5-6412-443b-9af4-a23c8d360d4b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.093837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa', 'request_id': 'req-741a12a5-6412-443b-9af4-a23c8d360d4b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.098083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5b95-281c-4b55-b1b8-01ac91e2f35c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.102691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '01afcd6eaace49c6abf337e0d6d9a0fa', 'request_id': 'req-741a12a5-6412-443b-9af4-a23c8d360d4b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.109832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2685/5355] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:30 2022] DELETE /identity/v3/domains/01afcd6eaace49c6abf337e0d6d9a0fa => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:31.113556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.115374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:31.180089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.180736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.181022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.181298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.181979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.184143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.212433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a12a5-6412-443b-9af4-a23c8d360d4b tempest-UsersV3TestJSON-1489046636 tempest-UsersV3TestJSON-1489046636-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.218249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.218992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.219533 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2671/5356] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:30 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:31.222351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.222662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] PATH_INFO: `/v3/users/920b0d80be364808978436af4b8b1d01` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.223326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.224701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=920b0d80be364808978436af4b8b1d01)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.225354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:31.227110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.250616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ede57d-d88f-4be6-bc56-1fb8416b97d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.267136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.267954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.268328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.268697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.269794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.271386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.294150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2672/5357] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:31.297569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.311670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920b0d80be364808978436af4b8b1d01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.313063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402399af-2f11-4884-bb56-36b9254f63c3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.322476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.323295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.323962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.325551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920b0d80be364808978436af4b8b1d01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.326206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920b0d80be364808978436af4b8b1d01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.329398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.330139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.331793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.335181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:31.339151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920b0d80be364808978436af4b8b1d01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.340053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a3d8db65-1678-42b1-8f70-a821f9353db0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920b0d80be364808978436af4b8b1d01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:31.361139 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2673/5358] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:31.365345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.369435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:31.372914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2686/5359] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:31 2022] DELETE /identity/v3/users/920b0d80be364808978436af4b8b1d01 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:31.377765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.378207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.378582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.398462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13558fc-593b-4ec9-8126-9c8cdcdefb12 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.413073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:31.415144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:31.499948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:31.515956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe445558-486b-4fa7-9890-e98813a9031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.516751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe445558-486b-4fa7-9890-e98813a9031f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.517099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe445558-486b-4fa7-9890-e98813a9031f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.517444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe445558-486b-4fa7-9890-e98813a9031f admin admin] PATH_INFO: `/v3/projects/e3bb1db6c3fe4a7d826d8638fe5eaae9/users/74a3a7be4419445f96eb695869e37dc8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.526378 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2687/5360] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:31.541185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe445558-486b-4fa7-9890-e98813a9031f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3bb1db6c3fe4a7d826d8638fe5eaae9, user_id=74a3a7be4419445f96eb695869e37dc8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.545520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe445558-486b-4fa7-9890-e98813a9031f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.557105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.559839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:31.571442 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2674/5361] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:31 2022] PUT /identity/v3/projects/e3bb1db6c3fe4a7d826d8638fe5eaae9/users/74a3a7be4419445f96eb695869e37dc8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:31.583003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.583210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.583471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.635268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75d5ea-f156-4fea-a1a7-ac1c06919fdf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.649485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] MFA Rules not processed for user `74a3a7be4419445f96eb695869e37dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:31.652807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:31.720908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.721544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.721864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.722144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.777271 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2675/5362] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:31.778468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.804510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:31.831387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.834273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.852721 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2688/5363] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:31.868359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9704c-63ce-4a3c-90f7-b2f49eac02e6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:31.876183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:31.876819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:31.877512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:31.877512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:31.878806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:31.881014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:31.928453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:31.929858 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2676/5364] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:31 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:31.943609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cf3be-25eb-48fc-90c7-bdf97eb2e498 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:32.015763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:32.016979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.016979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.017228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.017894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:32.020064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:32.066863 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2689/5365] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:31 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:32.068235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:32.102033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20697701-eb58-410e-985b-24c14a11b18e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:32.107542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:32.109054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.109410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.109751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.110582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:32.112395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:32.139255 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2677/5366] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:32.144024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:32.158637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c849831-31bc-42a8-9958-b0abb9680edf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:32.170458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:32.171222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.171582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.171871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] PATH_INFO: `/v3/projects/782fbc8414fb4b62826f1ddad0126d76/users/851a87d8d4f442fb89b83270484260f8/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.216922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782fbc8414fb4b62826f1ddad0126d76, user_id=851a87d8d4f442fb89b83270484260f8, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:32.221228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:32.239377 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2690/5367] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:32 2022] PUT /identity/v3/projects/782fbc8414fb4b62826f1ddad0126d76/users/851a87d8d4f442fb89b83270484260f8/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:32.243595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:32.262210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69b35d-7844-4f1f-b23a-aa22828b0c22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:32.333092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:32.396946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94469d-7104-4480-abfa-2027fb52fe26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:32.399204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94469d-7104-4480-abfa-2027fb52fe26 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.399502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94469d-7104-4480-abfa-2027fb52fe26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.399784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94469d-7104-4480-abfa-2027fb52fe26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.400452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94469d-7104-4480-abfa-2027fb52fe26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:32.402730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94469d-7104-4480-abfa-2027fb52fe26 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:32.417247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2678/5368] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:32.421116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:32.434971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7aa54-7eb5-40e5-93ac-f5f7721a9258 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:32.441863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:32.443463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.443964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.444399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] PATH_INFO: `/v3/projects/782fbc8414fb4b62826f1ddad0126d76/users/851a87d8d4f442fb89b83270484260f8/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.446675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=782fbc8414fb4b62826f1ddad0126d76, user_id=851a87d8d4f442fb89b83270484260f8, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:32.450366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:32.476758 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2691/5369] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:32 2022] PUT /identity/v3/projects/782fbc8414fb4b62826f1ddad0126d76/users/851a87d8d4f442fb89b83270484260f8/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:32.487071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.488542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.488817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.566402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] MFA Rules not processed for user `851a87d8d4f442fb89b83270484260f8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:32.574681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:32.697879 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2679/5370] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:32.718502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:32.822269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845aa3fa-0f64-4b24-8660-9fc6be4ae90b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:32.834049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:32.834860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.836828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.837154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:32.852614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:32.884153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:32.888746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:32.956010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:32.972460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:32.974572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5922708-eee2-456f-8fb3-fc91ddd349fa service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:32.989678 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2692/5371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:32.991409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:32.991799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:32.992472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:33.020353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:33.022110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:33.047974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e1276-0026-4d49-a877-cf2be88f6577 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:33.055892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:33.055892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:33.055892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:33.055892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] PATH_INFO: `/v3/projects/be071bfdc7904032b658821cb91da6b6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:33.057260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be071bfdc7904032b658821cb91da6b6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:33.059236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:33.126412 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2693/5372] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:33.143347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:33.145866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:33.150788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be071bfdc7904032b658821cb91da6b6', 'request_id': 'req-abbdae48-3c98-4fdd-92fe-1533337f94c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.159553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be071bfdc7904032b658821cb91da6b6', 'request_id': 'req-abbdae48-3c98-4fdd-92fe-1533337f94c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.164377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:33.167507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be071bfdc7904032b658821cb91da6b6', 'request_id': 'req-abbdae48-3c98-4fdd-92fe-1533337f94c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.188725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] The token cache is being invalidate because project be071bfdc7904032b658821cb91da6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:33.189524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.190470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.197334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2680/5373] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:32 2022] DELETE /identity/v3/projects/be071bfdc7904032b658821cb91da6b6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:33.198406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:33.199837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:33.254060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b39e8-05f1-40a5-b105-b889c1ce12b0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:33.293435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdae48-3c98-4fdd-92fe-1533337f94c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:33.299651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:33.300313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:33.300597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:33.300873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] PATH_INFO: `/v3/users/c604523e54504062a6518876d4df888f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:33.306674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c604523e54504062a6518876d4df888f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:33.309696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:33.351308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:33.352367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:33.353261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:33.354083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:33.357285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:33.379777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c604523e54504062a6518876d4df888f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.393865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c604523e54504062a6518876d4df888f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.394744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c604523e54504062a6518876d4df888f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.410486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c604523e54504062a6518876d4df888f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.411497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e51e00b-6884-4d10-8e93-a2c692f802db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c604523e54504062a6518876d4df888f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:33.413295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:33.433004 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2681/5374] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:33 2022] DELETE /identity/v3/users/c604523e54504062a6518876d4df888f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:33.447767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:33.449530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:33.462340 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2694/5375] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:10:33.629289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855542b8-889c-410c-b64b-8ac23e9890f4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:33.629577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855542b8-889c-410c-b64b-8ac23e9890f4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:33.629940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855542b8-889c-410c-b64b-8ac23e9890f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:33.656527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-855542b8-889c-410c-b64b-8ac23e9890f4 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:33.657887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-855542b8-889c-410c-b64b-8ac23e9890f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:33.732585 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2682/5376] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:33.748701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:33.750561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:33.768143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb6fb1-c0c1-4104-9640-1fbf9648f041 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:33.882989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:33.884656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:33.884656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:33.885074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:33.915672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:33.918021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:33.944153 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2695/5377] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:34.139279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:34.139905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:34.140415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:34.200976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:34.203110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:34.217239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2683/5378] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:10:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:34.233697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:34.235491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:34.255326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b7bb8-d27f-4f56-8c03-f65f14f5bfa6 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:34.262461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d17d38-d8af-4e08-af55-a7c5d2e02384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:34.263497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17d38-d8af-4e08-af55-a7c5d2e02384 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:34.264136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17d38-d8af-4e08-af55-a7c5d2e02384 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:34.264782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d17d38-d8af-4e08-af55-a7c5d2e02384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:34.275047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17d38-d8af-4e08-af55-a7c5d2e02384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:34.276654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d17d38-d8af-4e08-af55-a7c5d2e02384 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:34.301942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2696/5379] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:10:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:10:34.433854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:34.435854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:34.443926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:34.531859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9a0b8-fc3d-4142-b7ad-62488e141b24 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:34.536884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:34.537750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:34.538212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:34.538548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] PATH_INFO: `/v3/users/d1dc27c611114996857a8c1ee7a573a6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:34.539766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dc27c611114996857a8c1ee7a573a6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:34.541785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:34.605666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dc27c611114996857a8c1ee7a573a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:34.619974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dc27c611114996857a8c1ee7a573a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:34.621101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dc27c611114996857a8c1ee7a573a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:34.629083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dc27c611114996857a8c1ee7a573a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:34.630197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dc27c611114996857a8c1ee7a573a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:34.648429 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2684/5380] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:34 2022] DELETE /identity/v3/users/d1dc27c611114996857a8c1ee7a573a6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:34.652618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:34.653243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:34.653584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:34.679925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:34.681535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:34.763171 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2697/5381] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:34.792737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:34.796042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:34.871626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90bb25-5b53-473f-9147-bfd7726bf8a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:34.877274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819598ac-9266-4ff7-b753-998d9b93c5bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:34.878142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819598ac-9266-4ff7-b753-998d9b93c5bc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:34.879378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819598ac-9266-4ff7-b753-998d9b93c5bc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:34.879708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819598ac-9266-4ff7-b753-998d9b93c5bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:34.897796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819598ac-9266-4ff7-b753-998d9b93c5bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:34.899934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819598ac-9266-4ff7-b753-998d9b93c5bc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:34.913169 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2685/5382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:34.914451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:34.915915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:34.934881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5ae81-fdc8-47e3-b088-783e115814cd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:34.945154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:34.946097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:34.946219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:34.946501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] PATH_INFO: `/v3/projects/cff31acc927a45169552c8aec0f3eabc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:34.947850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff31acc927a45169552c8aec0f3eabc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:34.949883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.006221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff31acc927a45169552c8aec0f3eabc', 'request_id': 'req-9154bb1d-55a0-4504-a713-c00ec8fb85c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.011403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:35.017834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff31acc927a45169552c8aec0f3eabc', 'request_id': 'req-9154bb1d-55a0-4504-a713-c00ec8fb85c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.030476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff31acc927a45169552c8aec0f3eabc', 'request_id': 'req-9154bb1d-55a0-4504-a713-c00ec8fb85c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.056398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] The token cache is being invalidate because project cff31acc927a45169552c8aec0f3eabc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:35.056705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.058221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9154bb1d-55a0-4504-a713-c00ec8fb85c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.060150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2698/5383] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:34 2022] DELETE /identity/v3/projects/cff31acc927a45169552c8aec0f3eabc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:35.066373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.067448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.067925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.093492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:35.094893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:35.121077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:35.164880 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2686/5384] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:35.173719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.173887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.174223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.199460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:35.200838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:35.211828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2699/5385] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:35.216620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.230108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0b9ef-3f24-4893-b220-631c5b534631 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.240265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:35.242047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.242681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.243029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.243893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:35.244046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:35.246107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.263760 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2687/5386] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:35.268675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.279494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24031edd-8571-4f68-ba63-d0c9b5da36c9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.285054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:35.285963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.286314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.286663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.287863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:35.293864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.341273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2700/5387] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:35 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:35.341846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.362106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ed1c-f25d-4cec-aa5a-ddd6cc7ec11a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.498291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:35.498833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.499943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.500565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.502948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:35.508712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.566862 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2688/5388] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:35 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:35.567943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.591638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f269b-db50-4227-a465-4cbbb11062bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.597794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:35.599025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.599025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.599420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.600215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:35.602350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.608578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.611982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:35.637405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6b62b-6660-44b6-a842-9e3039eea441 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.650293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:35.650971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2701/5389] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:35.652398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.652535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.653129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.653339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] PATH_INFO: `/v3/projects/431409236f15444e85495d233664fff8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.657744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=431409236f15444e85495d233664fff8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:35.666517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.692954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c45a7-2379-46b2-86b3-8be67f89c0ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.707142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:35.707772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:35.708233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:35.708513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:35.709162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:35.711186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:35.745455 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2702/5390] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:35.753285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.774929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01d9b5-2edd-42cd-8fb6-4cf24d1d39f3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:35.822634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '431409236f15444e85495d233664fff8', 'request_id': 'req-60dfae61-f08d-4a32-9c55-5c306ed22750'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.862549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '431409236f15444e85495d233664fff8', 'request_id': 'req-60dfae61-f08d-4a32-9c55-5c306ed22750'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.904047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '431409236f15444e85495d233664fff8', 'request_id': 'req-60dfae61-f08d-4a32-9c55-5c306ed22750'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.953287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] The token cache is being invalidate because project 431409236f15444e85495d233664fff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:35.953571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.954366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:35.970571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2689/5391] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:35 2022] DELETE /identity/v3/projects/431409236f15444e85495d233664fff8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:35.971618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:35.973625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:36.000919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74d0e6-33ec-48bd-b8b3-3034647d7633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.002112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d0e6-33ec-48bd-b8b3-3034647d7633 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.002535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d0e6-33ec-48bd-b8b3-3034647d7633 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.002977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74d0e6-33ec-48bd-b8b3-3034647d7633 admin admin] PATH_INFO: `/v3/projects/f055157e01834ded901b2f3d84a17a72/users/f36ee864614745518eac90f4e2b066d9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.021832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:36.036299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d0e6-33ec-48bd-b8b3-3034647d7633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f055157e01834ded901b2f3d84a17a72, user_id=f36ee864614745518eac90f4e2b066d9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.041123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74d0e6-33ec-48bd-b8b3-3034647d7633 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.063640 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2703/5392] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:35 2022] PUT /identity/v3/projects/f055157e01834ded901b2f3d84a17a72/users/f36ee864614745518eac90f4e2b066d9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:36.065073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea970e-29e5-4be2-81f3-f65bda97e730 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.065429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea970e-29e5-4be2-81f3-f65bda97e730 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.065709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea970e-29e5-4be2-81f3-f65bda97e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.076268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfae61-f08d-4a32-9c55-5c306ed22750 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.087812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-afea970e-29e5-4be2-81f3-f65bda97e730 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:36.089148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afea970e-29e5-4be2-81f3-f65bda97e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:36.156973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.157646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.157998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.158278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.160181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:36.173295 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2704/5393] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:36.184014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ab-eb0b-4b85-91de-01992062c63b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.184306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ab-eb0b-4b85-91de-01992062c63b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.184607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2830ab-eb0b-4b85-91de-01992062c63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.220516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:36.230085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6e2830ab-eb0b-4b85-91de-01992062c63b None None] MFA Rules not processed for user `f36ee864614745518eac90f4e2b066d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:36.232350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6e2830ab-eb0b-4b85-91de-01992062c63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:36.357495 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2705/5394] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:36.362096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.362558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.362860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.367610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.369215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.388587 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2690/5395] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:36.391327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.413269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:36.416611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:36.418277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:36.430353 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2706/5396] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:36.436365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.461925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fbca0-d627-4174-a2a0-886537adff7a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.464009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55699ba-1e4a-477c-b56c-ecc6ba905a9e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.470796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.471350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.472852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.473139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.473788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.476139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.477202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.477341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.478179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.478897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.479742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:36.498682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.504038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.527695 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2691/5397] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:36.533260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.543652 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2707/5398] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:36.554500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.577292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61cd099-89e1-4037-a774-3fcf5e7ab3ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.705111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b5dd3-8e48-4f8f-b663-634e50002303 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.716011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.716675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.716964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.717236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.718240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.720012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.724347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.724997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.725284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.725748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.726490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.728698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.746247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:36.772165 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2692/5399] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/users => generated 290 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:36.773845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.791578 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2708/5400] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/projects => generated 395 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:36.797523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.802123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4f4c0-ce98-4c3e-85be-c122f9ea2d9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.933419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.934145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.934430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.935984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.936285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.937942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.943745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b47386-bfc4-45cf-bf71-034def20c1ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:36.956414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:36.958812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:36.959465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:36.961215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:36.962151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:36.966477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:36.967533 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2693/5401] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:36.970218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:36.995226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51566f25-4769-4889-a4d5-edb22bd4987f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.004280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:37.010727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.013909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.014332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.015112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] PATH_INFO: `/v3/projects/96451cc216694a308391bfaa6e81a5a3/users/c463383d5b264030a2275b9d0a731b13/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.022099 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2709/5402] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:36 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:37.024570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.051673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b13aa9-2c94-4881-9b96-b8133aab7849 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.059857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96451cc216694a308391bfaa6e81a5a3, user_id=c463383d5b264030a2275b9d0a731b13, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.062655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.066542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.067190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.067474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.067750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.068402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.070521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.091422 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2710/5403] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:37.096099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.096475 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2694/5404] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:36 2022] PUT /identity/v3/projects/96451cc216694a308391bfaa6e81a5a3/users/c463383d5b264030a2275b9d0a731b13/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:37.101282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.111300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a85f8-a25d-4a04-853f-728c4eb52ae5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.201870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.203499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.203778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.204050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.204712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.212766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.228980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4ace5-1878-48e2-aec1-3c5eaa92f462 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.234372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.235009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.235292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.235564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.236216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.238511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.241071 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2711/5405] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:37.246487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.259691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2695/5406] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:37.264582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.277697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145ccd6-012b-484d-b048-11839828e52a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.290263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9c15d-e08c-4f7d-bc15-7d0fc00520d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.291871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575a697-e7b4-40c1-a0e2-ac4802a5eb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.292570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575a697-e7b4-40c1-a0e2-ac4802a5eb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.292843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575a697-e7b4-40c1-a0e2-ac4802a5eb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.293115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575a697-e7b4-40c1-a0e2-ac4802a5eb99 admin admin] PATH_INFO: `/v3/projects/3e8451f602c24cf5bea6f42dab290345/users/0abfed1818be4d8fb042d536456c8e91/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.303301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.306055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.306332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.307836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] PATH_INFO: `/v3/projects/96451cc216694a308391bfaa6e81a5a3/users/c463383d5b264030a2275b9d0a731b13/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.313857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96451cc216694a308391bfaa6e81a5a3, user_id=c463383d5b264030a2275b9d0a731b13, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.321470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.322671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575a697-e7b4-40c1-a0e2-ac4802a5eb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8451f602c24cf5bea6f42dab290345, user_id=0abfed1818be4d8fb042d536456c8e91, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.326481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575a697-e7b4-40c1-a0e2-ac4802a5eb99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.347125 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2712/5407] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:37 2022] PUT /identity/v3/projects/3e8451f602c24cf5bea6f42dab290345/users/0abfed1818be4d8fb042d536456c8e91/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:37.360059 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2696/5408] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:37 2022] PUT /identity/v3/projects/96451cc216694a308391bfaa6e81a5a3/users/c463383d5b264030a2275b9d0a731b13/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:37.373509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148fc6d-1ac4-4f8f-a19f-8b8e8362f6a2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.379436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148fc6d-1ac4-4f8f-a19f-8b8e8362f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.379846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148fc6d-1ac4-4f8f-a19f-8b8e8362f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.385278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.393202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:37.450762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3148fc6d-1ac4-4f8f-a19f-8b8e8362f6a2 None None] MFA Rules not processed for user `0abfed1818be4d8fb042d536456c8e91`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:37.453460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3148fc6d-1ac4-4f8f-a19f-8b8e8362f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:37.510402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:37.519870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acab21-dbb9-42a2-b860-56c4c3925b15 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.604953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.605739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.606140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.606502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.611177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:37.631755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2713/5409] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:37.633351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.633726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.634021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.698227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] MFA Rules not processed for user `c463383d5b264030a2275b9d0a731b13`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:37.699491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:37.732654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.736671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.757222 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2697/5410] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:37.759150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.764854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:37.767946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:37.798803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7d87e-7a54-40fe-9a3e-837cba05b02e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.814043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.815733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.816123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.816521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.828202 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2714/5411] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:37.831937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.838601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.841152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.853189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102a1ee-e3d4-406b-bafa-ab5df0b4974c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.859645 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2698/5412] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:37 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:37.864320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.865239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.865687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.866151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.867100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.868796 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:37.868796 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:37.868796 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:37.870192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4301adf-6579-4010-b8c8-f90faf1559d7 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.893778 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2715/5413] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:10:37 2022] POST /identity/v3/regions => generated 223 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:10:37.898565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:37.913104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bec41-7bfb-4f0a-80c2-384fed16bb96 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:37.956379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.956674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.956956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.958862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:37.959794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:37.960095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:37.960310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:37.960944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:37.962004 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:37.962004 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:10:37.962004 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:10:37.963475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:37.996009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] MFA Rules not processed for user `0abfed1818be4d8fb042d536456c8e91`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:37.996009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:38.018813 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2699/5414] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:10:37 2022] POST /identity/v3/regions => generated 224 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:38.027002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.048961 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2716/5415] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:37 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:38.087003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cec036-32b7-4b04-8494-cdef7326f8cd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.101929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.102923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.103438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.103861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/fd7ea7cc-5d45-42ef-acbb-e94b921710b1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.105394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:create_region(region_id=fd7ea7cc-5d45-42ef-acbb-e94b921710b1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.107478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.153947 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2700/5416] 10.222.0.16 () {60 vars in 1259 bytes} [Sat Oct 29 03:10:38 2022] PUT /identity/v3/regions/fd7ea7cc-5d45-42ef-acbb-e94b921710b1 => generated 232 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:38.158610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.194733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fef02-4797-4d17-bcd5-95014f3322ed None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.217000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.217954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.218790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.219235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/fd7ea7cc-5d45-42ef-acbb-e94b921710b1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.219990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fd7ea7cc-5d45-42ef-acbb-e94b921710b1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.221928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.257980 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2717/5417] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:10:38 2022] DELETE /identity/v3/regions/fd7ea7cc-5d45-42ef-acbb-e94b921710b1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:38.262735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.296511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74cb17-7f06-4d37-9949-74ae133ec08c tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.328241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.329162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.329768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.330450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.331568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.340031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.385489 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2701/5418] 10.222.0.16 () {60 vars in 1150 bytes} [Sat Oct 29 03:10:38 2022] POST /identity/v3/regions => generated 253 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:38.389512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.400685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d17f7-ace6-4b40-af2d-b1b4004dcab1 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.416590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.417166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.417449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.417726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/94279087cd5542e4825f537b1363aa26` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.418453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:update_region(region_id=94279087cd5542e4825f537b1363aa26)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.419640 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:38.419640 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:38.419640 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:38.420545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.451921 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2718/5419] 10.222.0.16 () {60 vars in 1250 bytes} [Sat Oct 29 03:10:38 2022] PATCH /identity/v3/regions/94279087cd5542e4825f537b1363aa26 => generated 252 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:38.453772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.466476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc48ab-36e6-4df1-96a8-21a96a33756b tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.474459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:38.487421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.488223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.488842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.489131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/94279087cd5542e4825f537b1363aa26` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.489732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:get_region(region_id=94279087cd5542e4825f537b1363aa26)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.491570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.501865 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2702/5420] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:38 2022] GET /identity/v3/regions/94279087cd5542e4825f537b1363aa26 => generated 252 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:38.503944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.517931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5eb65-554d-43c7-a84d-ce306bc82577 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.524988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.525928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.526374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.526917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/94279087cd5542e4825f537b1363aa26` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.527828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=94279087cd5542e4825f537b1363aa26)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.529600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.569316 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2719/5421] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:38 2022] DELETE /identity/v3/regions/94279087cd5542e4825f537b1363aa26 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:38.571550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.585639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bca4d0-5879-4f81-900a-42f9769cd86f tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.614824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.616073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.616425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.616763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.618899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.620793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.632857 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2703/5422] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 03:10:38 2022] GET /identity/v3/regions => generated 669 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:38.634614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.649304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692350-d6d2-4d7d-b456-ba437d9c6f1d tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.657603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.658717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.659099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.659498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/94279087cd5542e4825f537b1363aa26` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.660397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=94279087cd5542e4825f537b1363aa26)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.662339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Could not find region: 94279087cd5542e4825f537b1363aa26.: keystone.exception.RegionNotFound: Could not find region: 94279087cd5542e4825f537b1363aa26. Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 94279087cd5542e4825f537b1363aa26. Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:38.676100 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: 94279087cd5542e4825f537b1363aa26. Oct 29 03:10:38.677533 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:38.680668 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2720/5423] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:38 2022] DELETE /identity/v3/regions/94279087cd5542e4825f537b1363aa26 => generated 112 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:10:38.687502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.704402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d87f55-d019-4f22-af42-733affcf46cc tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.709721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.711386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.711897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.712688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.713066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.714401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.721259 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2704/5424] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 03:10:38 2022] GET /identity/v3/regions => generated 669 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:38.727492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.740935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54912085-d80c-4246-9886-8b4f9b8aa411 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.748722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.749978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.750365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.750990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.751656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.753433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.800093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.811541 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2721/5425] 10.222.0.16 () {60 vars in 1150 bytes} [Sat Oct 29 03:10:38 2022] POST /identity/v3/regions => generated 253 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:38.815568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.875597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f930ea-9bc1-4aa2-ba1e-bc4f2a2f4dfd tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.884219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.885364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.885978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.889952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.891314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Adding query filter params (parent_region_id=16644a4fae34411d91826445448f8c6a) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:38.891725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.893093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.901829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2722/5426] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:10:38 2022] GET /identity/v3/regions?parent_region_id=16644a4fae34411d91826445448f8c6a => generated 399 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:38.931386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:38.954341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b025ae6-db9f-438f-aef8-b42e00ac8eb9 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.979059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.979754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:38.980083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:38.980354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] PATH_INFO: `/v3/users/0abfed1818be4d8fb042d536456c8e91` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:38.981830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0abfed1818be4d8fb042d536456c8e91)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:38.982861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff63a1-df75-4a8a-92f8-a751d551bdcf tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:38.986470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:38.998077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:38.999498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.000032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.000527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/658ec0db8daf407089a3e57a384c7f90` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:39.001643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=658ec0db8daf407089a3e57a384c7f90)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:39.012552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:39.052874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2723/5427] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:38 2022] DELETE /identity/v3/regions/658ec0db8daf407089a3e57a384c7f90 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:39.057656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:39.090977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0abfed1818be4d8fb042d536456c8e91'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.094335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:39.109330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b30180-b877-47b5-9b68-3c9e337f17d3 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:39.116351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:39.117902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.118292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.119035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/aa321b864cdc491e9bdf5e3bb71026d4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:39.120387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=aa321b864cdc491e9bdf5e3bb71026d4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:39.122451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:39.147812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0abfed1818be4d8fb042d536456c8e91'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.148714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0abfed1818be4d8fb042d536456c8e91'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.151953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2724/5428] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:39 2022] DELETE /identity/v3/regions/aa321b864cdc491e9bdf5e3bb71026d4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:39.155795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:39.159031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:39.165950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0abfed1818be4d8fb042d536456c8e91'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.167836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e6ff62e8-4ff7-455e-8d17-a40c85e3aa36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0abfed1818be4d8fb042d536456c8e91'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.195824 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2705/5429] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:38 2022] DELETE /identity/v3/users/0abfed1818be4d8fb042d536456c8e91 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:39.200420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.200932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.201373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:39.215500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230eea0b-fb81-4f86-b82e-6af565eec4f6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:39.248886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:39.251820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:39.304397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:39.354656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c463383d5b264030a2275b9d0a731b13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96451cc216694a308391bfaa6e81a5a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:39.355484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.355865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.356241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] PATH_INFO: `/v3/regions/16644a4fae34411d91826445448f8c6a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:39.356938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorizing `identity:delete_region(region_id=16644a4fae34411d91826445448f8c6a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:39.359893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:39.399894 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2725/5430] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:10:39 2022] DELETE /identity/v3/regions/16644a4fae34411d91826445448f8c6a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:39.403762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:39.407282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:39.409098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2706/5431] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:39.440305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524c85-4ce8-4384-939c-8a44fd84d0a6 tempest-RegionsTestJSON-2079310913 tempest-RegionsTestJSON-2079310913-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:39.446812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:39.447674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.447959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.448283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] PATH_INFO: `/v3/users/f36ee864614745518eac90f4e2b066d9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:39.450178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f36ee864614745518eac90f4e2b066d9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:39.452398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:39.534336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:39.535577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f36ee864614745518eac90f4e2b066d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.536962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:39.549975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f36ee864614745518eac90f4e2b066d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.551083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f36ee864614745518eac90f4e2b066d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.575570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f36ee864614745518eac90f4e2b066d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.576710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-af6e55af-d3d0-4d77-9ade-5f061d9ccc2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f36ee864614745518eac90f4e2b066d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:39.615175 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2726/5432] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:39 2022] DELETE /identity/v3/users/f36ee864614745518eac90f4e2b066d9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:39.620155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.620715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.621156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:39.668956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:39.670477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:39.699844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:39.773446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028e426-ab0f-42e8-bad1-5af5e414ebe1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:39.886211 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2727/5433] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:39.904455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:39.906390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:39.991605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:39.994031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:39.995652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:39.996909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:40.001581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:40.034799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:40.039440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:40.067020 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2707/5434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:40.068891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241567d4-dc1c-4595-b3eb-d621e822494b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:40.073557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:40.074525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:40.075065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:40.075510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:40.088024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:40.090122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:40.109313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2728/5435] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:10:40.967579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:40.970199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:41.002687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b1894-2157-490a-96e2-51c8a0ccaf7f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:41.019385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:41.020678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:41.021181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:41.021935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] PATH_INFO: `/v3/projects/f055157e01834ded901b2f3d84a17a72` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:41.023592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f055157e01834ded901b2f3d84a17a72)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:41.025614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:41.210637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f055157e01834ded901b2f3d84a17a72', 'request_id': 'req-efb66562-a7c0-4ef9-9b9a-ededb2982a46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.240197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f055157e01834ded901b2f3d84a17a72', 'request_id': 'req-efb66562-a7c0-4ef9-9b9a-ededb2982a46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.245483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:41.260302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f055157e01834ded901b2f3d84a17a72', 'request_id': 'req-efb66562-a7c0-4ef9-9b9a-ededb2982a46'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.290456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] The token cache is being invalidate because project f055157e01834ded901b2f3d84a17a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:41.290767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.293893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.297581 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2708/5436] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:40 2022] DELETE /identity/v3/projects/f055157e01834ded901b2f3d84a17a72 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:41.301790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:41.317525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23311ce2-b501-47c0-b6ed-7b6d0faf3a3d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:41.457287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:41.458005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:41.458287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:41.458559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] PATH_INFO: `/v3/users/c463383d5b264030a2275b9d0a731b13` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:41.459850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c463383d5b264030a2275b9d0a731b13)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:41.461845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:41.526186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c463383d5b264030a2275b9d0a731b13'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.543310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c463383d5b264030a2275b9d0a731b13'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.543310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c463383d5b264030a2275b9d0a731b13'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.602393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c463383d5b264030a2275b9d0a731b13'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.605254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c463383d5b264030a2275b9d0a731b13'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:41.613905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:41.661664 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2729/5437] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:41 2022] DELETE /identity/v3/users/c463383d5b264030a2275b9d0a731b13 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:42.384260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:42.386200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:42.577738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb66562-a7c0-4ef9-9b9a-ededb2982a46 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:42.689226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:42.691214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:42.691613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:42.691968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:42.694569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:42.886401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:42.892040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:42.926033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:42.928497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:42.929034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2709/5438] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:42.967345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948e5d55-cf99-4945-af98-29849beeeef2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:42.979593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:42.982312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:42.983487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:42.984043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] PATH_INFO: `/v3/projects/3e8451f602c24cf5bea6f42dab290345` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:42.988493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8451f602c24cf5bea6f42dab290345)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:42.994180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:43.092089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8451f602c24cf5bea6f42dab290345', 'request_id': 'req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.105031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8451f602c24cf5bea6f42dab290345', 'request_id': 'req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.116895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8451f602c24cf5bea6f42dab290345', 'request_id': 'req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.131926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.133436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:43.154212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] The token cache is being invalidate because project 3e8451f602c24cf5bea6f42dab290345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:43.154624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.155298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a015bf9c-df8d-46d7-ad36-d4103a6d1e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.159391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2730/5439] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:42 2022] DELETE /identity/v3/projects/3e8451f602c24cf5bea6f42dab290345 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:43.164699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2390682-3339-43c7-9913-f107c8f886ae None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.164994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2390682-3339-43c7-9913-f107c8f886ae None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.165263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2390682-3339-43c7-9913-f107c8f886ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.170349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d18484-b307-4ff0-9d0c-4c34932014e5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:43.206540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c2390682-3339-43c7-9913-f107c8f886ae None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:43.210862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2390682-3339-43c7-9913-f107c8f886ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:43.283885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:43.309922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:43.311106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.311731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.312777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] PATH_INFO: `/v3/projects/96451cc216694a308391bfaa6e81a5a3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.315225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96451cc216694a308391bfaa6e81a5a3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:43.319049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:43.367584 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2731/5440] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:43.374598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.375210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.375688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.422391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:43.424091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:43.443243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96451cc216694a308391bfaa6e81a5a3', 'request_id': 'req-ca749675-dd84-4874-8309-e044b4f877c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.463048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96451cc216694a308391bfaa6e81a5a3', 'request_id': 'req-ca749675-dd84-4874-8309-e044b4f877c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.477290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96451cc216694a308391bfaa6e81a5a3', 'request_id': 'req-ca749675-dd84-4874-8309-e044b4f877c5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.511362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] The token cache is being invalidate because project 96451cc216694a308391bfaa6e81a5a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:43.511830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.512654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ca749675-dd84-4874-8309-e044b4f877c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:43.519784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2710/5441] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:43 2022] DELETE /identity/v3/projects/96451cc216694a308391bfaa6e81a5a3 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:43.521609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f14d-6121-4a73-80ec-f630b6044dfe None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.522037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f14d-6121-4a73-80ec-f630b6044dfe None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.522370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18f14d-6121-4a73-80ec-f630b6044dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.545836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea18f14d-6121-4a73-80ec-f630b6044dfe None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:43.547990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea18f14d-6121-4a73-80ec-f630b6044dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:43.550231 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2732/5442] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:43.560990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.575280 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2711/5443] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:43.577926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.578245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.578681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.588350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1fb1e-da91-4f31-bc09-9b0bef1d96ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:43.613903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:43.615958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.618091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.618451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.621162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:43.621579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:43.624705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:43.627823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:43.629382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:43.630553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:43.666855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2712/5444] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:43.677550 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2733/5445] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:10:43.678825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.682286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.704401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abbe3f-9f69-4302-92f5-1bdf93498ac9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:43.709987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f56416-a772-4e16-983e-07a62596435a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:43.719949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:43.721459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.722845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.726251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.727129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:10:43.727769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:43.728939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:43.729428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:43.730029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.730507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.730972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.731991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:43.734713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:43.759680 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2713/5446] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:43.764658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.783436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6454f-18e8-4793-b92d-701ed0f5887b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:43.795072 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2734/5447] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/projects => generated 397 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:43.802842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:43.803866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:43.804256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:43.804621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:43.804926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.805504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:43.809017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:43.873525 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2714/5448] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:43.877030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:43.934694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ca399-8dd7-450b-93ca-12785c3a54b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.093258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce64a5-c65d-4b73-a60d-081a70b46b94 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.107235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.109530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.109831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.110933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.112629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.119245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.123409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.124174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.124681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.125011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.125750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.129538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.178960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2735/5449] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/users => generated 299 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:44.182910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2715/5450] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:43 2022] POST /identity/v3/users => generated 285 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:44.183082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.184306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.200440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706828f-4411-48e4-9eea-75fbdce4e8fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.207651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53236f16-9ede-43f5-bdfd-f6be512ec9dc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.216839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.217756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.218368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.218856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.219242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.219884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.220167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.220446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.221534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.222433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.222782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.225929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.239768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2716/5451] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:44.245494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.253765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2736/5452] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:44.257719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.271054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c8698-7ef6-4773-b9d5-2f8b4b124cb4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.278086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ddc29-2713-4d71-aa5a-cc1f3e093356 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.281794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.282451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.282738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.283312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.283628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.286250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.290121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:44.295666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.296306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.296586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.296883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.297492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.299167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.320714 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2717/5453] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:44.322027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.331210 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2737/5454] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:44.335199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.345742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb999e-d1ee-490a-ade8-064a6d2b6e67 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.354461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd68ea-11ab-404f-a9b6-3de7148293b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.358408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc3768f-5695-4452-95a6-243fec033b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.359109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3768f-5695-4452-95a6-243fec033b8e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.359387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3768f-5695-4452-95a6-243fec033b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.359664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc3768f-5695-4452-95a6-243fec033b8e admin admin] PATH_INFO: `/v3/projects/036cbf9fda0a461d8f24468f73d9efc9/users/54f449af393d402bbf0b88b5f4bd97c5/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.369341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b9797-f215-4964-a121-ace2ef6a842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.370240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9797-f215-4964-a121-ace2ef6a842f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.370382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9797-f215-4964-a121-ace2ef6a842f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.370681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b9797-f215-4964-a121-ace2ef6a842f admin admin] PATH_INFO: `/v3/projects/50ec8b68206e47ff894b19726e829260/users/57ad9751505044e7a5e3a17d2da06fb7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.397459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3768f-5695-4452-95a6-243fec033b8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=036cbf9fda0a461d8f24468f73d9efc9, user_id=54f449af393d402bbf0b88b5f4bd97c5, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.402272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc3768f-5695-4452-95a6-243fec033b8e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.407337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9797-f215-4964-a121-ace2ef6a842f admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ec8b68206e47ff894b19726e829260, user_id=57ad9751505044e7a5e3a17d2da06fb7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.412542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b9797-f215-4964-a121-ace2ef6a842f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.443374 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2718/5455] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:44 2022] PUT /identity/v3/projects/036cbf9fda0a461d8f24468f73d9efc9/users/54f449af393d402bbf0b88b5f4bd97c5/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:44.446246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.446496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.446907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.447137 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2738/5456] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:44 2022] PUT /identity/v3/projects/50ec8b68206e47ff894b19726e829260/users/57ad9751505044e7a5e3a17d2da06fb7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:44.452345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.452987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.456468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.514627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:44.514795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] MFA Rules not processed for user `54f449af393d402bbf0b88b5f4bd97c5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:44.515974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:44.521468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:44.578166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:44.642820 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2719/5457] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:44.647193 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2739/5458] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:44.649147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.661153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61ed47-ce97-4ff4-b51b-9ee781aaf98b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.666507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.667279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.667566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.667840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.668751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.671132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.672814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.674473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:44.754319 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2720/5459] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:10:44 2022] POST /identity/v3/projects => generated 369 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:44.755438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:44.833414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6410d6-b6b6-41cc-8305-fc4f4f5f4e10 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.908657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bc310-e135-4776-bb43-ec1a32a55df7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:44.914011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.914640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.914916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.915188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.930026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:44.935295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:44.968696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:44.969437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:44.970220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:44.971562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:44.995644 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2721/5460] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:44 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:44.998803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.017233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.023711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.033750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1b4a0-5760-435a-85ad-cf317282867e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.054628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.058349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.058635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.058908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.060209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.061182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.066389 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2740/5461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:45.096491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.102236 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2722/5462] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:45.113240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5272226d-bbd1-48c6-8fed-db5d67944c66 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.126060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.129425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.131228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.131739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] PATH_INFO: `/v3/projects/4a35c93eec114499977fbb72985651f9/users/b59e9eab715f420ea35b7b5629af1faf/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.167085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a35c93eec114499977fbb72985651f9, user_id=b59e9eab715f420ea35b7b5629af1faf, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.175617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.211077 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2741/5463] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:45 2022] PUT /identity/v3/projects/4a35c93eec114499977fbb72985651f9/users/b59e9eab715f420ea35b7b5629af1faf/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:45.215928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.232392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6bd27-351c-43da-b20f-104bc3065005 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.271409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:45.343776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6e536-c863-45b8-962f-bc4a8b6d54c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.344542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e536-c863-45b8-962f-bc4a8b6d54c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.346054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e536-c863-45b8-962f-bc4a8b6d54c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.346467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6e536-c863-45b8-962f-bc4a8b6d54c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.347399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6e536-c863-45b8-962f-bc4a8b6d54c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.349134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6e536-c863-45b8-962f-bc4a8b6d54c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.367916 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2723/5464] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:45.371851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.390770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f528b71-5ba8-4a48-b15a-523b8aa49334 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.406551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.407276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.407534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.407823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] PATH_INFO: `/v3/projects/4a35c93eec114499977fbb72985651f9/users/b59e9eab715f420ea35b7b5629af1faf/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.412864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a35c93eec114499977fbb72985651f9, user_id=b59e9eab715f420ea35b7b5629af1faf, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.415304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.454669 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2742/5465] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:45 2022] PUT /identity/v3/projects/4a35c93eec114499977fbb72985651f9/users/b59e9eab715f420ea35b7b5629af1faf/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:45.458942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.462180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.470172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.543451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] MFA Rules not processed for user `b59e9eab715f420ea35b7b5629af1faf`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:45.544993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:45.673220 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2724/5466] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:45.679469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.702285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576e66a-7ae5-479b-b104-05732031eb5d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.707138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.707765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.708047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.708320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.708951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.711148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.750435 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2743/5467] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:10:45 2022] POST /identity/v3/projects => generated 329 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:45.754654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.767972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032a3a3-9718-4aeb-8962-1c4709091a8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.871581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.872464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.872821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.873181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.874129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.876207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.911347 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2725/5468] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:45 2022] POST /identity/v3/users => generated 413 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:45.916593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.929898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61f2b7-fa0c-4c08-aafe-af9fe6fa3807 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.935084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.935802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.936167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.936502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.937268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.939032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:45.962849 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2744/5469] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:45 2022] POST /identity/v3/roles => generated 244 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:45.964213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:45.975752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8edf6-4a25-4e6d-a667-ff851cc6e368 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:45.980781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:45.981525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:45.981906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:45.982246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:45.982992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:45.984713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.007699 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2726/5470] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:45 2022] POST /identity/v3/roles => generated 247 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:46.011699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.023595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578fd89-adef-4d35-a0f3-1619e7fb9129 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.028640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.029445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.029963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.030311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/3cd94ac259ea41bebf17c285000109bc/users/83bf8fbb0315416791389dd80a939646/roles/704b72ce7ba9403a914f8635f54394b4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.035316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:46.060418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3cd94ac259ea41bebf17c285000109bc, user_id=83bf8fbb0315416791389dd80a939646, role_id=704b72ce7ba9403a914f8635f54394b4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:46.063362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.085404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2745/5471] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:46 2022] PUT /identity/v3/projects/3cd94ac259ea41bebf17c285000109bc/users/83bf8fbb0315416791389dd80a939646/roles/704b72ce7ba9403a914f8635f54394b4 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:46.087669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.101266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff65a94b-99c4-4971-bdc5-0fd37c38e141 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.118685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:46.177340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024fffd-bd14-4b2d-9702-4684c8d2c05b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.178218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024fffd-bd14-4b2d-9702-4684c8d2c05b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.178498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024fffd-bd14-4b2d-9702-4684c8d2c05b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.178771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024fffd-bd14-4b2d-9702-4684c8d2c05b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/3cd94ac259ea41bebf17c285000109bc/users/83bf8fbb0315416791389dd80a939646/roles/fc35c8cbd0aa46e29618edd83f226574` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.181023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024fffd-bd14-4b2d-9702-4684c8d2c05b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3cd94ac259ea41bebf17c285000109bc, user_id=83bf8fbb0315416791389dd80a939646, role_id=fc35c8cbd0aa46e29618edd83f226574)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:46.183731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024fffd-bd14-4b2d-9702-4684c8d2c05b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.208150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2727/5472] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:46 2022] PUT /identity/v3/projects/3cd94ac259ea41bebf17c285000109bc/users/83bf8fbb0315416791389dd80a939646/roles/fc35c8cbd0aa46e29618edd83f226574 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:46.212790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.224432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14415c69-0b41-4368-87f1-d1ffbe36f7b0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.316843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74244e8e-07f0-4138-9d88-af1d057c6e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.317491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74244e8e-07f0-4138-9d88-af1d057c6e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.317997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74244e8e-07f0-4138-9d88-af1d057c6e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.318280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74244e8e-07f0-4138-9d88-af1d057c6e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.320304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74244e8e-07f0-4138-9d88-af1d057c6e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:46.323084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74244e8e-07f0-4138-9d88-af1d057c6e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.370151 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2746/5473] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:46 2022] GET /identity/v3/users => generated 8622 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:46.376819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.383332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.386220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.451747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] MFA Rules not processed for user `83bf8fbb0315416791389dd80a939646`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:46.453467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:46.590865 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2728/5474] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:46.592854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.593141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.593420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.616675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] MFA Rules not processed for user `83bf8fbb0315416791389dd80a939646`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:46.618291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:46.625559 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2747/5475] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:46.630383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.642178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a360760-9568-4e86-aa33-8dfa9d9d0597 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.648657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bf8fbb0315416791389dd80a939646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd94ac259ea41bebf17c285000109bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1920797534', 'tempest-NotDelegatedRole-1907739169'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.649306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.649600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.650436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.650752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:46.651962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.765436 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2729/5476] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:10:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:46.769287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.789007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d518e-683e-4d66-bef5-53618be856d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.801002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.801936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.802458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.803174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.804062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:46.805338 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:10:46.805338 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:10:46.805338 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:10:46.807477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.821130 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2748/5477] 10.222.0.16 () {58 vars in 1155 bytes} [Sat Oct 29 03:10:46 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:46.825237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.840231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee71603-0501-444d-8cc7-1c41d814f152 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.847687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bf8fbb0315416791389dd80a939646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd94ac259ea41bebf17c285000109bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1920797534', 'tempest-NotDelegatedRole-1907739169'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.848631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.849533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.850229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] PATH_INFO: `/v3/OS-TRUST/trusts/48723c95b76b4174bae7fc22a623771b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:46.867817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: Authorizing `identity:delete_trust(trust_id=48723c95b76b4174bae7fc22a623771b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:46.870872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:46.893538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:46.937370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '48723c95b76b4174bae7fc22a623771b', 'request_id': 'req-ae71cda2-e86e-435e-83f1-6c0812d7fbac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:46.938316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '48723c95b76b4174bae7fc22a623771b', 'request_id': 'req-ae71cda2-e86e-435e-83f1-6c0812d7fbac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:46.954284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '48723c95b76b4174bae7fc22a623771b', 'request_id': 'req-ae71cda2-e86e-435e-83f1-6c0812d7fbac'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:46.961899 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2730/5478] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:10:46 2022] DELETE /identity/v3/OS-TRUST/trusts/48723c95b76b4174bae7fc22a623771b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:46.965859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:46.967723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:46.987077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999e7c-9ad1-49f5-bedc-7aa46b912a7f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:46.991352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83bf8fbb0315416791389dd80a939646', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3cd94ac259ea41bebf17c285000109bc', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1920797534', 'tempest-NotDelegatedRole-1907739169'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:46.992010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:46.992751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:46.993027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] PATH_INFO: `/v3/OS-TRUST/trusts/48723c95b76b4174bae7fc22a623771b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Could not find trust: 48723c95b76b4174bae7fc22a623771b.: keystone.exception.TrustNotFound: Could not find trust: 48723c95b76b4174bae7fc22a623771b. Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 29 03:10:47.045027 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 48723c95b76b4174bae7fc22a623771b. Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:47.049789 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2749/5479] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:10:46 2022] GET /identity/v3/OS-TRUST/trusts/48723c95b76b4174bae7fc22a623771b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:10:47.053230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:47.056054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:47.110951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71cda2-e86e-435e-83f1-6c0812d7fbac tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:47.120477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:47.121265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:47.121612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:47.122022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/fc35c8cbd0aa46e29618edd83f226574` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:47.123559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fc35c8cbd0aa46e29618edd83f226574)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:47.126997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:47.216036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role fc35c8cbd0aa46e29618edd83f226574 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:47.216890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.218039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.231733 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2731/5480] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:47 2022] DELETE /identity/v3/roles/fc35c8cbd0aa46e29618edd83f226574 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:47.236130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:47.238198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:47.259676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900943a-d84a-45d9-963b-814596439192 tempest-TrustsV3TestJSON-1082340836 tempest-user-394369206] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:47.353605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:47.354335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:47.354615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:47.354889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/704b72ce7ba9403a914f8635f54394b4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:47.356440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=704b72ce7ba9403a914f8635f54394b4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:47.358294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:47.439254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 704b72ce7ba9403a914f8635f54394b4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:47.439615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.441284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.446967 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2750/5481] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:47 2022] DELETE /identity/v3/roles/704b72ce7ba9403a914f8635f54394b4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:47.448886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:47.467565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11fb9f-4da6-4482-854c-62860ff747c7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:47.583152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:47.583882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:47.584523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:47.584816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users/83bf8fbb0315416791389dd80a939646` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:47.586144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=83bf8fbb0315416791389dd80a939646)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:47.588156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:47.670005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bf8fbb0315416791389dd80a939646'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.689534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bf8fbb0315416791389dd80a939646'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.690451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bf8fbb0315416791389dd80a939646'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.702480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bf8fbb0315416791389dd80a939646'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.703337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bf8fbb0315416791389dd80a939646'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.722239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2732/5482] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:47 2022] DELETE /identity/v3/users/83bf8fbb0315416791389dd80a939646 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:47.728698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:47.730768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:47.746669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a3779-d0b5-418c-9ff0-3c1c99dcca6c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:47.784105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:47.862207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:47.862872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:47.863157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:47.863434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/3cd94ac259ea41bebf17c285000109bc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:47.864603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3cd94ac259ea41bebf17c285000109bc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:47.867074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:47.939708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd94ac259ea41bebf17c285000109bc', 'request_id': 'req-0a354b25-41f9-462d-8c44-f76f0721d255'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.947618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd94ac259ea41bebf17c285000109bc', 'request_id': 'req-0a354b25-41f9-462d-8c44-f76f0721d255'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.953996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd94ac259ea41bebf17c285000109bc', 'request_id': 'req-0a354b25-41f9-462d-8c44-f76f0721d255'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.973364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] The token cache is being invalidate because project 3cd94ac259ea41bebf17c285000109bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:47.974017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.975471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:47.977688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2751/5483] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:47 2022] DELETE /identity/v3/projects/3cd94ac259ea41bebf17c285000109bc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:47.982861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:47.985211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:48.002672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2599c2-55ea-4815-91dc-21b1d14e1ae0 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.029110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:48.096925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.097657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.098025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.098318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.099917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.101132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.142534 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2733/5484] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:10:47 2022] POST /identity/v3/projects => generated 329 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:48.146680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:48.148810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:48.161963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a354b25-41f9-462d-8c44-f76f0721d255 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.249000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.250947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.251234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.251507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.252982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.254955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.304495 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2752/5485] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:48 2022] POST /identity/v3/users => generated 413 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:48.308417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:48.320285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8e07d-9b62-4ddd-b65b-e957f42bc4cf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.329416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.329416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.329737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.329903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.330575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.332385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.360687 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2734/5486] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:48 2022] POST /identity/v3/roles => generated 243 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:48.364004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:48.379414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c1b46-00e2-4e7e-af42-3ebf626f74ec tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.387276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.387975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.388262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.388540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.389208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.390858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.421566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:48.422947 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2753/5487] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:48 2022] POST /identity/v3/roles => generated 246 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:48.439375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3233c05-aa72-4175-a12e-f42958a652ff tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.445554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.447051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.447336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.448279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/fd91e777a8024aaaa594fed6e95d9919/users/e97aed55f04045bd9c9a9655418892db/roles/d983033c5b514f5a9377d2e6ca417b4d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.486760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd91e777a8024aaaa594fed6e95d9919, user_id=e97aed55f04045bd9c9a9655418892db, role_id=d983033c5b514f5a9377d2e6ca417b4d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.494759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.519759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2735/5488] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:48 2022] PUT /identity/v3/projects/fd91e777a8024aaaa594fed6e95d9919/users/e97aed55f04045bd9c9a9655418892db/roles/d983033c5b514f5a9377d2e6ca417b4d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:48.524251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:48.536397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f80bbd-7797-47cb-875e-bcb217dd473e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.579845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:48.676300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dbae9-f133-48dd-a4db-00f8f9759931 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.677011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dbae9-f133-48dd-a4db-00f8f9759931 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.677288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dbae9-f133-48dd-a4db-00f8f9759931 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.677558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dbae9-f133-48dd-a4db-00f8f9759931 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/fd91e777a8024aaaa594fed6e95d9919/users/e97aed55f04045bd9c9a9655418892db/roles/3a59ae1755704366b73bcb4571247252` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.680215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dbae9-f133-48dd-a4db-00f8f9759931 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd91e777a8024aaaa594fed6e95d9919, user_id=e97aed55f04045bd9c9a9655418892db, role_id=3a59ae1755704366b73bcb4571247252)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.686574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825dbae9-f133-48dd-a4db-00f8f9759931 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.707402 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2754/5489] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:48 2022] PUT /identity/v3/projects/fd91e777a8024aaaa594fed6e95d9919/users/e97aed55f04045bd9c9a9655418892db/roles/3a59ae1755704366b73bcb4571247252 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:48.709243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:48.730957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e13182-175e-4c20-97fc-7eb664095949 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:48.822099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772bc5d-07a5-49ff-9394-a2910af2f8b8 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:48.824186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772bc5d-07a5-49ff-9394-a2910af2f8b8 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.824695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772bc5d-07a5-49ff-9394-a2910af2f8b8 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.825399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772bc5d-07a5-49ff-9394-a2910af2f8b8 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:48.826792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772bc5d-07a5-49ff-9394-a2910af2f8b8 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:48.829533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772bc5d-07a5-49ff-9394-a2910af2f8b8 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:48.947727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2736/5490] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:48 2022] GET /identity/v3/users => generated 8622 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:48.949018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:48.949305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:48.949580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.029106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] MFA Rules not processed for user `e97aed55f04045bd9c9a9655418892db`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:49.031650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:49.193973 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2755/5491] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:48 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:49.203496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:49.204328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:49.205213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.231639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] MFA Rules not processed for user `e97aed55f04045bd9c9a9655418892db`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:49.233147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:49.263130 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2737/5492] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:10:49.267432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:49.279656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d2e260-b9e7-4c7a-bb40-61621b65da77 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:49.290461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e97aed55f04045bd9c9a9655418892db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd91e777a8024aaaa594fed6e95d9919', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-510058208', 'tempest-NotDelegatedRole-624244854'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:49.291495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:49.292019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:49.292515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.293579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: Authorizing `identity:create_trust()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:49.295308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:49.479443 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2756/5493] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:10:49 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:49.483320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:49.496965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9759c5-9ef3-4a70-9898-f451e04f9bee None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:49.502158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e97aed55f04045bd9c9a9655418892db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd91e777a8024aaaa594fed6e95d9919', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-510058208', 'tempest-NotDelegatedRole-624244854'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:49.503404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:49.503888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:49.504558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.505439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:49.507131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:49.515000 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2738/5494] 10.222.0.16 () {58 vars in 1252 bytes} [Sat Oct 29 03:10:49 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=e97aed55f04045bd9c9a9655418892db => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:49.519143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:49.530508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5755d-0968-4fee-befb-1b72471e4eb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:49.536228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e97aed55f04045bd9c9a9655418892db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd91e777a8024aaaa594fed6e95d9919', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-510058208', 'tempest-NotDelegatedRole-624244854'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:49.537270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:49.539074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:49.539606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] PATH_INFO: `/v3/OS-TRUST/trusts/65361f6236a744129bce907678b4451e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.565533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: Authorizing `identity:delete_trust(trust_id=65361f6236a744129bce907678b4451e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:49.567470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:49.608661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '65361f6236a744129bce907678b4451e', 'request_id': 'req-802cbcff-8ca7-4e25-a74c-4b65c9143757'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:49.609242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '65361f6236a744129bce907678b4451e', 'request_id': 'req-802cbcff-8ca7-4e25-a74c-4b65c9143757'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:49.609920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '65361f6236a744129bce907678b4451e', 'request_id': 'req-802cbcff-8ca7-4e25-a74c-4b65c9143757'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:49.614833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:49.643545 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2757/5495] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:10:49 2022] DELETE /identity/v3/OS-TRUST/trusts/65361f6236a744129bce907678b4451e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:49.648239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:49.650179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:49.673647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4c5c5-2ffe-4798-a15d-66ec6ff37b5b tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:49.681591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e97aed55f04045bd9c9a9655418892db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fd91e777a8024aaaa594fed6e95d9919', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-510058208', 'tempest-NotDelegatedRole-624244854'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:49.682676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:49.683162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:49.683592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] PATH_INFO: `/v3/OS-TRUST/trusts/65361f6236a744129bce907678b4451e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Could not find trust: 65361f6236a744129bce907678b4451e.: keystone.exception.TrustNotFound: Could not find trust: 65361f6236a744129bce907678b4451e. Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 29 03:10:49.696995 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 65361f6236a744129bce907678b4451e. Oct 29 03:10:49.698413 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:49.701827 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2739/5496] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:10:49 2022] GET /identity/v3/OS-TRUST/trusts/65361f6236a744129bce907678b4451e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:10:49.705700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:49.707192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:49.723347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cbcff-8ca7-4e25-a74c-4b65c9143757 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:49.728471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:49.729136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:49.729422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:49.729701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/3a59ae1755704366b73bcb4571247252` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:49.731173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3a59ae1755704366b73bcb4571247252)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:49.732968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:49.787658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 3a59ae1755704366b73bcb4571247252 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:49.788442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:49.789423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:49.792548 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2758/5497] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:49 2022] DELETE /identity/v3/roles/3a59ae1755704366b73bcb4571247252 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:49.796452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:49.798332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:49.818203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6c85a-464d-4ef8-bf63-8213aa922cb2 tempest-TrustsV3TestJSON-1919460464 tempest-user-716590279] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:50.023450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:50.048712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:50.050678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:50.051115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:50.051518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/d983033c5b514f5a9377d2e6ca417b4d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:50.054095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d983033c5b514f5a9377d2e6ca417b4d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:50.055889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:50.128692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role d983033c5b514f5a9377d2e6ca417b4d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:50.129204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.129984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.132711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2740/5498] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:49 2022] DELETE /identity/v3/roles/d983033c5b514f5a9377d2e6ca417b4d => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:50.136551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:50.149908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee4b51-8e3d-4f30-aecd-740b56e9173c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:50.232458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:50.234026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:50.234026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:50.234386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users/e97aed55f04045bd9c9a9655418892db` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:50.235827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e97aed55f04045bd9c9a9655418892db)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:50.238099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:50.324234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97aed55f04045bd9c9a9655418892db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.344163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97aed55f04045bd9c9a9655418892db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.345228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97aed55f04045bd9c9a9655418892db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.354725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97aed55f04045bd9c9a9655418892db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.355684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97aed55f04045bd9c9a9655418892db'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.385780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2759/5499] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:50 2022] DELETE /identity/v3/users/e97aed55f04045bd9c9a9655418892db => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:50.389743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:50.392279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:50.409539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4817936-4103-439c-9755-9f49436e890a tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:50.487357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:50.488564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:50.488976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:50.489341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/fd91e777a8024aaaa594fed6e95d9919` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:50.490731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd91e777a8024aaaa594fed6e95d9919)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:50.493510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:50.577590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd91e777a8024aaaa594fed6e95d9919', 'request_id': 'req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.587421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd91e777a8024aaaa594fed6e95d9919', 'request_id': 'req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.599035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd91e777a8024aaaa594fed6e95d9919', 'request_id': 'req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.618726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] The token cache is being invalidate because project fd91e777a8024aaaa594fed6e95d9919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:50.619008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.619897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:50.625963 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2741/5500] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:50 2022] DELETE /identity/v3/projects/fd91e777a8024aaaa594fed6e95d9919 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:50.628661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:50.630614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:50.650815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875adeb-1bec-4719-a186-fff82a717b68 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:50.718326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:50.794706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:50.795346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:50.795698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:50.795882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:50.796513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:50.798915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:50.894134 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2760/5501] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:10:50 2022] POST /identity/v3/projects => generated 329 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:50.898382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:50.900946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:50.954786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c3d59-87dc-41b3-9e82-788fd3ffc8c6 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:51.067657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:51.178275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:51.179034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.179326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.179757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.180634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:51.182785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:51.212340 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2742/5502] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:50 2022] POST /identity/v3/users => generated 416 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:51.216482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:51.233317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fd40e-b376-4b5c-8c44-56efc32920eb tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:51.245826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:51.246485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.246767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.247040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.247726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:51.249339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:51.284037 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2761/5503] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:51 2022] POST /identity/v3/roles => generated 243 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:51.288107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:51.308524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065dde-3824-4a17-8107-35f42df90d9e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:51.322883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:51.323567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.323855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.324289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.324997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:51.326675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:51.367454 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2743/5504] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:51 2022] POST /identity/v3/roles => generated 247 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:51.371613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:51.392572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918d920-244b-47cd-bfa2-0518565426a9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:51.409216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:51.409936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.410221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.410497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/3c3c060f0056482abdc1fdc75f3530e3/users/de4e88ece9d1432398eaf13981c50997/roles/28aaf644ce9642dc92ad16b255377d1c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.464150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3c3c060f0056482abdc1fdc75f3530e3, user_id=de4e88ece9d1432398eaf13981c50997, role_id=28aaf644ce9642dc92ad16b255377d1c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:51.467319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:51.505552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2762/5505] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:51 2022] PUT /identity/v3/projects/3c3c060f0056482abdc1fdc75f3530e3/users/de4e88ece9d1432398eaf13981c50997/roles/28aaf644ce9642dc92ad16b255377d1c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:51.512143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:51.528593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4394c-1755-4f65-9c23-e17790200641 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:51.657153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e489b-2b5f-47c4-b056-ea2d05d574d1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:51.657884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e489b-2b5f-47c4-b056-ea2d05d574d1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.658176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e489b-2b5f-47c4-b056-ea2d05d574d1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.658442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e489b-2b5f-47c4-b056-ea2d05d574d1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/3c3c060f0056482abdc1fdc75f3530e3/users/de4e88ece9d1432398eaf13981c50997/roles/02b6bd2963494fd48eff2ca4fd91e1cf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.662124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e489b-2b5f-47c4-b056-ea2d05d574d1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3c3c060f0056482abdc1fdc75f3530e3, user_id=de4e88ece9d1432398eaf13981c50997, role_id=02b6bd2963494fd48eff2ca4fd91e1cf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:51.664844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e489b-2b5f-47c4-b056-ea2d05d574d1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:51.692098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2744/5506] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:51 2022] PUT /identity/v3/projects/3c3c060f0056482abdc1fdc75f3530e3/users/de4e88ece9d1432398eaf13981c50997/roles/02b6bd2963494fd48eff2ca4fd91e1cf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:51.696499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:51.721583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046a001-0f1f-4bae-84db-ba4854dfaa8c tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:51.854736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37da5e4-9fcd-4c95-a143-dbb1030d4be1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:51.855504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37da5e4-9fcd-4c95-a143-dbb1030d4be1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.856029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37da5e4-9fcd-4c95-a143-dbb1030d4be1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.856261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37da5e4-9fcd-4c95-a143-dbb1030d4be1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.857668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37da5e4-9fcd-4c95-a143-dbb1030d4be1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:51.859984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37da5e4-9fcd-4c95-a143-dbb1030d4be1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:51.910857 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2763/5507] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:51 2022] GET /identity/v3/users => generated 8625 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:51.915697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:51.916210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:51.917676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:51.963833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] MFA Rules not processed for user `de4e88ece9d1432398eaf13981c50997`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:51.965324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:52.068463 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2745/5508] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:51 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:52.079586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.080213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.080757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.123374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] MFA Rules not processed for user `de4e88ece9d1432398eaf13981c50997`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:52.126819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:52.145349 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2764/5509] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:52 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:52.150152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.162790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d742-d656-4fd1-8ff8-4262d96cbc5e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.174151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.174796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.175322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.175602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.176276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.177570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.248043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:52.384731 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2746/5510] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:10:52 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:52.388941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.405452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e9a8e-711e-4fb9-ae26-33fb23b1aedf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.414643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.415006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.415433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.416002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.439469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:get_trust(trust_id=198cd92153f64463a17597b533d0466a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.441555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.456301 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2765/5511] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:10:52 2022] GET /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a => generated 858 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:52.463339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.475730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8b67f-21f0-48d8-a079-c543381ae79a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.487937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.488554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.488829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.492729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.501176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=198cd92153f64463a17597b533d0466a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.504402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.513857 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2747/5512] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:10:52 2022] GET /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:52.518017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.531417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6f21d-ab83-4d69-951a-ecff31724a73 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.541553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.542749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.543227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.543734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/28aaf644ce9642dc92ad16b255377d1c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.551551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:get_role_for_trust(trust_id=198cd92153f64463a17597b533d0466a, role_id=28aaf644ce9642dc92ad16b255377d1c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.553608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.563320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2766/5513] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:10:52 2022] GET /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/28aaf644ce9642dc92ad16b255377d1c => generated 243 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:52.567434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.583658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302bbd3d-d5a1-4bfc-80ee-70a713997862 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.589675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.590843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.591320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.591824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/28aaf644ce9642dc92ad16b255377d1c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.601503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:get_role_for_trust(trust_id=198cd92153f64463a17597b533d0466a, role_id=28aaf644ce9642dc92ad16b255377d1c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.604709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.620177 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2748/5514] 10.222.0.16 () {58 vars in 1369 bytes} [Sat Oct 29 03:10:52 2022] HEAD /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/28aaf644ce9642dc92ad16b255377d1c => generated 0 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 29 03:10:52.625665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.637356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c377b39b-03e7-47c4-a0bf-c6c192c31eb7 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.645644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.646364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.646975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.647281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/02b6bd2963494fd48eff2ca4fd91e1cf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.656099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:get_role_for_trust(trust_id=198cd92153f64463a17597b533d0466a, role_id=02b6bd2963494fd48eff2ca4fd91e1cf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.658003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Could not find role: 02b6bd2963494fd48eff2ca4fd91e1cf.: keystone.exception.RoleNotFound: Could not find role: 02b6bd2963494fd48eff2ca4fd91e1cf. Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:10:52.671388 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 02b6bd2963494fd48eff2ca4fd91e1cf. Oct 29 03:10:52.672535 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:52.676314 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2767/5515] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:10:52 2022] GET /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/02b6bd2963494fd48eff2ca4fd91e1cf => generated 110 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:10:52.677757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.691439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa94bb-3303-4a51-9bfd-33fb262f0569 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.699556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.700246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.700527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.700802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/02b6bd2963494fd48eff2ca4fd91e1cf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.708285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:get_role_for_trust(trust_id=198cd92153f64463a17597b533d0466a, role_id=02b6bd2963494fd48eff2ca4fd91e1cf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.710815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Could not find role: 02b6bd2963494fd48eff2ca4fd91e1cf.: keystone.exception.RoleNotFound: Could not find role: 02b6bd2963494fd48eff2ca4fd91e1cf. Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:10:52.724203 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 02b6bd2963494fd48eff2ca4fd91e1cf. Oct 29 03:10:52.725579 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:52.726860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2749/5516] 10.222.0.16 () {58 vars in 1369 bytes} [Sat Oct 29 03:10:52 2022] HEAD /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a/roles/02b6bd2963494fd48eff2ca4fd91e1cf => generated 0 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 29 03:10:52.730042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.740570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7729d-a64f-414e-8d82-a5ed7b70b413 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.745427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.746312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.746597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.746870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.753749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorizing `identity:delete_trust(trust_id=198cd92153f64463a17597b533d0466a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.755265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:52.759035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:52.794647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '198cd92153f64463a17597b533d0466a', 'request_id': 'req-6f4ef253-659a-4d48-a516-a162a0b298b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:52.801835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '198cd92153f64463a17597b533d0466a', 'request_id': 'req-6f4ef253-659a-4d48-a516-a162a0b298b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:52.803857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '198cd92153f64463a17597b533d0466a', 'request_id': 'req-6f4ef253-659a-4d48-a516-a162a0b298b9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:52.846254 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2768/5517] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:10:52 2022] DELETE /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:52.847545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.850100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:52.876154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6271-43b6-4290-a003-e56b9996d71a tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.882604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de4e88ece9d1432398eaf13981c50997', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c3c060f0056482abdc1fdc75f3530e3', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1197217536', 'tempest-DelegatedRole-385332407'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.883689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.884451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.885312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] PATH_INFO: `/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Could not find trust: 198cd92153f64463a17597b533d0466a.: keystone.exception.TrustNotFound: Could not find trust: 198cd92153f64463a17597b533d0466a. Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 29 03:10:52.904033 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 198cd92153f64463a17597b533d0466a. Oct 29 03:10:52.905260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:52.914349 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2750/5518] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:10:52 2022] GET /identity/v3/OS-TRUST/trusts/198cd92153f64463a17597b533d0466a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 03:10:52.918210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:52.919974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:52.949025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ef253-659a-4d48-a516-a162a0b298b9 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:52.974437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:52.975270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:52.975596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:52.975868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/02b6bd2963494fd48eff2ca4fd91e1cf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:52.977582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=02b6bd2963494fd48eff2ca4fd91e1cf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:52.979298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:53.074071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 02b6bd2963494fd48eff2ca4fd91e1cf has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:53.074391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.075043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.077651 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2769/5519] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:52 2022] DELETE /identity/v3/roles/02b6bd2963494fd48eff2ca4fd91e1cf => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:53.081647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:53.085492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:53.104877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415456-8ad1-469a-ad4a-5ba3fc55ab20 tempest-TrustsV3TestJSON-1328522833 tempest-user-1768503109] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:53.226410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:53.227452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:53.228967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:53.230335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/28aaf644ce9642dc92ad16b255377d1c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:53.232301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=28aaf644ce9642dc92ad16b255377d1c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:53.234295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:53.295301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 28aaf644ce9642dc92ad16b255377d1c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:53.295946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.297244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.300877 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2751/5520] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:53 2022] DELETE /identity/v3/roles/28aaf644ce9642dc92ad16b255377d1c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:53.304875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:53.317355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3d1e1-e820-4113-b022-696ff29898a4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:53.404712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:53.405514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:53.406003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:53.406681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users/de4e88ece9d1432398eaf13981c50997` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:53.408094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=de4e88ece9d1432398eaf13981c50997)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:53.411578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:53.520859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4e88ece9d1432398eaf13981c50997'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.533148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4e88ece9d1432398eaf13981c50997'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.534157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4e88ece9d1432398eaf13981c50997'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.559963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4e88ece9d1432398eaf13981c50997'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.560975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4e88ece9d1432398eaf13981c50997'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.586838 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2770/5521] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:53 2022] DELETE /identity/v3/users/de4e88ece9d1432398eaf13981c50997 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:53.591628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:53.595712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:53.628196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686544-b191-466a-9969-1d13d476105f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:53.658393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:53.736190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:53.737282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:53.737725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:53.739361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/3c3c060f0056482abdc1fdc75f3530e3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:53.741412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3c3c060f0056482abdc1fdc75f3530e3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:53.746440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:53.834242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c3c060f0056482abdc1fdc75f3530e3', 'request_id': 'req-b41de9e8-929f-4d4f-b59f-450522991881'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.841970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c3c060f0056482abdc1fdc75f3530e3', 'request_id': 'req-b41de9e8-929f-4d4f-b59f-450522991881'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.848662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c3c060f0056482abdc1fdc75f3530e3', 'request_id': 'req-b41de9e8-929f-4d4f-b59f-450522991881'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.863808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] The token cache is being invalidate because project 3c3c060f0056482abdc1fdc75f3530e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:53.864291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.865074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:53.868734 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2752/5522] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:53 2022] DELETE /identity/v3/projects/3c3c060f0056482abdc1fdc75f3530e3 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:53.875803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:53.878397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:53.908423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3c6a0-afb5-41c0-82dd-786144c0a5aa tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:53.934973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:54.042631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.043859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.044379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.044867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.045731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.047984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.091197 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2771/5523] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:10:53 2022] POST /identity/v3/projects => generated 328 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:54.095125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:54.098350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:54.121633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de9e8-929f-4d4f-b59f-450522991881 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:54.204499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.205595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.206097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.206901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.207745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.210089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.246012 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2753/5524] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:54 2022] POST /identity/v3/users => generated 413 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:54.249720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:54.269906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a725-176c-4a6d-9ce4-719a66b906af tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:54.280711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.281710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.282100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.283103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.284045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.286655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.312256 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2772/5525] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:54 2022] POST /identity/v3/roles => generated 243 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:54.316140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:54.337996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a0213-dbb9-4050-abaf-ff8095090475 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:54.343881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.344798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.345286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.345767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.347077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.349394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.374144 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2754/5526] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:54 2022] POST /identity/v3/roles => generated 247 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:54.378094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:54.396025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ebea0b-516a-4d98-a30f-5bf846f94e38 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:54.404064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.405042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.406183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.406721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/2d41d5a016774ef7ac009f882c567df8/users/c8cafe706b65408ca466f976c542e121/roles/d4a88337cd1f49c88429ca4b7b09973a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.424391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d41d5a016774ef7ac009f882c567df8, user_id=c8cafe706b65408ca466f976c542e121, role_id=d4a88337cd1f49c88429ca4b7b09973a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.427658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.450887 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2773/5527] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:54 2022] PUT /identity/v3/projects/2d41d5a016774ef7ac009f882c567df8/users/c8cafe706b65408ca466f976c542e121/roles/d4a88337cd1f49c88429ca4b7b09973a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:54.461082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:54.484297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d083be-a7d3-483a-a143-8891c42e76b4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:54.539771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:54.586848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb172dc5-4296-4768-8dcc-9e729bf8c7f9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.587666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172dc5-4296-4768-8dcc-9e729bf8c7f9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.588010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172dc5-4296-4768-8dcc-9e729bf8c7f9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.588456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb172dc5-4296-4768-8dcc-9e729bf8c7f9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/2d41d5a016774ef7ac009f882c567df8/users/c8cafe706b65408ca466f976c542e121/roles/af66a18b80a149ab88fbfee00832cc5f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.591485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb172dc5-4296-4768-8dcc-9e729bf8c7f9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2d41d5a016774ef7ac009f882c567df8, user_id=c8cafe706b65408ca466f976c542e121, role_id=af66a18b80a149ab88fbfee00832cc5f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.595397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb172dc5-4296-4768-8dcc-9e729bf8c7f9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.616199 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2755/5528] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:54 2022] PUT /identity/v3/projects/2d41d5a016774ef7ac009f882c567df8/users/c8cafe706b65408ca466f976c542e121/roles/af66a18b80a149ab88fbfee00832cc5f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:54.622418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:54.653743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42650822-e7e7-4987-a8c6-80be1ae05af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:54.763864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ab139-24f9-4df1-a329-14a1a0f36af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:54.764515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab139-24f9-4df1-a329-14a1a0f36af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.764801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab139-24f9-4df1-a329-14a1a0f36af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.765080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ab139-24f9-4df1-a329-14a1a0f36af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.765770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ab139-24f9-4df1-a329-14a1a0f36af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:54.767667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ab139-24f9-4df1-a329-14a1a0f36af5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:54.829142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2774/5529] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:54 2022] GET /identity/v3/users => generated 8622 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:10:54.834301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:54.834589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:54.834917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:54.942662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] MFA Rules not processed for user `c8cafe706b65408ca466f976c542e121`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:54.944699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:55.047545 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2756/5530] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:54 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:55.057705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:55.058230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:55.058500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:55.096016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] MFA Rules not processed for user `c8cafe706b65408ca466f976c542e121`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:55.097530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:55.117498 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2775/5531] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:55.118595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:55.131604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a651bc-849b-4f6c-a63c-c7b49f21245a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:55.136646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8cafe706b65408ca466f976c542e121', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d41d5a016774ef7ac009f882c567df8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-395395810', 'tempest-NotDelegatedRole-1746046540'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:55.137366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:55.137772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:55.138189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:55.138942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:55.140717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 29 03:10:55.284519 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 29 03:10:55.285888 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:55.290884 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2757/5532] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:10:55 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 169 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:10:55.292102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:55.308538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be704b-707f-4e93-986f-533b66980ce3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:55.314967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:55.315333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:55.315616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:55.315889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/af66a18b80a149ab88fbfee00832cc5f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:55.317514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=af66a18b80a149ab88fbfee00832cc5f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:55.320829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:55.394451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role af66a18b80a149ab88fbfee00832cc5f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:55.394758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.395575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.398683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2776/5533] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:55 2022] DELETE /identity/v3/roles/af66a18b80a149ab88fbfee00832cc5f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:55.403447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:55.406027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:55.428126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d51083-0e61-4515-8197-1cc082ea802e tempest-TrustsV3TestJSON-754145136 tempest-user-417961450] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:55.507114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:55.537630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:55.538637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:55.539026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:55.539923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/d4a88337cd1f49c88429ca4b7b09973a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:55.541642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d4a88337cd1f49c88429ca4b7b09973a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:55.544173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:55.654915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role d4a88337cd1f49c88429ca4b7b09973a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:55.656766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.658879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.668066 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2758/5534] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:55 2022] DELETE /identity/v3/roles/d4a88337cd1f49c88429ca4b7b09973a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:55.668713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:55.683996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b34e4d-8659-49a1-87a2-28d6f9992602 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:55.693174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:55.796111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:55.797097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:55.797951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:55.798804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users/c8cafe706b65408ca466f976c542e121` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:55.802251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c8cafe706b65408ca466f976c542e121)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:55.805716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:55.879228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cafe706b65408ca466f976c542e121'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.895712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cafe706b65408ca466f976c542e121'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.897427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cafe706b65408ca466f976c542e121'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.909316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cafe706b65408ca466f976c542e121'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.910435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cafe706b65408ca466f976c542e121'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:55.945760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:55.946825 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2777/5535] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:55 2022] DELETE /identity/v3/users/c8cafe706b65408ca466f976c542e121 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:55.947965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:55.965743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8715c6-a44a-41ce-9dc4-ccc34167e9bf tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.042846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.043748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.044139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.044505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/2d41d5a016774ef7ac009f882c567df8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.045744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2d41d5a016774ef7ac009f882c567df8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.048273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.107261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d41d5a016774ef7ac009f882c567df8', 'request_id': 'req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:56.116429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d41d5a016774ef7ac009f882c567df8', 'request_id': 'req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:56.128382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d41d5a016774ef7ac009f882c567df8', 'request_id': 'req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:56.147282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] The token cache is being invalidate because project 2d41d5a016774ef7ac009f882c567df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:56.147844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:56.148549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:56.154944 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2759/5536] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:55 2022] DELETE /identity/v3/projects/2d41d5a016774ef7ac009f882c567df8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:56.159618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.164094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:56.186377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5822d6-082e-4fd3-beed-bfe3fea3696e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.311611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.313835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.314193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.314797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.315683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.320753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.418034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2778/5537] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:10:56 2022] POST /identity/v3/projects => generated 328 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:56.419121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.420906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:56.439902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbde39-48ed-45fb-9e17-74bf77de8b2f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.505159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:56.539095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.540264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.540779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.541299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.542182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.545277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.577620 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2760/5538] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:56 2022] POST /identity/v3/users => generated 416 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:56.582041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.605161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cace1e-50ce-4e33-a2e9-d0a16af2aec4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.612475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.613110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.613393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.613670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.615145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.616833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.633124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:56.652221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.660433 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2779/5539] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:56 2022] POST /identity/v3/roles => generated 244 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:56.681948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb17243-044b-429b-bd39-da5e3db1ee72 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.691055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.691958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.692533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.693595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.695270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.697175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.736110 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2761/5540] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:10:56 2022] POST /identity/v3/roles => generated 247 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:10:56.737303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.765744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e6ea6-079d-4a9c-b29a-c50289411cd9 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.772273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.773053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.773339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.773617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/1d97671b1eed497898b5ff9087c8e013/users/a1e5cfcbdcf245388d061cbbfae75204/roles/30f5dc2ad5ba45048ab02d561acf542d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.802552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1d97671b1eed497898b5ff9087c8e013, user_id=a1e5cfcbdcf245388d061cbbfae75204, role_id=30f5dc2ad5ba45048ab02d561acf542d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.806631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.831634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2780/5541] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:56 2022] PUT /identity/v3/projects/1d97671b1eed497898b5ff9087c8e013/users/a1e5cfcbdcf245388d061cbbfae75204/roles/30f5dc2ad5ba45048ab02d561acf542d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:10:56.833314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.845674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d1d2e-cd62-4234-a54b-af2f1df1566e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:56.916916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ec62-b237-4ca1-96cf-4d07fe7db7ea tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:56.919179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ec62-b237-4ca1-96cf-4d07fe7db7ea tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:56.919691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ec62-b237-4ca1-96cf-4d07fe7db7ea tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:56.920180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ec62-b237-4ca1-96cf-4d07fe7db7ea tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/1d97671b1eed497898b5ff9087c8e013/users/a1e5cfcbdcf245388d061cbbfae75204/roles/ce6a41a962dc4fd2a748ee6c50c53c4f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:56.923494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ec62-b237-4ca1-96cf-4d07fe7db7ea tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1d97671b1eed497898b5ff9087c8e013, user_id=a1e5cfcbdcf245388d061cbbfae75204, role_id=ce6a41a962dc4fd2a748ee6c50c53c4f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:56.926499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ec62-b237-4ca1-96cf-4d07fe7db7ea tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:56.952796 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2762/5542] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:10:56 2022] PUT /identity/v3/projects/1d97671b1eed497898b5ff9087c8e013/users/a1e5cfcbdcf245388d061cbbfae75204/roles/ce6a41a962dc4fd2a748ee6c50c53c4f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:56.953746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:56.967071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd69d0c-0bef-4992-980e-a27b603b8523 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.047622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27299-9b7f-4189-a8f5-8d65981036a1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.048250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27299-9b7f-4189-a8f5-8d65981036a1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.048533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27299-9b7f-4189-a8f5-8d65981036a1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.048808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27299-9b7f-4189-a8f5-8d65981036a1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.049632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27299-9b7f-4189-a8f5-8d65981036a1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.052624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27299-9b7f-4189-a8f5-8d65981036a1 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.092513 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2781/5543] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:10:56 2022] GET /identity/v3/users => generated 8625 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:10:57.097979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.098340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.098679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.155406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] MFA Rules not processed for user `a1e5cfcbdcf245388d061cbbfae75204`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:57.157947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:57.262516 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2763/5544] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:57.273284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.273589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.273875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.306015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] MFA Rules not processed for user `a1e5cfcbdcf245388d061cbbfae75204`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:57.308525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:57.327289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.335057 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2782/5545] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:57 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:10:57.339483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfbc3a-adf0-4bcd-b02a-76862b2cd697 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.344083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.344991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.345512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.346954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.347893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:create_trust()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.349923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.400733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:57.470306 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2764/5546] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:10:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:57.475144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.488521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdce8df-fe5a-4232-9b3c-1d5a1e1f70d3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.495444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.496159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.496437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.496706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.503549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:get_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.505963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.519730 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2783/5547] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:10:57 2022] GET /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0 => generated 834 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:57.520980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.533068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5886c99-a84f-4801-a412-88e8cf538182 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.540584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.568956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.569209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.569866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.592838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.596025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.606351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2765/5548] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:10:57 2022] GET /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles => generated 371 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:10:57.610841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.628645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94643-6835-4439-8884-ad6086268ac0 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.635652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.636743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.637589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.638156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/30f5dc2ad5ba45048ab02d561acf542d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.648794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:get_role_for_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0, role_id=30f5dc2ad5ba45048ab02d561acf542d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.650703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.666313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2784/5549] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:10:57 2022] GET /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/30f5dc2ad5ba45048ab02d561acf542d => generated 244 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:10:57.670338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.687824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92242d53-038c-4e9c-aed2-e00ab331b170 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.693935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.695047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.695971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.696438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/30f5dc2ad5ba45048ab02d561acf542d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.705944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:get_role_for_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0, role_id=30f5dc2ad5ba45048ab02d561acf542d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.708293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.718746 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2766/5550] 10.222.0.16 () {58 vars in 1369 bytes} [Sat Oct 29 03:10:57 2022] HEAD /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/30f5dc2ad5ba45048ab02d561acf542d => generated 0 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 29 03:10:57.727469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.742908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101fa78-1b35-42b2-8a9e-52cba7282749 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.748570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.749535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.750080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.750551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/ce6a41a962dc4fd2a748ee6c50c53c4f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.760292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:get_role_for_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0, role_id=ce6a41a962dc4fd2a748ee6c50c53c4f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.762567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Could not find role: ce6a41a962dc4fd2a748ee6c50c53c4f.: keystone.exception.RoleNotFound: Could not find role: ce6a41a962dc4fd2a748ee6c50c53c4f. Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:10:57.775798 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ce6a41a962dc4fd2a748ee6c50c53c4f. Oct 29 03:10:57.777146 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:10:57.777304 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2785/5551] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:10:57 2022] GET /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/ce6a41a962dc4fd2a748ee6c50c53c4f => generated 110 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:10:57.781476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.795139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fbe1eb-56ca-4d55-b7b8-883a40b212f3 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.802134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.803384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.803668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.803948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/ce6a41a962dc4fd2a748ee6c50c53c4f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.810957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:get_role_for_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0, role_id=ce6a41a962dc4fd2a748ee6c50c53c4f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.812489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Could not find role: ce6a41a962dc4fd2a748ee6c50c53c4f.: keystone.exception.RoleNotFound: Could not find role: ce6a41a962dc4fd2a748ee6c50c53c4f. Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:10:57.826879 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ce6a41a962dc4fd2a748ee6c50c53c4f. Oct 29 03:10:57.828241 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:57.828691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2767/5552] 10.222.0.16 () {58 vars in 1369 bytes} [Sat Oct 29 03:10:57 2022] HEAD /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0/roles/ce6a41a962dc4fd2a748ee6c50c53c4f => generated 0 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 29 03:10:57.832683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.844071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa93ea7-7adb-4ff5-a9c3-672c3f29f6d7 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.850506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.851398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.851669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.851940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.864997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorizing `identity:delete_trust(trust_id=16a645fbb5a245ca829fb7db0625a8e0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:57.866885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:57.897279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '16a645fbb5a245ca829fb7db0625a8e0', 'request_id': 'req-8d71c329-4774-460b-87b7-3a3003cbe445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:57.899194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '16a645fbb5a245ca829fb7db0625a8e0', 'request_id': 'req-8d71c329-4774-460b-87b7-3a3003cbe445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:57.901323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '16a645fbb5a245ca829fb7db0625a8e0', 'request_id': 'req-8d71c329-4774-460b-87b7-3a3003cbe445'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:57.926076 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2786/5553] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:10:57 2022] DELETE /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:57.931419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.934333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:57.955115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001bcdf-c83a-4e62-a9a0-48f181d0dfdf tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:57.961160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e5cfcbdcf245388d061cbbfae75204', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d97671b1eed497898b5ff9087c8e013', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2141613761', 'tempest-DelegatedRole-1408734354'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:57.962242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:57.963094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:57.964076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] PATH_INFO: `/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Could not find trust: 16a645fbb5a245ca829fb7db0625a8e0.: keystone.exception.TrustNotFound: Could not find trust: 16a645fbb5a245ca829fb7db0625a8e0. Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 29 03:10:57.982227 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 16a645fbb5a245ca829fb7db0625a8e0. Oct 29 03:10:57.983610 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:10:57.986567 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2768/5554] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:10:57 2022] GET /identity/v3/OS-TRUST/trusts/16a645fbb5a245ca829fb7db0625a8e0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:10:57.992126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:57.996261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:58.015870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71c329-4774-460b-87b7-3a3003cbe445 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:58.021666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:58.023037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:58.023510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:58.023956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/ce6a41a962dc4fd2a748ee6c50c53c4f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:58.026194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ce6a41a962dc4fd2a748ee6c50c53c4f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:58.030598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:58.085024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:58.113036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role ce6a41a962dc4fd2a748ee6c50c53c4f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:58.113374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.114116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.118325 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2787/5555] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:57 2022] DELETE /identity/v3/roles/ce6a41a962dc4fd2a748ee6c50c53c4f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:58.122691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:58.128738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:58.134094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:58.136072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:58.153964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d6cb6-c48f-4bc7-a114-81edb64b9f15 tempest-TrustsV3TestJSON-308097410 tempest-user-1072610427] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:58.246122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5544d0-9735-4ae8-a59d-30a06b2be98d tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:58.254279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:58.255320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:58.255608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:58.255608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] PATH_INFO: `/v3/users/dc4e17d222e0426698d1ef9a17921d64` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:58.257471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4e17d222e0426698d1ef9a17921d64)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:58.259725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:58.269289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:58.270007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:58.270251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:58.270523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/30f5dc2ad5ba45048ab02d561acf542d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:58.274132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=30f5dc2ad5ba45048ab02d561acf542d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:58.277455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:58.358964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 30f5dc2ad5ba45048ab02d561acf542d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:58.359889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.360765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.369481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2769/5556] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:58 2022] DELETE /identity/v3/roles/30f5dc2ad5ba45048ab02d561acf542d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:58.370644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:58.372606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:58.372939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4e17d222e0426698d1ef9a17921d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.404634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4e17d222e0426698d1ef9a17921d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.405580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4e17d222e0426698d1ef9a17921d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.416567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4e17d222e0426698d1ef9a17921d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.421277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4e17d222e0426698d1ef9a17921d64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.465136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2788/5557] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:58 2022] DELETE /identity/v3/users/dc4e17d222e0426698d1ef9a17921d64 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:58.471832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:58.528542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaab0d5-cb56-41ee-a3a5-32c9971ca7ef tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:58.724847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:58.726209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:58.726581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:58.727279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users/a1e5cfcbdcf245388d061cbbfae75204` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:58.734008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a1e5cfcbdcf245388d061cbbfae75204)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:58.736182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:58.895410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e5cfcbdcf245388d061cbbfae75204'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.901068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:58.903106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:58.944422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e5cfcbdcf245388d061cbbfae75204'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.946551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e5cfcbdcf245388d061cbbfae75204'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.971002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e5cfcbdcf245388d061cbbfae75204'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:58.971002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e5cfcbdcf245388d061cbbfae75204'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.023732 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2770/5558] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:10:58 2022] DELETE /identity/v3/users/a1e5cfcbdcf245388d061cbbfae75204 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:59.027634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:59.029765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:59.052388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09556a3-0296-4764-97d7-0307ea9f6ed7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:59.141100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:59.184744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:59.223188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192bebe-c2a3-4279-bab1-10cd4b3f3e0b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:59.233540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:59.234244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:59.234526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:59.235301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/1d97671b1eed497898b5ff9087c8e013` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:59.236757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1d97671b1eed497898b5ff9087c8e013)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:59.240410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:59.241422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:59.241883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:59.242532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:59.248716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:59.249542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:59.388057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d97671b1eed497898b5ff9087c8e013', 'request_id': 'req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.406485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d97671b1eed497898b5ff9087c8e013', 'request_id': 'req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.422101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:59.423936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:59.436557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d97671b1eed497898b5ff9087c8e013', 'request_id': 'req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.469258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] The token cache is being invalidate because project 1d97671b1eed497898b5ff9087c8e013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:59.469628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.470702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.472633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2771/5559] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:59 2022] DELETE /identity/v3/projects/1d97671b1eed497898b5ff9087c8e013 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:59.473533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:59.475966 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2789/5560] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:10:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:10:59.477878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:59.479347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:59.513014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587511b7-754e-44b5-adde-4619a584400c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:59.651272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:59.653333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:59.655691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:59.656486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:59.657350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:59.661172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9852349-1ecc-4579-b0e0-f6abdb17d1e3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:59.664555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:59.680453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:59.681165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:59.681439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:59.681760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] PATH_INFO: `/v3/projects/d4193e4464b7488b9b3bb4064afb0288` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:59.682906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4193e4464b7488b9b3bb4064afb0288)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:59.684841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:10:59.705633 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2790/5561] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:10:59 2022] POST /identity/v3/projects => generated 329 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:10:59.719789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:10:59.722328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:59.784630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4193e4464b7488b9b3bb4064afb0288', 'request_id': 'req-58bb2ba4-0d8f-46ab-973f-64097477962e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.805147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4193e4464b7488b9b3bb4064afb0288', 'request_id': 'req-58bb2ba4-0d8f-46ab-973f-64097477962e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.811639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4193e4464b7488b9b3bb4064afb0288', 'request_id': 'req-58bb2ba4-0d8f-46ab-973f-64097477962e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.826918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:59.843441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] The token cache is being invalidate because project d4193e4464b7488b9b3bb4064afb0288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:10:59.844015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.844973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-58bb2ba4-0d8f-46ab-973f-64097477962e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:10:59.846980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd47ddb-b415-4b7f-a7b8-667144e50eee tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:10:59.847481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2772/5562] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:10:59 2022] DELETE /identity/v3/projects/d4193e4464b7488b9b3bb4064afb0288 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:10:59.852723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828339e7-392f-4555-ba25-e0f2fe32be4e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:59.853250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828339e7-392f-4555-ba25-e0f2fe32be4e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:59.853681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828339e7-392f-4555-ba25-e0f2fe32be4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:59.903087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-828339e7-392f-4555-ba25-e0f2fe32be4e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:10:59.904457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-828339e7-392f-4555-ba25-e0f2fe32be4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:10:59.918710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:10:59.956969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:10:59.958221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:10:59.958762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:10:59.959053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:10:59.960225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:10:59.962262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.005228 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2791/5563] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:10:59 2022] POST /identity/v3/users => generated 416 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:00.006502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.014472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:00.044599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61a9cb6-27e2-4a7a-b464-8c86632cbf4e tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.065482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.066441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.066441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.066694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.067362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.069112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.070772 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2773/5564] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:00.079983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.080415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.080808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.093261 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2792/5565] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/roles => generated 244 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:00.100629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.120715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69778723-510c-4499-8119-56966c7821ab tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.129416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.130234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.130577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.130995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.132058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.134183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.134787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:00.136060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:00.158810 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2774/5566] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:00.162884 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2793/5567] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/roles => generated 247 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:00.163644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.167096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.181277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d3de1-ec4b-4ca2-ab52-faf680159cf4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.185663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b8637-1800-4e10-a220-d823f0532fcb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.186567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.187384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.187790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.188263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/7472eb1bffc54b98a7fc5217b8f4564d/users/7a4bc45e179340d8b99ef22311f10ed6/roles/3b334e51b2654ef2a2617cc0c3687808` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.197528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.198557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.198839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.199113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.199781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:00.200089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.201747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.212312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7472eb1bffc54b98a7fc5217b8f4564d, user_id=7a4bc45e179340d8b99ef22311f10ed6, role_id=3b334e51b2654ef2a2617cc0c3687808)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.215504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.231843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2775/5568] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:11:00.236056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.239553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2794/5569] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:00 2022] PUT /identity/v3/projects/7472eb1bffc54b98a7fc5217b8f4564d/users/7a4bc45e179340d8b99ef22311f10ed6/roles/3b334e51b2654ef2a2617cc0c3687808 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:00.240934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.258756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa1203-6f74-487d-8bb2-5a01427a330a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.324247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc442f-f321-49b7-9478-506b9164d9ca tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.338713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.339408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.339688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.340825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/7472eb1bffc54b98a7fc5217b8f4564d/users/7a4bc45e179340d8b99ef22311f10ed6/roles/1680439177bb43f592e196770e3b1ff9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.345190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7472eb1bffc54b98a7fc5217b8f4564d, user_id=7a4bc45e179340d8b99ef22311f10ed6, role_id=1680439177bb43f592e196770e3b1ff9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.348923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.387503 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2795/5570] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:00 2022] PUT /identity/v3/projects/7472eb1bffc54b98a7fc5217b8f4564d/users/7a4bc45e179340d8b99ef22311f10ed6/roles/1680439177bb43f592e196770e3b1ff9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:00.392923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.397349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.398267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.398591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.398904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.399600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.402147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.456230 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2776/5571] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:00.457676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:00.460309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.525647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d2a50-eee9-489d-a91c-9f8eccf7057f tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.569654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918994aa-b0c4-4976-a7ae-5f930633987a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.579172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.579815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.580096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.580371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.581015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.584174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.654889 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2777/5572] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:00.655880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.672921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94ef2e-522d-4a2d-b590-8accb50400b3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.673646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94ef2e-522d-4a2d-b590-8accb50400b3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.674138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94ef2e-522d-4a2d-b590-8accb50400b3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.674419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94ef2e-522d-4a2d-b590-8accb50400b3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.677100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94ef2e-522d-4a2d-b590-8accb50400b3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.683340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e018b-ad92-4f15-9521-bd06accfd0e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.684810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94ef2e-522d-4a2d-b590-8accb50400b3 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.698071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.698850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.699206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.699483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.701796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.706367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.715553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:00.753142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2778/5573] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:00 2022] GET /identity/v3/roles => generated 1893 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:00.754670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.795029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2796/5574] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:00 2022] GET /identity/v3/users => generated 8626 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:11:00.798200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8ee71-8800-44e5-9a16-8a354081a1d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.798369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bf4d97-1083-4f8c-b6e4-8e653f92477d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.798566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8ee71-8800-44e5-9a16-8a354081a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.798974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8ee71-8800-44e5-9a16-8a354081a1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.818082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.819013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.819211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.819434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.820150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.821663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.852539 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2779/5575] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:00 2022] GET /identity/v3/roles => generated 1893 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:00.857465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:00.880112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27915cb2-faf6-49d0-a4dc-93939de5d052 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:00.891766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b544e2-511f-4bd1-af96-79f43ab4c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:00.892952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b544e2-511f-4bd1-af96-79f43ab4c40a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:00.893236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-62c8ee71-8800-44e5-9a16-8a354081a1d3 None None] MFA Rules not processed for user `7a4bc45e179340d8b99ef22311f10ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:00.893604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b544e2-511f-4bd1-af96-79f43ab4c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:00.894101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b544e2-511f-4bd1-af96-79f43ab4c40a admin admin] PATH_INFO: `/v3/projects/38f9e1e21653406ebb6203c714551a02/users/ec6f5c41ab1d4c2d90041c01efe8bc54/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:00.894595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-62c8ee71-8800-44e5-9a16-8a354081a1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:00.919464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b544e2-511f-4bd1-af96-79f43ab4c40a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f9e1e21653406ebb6203c714551a02, user_id=ec6f5c41ab1d4c2d90041c01efe8bc54, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:00.924261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b544e2-511f-4bd1-af96-79f43ab4c40a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:00.984028 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2780/5576] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:00 2022] PUT /identity/v3/projects/38f9e1e21653406ebb6203c714551a02/users/ec6f5c41ab1d4c2d90041c01efe8bc54/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:00.998299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.000733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.001203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.065185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:01.068960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:01.091895 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2797/5577] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:01.095491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.095803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.096081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.138175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] MFA Rules not processed for user `7a4bc45e179340d8b99ef22311f10ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:01.139420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:01.190985 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2781/5578] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:01.223879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.226881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:01.301613 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2798/5579] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:01 2022] POST /identity/v3/auth/tokens => generated 3281 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:01.302918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.311012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:01.318381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e7e17-1f2a-4cdb-a1f8-69e08068f955 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.329969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.330612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.331293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.331293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.332079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:create_trust()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.335709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.367672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba682a-111c-4776-b8d0-0e3527edfe2f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.375479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.376376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.377583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.380905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.405569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.407207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.433267 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2782/5580] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:01.481611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2799/5581] 10.222.0.16 () {60 vars in 1174 bytes} [Sat Oct 29 03:11:01 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:01.483147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.502321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df014d04-bfd3-426b-a403-ff307019d945 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.508627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.509296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.509831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.510118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.520542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:get_trust(trust_id=8f99a828603a465698d98e29499f94c3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.522203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.536226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2783/5582] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:11:01 2022] GET /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3 => generated 835 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:01.540262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.559470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745824df-0911-43f4-b090-2358b0e851ee tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.570996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.571722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.571998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.572270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.592282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=8f99a828603a465698d98e29499f94c3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.593996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.611815 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2800/5583] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:11:01 2022] GET /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles => generated 371 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:01.616346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.628704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cab91-b6a3-4999-be62-1815e61bed86 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.634218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.637702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.638122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.638602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/3b334e51b2654ef2a2617cc0c3687808` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.649463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8f99a828603a465698d98e29499f94c3, role_id=3b334e51b2654ef2a2617cc0c3687808)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.651544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.660830 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2784/5584] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:11:01 2022] GET /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/3b334e51b2654ef2a2617cc0c3687808 => generated 244 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:01.665602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.680852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8361293-d978-45cb-aa2e-5760608d8c16 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.691075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.691891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.692270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.692642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/3b334e51b2654ef2a2617cc0c3687808` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.707390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8f99a828603a465698d98e29499f94c3, role_id=3b334e51b2654ef2a2617cc0c3687808)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.709179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.731398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2801/5585] 10.222.0.16 () {58 vars in 1369 bytes} [Sat Oct 29 03:11:01 2022] HEAD /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/3b334e51b2654ef2a2617cc0c3687808 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:01.731670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.752439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e70c2-4c2c-4669-bce6-4d7399cafd01 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.757241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.758468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.758988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.759497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/1680439177bb43f592e196770e3b1ff9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.767111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8f99a828603a465698d98e29499f94c3, role_id=1680439177bb43f592e196770e3b1ff9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.769040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-f100ad4d-42b6-4154-a384-8a5ff80ec19c tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Could not find role: 1680439177bb43f592e196770e3b1ff9.: keystone.exception.RoleNotFound: Could not find role: 1680439177bb43f592e196770e3b1ff9. Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:11:01.783101 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1680439177bb43f592e196770e3b1ff9. Oct 29 03:11:01.784348 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:11:01.788118 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2785/5586] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:11:01 2022] GET /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/1680439177bb43f592e196770e3b1ff9 => generated 110 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:11:01.792147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.826347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab702b-8e38-4e0f-a5fc-2124a8c7b7dc tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.827064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.828799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.829388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.844743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.846103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.846395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.846701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/1680439177bb43f592e196770e3b1ff9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.865324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:get_role_for_trust(trust_id=8f99a828603a465698d98e29499f94c3, role_id=1680439177bb43f592e196770e3b1ff9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.867977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Could not find role: 1680439177bb43f592e196770e3b1ff9.: keystone.exception.RoleNotFound: Could not find role: 1680439177bb43f592e196770e3b1ff9. Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:11:01.887051 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1680439177bb43f592e196770e3b1ff9. Oct 29 03:11:01.888240 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:11:01.892071 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2802/5587] 10.222.0.16 () {58 vars in 1369 bytes} [Sat Oct 29 03:11:01 2022] HEAD /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3/roles/1680439177bb43f592e196770e3b1ff9 => generated 0 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 29 03:11:01.892242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:01.901046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:01.907036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] MFA Rules not processed for user `57ad9751505044e7a5e3a17d2da06fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:01.908354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:01.937739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cace29-0474-496a-85f4-98040dee925b tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:01.944582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:01.945531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:01.946560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:01.947324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:01.955325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorizing `identity:delete_trust(trust_id=8f99a828603a465698d98e29499f94c3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:01.960969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:01.989864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8f99a828603a465698d98e29499f94c3', 'request_id': 'req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:01.991648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8f99a828603a465698d98e29499f94c3', 'request_id': 'req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:01.994527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8f99a828603a465698d98e29499f94c3', 'request_id': 'req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.021943 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2786/5588] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:01 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:02.028738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2803/5589] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:11:01 2022] DELETE /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:02.032541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:02.032735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:02.036279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:02.037432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:02.069606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49215e9b-2ed0-4ba4-a8a3-d9023bdcc250 tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:02.080125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a4bc45e179340d8b99ef22311f10ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7472eb1bffc54b98a7fc5217b8f4564d', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1417166900', 'tempest-NotDelegatedRole-1105177404'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:02.082424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:02.083137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:02.084417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] PATH_INFO: `/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Could not find trust: 8f99a828603a465698d98e29499f94c3.: keystone.exception.TrustNotFound: Could not find trust: 8f99a828603a465698d98e29499f94c3. Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 29 03:11:02.112965 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8f99a828603a465698d98e29499f94c3. Oct 29 03:11:02.114654 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:11:02.120825 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2804/5590] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:11:02 2022] GET /identity/v3/OS-TRUST/trusts/8f99a828603a465698d98e29499f94c3 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:11:02.122056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:02.124049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:02.236368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cf691-6bf3-44ee-8f28-3d317d662fef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:02.238603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:02.263417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:02.265059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:02.267843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:02.268513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:02.277561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba1b77-ee30-4b3f-a8dd-ab894988174a tempest-TrustsV3TestJSON-1170235888 tempest-user-1591595828] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:02.283982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:02.284651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:02.284888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:02.285307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:02.285594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/1680439177bb43f592e196770e3b1ff9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:02.288513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:02.288779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1680439177bb43f592e196770e3b1ff9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:02.290451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:02.302337 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2787/5591] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:02 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:11:02.358133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 1680439177bb43f592e196770e3b1ff9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:02.358557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.359340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.361991 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2805/5592] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:02 2022] DELETE /identity/v3/roles/1680439177bb43f592e196770e3b1ff9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:02.366894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:02.399907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73d2b2-dbd4-4db9-b01f-1bc561465748 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:02.479459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:02.480184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:02.480416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:02.480680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/roles/3b334e51b2654ef2a2617cc0c3687808` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:02.482693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3b334e51b2654ef2a2617cc0c3687808)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:02.485585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:02.511995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:02.544708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invalidating the token cache because role 3b334e51b2654ef2a2617cc0c3687808 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:02.545443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.546318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.548788 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2788/5593] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:02 2022] DELETE /identity/v3/roles/3b334e51b2654ef2a2617cc0c3687808 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:02.553185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:02.557410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:02.582694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0520011-719d-4bbf-bfb2-ab7033a12cd4 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:02.673119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:02.673390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:02.673607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:02.673910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/users/7a4bc45e179340d8b99ef22311f10ed6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:02.675422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7a4bc45e179340d8b99ef22311f10ed6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:02.678687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:02.743847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a4bc45e179340d8b99ef22311f10ed6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.755393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a4bc45e179340d8b99ef22311f10ed6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.756186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a4bc45e179340d8b99ef22311f10ed6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.792260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a4bc45e179340d8b99ef22311f10ed6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.794077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a4bc45e179340d8b99ef22311f10ed6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:02.890516 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2806/5594] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:02 2022] DELETE /identity/v3/users/7a4bc45e179340d8b99ef22311f10ed6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:02.894961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:02.897867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:02.913220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cc9f3-e92a-46a9-9a60-d600a03faad7 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:03.002690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b59e9eab715f420ea35b7b5629af1faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a35c93eec114499977fbb72985651f9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:03.004493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:03.004861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:03.005206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] PATH_INFO: `/v3/projects/7472eb1bffc54b98a7fc5217b8f4564d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:03.007627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7472eb1bffc54b98a7fc5217b8f4564d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:03.009843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:03.122538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7472eb1bffc54b98a7fc5217b8f4564d', 'request_id': 'req-273bb58f-ea31-4212-a725-ed506f193d2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.140261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7472eb1bffc54b98a7fc5217b8f4564d', 'request_id': 'req-273bb58f-ea31-4212-a725-ed506f193d2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.157311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7472eb1bffc54b98a7fc5217b8f4564d', 'request_id': 'req-273bb58f-ea31-4212-a725-ed506f193d2b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.183054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] The token cache is being invalidate because project 7472eb1bffc54b98a7fc5217b8f4564d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:03.183054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.184321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-273bb58f-ea31-4212-a725-ed506f193d2b tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.186865 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2789/5595] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:02 2022] DELETE /identity/v3/projects/7472eb1bffc54b98a7fc5217b8f4564d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:03.192687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:03.194660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:03.297864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:03.378767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86afeb-7840-4c7e-a7d3-bd5c176155b5 tempest-TrustsV3TestJSON-2064462748 tempest-TrustsV3TestJSON-2064462748-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:03.505398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:03.506508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:03.511212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:03.511212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] PATH_INFO: `/v3/users/54f449af393d402bbf0b88b5f4bd97c5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:03.514103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f449af393d402bbf0b88b5f4bd97c5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:03.518819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:03.642366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f449af393d402bbf0b88b5f4bd97c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.663176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f449af393d402bbf0b88b5f4bd97c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.664723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f449af393d402bbf0b88b5f4bd97c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.674312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f449af393d402bbf0b88b5f4bd97c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.675302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f449af393d402bbf0b88b5f4bd97c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:03.700066 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2807/5596] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:03 2022] DELETE /identity/v3/users/54f449af393d402bbf0b88b5f4bd97c5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:03.705080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:03.705080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:03.705722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:03.736089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:03.737064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:03.848792 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2790/5597] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:03.906149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:03.908071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:04.071592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf68248-f830-4db5-82da-992180a59905 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:04.083897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:04.084716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:04.084984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:04.085371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:04.097504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:04.099119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:04.111181 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2808/5598] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:06.447652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:06.451960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:06.465877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb56c00-ba74-4385-8428-ccfb716120b4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:06.483745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:06.484890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:06.484890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:06.485112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] PATH_INFO: `/v3/projects/036cbf9fda0a461d8f24468f73d9efc9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:06.486548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=036cbf9fda0a461d8f24468f73d9efc9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:06.493492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:06.529204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:06.639023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '036cbf9fda0a461d8f24468f73d9efc9', 'request_id': 'req-b7c20f0f-89d1-485e-b1ee-29f1f055b090'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.651404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '036cbf9fda0a461d8f24468f73d9efc9', 'request_id': 'req-b7c20f0f-89d1-485e-b1ee-29f1f055b090'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.660653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '036cbf9fda0a461d8f24468f73d9efc9', 'request_id': 'req-b7c20f0f-89d1-485e-b1ee-29f1f055b090'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.683493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] The token cache is being invalidate because project 036cbf9fda0a461d8f24468f73d9efc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:06.685926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.686781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.691660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2791/5599] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:06 2022] DELETE /identity/v3/projects/036cbf9fda0a461d8f24468f73d9efc9 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:06.692880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:06.707254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49619e7-61f3-4efc-af5e-1c5e5066fbd5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:06.714683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:06.838674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:06.839494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:06.839865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:06.840232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] PATH_INFO: `/v3/users/b59e9eab715f420ea35b7b5629af1faf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:06.841487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59e9eab715f420ea35b7b5629af1faf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:06.843790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:06.935719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59e9eab715f420ea35b7b5629af1faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.945856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59e9eab715f420ea35b7b5629af1faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.946434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59e9eab715f420ea35b7b5629af1faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.957197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59e9eab715f420ea35b7b5629af1faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:06.958498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-19530649-e459-42ec-8900-2426e5c8745f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59e9eab715f420ea35b7b5629af1faf'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:07.007321 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2809/5600] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:06 2022] DELETE /identity/v3/users/b59e9eab715f420ea35b7b5629af1faf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:07.669937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:07.672429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:07.695858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c20f0f-89d1-485e-b1ee-29f1f055b090 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:07.815261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:07.816120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:07.816490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:07.816859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] PATH_INFO: `/v3/projects/4a35c93eec114499977fbb72985651f9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:07.818148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a35c93eec114499977fbb72985651f9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:07.820179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:07.919264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a35c93eec114499977fbb72985651f9', 'request_id': 'req-913f68b3-3515-4f03-a45d-0f3aa476de8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:07.928509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a35c93eec114499977fbb72985651f9', 'request_id': 'req-913f68b3-3515-4f03-a45d-0f3aa476de8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:07.936905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a35c93eec114499977fbb72985651f9', 'request_id': 'req-913f68b3-3515-4f03-a45d-0f3aa476de8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:07.964167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] The token cache is being invalidate because project 4a35c93eec114499977fbb72985651f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:07.966200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:07.968660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-913f68b3-3515-4f03-a45d-0f3aa476de8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:07.972943 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2792/5601] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:07 2022] DELETE /identity/v3/projects/4a35c93eec114499977fbb72985651f9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:07.978225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:07.978739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:07.978849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.032831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:08.034415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:08.166714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2810/5602] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:08.175553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.176138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.176515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.205405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:08.207025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:08.217723 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2793/5603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:08.222150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.237116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d7e2-bfcd-43ff-9abd-9fead782291f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.244331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.245509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.245944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.246322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.247248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:08.247744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.249685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:08.269657 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2811/5604] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:08.273326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.293078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f704e77-c0c4-4b6d-a363-29f3f84da8c5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.301035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.301679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.302002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.302275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.304167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.307717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:08.329757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:08.354666 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2794/5605] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:08 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:08.358126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.370531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ab12d-a039-4fc1-a8bc-719eefef00e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.383977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:08.491014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.493670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.494222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.495022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.497463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.506551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:08.545900 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2812/5606] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:08 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:08.549285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.567955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78678a4-8360-467d-85a5-3de6e4665f89 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.579446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.579970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.580344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.581306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.583208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.588789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:08.603583 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2795/5607] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:08.604915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.620261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390f575-89a5-42ee-9301-64a56ecba5f9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.626439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62f329-8c18-4b1f-8779-0be0dfc15ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.626971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62f329-8c18-4b1f-8779-0be0dfc15ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.627393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62f329-8c18-4b1f-8779-0be0dfc15ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.628144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62f329-8c18-4b1f-8779-0be0dfc15ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.629848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62f329-8c18-4b1f-8779-0be0dfc15ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.631409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62f329-8c18-4b1f-8779-0be0dfc15ff5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:08.651734 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2813/5608] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:08.653796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.682272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bfc03-17a6-4d37-9dd1-a654aacaab26 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.690516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.691469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.692553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.693128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] PATH_INFO: `/v3/projects/2fc8cfcfa9a64e20b0220887672755f0/users/22466315f1244c31bbecaad36f652bc4/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.735191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc8cfcfa9a64e20b0220887672755f0, user_id=22466315f1244c31bbecaad36f652bc4, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.739059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:08.778208 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2796/5609] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:08 2022] PUT /identity/v3/projects/2fc8cfcfa9a64e20b0220887672755f0/users/22466315f1244c31bbecaad36f652bc4/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:08.788806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.789154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.789368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.853033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] MFA Rules not processed for user `22466315f1244c31bbecaad36f652bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:08.857774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:08.958060 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2814/5610] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:08.962857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:08.976346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f265c-80e3-464d-b5bf-fffff6a00514 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:08.982075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:08.983825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:08.984391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:08.985295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:08.996027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:create_application_credential(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:08.997495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.108357 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2797/5611] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Oct 29 03:11:08 2022] POST /identity/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials => generated 921 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:09.110235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.124194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7daf-4233-44a0-857a-d76fb06be132 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.142775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.143762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.146555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.147143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules/536024d9d22748a2a68319d2a1aeb76d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.148676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:delete_access_rule(user_id=22466315f1244c31bbecaad36f652bc4, access_rule_id=536024d9d22748a2a68319d2a1aeb76d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.150507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.delete(ref) Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application yield resource Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application next(self.gen) Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.rollback() Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.force_reraise() Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 29 03:11:09.223315 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise self.value Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application session.commit() Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._prepare_impl() Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.session.flush() Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._flush(objects) Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 29 03:11:09.224625 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application compat.raise_( Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application flush_context.execute() Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rec.execute(self) Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._synchronize( Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise AssertionError( Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 29 03:11:09.225852 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:11:09.227022 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:11:09.228172 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2815/5612] 10.222.0.16 () {58 vars in 1362 bytes} [Sat Oct 29 03:11:09 2022] DELETE /identity/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules/536024d9d22748a2a68319d2a1aeb76d => generated 89 bytes in 115 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 29 03:11:09.231991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.244500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e5998-b770-46e0-910b-7bb9c4fe4646 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.251563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.254656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.255233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.256976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials/03a3011d42e2410a9b60802c862a3671` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.270773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:delete_application_credential(user_id=22466315f1244c31bbecaad36f652bc4, application_credential_id=03a3011d42e2410a9b60802c862a3671)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.273248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.308445 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2798/5613] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:11:09 2022] DELETE /identity/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials/03a3011d42e2410a9b60802c862a3671 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:09.313018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.323035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdb478-2928-45fa-b72c-c65ebf48e3f1 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.328796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.329463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.329745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.330061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.333073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:list_access_rules(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.335141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.345180 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2816/5614] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:11:09 2022] GET /identity/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules => generated 369 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:09.346440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.365553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9a390-d812-418c-b62c-a66e1c025e36 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.386661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.387554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.388033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.389955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules/536024d9d22748a2a68319d2a1aeb76d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.395905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:delete_access_rule(user_id=22466315f1244c31bbecaad36f652bc4, access_rule_id=536024d9d22748a2a68319d2a1aeb76d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.398734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.448512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2799/5615] 10.222.0.16 () {58 vars in 1362 bytes} [Sat Oct 29 03:11:09 2022] DELETE /identity/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules/536024d9d22748a2a68319d2a1aeb76d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:09.452522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.474964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24c0ea-2ac2-4259-9175-cd948691dae5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.495404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.496391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.497273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.497745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.502945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:list_access_rules(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.507787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.520942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2817/5616] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:11:09 2022] GET /identity/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules => generated 158 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:09.525124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.576395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc44b6-6e45-44f0-aa17-65b96c52f671 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.583610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.584808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.585300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.586949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.587932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:create_application_credential(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.590174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.697039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:09.779653 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2800/5617] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Oct 29 03:11:09 2022] POST /identity/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials => generated 920 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:09.781094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.796794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5e638-84b4-4c6c-a2f6-83f65470f077 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.812009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.812897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.813706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.813706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.815106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:list_access_rules(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.816759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:09.833303 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2818/5618] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:11:09 2022] GET /identity/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules => generated 369 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:09.840397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:09.872095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa6c10-7835-4492-8310-f3b7f1033c04 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:09.884178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:09.886121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:09.886408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:09.886680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:09.887367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:create_application_credential(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:09.896825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:10.097975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2801/5619] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Oct 29 03:11:09 2022] POST /identity/v3/users/22466315f1244c31bbecaad36f652bc4/application_credentials => generated 919 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:10.101767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:10.115840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409bcbf-1989-4e74-b581-c7d7bf0e7ec5 tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:10.122973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb8a31-7f4d-415f-ae12-fdecdc7ee63a tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22466315f1244c31bbecaad36f652bc4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fc8cfcfa9a64e20b0220887672755f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:10.124062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb8a31-7f4d-415f-ae12-fdecdc7ee63a tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:10.124565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb8a31-7f4d-415f-ae12-fdecdc7ee63a tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:10.125186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb8a31-7f4d-415f-ae12-fdecdc7ee63a tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules/361509d897a64e59afdbfe5580fc73a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:10.128227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb8a31-7f4d-415f-ae12-fdecdc7ee63a tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorizing `identity:get_access_rule(user_id=22466315f1244c31bbecaad36f652bc4, access_rule_id=361509d897a64e59afdbfe5580fc73a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:10.130294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb8a31-7f4d-415f-ae12-fdecdc7ee63a tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:10.139755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2819/5620] 10.222.0.16 () {58 vars in 1359 bytes} [Sat Oct 29 03:11:10 2022] GET /identity/v3/users/22466315f1244c31bbecaad36f652bc4/access_rules/361509d897a64e59afdbfe5580fc73a6 => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:11:10.144697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:10.277322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fe3d4-c0e5-4f1b-88e3-9aa22c5dac3d tempest-AccessRulesV3Test-527312898 tempest-AccessRulesV3Test-527312898-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:10.282975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:10.283909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:10.284567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:10.285071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] PATH_INFO: `/v3/users/22466315f1244c31bbecaad36f652bc4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:10.286586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22466315f1244c31bbecaad36f652bc4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:10.289544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:10.386278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22466315f1244c31bbecaad36f652bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:10.415476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=7,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:10.479124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22466315f1244c31bbecaad36f652bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:10.480854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22466315f1244c31bbecaad36f652bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:10.502431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22466315f1244c31bbecaad36f652bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:10.503321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22466315f1244c31bbecaad36f652bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:10.534233 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2802/5621] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:10 2022] DELETE /identity/v3/users/22466315f1244c31bbecaad36f652bc4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:10.536491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:10.536994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:10.537171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:10.571781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:10.573553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:10.630683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:10.674051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:10.676102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:10.687265 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2820/5622] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:10.717540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:10.719629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:10.840450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fbb36-796c-4cdf-b103-87fb2d30eb41 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:10.845119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:10.845310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9581aed3-7e18-4dd7-8d3e-663a0ac4eca8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:10.845876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:10.846214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:10.846491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:10.859544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:10.862919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:10.866607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:10.867574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:10.867856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:10.868130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:10.871540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:10.878439 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2821/5623] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:11:11.018932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:11.020547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27114951-a9a3-4e7b-af96-3af812726696 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:11.052896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2803/5624] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:11:12.126285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:12.128034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:12.147042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30740c6d-b2ae-4309-802a-e58c6a1b53eb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:12.153025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:12.154176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.154668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.155298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] PATH_INFO: `/v3/projects/2fc8cfcfa9a64e20b0220887672755f0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.156717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc8cfcfa9a64e20b0220887672755f0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:12.159663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:12.265836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc8cfcfa9a64e20b0220887672755f0', 'request_id': 'req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:12.274494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc8cfcfa9a64e20b0220887672755f0', 'request_id': 'req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:12.283628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc8cfcfa9a64e20b0220887672755f0', 'request_id': 'req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:12.310764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] The token cache is being invalidate because project 2fc8cfcfa9a64e20b0220887672755f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:12.311036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:12.312247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b79c2c7-73b1-4037-bd6b-12c141f0d70a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:12.313892 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2822/5625] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:12 2022] DELETE /identity/v3/projects/2fc8cfcfa9a64e20b0220887672755f0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:12.321451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.322078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.322078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.357156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:12.358941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:12.447809 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2804/5626] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:12.456588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.456878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.457139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.478913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:12.483850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:12.497482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:12.498100 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2823/5627] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:12.511715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4dd19-dc8b-4202-a181-84754b436e5e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:12.517070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:12.517715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.518047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.518317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.518975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:12.519290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:12.520998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:12.522921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:12.541977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:12.562306 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2805/5628] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:12.570010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1b022-4d09-4193-8826-84be101bf9b0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:12.576475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:12.580557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.581520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.581520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.581819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:12.584745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:12.627327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:12.635898 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2824/5629] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:12 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:12.686261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3736a-04e7-4b20-9496-8c8a18dc1c05 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:12.805201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:12.806449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.806741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.807309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.808143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:12.810946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:12.848355 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2806/5630] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:12 2022] POST /identity/v3/users => generated 300 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:12.853559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:12.865058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0662e-7a25-439e-ac45-5c47d3ed0fb6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:12.884032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:12.887798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.888480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.889004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:12.890397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:12.892587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:12.924744 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2825/5631] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:12.925975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:12.942735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a2d82-d8f9-4e28-9c77-391f2fded785 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:12.949950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:12.951808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:12.952264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:12.952722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] PATH_INFO: `/v3/projects/044ed10b48db49838f32f39febbb96c2/users/8d80adf38e474daba529d7aa29a88a08/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.000944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=044ed10b48db49838f32f39febbb96c2, user_id=8d80adf38e474daba529d7aa29a88a08, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.009619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.051911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2807/5632] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:12 2022] PUT /identity/v3/projects/044ed10b48db49838f32f39febbb96c2/users/8d80adf38e474daba529d7aa29a88a08/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:13.053359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.070039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5059b06-8b9f-4718-9985-5a5151be51c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:13.124391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:13.210942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a465d-8c7a-484f-bf9b-33abc8f68c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:13.212805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a465d-8c7a-484f-bf9b-33abc8f68c2a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.213363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a465d-8c7a-484f-bf9b-33abc8f68c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.213832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a465d-8c7a-484f-bf9b-33abc8f68c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.214671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a465d-8c7a-484f-bf9b-33abc8f68c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.219247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a465d-8c7a-484f-bf9b-33abc8f68c2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.240539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2826/5633] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:13.244707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.258145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200404a1-6e9e-4035-8b5e-112c68ae6aee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:13.263397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:13.264219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.268571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.268969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] PATH_INFO: `/v3/projects/044ed10b48db49838f32f39febbb96c2/users/8d80adf38e474daba529d7aa29a88a08/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.271944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=044ed10b48db49838f32f39febbb96c2, user_id=8d80adf38e474daba529d7aa29a88a08, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.276241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.312237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2808/5634] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:13 2022] PUT /identity/v3/projects/044ed10b48db49838f32f39febbb96c2/users/8d80adf38e474daba529d7aa29a88a08/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:13.313620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.313938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.315059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.379774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] MFA Rules not processed for user `8d80adf38e474daba529d7aa29a88a08`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:13.383724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:13.506083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2827/5635] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:13.510204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.608251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883d64c-12f6-4179-aa5c-6a7028c921cc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:13.615040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:13.619797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.620409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.620900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.621738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.624177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.689706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2809/5636] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:13 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:13.694091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.713054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793223a-0023-4348-aecc-c11fe3565c16 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:13.840864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:13.842385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.842843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.844225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.844775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.847998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.884500 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2828/5637] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:13 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:13.886709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.907317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08963bb-2066-4e34-8357-3858247f45e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:13.914275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:13.914959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.915201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.915470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.916512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.918413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.934734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.936936 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2810/5638] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:13.947597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8377-cc8a-4a41-afa0-665b3bc08664 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:13.953605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de73520-2f3a-42c9-b85b-f06db5d0e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:13.954430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de73520-2f3a-42c9-b85b-f06db5d0e86d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:13.954780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de73520-2f3a-42c9-b85b-f06db5d0e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:13.955118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de73520-2f3a-42c9-b85b-f06db5d0e86d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:13.955839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de73520-2f3a-42c9-b85b-f06db5d0e86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:13.957584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de73520-2f3a-42c9-b85b-f06db5d0e86d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:13.969504 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2829/5639] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:13.973848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:13.987008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978d52c-06e8-423a-b5f1-0c07a80629da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:14.017200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:14.018258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:14.023449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:14.024016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] PATH_INFO: `/v3/projects/c6bab72fcfb4406595b4405443449839/users/5815614de15148079f2abcbdc56d2ab6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:14.054915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bab72fcfb4406595b4405443449839, user_id=5815614de15148079f2abcbdc56d2ab6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:14.058143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:14.062016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:14.091569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2811/5640] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:13 2022] PUT /identity/v3/projects/c6bab72fcfb4406595b4405443449839/users/5815614de15148079f2abcbdc56d2ab6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:14.094944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:14.095450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:14.095902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:14.131115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] MFA Rules not processed for user `5815614de15148079f2abcbdc56d2ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:14.133223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:14.148151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:14.261000 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2830/5641] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:14.280231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:14.283521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:14.398727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994d40-929b-4f7b-adfb-ca922e400ca5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:14.408799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7c1b9-2cf5-4a25-bbe5-1761e652c5ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:14.409718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c1b9-2cf5-4a25-bbe5-1761e652c5ff service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:14.410387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c1b9-2cf5-4a25-bbe5-1761e652c5ff service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:14.410857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7c1b9-2cf5-4a25-bbe5-1761e652c5ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:14.514637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7c1b9-2cf5-4a25-bbe5-1761e652c5ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:14.517060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7c1b9-2cf5-4a25-bbe5-1761e652c5ff service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:14.533854 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2812/5642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:15.544148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:15.631012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327874c-e851-46d8-8534-3aafb63ed161 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:15.635714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:15.636473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:15.636953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:15.637744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] PATH_INFO: `/v3/users/8d80adf38e474daba529d7aa29a88a08` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:15.638691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d80adf38e474daba529d7aa29a88a08)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:15.641327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:15.713347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d80adf38e474daba529d7aa29a88a08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:15.723119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d80adf38e474daba529d7aa29a88a08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:15.724196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d80adf38e474daba529d7aa29a88a08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:15.733566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d80adf38e474daba529d7aa29a88a08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:15.734464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d80adf38e474daba529d7aa29a88a08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:15.757786 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2831/5643] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:15 2022] DELETE /identity/v3/users/8d80adf38e474daba529d7aa29a88a08 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:15.762624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:15.763209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:15.763209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:15.785362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:15.786906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:15.860840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2813/5644] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:15.949659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:15.951897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:16.000995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:16.050744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76649e50-6c45-4713-abbf-02304ac784ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:16.057073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:16.058043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:16.058043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:16.058530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:16.072031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:16.074220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:16.089267 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2832/5645] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:16.312603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:16.314452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:16.329457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54561e4c-9f25-4480-b91d-8b65fa55331b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:16.336927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:16.337582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:16.337874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:16.338678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] PATH_INFO: `/v3/users/57ad9751505044e7a5e3a17d2da06fb7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:16.340077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ad9751505044e7a5e3a17d2da06fb7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:16.343150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:16.389600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:16.407704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ad9751505044e7a5e3a17d2da06fb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:16.428138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ad9751505044e7a5e3a17d2da06fb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:16.429106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ad9751505044e7a5e3a17d2da06fb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:16.437234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ad9751505044e7a5e3a17d2da06fb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:16.438035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-19d01039-0e5f-4e42-ba55-7d42b2c70d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ad9751505044e7a5e3a17d2da06fb7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:16.453514 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2814/5646] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:16 2022] DELETE /identity/v3/users/57ad9751505044e7a5e3a17d2da06fb7 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:16.879821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:16.894424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0b492-2007-4ce7-8904-9f07a367ee54 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:16.988439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:16.989261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:16.989363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:16.989741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] PATH_INFO: `/v3/projects/50ec8b68206e47ff894b19726e829260` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:16.991257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ec8b68206e47ff894b19726e829260)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:16.994402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.066278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ec8b68206e47ff894b19726e829260', 'request_id': 'req-269a1513-ede4-434f-8708-bea589254023'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.076087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ec8b68206e47ff894b19726e829260', 'request_id': 'req-269a1513-ede4-434f-8708-bea589254023'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.083054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ec8b68206e47ff894b19726e829260', 'request_id': 'req-269a1513-ede4-434f-8708-bea589254023'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.101649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] The token cache is being invalidate because project 50ec8b68206e47ff894b19726e829260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:17.102164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.102999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-269a1513-ede4-434f-8708-bea589254023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.111803 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2833/5647] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:16 2022] DELETE /identity/v3/projects/50ec8b68206e47ff894b19726e829260 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:17.112513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.112996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.116359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.142847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:17.144432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:17.261201 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2815/5648] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:17.272054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.272631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.273147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.295918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:17.297158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:17.313058 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2834/5649] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:17.320796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.323889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:17.334371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.349499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7fade-3939-4bd0-b479-b645966e05bc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.356125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a6a2e-621d-4ea5-9b18-fe62294a90e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.365210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.368120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.368727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.368727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] PATH_INFO: `/v3/projects/044ed10b48db49838f32f39febbb96c2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.372838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044ed10b48db49838f32f39febbb96c2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.373963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.377113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.377113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.377696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.378464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:17.378710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.389588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.393349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.428151 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2835/5650] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:17.437451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.456542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25368a6c-8d0b-4a0a-ba9b-70eab3f462f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.488264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044ed10b48db49838f32f39febbb96c2', 'request_id': 'req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.496822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044ed10b48db49838f32f39febbb96c2', 'request_id': 'req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.504041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044ed10b48db49838f32f39febbb96c2', 'request_id': 'req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.529485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] The token cache is being invalidate because project 044ed10b48db49838f32f39febbb96c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:17.530020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.532183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.539716 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2816/5651] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:17 2022] DELETE /identity/v3/projects/044ed10b48db49838f32f39febbb96c2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:17.545873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.545873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:17.550149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:17.580792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.581761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.582242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.583958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.585264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.588132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.613339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:17.636344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2836/5652] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:17 2022] POST /identity/v3/projects => generated 391 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:17.640358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.643973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:17.670921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8ef17-8d09-44c6-9ef2-8f500e6dcbd4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.731790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21fb3b-b4a0-4447-a9ed-8cdfbb8912e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.738207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.738992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.739270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.739851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.740749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.743284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.759946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.761583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.761871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.762179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] PATH_INFO: `/v3/users/5815614de15148079f2abcbdc56d2ab6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.764508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5815614de15148079f2abcbdc56d2ab6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.767726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.774705 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2837/5653] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:17 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:17.778862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.791673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef78a7e-aa82-421c-b616-fe68444f39d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.797777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.798625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.799018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.799401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.800158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.802408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.816631 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2838/5654] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:17.821345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.835696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867cfbfb-3391-4aee-89f1-497f0b670cdf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.837878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5815614de15148079f2abcbdc56d2ab6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.842768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.843469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.843778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.844245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:17.844990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:17.846835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:17.858472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5815614de15148079f2abcbdc56d2ab6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.859329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5815614de15148079f2abcbdc56d2ab6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.867890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2839/5655] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:17.869607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:17.869841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5815614de15148079f2abcbdc56d2ab6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.870610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f83a68c7-7165-4077-89e8-955d72d0269e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5815614de15148079f2abcbdc56d2ab6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:17.872081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:17.890688 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2817/5656] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:17 2022] DELETE /identity/v3/users/5815614de15148079f2abcbdc56d2ab6 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:17.895119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21ec2bf-c9c3-4a8e-8760-504140be715d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:17.980769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd3699-ff9c-4c56-b25f-45a2025b2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:17.981486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd3699-ff9c-4c56-b25f-45a2025b2a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:17.981771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd3699-ff9c-4c56-b25f-45a2025b2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:17.982684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd3699-ff9c-4c56-b25f-45a2025b2a71 admin admin] PATH_INFO: `/v3/projects/a92eaae8be3f450eb401dceb09341400/users/f4e793d75b944fc7a139abfa22789a94/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:18.001199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd3699-ff9c-4c56-b25f-45a2025b2a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a92eaae8be3f450eb401dceb09341400, user_id=f4e793d75b944fc7a139abfa22789a94, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:18.004020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd3699-ff9c-4c56-b25f-45a2025b2a71 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:18.026210 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2840/5657] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:17 2022] PUT /identity/v3/projects/a92eaae8be3f450eb401dceb09341400/users/f4e793d75b944fc7a139abfa22789a94/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:18.027339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:18.027622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:18.027888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:18.038923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:18.039818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:18.040096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:18.077164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] MFA Rules not processed for user `ec6f5c41ab1d4c2d90041c01efe8bc54`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:18.077894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:18.078489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:18.079363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:18.090981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:18.209688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:18.211881 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2841/5658] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:18.228472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:18.230478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:18.239964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2818/5659] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:18.257573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:18.260008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:18.399736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b1298-426b-448b-8c50-23337708ee3c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:18.405482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:18.407599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:18.408545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:18.409512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:18.421630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e55e5a-9abe-4030-b98d-ab8ad944cf30 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:18.430857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:18.434716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:18.438460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eae48d-e5a8-4f98-aaa6-82a74d05b698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:18.439417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae48d-e5a8-4f98-aaa6-82a74d05b698 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:18.439417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae48d-e5a8-4f98-aaa6-82a74d05b698 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:18.439713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eae48d-e5a8-4f98-aaa6-82a74d05b698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:18.456721 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2819/5660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:18.461726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eae48d-e5a8-4f98-aaa6-82a74d05b698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:18.463388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eae48d-e5a8-4f98-aaa6-82a74d05b698 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:18.478797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2842/5661] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:18.830952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:18.832814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:18.856246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04494b1-be42-415c-88cd-deea4ad02f51 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:18.862058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:18.863056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:18.863552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:18.864040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] PATH_INFO: `/v3/projects/c6bab72fcfb4406595b4405443449839` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:18.865520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bab72fcfb4406595b4405443449839)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:18.868107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:18.979747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bab72fcfb4406595b4405443449839', 'request_id': 'req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:18.990801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bab72fcfb4406595b4405443449839', 'request_id': 'req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:19.011607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bab72fcfb4406595b4405443449839', 'request_id': 'req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:19.035010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] The token cache is being invalidate because project c6bab72fcfb4406595b4405443449839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:19.035920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:19.043123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21bc316f-f6b1-4f67-8a0e-e0777ed1051c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:19.045852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2820/5662] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:18 2022] DELETE /identity/v3/projects/c6bab72fcfb4406595b4405443449839 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:19.050790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.051792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.052417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.099287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:19.103146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:19.225056 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2843/5663] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:19.232520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.233749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.234191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.278432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:19.279682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:19.300703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2821/5664] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:19.305879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:19.320220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb5dd56-a10f-40f9-8995-26fe7dfbbbb0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:19.326147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:19.327112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.327591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.328061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.329073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:19.329629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:19.331884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:19.362169 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2844/5665] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:19.363123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:19.384578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea33425-ac76-43ea-bb55-ec1b8ca91725 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:19.390676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:19.391315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.391599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.392013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.392501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:19.394458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:19.446518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2822/5666] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:19 2022] POST /identity/v3/projects => generated 369 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:19.454746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:19.472913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b15f0-d5f2-42a2-82ca-4683572c12b0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:19.499882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:19.597846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:19.598486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.598764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.599166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.599932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:19.601888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:19.630195 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2845/5667] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:19 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:19.634016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:19.654212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4decf0-a295-43ae-a3e2-b3ef3e827087 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:19.663444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:19.664340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.664818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.665249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.666215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:19.668367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:19.691491 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2823/5668] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:19.695631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:19.713526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a1f7c-df83-4723-9bf3-b1c943bc9cd8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:19.724175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989f47a-b5d4-440c-b751-f11bbd1070f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:19.725710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f47a-b5d4-440c-b751-f11bbd1070f9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.726271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f47a-b5d4-440c-b751-f11bbd1070f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.727317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989f47a-b5d4-440c-b751-f11bbd1070f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.728226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f47a-b5d4-440c-b751-f11bbd1070f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:19.730704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989f47a-b5d4-440c-b751-f11bbd1070f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:19.748070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2846/5669] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:19.751930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:19.764062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132bed0-180e-4e7e-a026-80811d7f3047 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:19.769159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:19.770100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.770535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.771350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] PATH_INFO: `/v3/projects/70e8aa9a7545459299f446643e391e8a/users/7abe35732fc24b04967e120b515f8574/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.792653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e8aa9a7545459299f446643e391e8a, user_id=7abe35732fc24b04967e120b515f8574, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:19.795869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:19.828020 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2824/5670] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:19 2022] PUT /identity/v3/projects/70e8aa9a7545459299f446643e391e8a/users/7abe35732fc24b04967e120b515f8574/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:19.829594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:19.829594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:19.829594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:19.866986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] MFA Rules not processed for user `7abe35732fc24b04967e120b515f8574`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:19.868291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:19.995749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2847/5671] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:19.999327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:20.049993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:20.105590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c4209-e522-48a3-9522-6b4dacd5ff83 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:20.123226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:20.124975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.125482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.127785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.128630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:20.134380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:20.198027 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2825/5672] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:19 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:20.200357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:20.236133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072bd57c-8aea-4755-bd76-72e34112bab9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:20.332120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:20.332765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.333040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.333341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.334399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:20.336919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:20.378099 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2848/5673] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:20 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:20.379487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:20.397739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61e6a-a999-4ec1-8871-64f1f2a88fc7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:20.405741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:20.406426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.406702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.406970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.407660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:20.409402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:20.434082 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2826/5674] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:20.435810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:20.451195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f01e0-8df6-4bb8-aec8-0d62c5cf5209 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:20.457256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5543ff20-a5a3-431e-bca2-e30ddf681dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:20.458342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ff20-a5a3-431e-bca2-e30ddf681dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.459046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ff20-a5a3-431e-bca2-e30ddf681dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.459660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5543ff20-a5a3-431e-bca2-e30ddf681dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.460724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543ff20-a5a3-431e-bca2-e30ddf681dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:20.462983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5543ff20-a5a3-431e-bca2-e30ddf681dc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:20.477186 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2849/5675] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:20.481393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:20.494867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8aa2-6a1b-4ed9-ad66-c9b07d96fc13 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:20.500569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:20.501784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.502331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.502928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] PATH_INFO: `/v3/projects/d38c806b558b4a87b680e411e729a6f4/users/73d31ebf42504006be3d16e6c482d364/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.524163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d38c806b558b4a87b680e411e729a6f4, user_id=73d31ebf42504006be3d16e6c482d364, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:20.527270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:20.551097 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2827/5676] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:20 2022] PUT /identity/v3/projects/d38c806b558b4a87b680e411e729a6f4/users/73d31ebf42504006be3d16e6c482d364/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:20.565256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.565726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.566146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.591022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:20.602623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] MFA Rules not processed for user `73d31ebf42504006be3d16e6c482d364`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:20.606169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:20.734668 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2850/5677] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:20.744112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:20.746698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:20.861645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8df0a-2ee8-4899-803f-eb4be0d19108 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:20.866451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:20.867674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:20.868069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:20.868495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:20.952693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:20.954623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:20.967511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2828/5678] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:21.160172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:21.177767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384e012-e826-440b-8aca-19944b596eb2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:21.190947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322a0bc-f0d2-4c56-a120-2c2b93a25c21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:21.192904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a0bc-f0d2-4c56-a120-2c2b93a25c21 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:21.193794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a0bc-f0d2-4c56-a120-2c2b93a25c21 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:21.194094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322a0bc-f0d2-4c56-a120-2c2b93a25c21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:21.206041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a0bc-f0d2-4c56-a120-2c2b93a25c21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:21.207701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322a0bc-f0d2-4c56-a120-2c2b93a25c21 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:21.229642 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2851/5679] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:23.266671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:23.310291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:23.361412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fa504-ad71-41da-9e9f-376f66542d86 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:23.369090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:23.370187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:23.370471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:23.370747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] PATH_INFO: `/v3/users/7abe35732fc24b04967e120b515f8574` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:23.372132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7abe35732fc24b04967e120b515f8574)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:23.374232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:23.483923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7abe35732fc24b04967e120b515f8574'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:23.509408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7abe35732fc24b04967e120b515f8574'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:23.510778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7abe35732fc24b04967e120b515f8574'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:23.526008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7abe35732fc24b04967e120b515f8574'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:23.527696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7abe35732fc24b04967e120b515f8574'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:23.548155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2829/5680] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:23 2022] DELETE /identity/v3/users/7abe35732fc24b04967e120b515f8574 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:23.553519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:23.553519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:23.554267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:23.582452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:23.586927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:23.746267 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2852/5681] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:23.818985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:23.820659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:23.996137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796405b-0d7e-46db-a4db-73b1fd2038d8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:24.023036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:24.023699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:24.023978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:24.024693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:24.038871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:24.040325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:24.059161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2830/5682] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:24.731869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:24.734597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:24.759622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff4d6c-02e7-41fa-941b-d2a0e498b91d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:24.765030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:24.766028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:24.766871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:24.781305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] PATH_INFO: `/v3/projects/70e8aa9a7545459299f446643e391e8a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:24.784437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e8aa9a7545459299f446643e391e8a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:24.787707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:24.927251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e8aa9a7545459299f446643e391e8a', 'request_id': 'req-8c1d471d-c338-476a-bbf6-a6b80604daab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:24.937623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e8aa9a7545459299f446643e391e8a', 'request_id': 'req-8c1d471d-c338-476a-bbf6-a6b80604daab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:24.981694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e8aa9a7545459299f446643e391e8a', 'request_id': 'req-8c1d471d-c338-476a-bbf6-a6b80604daab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.013683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] The token cache is being invalidate because project 70e8aa9a7545459299f446643e391e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:25.014518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.015834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.017969 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2853/5683] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:24 2022] DELETE /identity/v3/projects/70e8aa9a7545459299f446643e391e8a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:25.022166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:25.036803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac62d19-f612-4de2-9d35-384e1b0931c8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:25.104480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:25.136951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:25.137650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:25.137979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:25.138329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] PATH_INFO: `/v3/users/73d31ebf42504006be3d16e6c482d364` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:25.141053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d31ebf42504006be3d16e6c482d364)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:25.144306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:25.265897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d31ebf42504006be3d16e6c482d364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.293706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d31ebf42504006be3d16e6c482d364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.295383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d31ebf42504006be3d16e6c482d364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.316746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d31ebf42504006be3d16e6c482d364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.318289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-63bbd8f5-b6ac-42e6-9575-b48a371d3b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d31ebf42504006be3d16e6c482d364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:25.360563 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2831/5684] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:25 2022] DELETE /identity/v3/users/73d31ebf42504006be3d16e6c482d364 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:27.580954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:27.583232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:27.615109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d471d-c338-476a-bbf6-a6b80604daab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:27.652245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:27.756303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:27.757280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:27.757795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:27.758317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] PATH_INFO: `/v3/projects/d38c806b558b4a87b680e411e729a6f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:27.759797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d38c806b558b4a87b680e411e729a6f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:27.762680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:27.842640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd38c806b558b4a87b680e411e729a6f4', 'request_id': 'req-22f1168d-e587-4e89-b66e-4199f3cb783c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:27.862121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd38c806b558b4a87b680e411e729a6f4', 'request_id': 'req-22f1168d-e587-4e89-b66e-4199f3cb783c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:27.878793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd38c806b558b4a87b680e411e729a6f4', 'request_id': 'req-22f1168d-e587-4e89-b66e-4199f3cb783c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:27.904853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] The token cache is being invalidate because project d38c806b558b4a87b680e411e729a6f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:27.905144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:27.905940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-22f1168d-e587-4e89-b66e-4199f3cb783c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:27.908876 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2854/5685] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:27 2022] DELETE /identity/v3/projects/d38c806b558b4a87b680e411e729a6f4 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:27.916024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:27.916523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:27.916641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:27.955779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:27.957030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:28.107952 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2832/5686] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:28.115938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.116269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.116489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.158673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:28.159797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:28.184576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2855/5687] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:28.188925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:28.202898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21db6e6-320a-4168-b612-667d0ffbaaab None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:28.224056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:28.224775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.225058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.225328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.226027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:28.226336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:28.227991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:28.243781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2833/5688] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:28.248184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:28.268772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f411d2-ef8a-4dc5-9bb5-3ac4f62b75be None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:28.274156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:28.275758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.275895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.276109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.276765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:28.278743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:28.345797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2856/5689] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:28 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:28.347123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:28.364550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ac391-fa92-4fda-9ce8-814012423e30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:28.486573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:28.510113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:28.511344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.511344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.511344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.511911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:28.513895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:28.578178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2834/5690] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:28 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:28.579492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:28.596597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d60cd3-f89d-49b9-b87f-9a6e60b8cafd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:28.604418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:28.605062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.605340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.605612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.606321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:28.607918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:28.634790 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2857/5691] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:28.636340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:28.654952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fc679-2af1-4ede-98d9-36813c97fc36 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:28.666553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530878ad-cf62-425e-bf3c-727ef6d8e1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:28.667177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530878ad-cf62-425e-bf3c-727ef6d8e1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.667536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530878ad-cf62-425e-bf3c-727ef6d8e1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.668359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530878ad-cf62-425e-bf3c-727ef6d8e1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.669015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530878ad-cf62-425e-bf3c-727ef6d8e1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:28.670665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530878ad-cf62-425e-bf3c-727ef6d8e1b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:28.699857 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2835/5692] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:28.701108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:28.719641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13a752-c0d4-4a31-bc5c-0ab0389a25a2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:28.735203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:28.735923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.736188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.736664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] PATH_INFO: `/v3/projects/63478396858849f1a90bdc57832550d0/users/9888226482a34a12b370c9628218c1a9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.770444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63478396858849f1a90bdc57832550d0, user_id=9888226482a34a12b370c9628218c1a9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:28.773664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:28.796007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2858/5693] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:28 2022] PUT /identity/v3/projects/63478396858849f1a90bdc57832550d0/users/9888226482a34a12b370c9628218c1a9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:28.809514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:28.809914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:28.810256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:28.864790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] MFA Rules not processed for user `9888226482a34a12b370c9628218c1a9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:28.866234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:28.989014 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2836/5694] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:29.011041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:29.013133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:29.115800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:29.183146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e89f5-8c6c-41b4-a4ed-068651c10081 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:29.195864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aae415-86c0-4e34-966c-8d3d96a4fd52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:29.199388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aae415-86c0-4e34-966c-8d3d96a4fd52 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:29.199933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aae415-86c0-4e34-966c-8d3d96a4fd52 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:29.201398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aae415-86c0-4e34-966c-8d3d96a4fd52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:29.227329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aae415-86c0-4e34-966c-8d3d96a4fd52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:29.229239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aae415-86c0-4e34-966c-8d3d96a4fd52 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:29.245421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2859/5695] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:30.824128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:31.030104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e618d1-faa7-4487-ac24-0211f43dbf93 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:31.038577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:31.039516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:31.040264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:31.040728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] PATH_INFO: `/v3/users/9888226482a34a12b370c9628218c1a9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:31.042786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9888226482a34a12b370c9628218c1a9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:31.045535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:31.256791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9888226482a34a12b370c9628218c1a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:31.286755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9888226482a34a12b370c9628218c1a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:31.287574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9888226482a34a12b370c9628218c1a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:31.289221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:31.299898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9888226482a34a12b370c9628218c1a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:31.301241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9888226482a34a12b370c9628218c1a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:31.329664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2837/5696] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:30 2022] DELETE /identity/v3/users/9888226482a34a12b370c9628218c1a9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:31.334555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:31.335500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:31.335919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:31.368935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:31.370463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:31.469647 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2860/5697] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:31.503760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:31.506342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:31.625794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea10f3-2125-4bdd-9bf3-9ef1c51c46a5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:31.664738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:31.666012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:31.666548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:31.667015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:31.684214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:31.685963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:31.699417 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2838/5698] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:33.227019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:33.228825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:33.255902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89567f-9ac8-42aa-9e20-26971a20448f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:33.274110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:33.275198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:33.275639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:33.276046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] PATH_INFO: `/v3/users/ec6f5c41ab1d4c2d90041c01efe8bc54` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:33.277365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6f5c41ab1d4c2d90041c01efe8bc54)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:33.279489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:33.373668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6f5c41ab1d4c2d90041c01efe8bc54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.386234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6f5c41ab1d4c2d90041c01efe8bc54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.387578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6f5c41ab1d4c2d90041c01efe8bc54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.407387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6f5c41ab1d4c2d90041c01efe8bc54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.409777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1325f423-e86a-40c2-9e78-cde6c8b22514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6f5c41ab1d4c2d90041c01efe8bc54'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.457498 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2861/5699] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:33 2022] DELETE /identity/v3/users/ec6f5c41ab1d4c2d90041c01efe8bc54 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:33.603768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:33.605507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:33.628836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e823f-5870-4827-8dff-3d69722cf766 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:33.757846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:33.758848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:33.759027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:33.759268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] PATH_INFO: `/v3/projects/63478396858849f1a90bdc57832550d0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:33.762023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63478396858849f1a90bdc57832550d0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:33.766253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:33.851124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63478396858849f1a90bdc57832550d0', 'request_id': 'req-a3e5ddac-a96c-4d64-9317-0b0836300fe2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.866906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63478396858849f1a90bdc57832550d0', 'request_id': 'req-a3e5ddac-a96c-4d64-9317-0b0836300fe2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.884315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63478396858849f1a90bdc57832550d0', 'request_id': 'req-a3e5ddac-a96c-4d64-9317-0b0836300fe2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.906614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] The token cache is being invalidate because project 63478396858849f1a90bdc57832550d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:33.907127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.907992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:33.910023 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2839/5700] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:33 2022] DELETE /identity/v3/projects/63478396858849f1a90bdc57832550d0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:33.915361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be1ec-bd48-4d56-942b-64e45e00923a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:33.915707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be1ec-bd48-4d56-942b-64e45e00923a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:33.916035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be1ec-bd48-4d56-942b-64e45e00923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:33.944085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-666be1ec-bd48-4d56-942b-64e45e00923a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:33.945777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-666be1ec-bd48-4d56-942b-64e45e00923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:33.972798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:33.976036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.032308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:34.035661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:34.082273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2862/5701] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:34.090536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.090536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.090841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.119808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:34.122232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.133837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ddac-a96c-4d64-9317-0b0836300fe2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.139968 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2863/5702] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:34.140106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.140688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.140974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.141248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] PATH_INFO: `/v3/users/65f8413f34ee449db5ab1f9e43c90d16` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.141838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.142488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=65f8413f34ee449db5ab1f9e43c90d16)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.143719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.144426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.160323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d671b6-a2b3-4fe3-af44-375713e36d7c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.182500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.184921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.185450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.185652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] PATH_INFO: `/v3/projects/38f9e1e21653406ebb6203c714551a02` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.188370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f9e1e21653406ebb6203c714551a02)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.194456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.245738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65f8413f34ee449db5ab1f9e43c90d16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.272483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65f8413f34ee449db5ab1f9e43c90d16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.273790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65f8413f34ee449db5ab1f9e43c90d16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.283337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65f8413f34ee449db5ab1f9e43c90d16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.284130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65f8413f34ee449db5ab1f9e43c90d16'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.306748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2840/5703] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:33 2022] DELETE /identity/v3/users/65f8413f34ee449db5ab1f9e43c90d16 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:34.311576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.317845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.342900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f9e1e21653406ebb6203c714551a02', 'request_id': 'req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.356030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f9e1e21653406ebb6203c714551a02', 'request_id': 'req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.388252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f9e1e21653406ebb6203c714551a02', 'request_id': 'req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.419965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] The token cache is being invalidate because project 38f9e1e21653406ebb6203c714551a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:34.421249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.422838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5894beb-b3a6-4cec-b5b3-b01f88037bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:34.430343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2864/5704] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:34 2022] DELETE /identity/v3/projects/38f9e1e21653406ebb6203c714551a02 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:34.440440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.440879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.441310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.452843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dbd5f9-2b54-48f7-b8f6-bec4160ddabe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.460709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.461487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.461763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.462081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.462761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:34.463041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.464912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1372b-39a0-4ea8-ba97-1f7b89294d64 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.491860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2841/5705] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:34.491860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7aafe-c2cb-4893-bae3-c9d32676b0bd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.491860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7aafe-c2cb-4893-bae3-c9d32676b0bd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.491860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7aafe-c2cb-4893-bae3-c9d32676b0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.511898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:34.514671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.531304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6bd7aafe-c2cb-4893-bae3-c9d32676b0bd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:34.535095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6bd7aafe-c2cb-4893-bae3-c9d32676b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.538717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2865/5706] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:34.540598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.544820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.558365 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2842/5707] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:34.566710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.567234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.568049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.573062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d79fe-07bb-4005-9bda-6f3f2be9b33e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.587237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.587819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.588101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.588378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.589131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.591212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.618169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:34.620377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.638508 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2866/5708] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:34.638508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.647687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:34.650256 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2843/5709] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:34.651152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.678055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98730985-fb5c-484d-aa4b-95f42b0373cd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.708982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:34.779371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.780293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.780749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.781227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.782209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.784514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.802937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62c272-78c7-45cd-ae3d-3f0a8b8e2399 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.816058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.816798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.817366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.817780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.831154 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2844/5710] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/users => generated 279 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:34.835512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.840700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.855062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.861052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ac73-2658-47ef-822b-d5a73febf8f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.871809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.873011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.873436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.873976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.874804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:34.875311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.877688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261fc16-8549-449c-a2c5-3bd2873fffa0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.882523 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2867/5711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:34.883523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.895818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85733dcb-65e7-4c23-b650-8f93fbd205d5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:34.920797 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2845/5712] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:34.923169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:34.923855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.924170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:34.924458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.924735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.928858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:34.929316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:34.930258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:34.932007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:34.958634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2868/5713] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:34.959815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:34.995624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4385ec-3851-41cd-84f5-e98fd51d206c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.002589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] MFA Rules not processed for user `f4e793d75b944fc7a139abfa22789a94`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:35.003804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.003983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.004651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.005203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.005677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.006546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:35.008819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:35.070930 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2869/5714] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:35.071947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.098205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:35.159034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2846/5715] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:35.169689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.181829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319445a9-4e11-4535-a809-1ec94b1b4539 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.235172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788face-7b59-4123-8acc-022584e5ca56 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.248819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da2cb5-e9c2-4013-9bc9-9ad27781cc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.249637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2cb5-e9c2-4013-9bc9-9ad27781cc1a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.250052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2cb5-e9c2-4013-9bc9-9ad27781cc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.250462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da2cb5-e9c2-4013-9bc9-9ad27781cc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.251374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2cb5-e9c2-4013-9bc9-9ad27781cc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:35.257222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da2cb5-e9c2-4013-9bc9-9ad27781cc1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:35.285343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.286148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.286437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.286729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.287915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:35.288295 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2870/5716] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:35.291649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.292298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.292940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:35.293740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.339095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] MFA Rules not processed for user `f4e793d75b944fc7a139abfa22789a94`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:35.341396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.347809 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2847/5717] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:35 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:35.347809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.358595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4194b-7f93-40ed-82ef-c76d52c01281 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.364795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.365662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.366031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.367696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] PATH_INFO: `/v3/projects/e44e458970a24adaa59856767a67e23f/users/69444d296b3043b89c5405cccb212b95/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.378272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:35.387745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44e458970a24adaa59856767a67e23f, user_id=69444d296b3043b89c5405cccb212b95, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:35.391705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:35.415718 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2848/5718] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:35 2022] PUT /identity/v3/projects/e44e458970a24adaa59856767a67e23f/users/69444d296b3043b89c5405cccb212b95/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:35.417728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.420922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.468815 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2871/5719] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:35.471350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.503698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca3c13-65db-4264-8a90-8668641a759d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.580819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edaca6-3916-4c1e-966c-70b06c665535 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.587342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.588160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.588870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.588870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] PATH_INFO: `/v3/projects/aeee3855dfd344a9acb244e2696e38c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.590016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeee3855dfd344a9acb244e2696e38c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:35.592917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:35.619552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48a87d-f5f8-477e-a773-35d419a40ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.620180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a87d-f5f8-477e-a773-35d419a40ffa admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.620465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a87d-f5f8-477e-a773-35d419a40ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.620831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48a87d-f5f8-477e-a773-35d419a40ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.622958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48a87d-f5f8-477e-a773-35d419a40ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:35.625550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48a87d-f5f8-477e-a773-35d419a40ffa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:35.658828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2872/5720] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:35.660476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.660771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.661076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.680678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeee3855dfd344a9acb244e2696e38c0', 'request_id': 'req-f6243925-ac22-4a55-83d7-010bd1895307'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:35.690598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeee3855dfd344a9acb244e2696e38c0', 'request_id': 'req-f6243925-ac22-4a55-83d7-010bd1895307'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:35.699545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeee3855dfd344a9acb244e2696e38c0', 'request_id': 'req-f6243925-ac22-4a55-83d7-010bd1895307'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:35.723023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] The token cache is being invalidate because project aeee3855dfd344a9acb244e2696e38c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:35.723342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:35.724185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:35.726636 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2849/5721] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:35 2022] DELETE /identity/v3/projects/aeee3855dfd344a9acb244e2696e38c0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:35.727922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.730429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.746722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] MFA Rules not processed for user `69444d296b3043b89c5405cccb212b95`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:35.747986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.841059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:35.888197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6243925-ac22-4a55-83d7-010bd1895307 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:35.908381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:35.909177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:35.909456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:35.909733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:35.917782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.926467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2873/5722] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:35.928318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:35.929752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:35.950536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:36.033342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.035365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.051483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2850/5723] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:36.052498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.054087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:36.070647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823a706-f226-4643-a745-9cf01ed7f8ef service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.076240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.077099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.077379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.077648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] PATH_INFO: `/v3/users/74a3a7be4419445f96eb695869e37dc8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.079208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a3a7be4419445f96eb695869e37dc8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.081390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.082061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56903ee4-4399-4f28-977b-d203f94001ef None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.096382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.097481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.097987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.098456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.099602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.103060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.150468 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2874/5724] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:36.153631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.159992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:36.172038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a3a7be4419445f96eb695869e37dc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:36.209634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724cb3fb-eaf8-4f09-84b6-4d59e89aa884 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.222529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a3a7be4419445f96eb695869e37dc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:36.223361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a3a7be4419445f96eb695869e37dc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:36.233947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.234886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.235268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.235632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.235736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a3a7be4419445f96eb695869e37dc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:36.236386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a3a7be4419445f96eb695869e37dc8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:36.236492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.239008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.262841 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2851/5725] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:36 2022] DELETE /identity/v3/users/74a3a7be4419445f96eb695869e37dc8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:36.264049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.267784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:36.310240 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2875/5726] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:36 2022] POST /identity/v3/projects => generated 355 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:36.312001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.314052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:36.403271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06903-ba9b-4f32-993f-ae2b0f13790c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.450367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:36.478739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f89381-e180-4847-9d46-db29079aa253 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.490016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.490578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.490827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.491101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.491800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.494082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.531342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4157f9-7c3c-4aa4-bd92-c3ec10c056e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.532041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4157f9-7c3c-4aa4-bd92-c3ec10c056e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.532322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4157f9-7c3c-4aa4-bd92-c3ec10c056e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.532596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4157f9-7c3c-4aa4-bd92-c3ec10c056e1 admin admin] PATH_INFO: `/v3/projects/393e2b2202cb46e8b1603038f079b9aa/users/cc26b3ebcdfe4bea81cab484f092b401/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.546836 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2876/5727] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:36 2022] POST /identity/v3/users => generated 284 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:36.548936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.565492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad4971-e04c-48b8-8176-885eabe1ddbf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.581298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.582245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.582245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.582517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.583863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.585509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.588749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4157f9-7c3c-4aa4-bd92-c3ec10c056e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393e2b2202cb46e8b1603038f079b9aa, user_id=cc26b3ebcdfe4bea81cab484f092b401, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.591172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4157f9-7c3c-4aa4-bd92-c3ec10c056e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.615284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2877/5728] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:11:36.617787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.622271 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2852/5729] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:36 2022] PUT /identity/v3/projects/393e2b2202cb46e8b1603038f079b9aa/users/cc26b3ebcdfe4bea81cab484f092b401/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:36.626899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.627240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.627422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.640591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3288ba0-b5c1-4b27-98d4-5b5aa0beec0a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.674928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:36.678407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:36.694806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:36.769932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:36.770672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:36.771014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:36.771296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] PATH_INFO: `/v3/projects/9d5b1dc79a3b424b9c732fefcd6520b7/users/ca7d8b6256514a70a3d9f3986e3b9df2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:36.802934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5b1dc79a3b424b9c732fefcd6520b7, user_id=ca7d8b6256514a70a3d9f3986e3b9df2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:36.805652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:36.822201 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2853/5730] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:36.837861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2878/5731] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:36 2022] PUT /identity/v3/projects/9d5b1dc79a3b424b9c732fefcd6520b7/users/ca7d8b6256514a70a3d9f3986e3b9df2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:36.842737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.854881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efeaa93-9dfd-4087-bc1e-51c43ac81408 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:36.863417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:36.866036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:36.999322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77fd2-8c63-4182-82e3-79834aa70cfc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.000688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a06ecc-6836-4cd8-8226-9d11e1a4e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.002508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a06ecc-6836-4cd8-8226-9d11e1a4e50a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.003010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a06ecc-6836-4cd8-8226-9d11e1a4e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.003470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a06ecc-6836-4cd8-8226-9d11e1a4e50a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.004645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a06ecc-6836-4cd8-8226-9d11e1a4e50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.006200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.006456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.006748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.007104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.025999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a06ecc-6836-4cd8-8226-9d11e1a4e50a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.029635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.031134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.052960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2879/5732] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:11:37.053758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:37.054454 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2854/5733] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:37.065057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a47ff1-cbbb-47b4-9305-d25f9050f373 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.070694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.071394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.071673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.071948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] PATH_INFO: `/v3/projects/9d5b1dc79a3b424b9c732fefcd6520b7/users/ca7d8b6256514a70a3d9f3986e3b9df2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.073999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5b1dc79a3b424b9c732fefcd6520b7, user_id=ca7d8b6256514a70a3d9f3986e3b9df2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.076798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.091444 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2880/5734] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:37 2022] PUT /identity/v3/projects/9d5b1dc79a3b424b9c732fefcd6520b7/users/ca7d8b6256514a70a3d9f3986e3b9df2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:37.102711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.103143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.105262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.147388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] MFA Rules not processed for user `ca7d8b6256514a70a3d9f3986e3b9df2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:37.148800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:37.219933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:37.281786 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2855/5735] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:37.283311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:37.302491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c3b6-54e9-4ef4-9089-57fc7272ec2a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.308089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7d8b6256514a70a3d9f3986e3b9df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b1dc79a3b424b9c732fefcd6520b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.308359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.308758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.308886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.309540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:37.309949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.312124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.330799 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2881/5736] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:37.334562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:37.346083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a890d6-a80b-4fca-9f82-8aab20a7c152 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.361668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7d8b6256514a70a3d9f3986e3b9df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b1dc79a3b424b9c732fefcd6520b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.362339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.362615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.362893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.363538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.365627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.400303 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2856/5737] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:37 2022] POST /identity/v3/projects => generated 349 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:37.404752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:37.418330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac9940-da82-4966-aced-9a45722eee7e tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.517446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7d8b6256514a70a3d9f3986e3b9df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b1dc79a3b424b9c732fefcd6520b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.530156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.530365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.530659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.531352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:37.531701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.533352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.557671 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2882/5738] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:11:37.583311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:37.584995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:37.742818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f735489-a668-44be-b0b7-e46695b6661d tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.748412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:37.750380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:37.752389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.753075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.753283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.753557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.782636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.784268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.802743 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2857/5739] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:37.804222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:37.915654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac76211-9177-45f7-98e8-176c150ddedc tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:37.925493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:37.926331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:37.927325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:37.927843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:37.930198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:37.958468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:37.960237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:37.974322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2883/5740] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:11:38.658715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:38.660359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:38.823178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:38.824690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:38.846574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38728ff7-de73-44e3-b641-14218d0ff32c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:38.859375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:38.861603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659b52-cf5e-406f-a2f0-964ed2597422 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:38.862307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:38.862632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:38.862906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] PATH_INFO: `/v3/projects/e3bb1db6c3fe4a7d826d8638fe5eaae9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:38.866429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3bb1db6c3fe4a7d826d8638fe5eaae9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:38.871327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:38.885833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:38.886521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:38.886800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:38.890377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] PATH_INFO: `/v3/users/b6e0707a52b84a00931ed64619e9996a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:38.898702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e0707a52b84a00931ed64619e9996a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:38.907506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:38.975085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3bb1db6c3fe4a7d826d8638fe5eaae9', 'request_id': 'req-83242b56-c842-4c66-b1a0-8c2abd65681c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:38.993403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3bb1db6c3fe4a7d826d8638fe5eaae9', 'request_id': 'req-83242b56-c842-4c66-b1a0-8c2abd65681c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.030548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e0707a52b84a00931ed64619e9996a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.045189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e0707a52b84a00931ed64619e9996a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.045653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:39.045847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e0707a52b84a00931ed64619e9996a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.049287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3bb1db6c3fe4a7d826d8638fe5eaae9', 'request_id': 'req-83242b56-c842-4c66-b1a0-8c2abd65681c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.058539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e0707a52b84a00931ed64619e9996a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.059368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e0707a52b84a00931ed64619e9996a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.090506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] The token cache is being invalidate because project e3bb1db6c3fe4a7d826d8638fe5eaae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:39.091420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.092380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.101776 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2858/5741] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:38 2022] DELETE /identity/v3/projects/e3bb1db6c3fe4a7d826d8638fe5eaae9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:39.102575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:39.106315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:39.110627 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2884/5742] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:38 2022] DELETE /identity/v3/users/b6e0707a52b84a00931ed64619e9996a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:39.111270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:39.123370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:39.278945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860558ba-15d5-4111-be4d-a0504b0e6ccc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:39.298058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83242b56-c842-4c66-b1a0-8c2abd65681c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:39.304430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:39.305325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:39.307387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:39.311497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] PATH_INFO: `/v3/users/851a87d8d4f442fb89b83270484260f8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:39.316269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851a87d8d4f442fb89b83270484260f8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:39.322643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:39.376593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:39.450873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851a87d8d4f442fb89b83270484260f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.469456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca7d8b6256514a70a3d9f3986e3b9df2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d5b1dc79a3b424b9c732fefcd6520b7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:39.471097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:39.472965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:39.474236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] PATH_INFO: `/v3/projects/48ee417d5f1d46129e1d4f50363179a6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:39.478319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorizing `identity:delete_project(project_id=48ee417d5f1d46129e1d4f50363179a6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:39.480575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:39.480812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851a87d8d4f442fb89b83270484260f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.481523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851a87d8d4f442fb89b83270484260f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.504289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851a87d8d4f442fb89b83270484260f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.506404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4c67a51c-66fa-47b9-afda-18125b42cd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851a87d8d4f442fb89b83270484260f8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.568447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2885/5743] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:39 2022] DELETE /identity/v3/users/851a87d8d4f442fb89b83270484260f8 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:39.570048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:39.570408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:39.570645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:39.594445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:39.596797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:39.627036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48ee417d5f1d46129e1d4f50363179a6', 'request_id': 'req-cce96d43-dcf6-43e7-9ba7-18bff000de60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.641057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48ee417d5f1d46129e1d4f50363179a6', 'request_id': 'req-cce96d43-dcf6-43e7-9ba7-18bff000de60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.661443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48ee417d5f1d46129e1d4f50363179a6', 'request_id': 'req-cce96d43-dcf6-43e7-9ba7-18bff000de60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.694712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] The token cache is being invalidate because project 48ee417d5f1d46129e1d4f50363179a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:39.695331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.696202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:39.699097 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2859/5744] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:39 2022] DELETE /identity/v3/projects/48ee417d5f1d46129e1d4f50363179a6 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:39.736273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2886/5745] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:39.758117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:39.763849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:39.852030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:39.918570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce96d43-dcf6-43e7-9ba7-18bff000de60 tempest-QuotasTest-815731111 tempest-QuotasTest-815731111-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:39.934019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:39.935035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:39.935838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:39.936307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:39.947849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:39.949661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:39.961339 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2860/5746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:40.307274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:40.309184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:40.330998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92be93-5a3f-4945-9bcf-a443a05d7412 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:40.339945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:40.340814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:40.341221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:40.341616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] PATH_INFO: `/v3/users/69444d296b3043b89c5405cccb212b95` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:40.344722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69444d296b3043b89c5405cccb212b95)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:40.347994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:40.446371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:40.446484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69444d296b3043b89c5405cccb212b95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.447835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:40.464419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69444d296b3043b89c5405cccb212b95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.465064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69444d296b3043b89c5405cccb212b95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.469639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12f745-f8aa-4abc-97f3-52cfacfd5ad6 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:40.481989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69444d296b3043b89c5405cccb212b95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.483302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3a5be279-77e3-465d-9685-251ce8aef976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69444d296b3043b89c5405cccb212b95'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.489551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:40.493699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:40.494812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:40.495212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] PATH_INFO: `/v3/projects/782fbc8414fb4b62826f1ddad0126d76` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:40.499666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=782fbc8414fb4b62826f1ddad0126d76)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:40.503596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:40.550604 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2887/5747] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:40 2022] DELETE /identity/v3/users/69444d296b3043b89c5405cccb212b95 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:40.567547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d27dd-1a43-45ea-9e0b-a85dedf440d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:40.568207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d27dd-1a43-45ea-9e0b-a85dedf440d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:40.569692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d27dd-1a43-45ea-9e0b-a85dedf440d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:40.602592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782fbc8414fb4b62826f1ddad0126d76', 'request_id': 'req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.619323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:40.621406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782fbc8414fb4b62826f1ddad0126d76', 'request_id': 'req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.630092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-734d27dd-1a43-45ea-9e0b-a85dedf440d8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:40.634565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-734d27dd-1a43-45ea-9e0b-a85dedf440d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:40.639568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782fbc8414fb4b62826f1ddad0126d76', 'request_id': 'req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.670553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] The token cache is being invalidate because project 782fbc8414fb4b62826f1ddad0126d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:40.670553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.672285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6b405d5d-ccf0-4282-9a68-6dc9ccdebae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:40.674689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2861/5748] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:40 2022] DELETE /identity/v3/projects/782fbc8414fb4b62826f1ddad0126d76 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:40.679234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64867aef-871d-420f-a851-d49095d1db2f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:40.679807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64867aef-871d-420f-a851-d49095d1db2f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:40.680353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64867aef-871d-420f-a851-d49095d1db2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:40.708313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-64867aef-871d-420f-a851-d49095d1db2f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:40.710147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64867aef-871d-420f-a851-d49095d1db2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:40.824048 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2888/5749] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:40.843362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2862/5750] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:40.856821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:40.858349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:40.859124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64867aef-871d-420f-a851-d49095d1db2f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:40.859279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:40.862943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-64867aef-871d-420f-a851-d49095d1db2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:40.929891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:40.931936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:40.969070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2889/5751] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:40.979634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:40.991931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df4e11-2e65-41c8-ab53-d9855456de25 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:40.998789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.000111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.001436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.002055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.003390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:41.004343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.006808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.030955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64867aef-871d-420f-a851-d49095d1db2f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.034225 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2890/5752] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:11:41.035881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.036576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.036902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.037261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.038566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.045275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:41.055710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.057306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef83d0-c818-4e00-95be-3a26bc23b0bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.065477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.065944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.066751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.067126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.067564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.068451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.071073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.106128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2863/5753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:41.157660 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2891/5754] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:41 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:41.161828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.175401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d02e3-3c5d-4eb9-b3a0-58dcd8740bcf service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.304169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.304799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.305076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.305345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.306020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.308249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.349991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2864/5755] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:41 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:41.354872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.374852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b92e0-bc38-4815-b601-a41ea42ee9b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.381426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.383435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:41.390849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.391697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.392252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.392663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.396293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.398129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.405321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae869c-b6a5-4160-ae54-96476a7023cc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.418744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.419419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.419702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.419974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] PATH_INFO: `/v3/projects/810f58b3c977440887757041492bcd06` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.422012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810f58b3c977440887757041492bcd06)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.423450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.428363 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2892/5756] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:41.431990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.466515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef365114-45a0-4132-a060-1acd3ccd58ad admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.471971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.473550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.474312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.474801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.475825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.479725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.512223 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2893/5757] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:41.523138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.534100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810f58b3c977440887757041492bcd06', 'request_id': 'req-276317f2-41b9-43f7-875d-ee59d070fa34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:41.559959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810f58b3c977440887757041492bcd06', 'request_id': 'req-276317f2-41b9-43f7-875d-ee59d070fa34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:41.567186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c030c-945e-4348-9ec0-a979a42a26d3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.570086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810f58b3c977440887757041492bcd06', 'request_id': 'req-276317f2-41b9-43f7-875d-ee59d070fa34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:41.595581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] The token cache is being invalidate because project 810f58b3c977440887757041492bcd06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:41.596169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:41.596535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:41.603116 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2865/5758] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:41 2022] DELETE /identity/v3/projects/810f58b3c977440887757041492bcd06 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:41.606722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:41.608157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:41.681734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc476-98c9-4ab5-8a2e-1f4ecdafabd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.682614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc476-98c9-4ab5-8a2e-1f4ecdafabd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.683097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc476-98c9-4ab5-8a2e-1f4ecdafabd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.683385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc476-98c9-4ab5-8a2e-1f4ecdafabd8 admin admin] PATH_INFO: `/v3/projects/0d96357f465e4b1782a801ec12f4258a/users/fe033cace4254afa95d3f506ae9a588a/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.701570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc476-98c9-4ab5-8a2e-1f4ecdafabd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d96357f465e4b1782a801ec12f4258a, user_id=fe033cace4254afa95d3f506ae9a588a, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.704700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc476-98c9-4ab5-8a2e-1f4ecdafabd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.737232 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2894/5759] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:41 2022] PUT /identity/v3/projects/0d96357f465e4b1782a801ec12f4258a/users/fe033cace4254afa95d3f506ae9a588a/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:41.740128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.740429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.740923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.769501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276317f2-41b9-43f7-875d-ee59d070fa34 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:41.805422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:41.809899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] MFA Rules not processed for user `fe033cace4254afa95d3f506ae9a588a`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:41.815480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:41.858669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:41.869976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:41.870716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:41.870996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:41.871268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] PATH_INFO: `/v3/users/cac8de1904dd4237b299044f7c5abb0c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:41.872681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac8de1904dd4237b299044f7c5abb0c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:41.875582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:41.985666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac8de1904dd4237b299044f7c5abb0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:42.019543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac8de1904dd4237b299044f7c5abb0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:42.020609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac8de1904dd4237b299044f7c5abb0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:42.025147 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2895/5760] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:42.030734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.032352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:42.036728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac8de1904dd4237b299044f7c5abb0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:42.038793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac8de1904dd4237b299044f7c5abb0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:42.057154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac96d2-d4ac-4af2-92fe-0230f76111ea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.064748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.065613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.066029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.066410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.067295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.070628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.079518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2866/5761] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:41 2022] DELETE /identity/v3/users/cac8de1904dd4237b299044f7c5abb0c => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:42.131769 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2896/5762] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:42 2022] POST /identity/v3/projects => generated 367 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:42.132433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.134344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:42.269427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383845c1-ec9f-43f5-b3af-728ff35e3dd5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.355007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:42.407653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.410064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.410506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.411097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.412018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.414848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.454321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.471638 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2867/5763] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:42 2022] POST /identity/v3/users => generated 290 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:42.476244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546379c-a9fb-4977-b1c4-bd5c6d3c7dfd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.482778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.484611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.485671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.485671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.486652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.488468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.512468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.523322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2897/5764] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:42.526735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46a0f4-8d99-4e71-a01b-3c7fda9fd3b8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.533773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.535292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.536594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.537078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] PATH_INFO: `/v3/projects/9e7192a62a3b41699adfd0aa8df0cd13/users/71e4e35707ea4ef1b51059b49fba8dc2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.561469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7192a62a3b41699adfd0aa8df0cd13, user_id=71e4e35707ea4ef1b51059b49fba8dc2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.566414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.595917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.608734 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2868/5765] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:42 2022] PUT /identity/v3/projects/9e7192a62a3b41699adfd0aa8df0cd13/users/71e4e35707ea4ef1b51059b49fba8dc2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:42.610425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec40c7-b0e9-4183-a07d-5c3126c6f56a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.765125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.767532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.768016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.769730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.772358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.779310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.824646 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2898/5766] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:42.829657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.854515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d05991-0d91-461e-9392-c0482b8d909f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.862988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.864953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:42.877707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.882686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.882977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.885515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] PATH_INFO: `/v3/projects/9e7192a62a3b41699adfd0aa8df0cd13/users/71e4e35707ea4ef1b51059b49fba8dc2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.891722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7192a62a3b41699adfd0aa8df0cd13, user_id=71e4e35707ea4ef1b51059b49fba8dc2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.903339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.907101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09ce42-9259-430f-9aff-ed1e5328ac9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:42.932878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:42.933542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:42.933851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:42.934132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] PATH_INFO: `/v3/projects/e44e458970a24adaa59856767a67e23f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:42.942743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44e458970a24adaa59856767a67e23f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:42.948639 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2869/5767] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:42 2022] PUT /identity/v3/projects/9e7192a62a3b41699adfd0aa8df0cd13/users/71e4e35707ea4ef1b51059b49fba8dc2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:42.961204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:42.962640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:42.969327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:43.086911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44e458970a24adaa59856767a67e23f', 'request_id': 'req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.095086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44e458970a24adaa59856767a67e23f', 'request_id': 'req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.102777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44e458970a24adaa59856767a67e23f', 'request_id': 'req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.115409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c09e9-50b1-49fc-afda-37fafd874850 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:43.122030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] The token cache is being invalidate because project e44e458970a24adaa59856767a67e23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:43.122376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.123743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-45ca0c38-fb38-4aaa-a59e-06e429ef5c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.128291 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2899/5768] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:42 2022] DELETE /identity/v3/projects/e44e458970a24adaa59856767a67e23f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:43.129827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:43.130129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:43.130482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:43.146647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:43.230311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] MFA Rules not processed for user `71e4e35707ea4ef1b51059b49fba8dc2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:43.231812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:43.257141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:43.258006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:43.258391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:43.258768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:43.263659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:43.313043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:43.314657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:43.346866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2870/5769] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:43.352943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:43.354797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:43.404890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2900/5770] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:43.430824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:43.432959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:43.461369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb6c59-8566-446a-a10a-e7a35a4ad0d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:43.469378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:43.470059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:43.470324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:43.470595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:43.490979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:43.508578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:43.511001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:43.519553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca38db-4f7c-47e2-8688-492996f86bd3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:43.523169 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2901/5771] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:11:43.530935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:43.531705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:43.532059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:43.532660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] PATH_INFO: `/v3/users/ca7d8b6256514a70a3d9f3986e3b9df2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:43.534474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7d8b6256514a70a3d9f3986e3b9df2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:43.546957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:43.627988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7d8b6256514a70a3d9f3986e3b9df2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.649987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7d8b6256514a70a3d9f3986e3b9df2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.651315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7d8b6256514a70a3d9f3986e3b9df2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.661399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7d8b6256514a70a3d9f3986e3b9df2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.662250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-33cece4f-7bff-4dc0-b21a-8bb2b6f71a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7d8b6256514a70a3d9f3986e3b9df2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:43.681568 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2871/5772] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:43 2022] DELETE /identity/v3/users/ca7d8b6256514a70a3d9f3986e3b9df2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:43.981627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:43.984267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:44.048083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd4c2-f8cb-4314-b538-41330924ad96 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:44.151023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:44.151695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.151973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.152391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] PATH_INFO: `/v3/projects/5c9caa0416a6457aae239669ad99887d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.153627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9caa0416a6457aae239669ad99887d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:44.155640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:44.307118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9caa0416a6457aae239669ad99887d', 'request_id': 'req-59d2fbbb-1abe-4c30-a54a-de722ccd277d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:44.314223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9caa0416a6457aae239669ad99887d', 'request_id': 'req-59d2fbbb-1abe-4c30-a54a-de722ccd277d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:44.329769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9caa0416a6457aae239669ad99887d', 'request_id': 'req-59d2fbbb-1abe-4c30-a54a-de722ccd277d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:44.392413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] The token cache is being invalidate because project 5c9caa0416a6457aae239669ad99887d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:44.392862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:44.395487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-59d2fbbb-1abe-4c30-a54a-de722ccd277d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:44.397540 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2902/5773] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:43 2022] DELETE /identity/v3/projects/5c9caa0416a6457aae239669ad99887d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:44.402910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.403553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.403923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.438407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:44.440399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:44.535818 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2872/5774] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:44.537719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.538194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.538266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.555936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:44.574655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:44.575922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:44.588072 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2903/5775] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:44.592035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.615400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735fc30-1020-422f-8816-43e47c6324ee None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:44.622306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:44.623063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.623478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.623762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.624426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:44.625487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:44.627293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:44.644448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2873/5776] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:44.652129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.667527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f2912-015c-4026-8249-67d7db90ceb0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:44.680994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:44.682925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.683694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.684318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.684816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:44.688904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:44.726551 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2904/5777] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:44 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:44.731567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.744317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb07c48-a3cd-44da-a6d6-908c64ec761c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:44.814470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:44.815243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.815382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.815716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.816279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:44.819075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:44.841939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:44.875438 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2874/5778] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:44 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:44.879679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.892762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e3f5a-e8f0-45b5-9d67-a40a03219dd5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:44.897994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:44.898684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.899035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.899380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.900094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:44.902631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:44.916427 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2905/5779] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:44.920853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.935287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1052a1-2744-4ed4-ac6b-e0922767c489 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:44.944376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:44.945327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:44.945450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:44.946036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:44.946783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:44.949319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:44.966397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2875/5780] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:11:44.971647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.990692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:44.999282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314e090-182e-4c1c-9a22-eb570c32319d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:45.000880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:45.015125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13182b57-d43e-40b4-8871-ebef710945ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:45.015677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13182b57-d43e-40b4-8871-ebef710945ec admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:45.015962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13182b57-d43e-40b4-8871-ebef710945ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:45.016239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13182b57-d43e-40b4-8871-ebef710945ec admin admin] PATH_INFO: `/v3/projects/be2ff13425e74301b35ea1d171b6259a/users/9c13b085a3a04bcb825a0d4a0eb2ce8c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:45.055397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13182b57-d43e-40b4-8871-ebef710945ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2ff13425e74301b35ea1d171b6259a, user_id=9c13b085a3a04bcb825a0d4a0eb2ce8c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:45.058162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13182b57-d43e-40b4-8871-ebef710945ec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:45.114152 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2906/5781] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:44 2022] PUT /identity/v3/projects/be2ff13425e74301b35ea1d171b6259a/users/9c13b085a3a04bcb825a0d4a0eb2ce8c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:45.120673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:45.121343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:45.121613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:45.225174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] MFA Rules not processed for user `9c13b085a3a04bcb825a0d4a0eb2ce8c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:45.226568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:45.226869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b526d-064e-4294-91d7-e4a0e01890e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:45.360732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:45.365589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:45.365794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:45.369005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:45.380535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:45.407119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:45.409228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:45.428040 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2907/5782] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:45.453684 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2876/5783] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:45.485213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:45.487070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:45.588957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1d748-fb16-464d-83db-ca917ff0b5f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:45.599264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:45.600722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:45.601077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:45.601419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:45.613426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:45.615381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:45.630009 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2908/5784] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:45.635925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:45.658484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21db1e-a513-4abb-81b4-a809a94a852d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:45.664289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:45.665134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:45.665474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:45.665877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:45.668361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:45.696846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:45.701961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8b3e2-7491-4c74-9568-783289d2a6ac service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:45.725607 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2877/5785] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:46.273790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:46.275292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:46.350603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:46.421737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b29595-d5c0-47ba-ae14-0df8713e69bd service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:46.432403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:46.433311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:46.433986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:46.434446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] PATH_INFO: `/v3/projects/9d5b1dc79a3b424b9c732fefcd6520b7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:46.437373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5b1dc79a3b424b9c732fefcd6520b7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:46.442753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:46.549005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5b1dc79a3b424b9c732fefcd6520b7', 'request_id': 'req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:46.567349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5b1dc79a3b424b9c732fefcd6520b7', 'request_id': 'req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:46.592902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5b1dc79a3b424b9c732fefcd6520b7', 'request_id': 'req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:46.623279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] The token cache is being invalidate because project 9d5b1dc79a3b424b9c732fefcd6520b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:46.623864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:46.638898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d3fb767-f14a-4e49-a19f-098ea9b1abc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:46.643815 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2909/5786] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:46 2022] DELETE /identity/v3/projects/9d5b1dc79a3b424b9c732fefcd6520b7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:46.653009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:46.654834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:46.655409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:46.726020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:46.727638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:46.796531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:46.825674 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2878/5787] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:46.829414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:46.829939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:46.830259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:46.861117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:46.862384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:46.929594 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2910/5788] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:46.930668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:46.959901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42274c-3a9e-4122-ae94-3fb9b1c9ef91 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:46.979306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:46.981544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:46.982072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:46.983262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:46.984899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:46.985985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:46.996517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.033508 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2879/5789] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:47.034147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:47.046217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be63c04-2eb7-4ac8-af1b-36f70aae1a48 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:47.065034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:47.066066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.066375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.066654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.067436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:47.072325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.127473 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2911/5790] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:47 2022] POST /identity/v3/projects => generated 369 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:47.132471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:47.153610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9450ae-aa0d-4ea4-9b88-898fcb5806e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:47.313647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:47.314308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.314587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.314860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.315498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:47.317610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.360482 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2880/5791] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:47 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:47.364911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:47.385371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd543b-e1fc-4bda-aebe-4d95c91070ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:47.397835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:47.399074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.399358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.399629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.400289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:47.409456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.440826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2912/5792] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:47.445475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:47.466026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e48824-497c-4e82-8e16-0d1f95572551 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:47.471607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1831ae-731c-4ba2-aedf-19a8947c5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:47.472362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1831ae-731c-4ba2-aedf-19a8947c5c35 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.472818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1831ae-731c-4ba2-aedf-19a8947c5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.473200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1831ae-731c-4ba2-aedf-19a8947c5c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.474362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1831ae-731c-4ba2-aedf-19a8947c5c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:47.477781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1831ae-731c-4ba2-aedf-19a8947c5c35 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.515339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:47.518216 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2881/5793] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:47.530132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc863b4a-6e24-4319-8f09-2094259298e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:47.535384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:47.535693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.536021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.536550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] PATH_INFO: `/v3/projects/7e8b790eaaee4e5abe0b8bbd2671f83c/users/248edcc92caa4be9959a03aca93cfef7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.574779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8b790eaaee4e5abe0b8bbd2671f83c, user_id=248edcc92caa4be9959a03aca93cfef7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:47.578668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.596694 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2913/5794] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:47 2022] PUT /identity/v3/projects/7e8b790eaaee4e5abe0b8bbd2671f83c/users/248edcc92caa4be9959a03aca93cfef7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:47.611524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.611817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.612092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.694200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] MFA Rules not processed for user `248edcc92caa4be9959a03aca93cfef7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:47.696978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:47.829507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2882/5795] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:47.830491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:47.955197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a72f4c-ea92-4cc4-91d9-a44b2d70bd2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:47.964072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:47.964719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:47.964999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:47.965268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:47.965945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:47.968013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:47.979519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:48.034462 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2914/5796] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:47 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:48.038450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.052447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c973ce-ad5a-42de-9b1a-5ff8607a530c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.097063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.098973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:48.150359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:48.185149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.186256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.187031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.187403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.188268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.190453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.235987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f6b42-e807-47fe-9127-9cb385726935 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.237704 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2883/5797] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:48 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:48.238886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.247968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.248745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.249122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.249458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] PATH_INFO: `/v3/users/fe033cace4254afa95d3f506ae9a588a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.250807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe033cace4254afa95d3f506ae9a588a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.255445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.277002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8695aa-a5a0-4dc0-ac31-839212bdb0d5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.289422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.292899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.293188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.293473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.297636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.299341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.326313 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2884/5798] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:48.326515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.351238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e1a15-a0ca-4d25-b195-553abc14297f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.357728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe033cace4254afa95d3f506ae9a588a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.365447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.366292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.366846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.367440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] PATH_INFO: `/v3/projects/6d6ef803c239451bbca0bc18565f9e0c/users/a4b85e4bdfdd441295f5eb993388b2b8/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.369988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe033cace4254afa95d3f506ae9a588a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.370790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe033cace4254afa95d3f506ae9a588a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.387912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe033cace4254afa95d3f506ae9a588a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.389651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1a6af603-f2ca-40f1-b779-73ebdd77748b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe033cace4254afa95d3f506ae9a588a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.406402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6ef803c239451bbca0bc18565f9e0c, user_id=a4b85e4bdfdd441295f5eb993388b2b8, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.411276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.426055 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2915/5799] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:48 2022] DELETE /identity/v3/users/fe033cace4254afa95d3f506ae9a588a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:48.436186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.436478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.436753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.445121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2885/5800] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:48 2022] PUT /identity/v3/projects/6d6ef803c239451bbca0bc18565f9e0c/users/a4b85e4bdfdd441295f5eb993388b2b8/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:48.446262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.451953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:48.487442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:48.492488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:48.597039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e45cb-15bc-4c51-90f6-3787ca3bf980 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.608335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.609065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.609322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.609621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.610304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.611902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.614279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2916/5801] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:48.615234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.622604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:48.623807 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2886/5802] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:48.628247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.634765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:48.638506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7626db8-4d43-417f-a894-c431157c2489 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.643997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b44f56-c06c-4650-bc7b-d65de388aa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.644687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44f56-c06c-4650-bc7b-d65de388aa5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.644968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44f56-c06c-4650-bc7b-d65de388aa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.645292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b44f56-c06c-4650-bc7b-d65de388aa5e admin admin] PATH_INFO: `/v3/projects/6d6ef803c239451bbca0bc18565f9e0c/users/a4b85e4bdfdd441295f5eb993388b2b8/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.647418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b44f56-c06c-4650-bc7b-d65de388aa5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6ef803c239451bbca0bc18565f9e0c, user_id=a4b85e4bdfdd441295f5eb993388b2b8, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.650166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b44f56-c06c-4650-bc7b-d65de388aa5e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.652075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1601a-b14d-4079-955a-950528d77d56 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:48.661288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:48.662308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.662748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.664712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] PATH_INFO: `/v3/users/9c13b085a3a04bcb825a0d4a0eb2ce8c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.667368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c13b085a3a04bcb825a0d4a0eb2ce8c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:48.670200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:48.679192 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2887/5803] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:48 2022] PUT /identity/v3/projects/6d6ef803c239451bbca0bc18565f9e0c/users/a4b85e4bdfdd441295f5eb993388b2b8/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:11:48.680955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.681241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.681524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.726479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] MFA Rules not processed for user `a4b85e4bdfdd441295f5eb993388b2b8`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:48.729020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:48.811042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c13b085a3a04bcb825a0d4a0eb2ce8c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.833036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c13b085a3a04bcb825a0d4a0eb2ce8c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.834353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c13b085a3a04bcb825a0d4a0eb2ce8c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.850070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c13b085a3a04bcb825a0d4a0eb2ce8c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.851091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-696a1cf4-8d90-48dd-a31f-90275b446216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c13b085a3a04bcb825a0d4a0eb2ce8c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:48.881005 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2888/5804] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:48.881005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:48.881005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:48.894027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:48.899327 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2917/5805] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:48 2022] DELETE /identity/v3/users/9c13b085a3a04bcb825a0d4a0eb2ce8c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:48.903775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:48.904065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:48.904401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:48.935813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:48.937362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:49.002722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a62b0-067f-4116-928c-f4c37ef03768 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:49.077524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2918/5806] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:49.078788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:49.118869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:49.119663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:49.120039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:49.120410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:49.126149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:49.150797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:49.153362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:49.178759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2889/5807] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:49.180351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:49.205895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a46266-1124-456a-9745-ce70e0a347dc service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:49.207145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6e995-3653-4273-8961-e698fa35e77a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:49.214756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:49.215548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:49.216349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:49.217105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:49.219840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:49.220240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:49.221328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:49.221715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:49.241897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:49.244515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:49.278650 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2890/5808] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:49.287626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:49.339792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:49.341877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:49.359073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2919/5809] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:50.137514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:50.142538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:50.171772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3dcab-6db3-4805-acdf-73f4c19cb17a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:50.185969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:50.186910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:50.187809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:50.188619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] PATH_INFO: `/v3/projects/0d96357f465e4b1782a801ec12f4258a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:50.190319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d96357f465e4b1782a801ec12f4258a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:50.195235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:50.311642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d96357f465e4b1782a801ec12f4258a', 'request_id': 'req-40bcd4a4-69cd-41ac-8899-1ca7271deada'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.347037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d96357f465e4b1782a801ec12f4258a', 'request_id': 'req-40bcd4a4-69cd-41ac-8899-1ca7271deada'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.358068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d96357f465e4b1782a801ec12f4258a', 'request_id': 'req-40bcd4a4-69cd-41ac-8899-1ca7271deada'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.376616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] The token cache is being invalidate because project 0d96357f465e4b1782a801ec12f4258a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:50.377195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.379916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.385380 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2891/5810] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:50 2022] DELETE /identity/v3/projects/0d96357f465e4b1782a801ec12f4258a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:50.386268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:50.400259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ab4a5-cabf-48f5-b207-cc920dc1b007 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:50.477624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:50.478734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:50.479316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:50.479685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] PATH_INFO: `/v3/users/71e4e35707ea4ef1b51059b49fba8dc2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:50.481631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e4e35707ea4ef1b51059b49fba8dc2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:50.483400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:50.577946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e4e35707ea4ef1b51059b49fba8dc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.589324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e4e35707ea4ef1b51059b49fba8dc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.590283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e4e35707ea4ef1b51059b49fba8dc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.600458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e4e35707ea4ef1b51059b49fba8dc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.601233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e3ac52d7-6b6f-4be3-a287-2a6da91bffc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e4e35707ea4ef1b51059b49fba8dc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:50.633500 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2920/5811] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:50 2022] DELETE /identity/v3/users/71e4e35707ea4ef1b51059b49fba8dc2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:50.787701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:50.789111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:50.820094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcd4a4-69cd-41ac-8899-1ca7271deada admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:50.916771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:51.020119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:51.023215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.023492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.023762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] PATH_INFO: `/v3/projects/be2ff13425e74301b35ea1d171b6259a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.028993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2ff13425e74301b35ea1d171b6259a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:51.031254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:51.120508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2ff13425e74301b35ea1d171b6259a', 'request_id': 'req-4044cc0b-91ae-4634-8dcd-f2b88842895c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.132858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2ff13425e74301b35ea1d171b6259a', 'request_id': 'req-4044cc0b-91ae-4634-8dcd-f2b88842895c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.145518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2ff13425e74301b35ea1d171b6259a', 'request_id': 'req-4044cc0b-91ae-4634-8dcd-f2b88842895c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.176003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] The token cache is being invalidate because project be2ff13425e74301b35ea1d171b6259a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:51.176438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.177192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4044cc0b-91ae-4634-8dcd-f2b88842895c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.181032 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2892/5812] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:50 2022] DELETE /identity/v3/projects/be2ff13425e74301b35ea1d171b6259a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:51.185640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.185999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.186227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.211360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:51.213442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:51.281044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:51.313390 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2921/5813] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:51.315269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.315481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.315745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.376579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:51.381360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:51.404020 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2893/5814] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:51.408192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:51.424552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bbd92-db94-430f-ac9a-9a7267f1b0ab None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:51.439623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:51.440402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.440684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.440950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.441680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:51.442104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:51.445690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:51.466965 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2922/5815] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:51.471719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:51.486059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:51.487193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f24c9-5885-4e2b-bb07-b4692ded6b47 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:51.489329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:51.500099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:51.513182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.515652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.515974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.516827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:51.523389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:51.545196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf407755-2401-4587-8987-0a1cd8b27a3c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:51.555055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:51.556686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.557207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.557668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] PATH_INFO: `/v3/projects/9e7192a62a3b41699adfd0aa8df0cd13` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.563043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7192a62a3b41699adfd0aa8df0cd13)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:51.565483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:51.603550 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2894/5816] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:51.607762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:51.684493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7192a62a3b41699adfd0aa8df0cd13', 'request_id': 'req-fdefb8d4-a37a-40b2-a939-89d324306b9c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.708116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7192a62a3b41699adfd0aa8df0cd13', 'request_id': 'req-fdefb8d4-a37a-40b2-a939-89d324306b9c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.722302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7192a62a3b41699adfd0aa8df0cd13', 'request_id': 'req-fdefb8d4-a37a-40b2-a939-89d324306b9c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.749374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] The token cache is being invalidate because project 9e7192a62a3b41699adfd0aa8df0cd13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:51.749730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.751345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdefb8d4-a37a-40b2-a939-89d324306b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:51.752720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e22f91-60f3-401e-9af0-84578ede3dda admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:51.754833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2923/5817] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:51 2022] DELETE /identity/v3/projects/9e7192a62a3b41699adfd0aa8df0cd13 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:51.762303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.762594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.762866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.809541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:51.811135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:51.855362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:51.901636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc67481-dd67-4197-a33d-17ede6ec74b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:51.903058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc67481-dd67-4197-a33d-17ede6ec74b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.903058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc67481-dd67-4197-a33d-17ede6ec74b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.903355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc67481-dd67-4197-a33d-17ede6ec74b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.903947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc67481-dd67-4197-a33d-17ede6ec74b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:51.906863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc67481-dd67-4197-a33d-17ede6ec74b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:51.944941 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2895/5818] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:51 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:51.946372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:51.946672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:51.946912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:51.979494 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2924/5819] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:51.980272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:51.986746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.012671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01690d58-dc31-4ad5-960d-b4f19ed29506 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.024265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2d3e3-76ad-43d9-b127-ca341f4819c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.025318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2d3e3-76ad-43d9-b127-ca341f4819c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.025789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2d3e3-76ad-43d9-b127-ca341f4819c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.026277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2d3e3-76ad-43d9-b127-ca341f4819c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.026620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] MFA Rules not processed for user `cc26b3ebcdfe4bea81cab484f092b401`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:52.027386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2d3e3-76ad-43d9-b127-ca341f4819c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.027905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.030046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2d3e3-76ad-43d9-b127-ca341f4819c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.048889 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2925/5820] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:52.050673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.051676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.053303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.083330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:52.088711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.117398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2926/5821] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:52.120249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.145992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac75ba2-f4dc-477b-8423-0026987669a6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.152000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.152623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.153123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.153656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.154623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.156437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.175424 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2927/5822] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:52.175424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.190089 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2896/5823] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:52.190643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d3b4-5b50-44ee-8b89-8b55fec99543 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.191139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.194923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.206783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.207374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.207740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.208019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.211591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:52.211913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.216669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.257916 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2928/5824] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:52.261092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.276974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a76fa1-5159-46b3-95ce-ed72926b86e7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.281882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.283076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.283076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.283441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] PATH_INFO: `/v3/projects/0b27973fbfe04bafae49d7ee85a25c09/users/fda98afa4e8647c09a95688cd4c2c01b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.299386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:52.305079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b27973fbfe04bafae49d7ee85a25c09, user_id=fda98afa4e8647c09a95688cd4c2c01b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.307989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.335003 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2929/5825] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:52 2022] PUT /identity/v3/projects/0b27973fbfe04bafae49d7ee85a25c09/users/fda98afa4e8647c09a95688cd4c2c01b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:52.335950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.336863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f399b-ee86-4779-87dd-845250b3dad5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.337766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.438756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:52.454372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.456859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.457339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.457645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.460998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.481898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.483788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.509167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa550579-2ce3-49d0-bda2-f21a5e762684 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.516779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2897/5826] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:52.518008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.519182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81ab02-7d97-4cc4-903a-8fe3637377c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.520089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81ab02-7d97-4cc4-903a-8fe3637377c1 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.520421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81ab02-7d97-4cc4-903a-8fe3637377c1 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.520752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81ab02-7d97-4cc4-903a-8fe3637377c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.612649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81ab02-7d97-4cc4-903a-8fe3637377c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.614835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81ab02-7d97-4cc4-903a-8fe3637377c1 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.625769 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2930/5827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:52.627050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.627567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.627941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.685151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] MFA Rules not processed for user `fda98afa4e8647c09a95688cd4c2c01b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:52.687124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.764325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb89556-ebcc-47a0-8db8-8ae9e3d46d42 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:52.782053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:52.782800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:52.783080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:52.783351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:52.785357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:52.789554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:52.866967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2898/5828] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:52 2022] POST /identity/v3/projects => generated 407 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:52.868964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.880872 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2931/5829] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:52.894483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:52.896919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:52.959191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:53.090616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdccf6-3048-496d-ba2c-ba10c0db1f54 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:53.093434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14302e-8f37-48ff-a9b1-2fbec9869898 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:53.108800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:53.109900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.110268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.110638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.111365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:53.115012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:53.159703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2899/5830] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:52 2022] POST /identity/v3/users => generated 304 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:53.166287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:53.189618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6053c217-c486-481f-9e1a-472f90f799ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:53.202771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:53.205345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.205945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.206458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.208098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:53.211194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:53.226736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3370f76-e43e-47fd-bc05-147a767add00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:53.227383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370f76-e43e-47fd-bc05-147a767add00 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.228623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370f76-e43e-47fd-bc05-147a767add00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.228623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3370f76-e43e-47fd-bc05-147a767add00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.243527 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2900/5831] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:53.247869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:53.268667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647a699-d919-4d60-8cb0-10823142e181 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:53.279374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:53.280045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.280315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.280625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.282056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:53.283491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:53.306186 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2901/5832] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:53.310889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:53.331828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35008-5715-4f5f-9415-6e9b4cdef2ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:53.346630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:53.347505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.347787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.348055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] PATH_INFO: `/v3/projects/6b5417287e7541ada935c241754d0e32/users/acdcbb0fee2640aaa19330e1d1049a67/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.377702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3370f76-e43e-47fd-bc05-147a767add00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:53.380772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3370f76-e43e-47fd-bc05-147a767add00 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:53.391479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5417287e7541ada935c241754d0e32, user_id=acdcbb0fee2640aaa19330e1d1049a67, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:53.395535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:53.407398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2932/5833] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:53.444389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2902/5834] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:53 2022] PUT /identity/v3/projects/6b5417287e7541ada935c241754d0e32/users/acdcbb0fee2640aaa19330e1d1049a67/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:53.454841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.455146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.455387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.497990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] MFA Rules not processed for user `acdcbb0fee2640aaa19330e1d1049a67`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:53.499383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:53.688374 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2933/5835] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:53 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:53.695258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:53.725502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:53.858260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa9580-812b-44bf-97f0-c369ee0aa539 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:53.874007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:53.874007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:53.874168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:53.874380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:53.875036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:53.877489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:53.943269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2903/5836] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:53 2022] POST /identity/v3/projects => generated 407 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:53.946372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:53.971363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cfde7-c598-4001-979b-f49134787c3a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:54.019047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:54.020912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:54.170559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838823aa-c4aa-4c92-ad6d-539b85905a2b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:54.187516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:54.190818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.191981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.192938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e4d08-e4e2-470a-9010-e11129eb69c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:54.193409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] PATH_INFO: `/v3/users/fda98afa4e8647c09a95688cd4c2c01b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.195923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e4d08-e4e2-470a-9010-e11129eb69c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.196771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=fda98afa4e8647c09a95688cd4c2c01b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:54.197208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e4d08-e4e2-470a-9010-e11129eb69c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.197616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e4d08-e4e2-470a-9010-e11129eb69c6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.199046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e4d08-e4e2-470a-9010-e11129eb69c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:54.203179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:54.206702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e4d08-e4e2-470a-9010-e11129eb69c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:54.258732 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2934/5837] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:53 2022] POST /identity/v3/users => generated 310 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:54.261318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483a841-7282-4ccc-856a-6e03e0cdaf98 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.267478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483a841-7282-4ccc-856a-6e03e0cdaf98 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.267947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483a841-7282-4ccc-856a-6e03e0cdaf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.320843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d483a841-7282-4ccc-856a-6e03e0cdaf98 None None] MFA Rules not processed for user `cc26b3ebcdfe4bea81cab484f092b401`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:54.322138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d483a841-7282-4ccc-856a-6e03e0cdaf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:54.328917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fda98afa4e8647c09a95688cd4c2c01b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:54.358704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fda98afa4e8647c09a95688cd4c2c01b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:54.361165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fda98afa4e8647c09a95688cd4c2c01b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:54.387045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fda98afa4e8647c09a95688cd4c2c01b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:54.391064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fda98afa4e8647c09a95688cd4c2c01b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:54.426043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2904/5838] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:11:54 2022] DELETE /identity/v3/users/fda98afa4e8647c09a95688cd4c2c01b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:54.427377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:54.430903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:54.454026 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2935/5839] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:54.455442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.455661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.455937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.469824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:54.508081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:54.509399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:54.569348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7f4cb-9c73-4c81-81dd-b573a1509bac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:54.632124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:54.632810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.636264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.636732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.637427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:54.639232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:54.669368 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2905/5840] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:54.675425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:54.700884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3d548-8826-4c62-9b10-f12a8d2b4cfd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:54.718553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2936/5841] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:54.723646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:54.724596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.725069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.725530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] PATH_INFO: `/v3/projects/54bc08b275eb47559d81d32febea179c/users/6822d2db414c4f05a7dfdf3d8a6a717d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.731246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:54.732706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:54.773480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54bc08b275eb47559d81d32febea179c, user_id=6822d2db414c4f05a7dfdf3d8a6a717d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:54.779959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:54.809278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2906/5842] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:54 2022] PUT /identity/v3/projects/54bc08b275eb47559d81d32febea179c/users/6822d2db414c4f05a7dfdf3d8a6a717d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:54.816956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:54.949271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6f90-0a55-477a-890d-c7d23e135ed6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:54.955962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:54.956858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:54.957131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:54.957397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:54.958175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:54.960228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:54.967356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a56539-f002-45f7-989d-5677ecf1cfc3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:54.981855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2907/5843] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:54.985180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:54.999332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:55.024613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a33c72-571d-4412-8335-ed087b77ac27 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:55.039219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76c91d-7666-46eb-a5d7-e45836870a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:55.040163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c91d-7666-46eb-a5d7-e45836870a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:55.040448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c91d-7666-46eb-a5d7-e45836870a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:55.041102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76c91d-7666-46eb-a5d7-e45836870a3a admin admin] PATH_INFO: `/v3/projects/54bc08b275eb47559d81d32febea179c/users/6822d2db414c4f05a7dfdf3d8a6a717d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:55.043987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c91d-7666-46eb-a5d7-e45836870a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=54bc08b275eb47559d81d32febea179c, user_id=6822d2db414c4f05a7dfdf3d8a6a717d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:55.046857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b76c91d-7666-46eb-a5d7-e45836870a3a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:55.081036 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2908/5844] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:54 2022] PUT /identity/v3/projects/54bc08b275eb47559d81d32febea179c/users/6822d2db414c4f05a7dfdf3d8a6a717d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:55.102104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:55.104925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:55.106164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:55.156709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:55.157350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:55.157627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:55.157920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:55.166627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] MFA Rules not processed for user `6822d2db414c4f05a7dfdf3d8a6a717d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:55.168982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:55.181521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:55.183668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:55.215876 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2937/5845] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:55.289734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:55.301523 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2909/5846] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:55.364520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:55.366548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:55.406602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef27599-f69e-4943-bdd2-d332f69e6aa6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:55.534754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:55.600277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:55.600925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:55.601213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:55.601484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:55.605066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:55.731036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f7d70-b65c-4cd4-9a66-7a9c8f7843a5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:55.761753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:55.768292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:55.768616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:55.768928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:55.778416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:55.815677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:55.817152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:55.839992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:55.846804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d776815-569c-4a98-b99b-a71ce99974e2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:55.863087 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2910/5847] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:55.876318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2938/5848] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:55 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:56.175526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:56.177404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:56.347853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834ec7-9920-4f62-b59a-5b887aa4fcd1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:56.361647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:56.362512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:56.362867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:56.363198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] PATH_INFO: `/v3/projects/0b27973fbfe04bafae49d7ee85a25c09` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:56.366368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b27973fbfe04bafae49d7ee85a25c09)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:56.368758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:56.448197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b27973fbfe04bafae49d7ee85a25c09', 'request_id': 'req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:56.456724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b27973fbfe04bafae49d7ee85a25c09', 'request_id': 'req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:56.466178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b27973fbfe04bafae49d7ee85a25c09', 'request_id': 'req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:56.485100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] The token cache is being invalidate because project 0b27973fbfe04bafae49d7ee85a25c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:11:56.485658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:56.486529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9fa15816-ce2b-4ca9-8040-930b0ad7d1fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:11:56.489644 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2911/5849] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:11:56 2022] DELETE /identity/v3/projects/0b27973fbfe04bafae49d7ee85a25c09 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:56.494644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:56.495049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:56.495478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:56.524084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:56.525478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:56.641918 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2939/5850] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:56.644367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:56.644944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:56.645501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:56.674995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:56.677542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:56.701236 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2912/5851] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:11:56.702647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:56.719094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56243dc8-571e-4437-ad28-5ebc3d578743 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:56.729682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:56.730363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:56.730639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:56.731228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:56.731687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:11:56.731990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:56.735536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:56.741143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:56.762049 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2940/5852] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:11:56.766266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:56.778551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03880c-d3cf-4cdd-bf4d-bcdc48665a21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:56.789473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:56.790852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:56.791267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:56.791606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:56.792793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:56.794891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:56.848440 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2913/5853] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:11:56 2022] POST /identity/v3/projects => generated 355 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:11:56.852518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:56.874581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f7837-ac87-4e00-8807-9df02b58bc9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:56.981637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:56.982482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:56.986265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:56.986747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:56.987656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:56.989773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:57.021620 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2941/5854] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:11:56 2022] POST /identity/v3/users => generated 278 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:11:57.025792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:57.034757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:57.042736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35782d36-2209-4c3c-bc7a-f0e338060a5b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:57.054853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:57.071920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:57.071920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:57.071920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:57.073618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:57.078582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:57.100372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2914/5855] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:57.103452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:57.115922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d949856-a9cc-4f8c-addd-6f64d5fa5928 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:57.126339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21368bc3-ee24-485a-9381-f4ca534db8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:57.126981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368bc3-ee24-485a-9381-f4ca534db8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:57.127259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368bc3-ee24-485a-9381-f4ca534db8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:57.127532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21368bc3-ee24-485a-9381-f4ca534db8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:57.128184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368bc3-ee24-485a-9381-f4ca534db8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:57.130006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21368bc3-ee24-485a-9381-f4ca534db8f1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:57.152221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2942/5856] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:11:57.154402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:57.167164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f8100-1dfd-402d-8b17-0063f1d11f04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:57.172459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:57.173602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:57.173602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:57.173790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] PATH_INFO: `/v3/projects/b6274033b3c24ed586953d2e5d955c88/users/e6ce6f5da87248398915ddef45d38566/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:57.195578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6274033b3c24ed586953d2e5d955c88, user_id=e6ce6f5da87248398915ddef45d38566, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:57.199958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:57.231926 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2915/5857] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:11:57 2022] PUT /identity/v3/projects/b6274033b3c24ed586953d2e5d955c88/users/e6ce6f5da87248398915ddef45d38566/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:11:57.233513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:57.234040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:57.234531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:57.295510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] MFA Rules not processed for user `e6ce6f5da87248398915ddef45d38566`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:11:57.296998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:57.415552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2943/5858] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:11:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:11:57.439850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:57.441774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:57.552137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd69e05-cbcf-4f92-bf8a-ac6a1e94385a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:57.570481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:57.571136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:57.571423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:57.571704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:57.584704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:57.588577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:57.600781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2916/5859] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:11:58.344536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:11:58.350234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:58.479709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:11:58.508716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e424cca-902f-4c94-8c0d-5c77a3b7a6ed None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:11:58.515336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:11:58.516328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:11:58.516610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:11:58.517050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:11:58.518884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:11:58.684477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:11:58.686894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:11:58.699673 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2944/5860] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:11:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:07.595887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=39,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:08.122645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:08.124268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:08.264842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d0726-0071-4bb4-a550-3fb86811376c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:08.275535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b85e4bdfdd441295f5eb993388b2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ef803c239451bbca0bc18565f9e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:08.276349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:08.276742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:08.277120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:08.278079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:08.278499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:08.285914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:08.321151 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2917/5861] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:12:08.322056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:08.355713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946d14-2a9b-43d9-abd1-94837a75153b service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:08.370964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b85e4bdfdd441295f5eb993388b2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ef803c239451bbca0bc18565f9e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:08.372484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:08.372885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:08.373173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:08.374968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:08.377106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:08.438999 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2945/5862] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:08 2022] POST /identity/v3/projects => generated 348 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:08.442168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:08.459094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42768f35-45ab-4c8b-8dc5-8adcfe28d685 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:08.590180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b85e4bdfdd441295f5eb993388b2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ef803c239451bbca0bc18565f9e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:08.590947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:08.591350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:08.591726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:08.592489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:08.592901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:08.594656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:08.629705 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2918/5863] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:12:10.460982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:10.502322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6985dbd-c331-41e7-ba0e-e1b497b3b87c tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:10.512890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4b85e4bdfdd441295f5eb993388b2b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6ef803c239451bbca0bc18565f9e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:10.514997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:10.515783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:10.516268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] PATH_INFO: `/v3/projects/d749c36d71fc46ba9c40dca59cd9e114` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:10.517678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d749c36d71fc46ba9c40dca59cd9e114)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:10.527868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:10.655028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd749c36d71fc46ba9c40dca59cd9e114', 'request_id': 'req-ad9c3b23-46bc-4925-9278-751c891716fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:10.684600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd749c36d71fc46ba9c40dca59cd9e114', 'request_id': 'req-ad9c3b23-46bc-4925-9278-751c891716fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:10.700449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd749c36d71fc46ba9c40dca59cd9e114', 'request_id': 'req-ad9c3b23-46bc-4925-9278-751c891716fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:10.726381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] The token cache is being invalidate because project d749c36d71fc46ba9c40dca59cd9e114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:10.727220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:10.728125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:10.731219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2946/5864] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:10 2022] DELETE /identity/v3/projects/d749c36d71fc46ba9c40dca59cd9e114 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:10.780774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:10.782746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:10.947049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674f825-eab2-41a1-92ed-e2dfc095caa9 tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:11.031685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:11.045400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:11.047216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:11.047707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:11.048236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:11.052448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:11.165020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:11.167206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:11.203107 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2919/5865] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:12.741591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:12.744060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:12.881253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:12.889432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c3b23-46bc-4925-9278-751c891716fa tempest-RoutersAdminTest-1521618183 tempest-RoutersAdminTest-1521618183-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:12.896861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:12.897771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:12.899204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:12.899454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] PATH_INFO: `/v3/users/f4e793d75b944fc7a139abfa22789a94` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:12.901013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e793d75b944fc7a139abfa22789a94)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:12.903580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:13.033058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e793d75b944fc7a139abfa22789a94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:13.055339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e793d75b944fc7a139abfa22789a94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:13.056173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e793d75b944fc7a139abfa22789a94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:13.077023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e793d75b944fc7a139abfa22789a94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:13.078462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-238fc464-0fbc-4201-b0b6-da7876517b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e793d75b944fc7a139abfa22789a94'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:13.143663 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2947/5866] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:12 2022] DELETE /identity/v3/users/f4e793d75b944fc7a139abfa22789a94 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:14.887084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:14.907756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425044b-c1b2-445a-be62-04b52e6b3e9e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:15.027463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:15.028351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:15.028585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:15.028731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] PATH_INFO: `/v3/projects/a92eaae8be3f450eb401dceb09341400` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:15.029949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a92eaae8be3f450eb401dceb09341400)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:15.033496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:15.155510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a92eaae8be3f450eb401dceb09341400', 'request_id': 'req-122767bc-298c-4ccc-9618-ad0aeb829364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:15.173883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a92eaae8be3f450eb401dceb09341400', 'request_id': 'req-122767bc-298c-4ccc-9618-ad0aeb829364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:15.192293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a92eaae8be3f450eb401dceb09341400', 'request_id': 'req-122767bc-298c-4ccc-9618-ad0aeb829364'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:15.222758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] The token cache is being invalidate because project a92eaae8be3f450eb401dceb09341400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:15.223198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:15.225036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-122767bc-298c-4ccc-9618-ad0aeb829364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:15.229889 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2920/5867] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:14 2022] DELETE /identity/v3/projects/a92eaae8be3f450eb401dceb09341400 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:15.235269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:15.235776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:15.235897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:15.281316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:15.282995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:15.431790 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2948/5868] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:12:15.441281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:15.441281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:15.441281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:15.478434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:15.480317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:15.509418 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2921/5869] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:15.516128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:15.530908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ba612-09b4-4848-ba04-346e1fe181d7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:15.546226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:15.547231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:15.547511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:15.547783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:15.548639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:15.548767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:15.550411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:15.588968 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2949/5870] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:12:15.590793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:15.609360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c875e63-5e7e-4515-81e4-602db3689ba3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:15.618527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:15.619345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:15.619681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:15.620018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:15.620744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:15.627134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:15.688171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:15.701453 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2922/5871] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:15 2022] POST /identity/v3/projects => generated 397 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:15.705701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:15.719199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa9a8-76a0-4d91-91fd-c49dbdfdfe1b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:15.855954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:15.856707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:15.857084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:15.857456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:15.858250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:15.863361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:15.892218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:15.922852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2950/5872] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:15 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:15.926766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:15.984123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad393c0-9eb5-479e-8f18-a0b1e52faa8f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:15.999394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:16.000032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:16.000433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:16.001043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:16.001694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:16.004012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:16.045457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2923/5873] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:12:16.046732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:16.067981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ed4f0-1efb-4523-af05-4d3df924e305 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:16.076233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ed3d4-35fc-4fad-b6f5-66d3dd405f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:16.077162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed3d4-35fc-4fad-b6f5-66d3dd405f5b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:16.077613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed3d4-35fc-4fad-b6f5-66d3dd405f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:16.078127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ed3d4-35fc-4fad-b6f5-66d3dd405f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:16.078781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ed3d4-35fc-4fad-b6f5-66d3dd405f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:16.080419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ed3d4-35fc-4fad-b6f5-66d3dd405f5b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:16.112024 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2951/5874] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:16.116650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:16.132638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f016c-ba25-4849-a353-8c768981f98f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:16.146266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:16.147380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:16.147788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:16.148569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] PATH_INFO: `/v3/projects/015cadf2cdfb4250b719b96a082024ce/users/bb414159a80d48f9bbce14d6f89b5334/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:16.188727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=015cadf2cdfb4250b719b96a082024ce, user_id=bb414159a80d48f9bbce14d6f89b5334, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:16.191892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:16.242654 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2924/5875] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:16 2022] PUT /identity/v3/projects/015cadf2cdfb4250b719b96a082024ce/users/bb414159a80d48f9bbce14d6f89b5334/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:16.247824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:16.248351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:16.248351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:16.301059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:16.302973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:16.444265 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2952/5876] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:16.919387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:16.921253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:16.993405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba3422-345e-4899-af01-214f6d8e79cf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:16.997533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e0ea9-ace7-4440-ad45-c5fe4be5c5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:16.998540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0ea9-ace7-4440-ad45-c5fe4be5c5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:16.999303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0ea9-ace7-4440-ad45-c5fe4be5c5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:16.999643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e0ea9-ace7-4440-ad45-c5fe4be5c5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:17.026917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e0ea9-ace7-4440-ad45-c5fe4be5c5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:17.030699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e0ea9-ace7-4440-ad45-c5fe4be5c5b1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:17.065150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2925/5877] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:18.456562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:18.459361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:18.476696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232375f-c9fb-46a0-9e88-a542ea221883 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:18.484587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:18.485428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:18.485886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:18.486453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] PATH_INFO: `/v3/users/acdcbb0fee2640aaa19330e1d1049a67` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:18.495919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdcbb0fee2640aaa19330e1d1049a67)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:18.499620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:18.593413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdcbb0fee2640aaa19330e1d1049a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:18.605576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdcbb0fee2640aaa19330e1d1049a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:18.606689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdcbb0fee2640aaa19330e1d1049a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:18.632247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdcbb0fee2640aaa19330e1d1049a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:18.633641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdcbb0fee2640aaa19330e1d1049a67'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:18.670168 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2953/5878] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:18 2022] DELETE /identity/v3/users/acdcbb0fee2640aaa19330e1d1049a67 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:18.675018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:18.676051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:18.676480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:18.717492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:18.737164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:18.927865 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2926/5879] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:18.996140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:18.998112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:19.161185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18fd62-0fef-43c9-bb3f-8492fdb2793e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:19.165998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:19.167043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:19.167357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:19.167776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:19.176413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:19.194501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:19.198666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:19.220657 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2954/5880] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:20.641105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:20.642836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:20.671293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cebe8a-4ead-4cdd-a4d2-06272f900f23 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:20.686536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:20.687207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:20.687483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:20.687931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] PATH_INFO: `/v3/projects/6b5417287e7541ada935c241754d0e32` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:20.689326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5417287e7541ada935c241754d0e32)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:20.691508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:20.819842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5417287e7541ada935c241754d0e32', 'request_id': 'req-20061280-4b8f-4f74-9f29-78783677aff2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:20.833578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5417287e7541ada935c241754d0e32', 'request_id': 'req-20061280-4b8f-4f74-9f29-78783677aff2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:20.866423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5417287e7541ada935c241754d0e32', 'request_id': 'req-20061280-4b8f-4f74-9f29-78783677aff2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:20.869021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:20.919331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] The token cache is being invalidate because project 6b5417287e7541ada935c241754d0e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:20.919650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:20.922671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:20.928883 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2927/5881] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:20 2022] DELETE /identity/v3/projects/6b5417287e7541ada935c241754d0e32 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:20.930959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:20.948275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06152587-12cb-496d-b757-74b46529bdf1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:21.071897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:21.072642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:21.072979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:21.073395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] PATH_INFO: `/v3/users/6822d2db414c4f05a7dfdf3d8a6a717d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:21.091170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6822d2db414c4f05a7dfdf3d8a6a717d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:21.107859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:21.192563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6822d2db414c4f05a7dfdf3d8a6a717d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:21.202318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6822d2db414c4f05a7dfdf3d8a6a717d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:21.203252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6822d2db414c4f05a7dfdf3d8a6a717d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:21.211404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6822d2db414c4f05a7dfdf3d8a6a717d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:21.212509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e1a596fc-88d2-4e94-afc9-ba532d366030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6822d2db414c4f05a7dfdf3d8a6a717d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:21.234170 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2955/5882] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:20 2022] DELETE /identity/v3/users/6822d2db414c4f05a7dfdf3d8a6a717d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:22.523164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:22.525367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:22.550715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20061280-4b8f-4f74-9f29-78783677aff2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:22.704482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:22.705278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:22.705623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:22.707020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] PATH_INFO: `/v3/projects/54bc08b275eb47559d81d32febea179c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:22.710653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54bc08b275eb47559d81d32febea179c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:22.712849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:22.831521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54bc08b275eb47559d81d32febea179c', 'request_id': 'req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:22.851282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54bc08b275eb47559d81d32febea179c', 'request_id': 'req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:22.862698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54bc08b275eb47559d81d32febea179c', 'request_id': 'req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:22.907836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] The token cache is being invalidate because project 54bc08b275eb47559d81d32febea179c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:22.908141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:22.912783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c85b4d2b-a352-4d7e-a01b-a2ba5d81d798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:22.920274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2928/5883] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:22 2022] DELETE /identity/v3/projects/54bc08b275eb47559d81d32febea179c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:22.925271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:22.926162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:22.926162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:22.977538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:22.980203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:23.153502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2956/5884] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:23.163304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.164184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.164461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.209117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:23.213899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:23.234952 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2929/5885] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:23.236313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:23.252470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b9e28-b159-47a9-959d-736ff9f718a0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:23.261037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:23.261668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.261986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.265355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.266070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:23.266521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:23.268238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:23.299708 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2957/5886] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:12:23.303550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:23.314431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf86a9-a36a-4af0-93e0-967bd80ac5bf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:23.328582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:23.330695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.330974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.331246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.335127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:23.342498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:23.416473 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2930/5887] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:23 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:23.418151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:23.424286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:23.437453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2bb13d-08cd-477c-8609-c64f718f9882 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:23.578947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:23.579680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.580046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.580385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.581091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:23.583210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:23.650624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2958/5888] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:23 2022] POST /identity/v3/users => generated 283 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:12:23.652011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:23.671067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c7dc0-424d-4b93-8572-0ca6f79f724c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:23.689046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:23.689785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.690239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.690601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.691518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:23.693317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:23.717723 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2931/5889] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:23.723569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:23.739791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b6ae2-0cb3-459b-a4ee-289da774ab5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:23.747764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1cded-f602-45a7-815a-f79e63aeec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:23.749061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1cded-f602-45a7-815a-f79e63aeec21 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.750375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1cded-f602-45a7-815a-f79e63aeec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.751043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1cded-f602-45a7-815a-f79e63aeec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.752208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1cded-f602-45a7-815a-f79e63aeec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:23.754525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1cded-f602-45a7-815a-f79e63aeec21 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:23.792111 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2959/5890] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:23.793683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:23.805572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7072c7-a18a-41f4-8c98-2632c9022e55 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:23.811726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:23.812882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.813384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.814034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] PATH_INFO: `/v3/projects/4ce27d5a591b45ab9ab963f57f3d2e1a/users/8724882c4c6141708c2d4958c9e27aa2/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.870293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce27d5a591b45ab9ab963f57f3d2e1a, user_id=8724882c4c6141708c2d4958c9e27aa2, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:23.876689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:23.915816 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2932/5891] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:23 2022] PUT /identity/v3/projects/4ce27d5a591b45ab9ab963f57f3d2e1a/users/8724882c4c6141708c2d4958c9e27aa2/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:23.927401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:23.928189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:23.928610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:23.968355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] MFA Rules not processed for user `8724882c4c6141708c2d4958c9e27aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:23.970476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:24.084227 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2960/5892] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:24.085621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:24.110780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:24.178295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa81f-5c63-4cdd-85fa-30fb40ae786a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:24.189781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:24.190908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.191306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.191713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.192459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:24.194772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:24.250116 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2933/5893] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:24 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:12:24.254334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:24.287769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb37db8-bb4f-4bf8-b6f3-a29b255f99a8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:24.395150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:24.396078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.396390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.397412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.399389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:24.402498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:24.440767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:24.474001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2961/5894] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:24 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:12:24.476686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:24.494356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040eabe3-5f02-4903-942f-97d69426f9ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:24.514633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:24.515274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.515744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.516020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.516670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:24.518712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:24.534976 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2934/5895] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:12:24.540246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:24.573412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e961bc5-ead8-4e9a-879f-1812f64f7de3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:24.578491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:24.579405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.579878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.580402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] PATH_INFO: `/v3/projects/f0f21477eb0a4ba18656978db3259780/users/612afed976f54212bc3dac33a267f167/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.609025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f21477eb0a4ba18656978db3259780, user_id=612afed976f54212bc3dac33a267f167, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:24.614622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:24.643685 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2962/5896] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:24 2022] PUT /identity/v3/projects/f0f21477eb0a4ba18656978db3259780/users/612afed976f54212bc3dac33a267f167/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:24.647591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:24.663685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04f803-4033-4c37-8c43-455234c56ad5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:24.750857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849b49b-335c-40bf-bb99-af0e8690ba75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:24.752151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b49b-335c-40bf-bb99-af0e8690ba75 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.752577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b49b-335c-40bf-bb99-af0e8690ba75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.752991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b49b-335c-40bf-bb99-af0e8690ba75 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.754132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849b49b-335c-40bf-bb99-af0e8690ba75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:24.756142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849b49b-335c-40bf-bb99-af0e8690ba75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:24.772360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2935/5897] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:24.773099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:24.785313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bfe80-ad46-415b-8e19-af338436b180 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:24.790905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:24.792193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.792801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.793431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] PATH_INFO: `/v3/projects/f0f21477eb0a4ba18656978db3259780/users/612afed976f54212bc3dac33a267f167/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.796306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f21477eb0a4ba18656978db3259780, user_id=612afed976f54212bc3dac33a267f167, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:24.799436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:24.843387 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2963/5898] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:24 2022] PUT /identity/v3/projects/f0f21477eb0a4ba18656978db3259780/users/612afed976f54212bc3dac33a267f167/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:12:24.845672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:24.846092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:24.846454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:24.901198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] MFA Rules not processed for user `612afed976f54212bc3dac33a267f167`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:24.906240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:25.124088 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2936/5899] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:12:25.152565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:25.154386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:25.377050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c15efc-e286-4b74-8a2d-798402c1c919 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:25.392223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:25.393014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:25.393423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:25.393863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:25.421325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:25.422944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:25.444136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2964/5900] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:26.181308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:26.183923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:26.219352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:26.348217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8751e0e-2220-4170-8d44-a3bba1476b61 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:26.360650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:26.361522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:26.362456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:26.362692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:26.364711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:26.410252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:26.412203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c476-782d-4337-89a8-a3db35709144 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:26.451277 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2937/5901] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:30.691864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:30.709207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e21513-bfba-4433-b26b-2d9af017c736 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:30.716866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1aeb9f-ce9a-482f-9417-c17958d7c265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:30.717476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aeb9f-ce9a-482f-9417-c17958d7c265 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:30.717964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aeb9f-ce9a-482f-9417-c17958d7c265 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:30.718387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1aeb9f-ce9a-482f-9417-c17958d7c265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:30.831451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aeb9f-ce9a-482f-9417-c17958d7c265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:30.833531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1aeb9f-ce9a-482f-9417-c17958d7c265 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:30.857700 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2965/5902] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:31.024204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:31.024606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:31.024755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:31.109252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] MFA Rules not processed for user `bb414159a80d48f9bbce14d6f89b5334`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:31.110484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:31.267077 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2938/5903] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:31.278798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:31.279183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:31.279464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:31.317163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] MFA Rules not processed for user `bb414159a80d48f9bbce14d6f89b5334`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:31.318755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:31.352926 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2966/5904] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:31.365500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:31.367988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:31.418127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2326be3-3ea8-44f0-a7b7-93582aa4d32b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:31.435280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094d92-ddcc-4527-978e-4332ff0c3e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:31.436062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094d92-ddcc-4527-978e-4332ff0c3e77 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:31.436307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094d92-ddcc-4527-978e-4332ff0c3e77 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:31.441477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094d92-ddcc-4527-978e-4332ff0c3e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:31.454333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e094d92-ddcc-4527-978e-4332ff0c3e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:31.456297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e094d92-ddcc-4527-978e-4332ff0c3e77 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:31.491000 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2939/5905] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:33.172637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:33.319980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:33.325489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f71bf-9718-40bd-86dc-39e9e3116a86 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:33.331790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:33.332903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:33.333629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:33.334174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] PATH_INFO: `/v3/users/8724882c4c6141708c2d4958c9e27aa2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:33.336221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8724882c4c6141708c2d4958c9e27aa2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:33.338527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:33.429774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8724882c4c6141708c2d4958c9e27aa2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:33.441936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8724882c4c6141708c2d4958c9e27aa2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:33.444047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8724882c4c6141708c2d4958c9e27aa2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:33.470868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8724882c4c6141708c2d4958c9e27aa2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:33.472099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8724882c4c6141708c2d4958c9e27aa2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:33.534833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2967/5906] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:33 2022] DELETE /identity/v3/users/8724882c4c6141708c2d4958c9e27aa2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:33.539881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:33.540424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:33.540424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:33.643986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:33.649953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:33.836582 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2940/5907] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:33.894096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:33.896270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:34.044110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf42cf5-3088-40de-8894-606d15e8254f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:34.050533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:34.051207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:34.051501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:34.051746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:34.091695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:34.094912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:34.146790 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2968/5908] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:36.965837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:36.970493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:36.993868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12576c-5afe-4a83-95e7-3fb2b8d80695 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:37.016082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:37.017083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:37.017740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:37.018201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] PATH_INFO: `/v3/projects/4ce27d5a591b45ab9ab963f57f3d2e1a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:37.020540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce27d5a591b45ab9ab963f57f3d2e1a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:37.022928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:37.051733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:37.135306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce27d5a591b45ab9ab963f57f3d2e1a', 'request_id': 'req-c2a59881-a55d-4655-885d-b466407e06cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.149095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce27d5a591b45ab9ab963f57f3d2e1a', 'request_id': 'req-c2a59881-a55d-4655-885d-b466407e06cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.164100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce27d5a591b45ab9ab963f57f3d2e1a', 'request_id': 'req-c2a59881-a55d-4655-885d-b466407e06cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.182130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] The token cache is being invalidate because project 4ce27d5a591b45ab9ab963f57f3d2e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:37.182586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.183346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2a59881-a55d-4655-885d-b466407e06cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.190025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:37.193254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2941/5909] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:36 2022] DELETE /identity/v3/projects/4ce27d5a591b45ab9ab963f57f3d2e1a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:37.208103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b1f65-4c7b-4d41-b675-a45b1b0abff1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:37.376566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:37.378449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:37.379077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:37.379507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] PATH_INFO: `/v3/users/612afed976f54212bc3dac33a267f167` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:37.381451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] RBAC: Authorizing `identity:delete_user(user_id=612afed976f54212bc3dac33a267f167)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:37.387514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:37.425642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:37.473343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '612afed976f54212bc3dac33a267f167'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.500798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '612afed976f54212bc3dac33a267f167'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.501877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '612afed976f54212bc3dac33a267f167'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.524665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '612afed976f54212bc3dac33a267f167'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.525563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '612afed976f54212bc3dac33a267f167'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:37.562204 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2969/5910] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:37 2022] DELETE /identity/v3/users/612afed976f54212bc3dac33a267f167 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:12:38.437645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed706-2902-42fc-bae8-38acc4bc291d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:38.438244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed706-2902-42fc-bae8-38acc4bc291d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:38.438244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceed706-2902-42fc-bae8-38acc4bc291d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:38.476598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9ceed706-2902-42fc-bae8-38acc4bc291d None None] MFA Rules not processed for user `4aab5eb9a3764e75863bf930c2bbd8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:38.480055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ceed706-2902-42fc-bae8-38acc4bc291d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:38.646280 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2942/5911] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:39.314453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:39.316325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:39.448345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ec3d5-fe86-44e4-8310-a89cf751839b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:39.458010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:39.462601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:39.462818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:39.463015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] PATH_INFO: `/v3/projects/f0f21477eb0a4ba18656978db3259780` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:39.465628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f21477eb0a4ba18656978db3259780)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:39.471088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:39.602625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f21477eb0a4ba18656978db3259780', 'request_id': 'req-32eaa142-96aa-4570-a146-6a7f7215b47e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:39.620072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f21477eb0a4ba18656978db3259780', 'request_id': 'req-32eaa142-96aa-4570-a146-6a7f7215b47e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:39.641969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f21477eb0a4ba18656978db3259780', 'request_id': 'req-32eaa142-96aa-4570-a146-6a7f7215b47e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:39.673595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] The token cache is being invalidate because project f0f21477eb0a4ba18656978db3259780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:39.674191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:39.675022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32eaa142-96aa-4570-a146-6a7f7215b47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:39.680472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2970/5912] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:39 2022] DELETE /identity/v3/projects/f0f21477eb0a4ba18656978db3259780 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:39.681999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:39.682885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:39.683301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:39.724853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:39.726596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:39.839818 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2943/5913] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:39.847480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:39.847762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:39.848041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:39.883447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:39.885445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:39.901113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:39.901335 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2971/5914] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:39.918429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4498b0a-1848-4fd6-8037-7da0ee5ca559 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:39.932291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:39.934326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:39.934657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:39.935013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:39.936767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:39.937224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:39.946995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:39.970192 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2944/5915] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:12:39.974819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:39.989580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83604e-4fe1-4d4f-8e28-517725efff93 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:40.003070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:40.003882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.004163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.004605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.005253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:40.007438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:40.066624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:40.078471 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2972/5916] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:39 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:40.082698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:40.096957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b3298-c8dd-4dcc-87d3-03ab65cf3359 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:40.148796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:40.258465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:40.259094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.259370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.259646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.260282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:40.266353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:40.314377 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2945/5917] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:40 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:40.319012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:40.332566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa0185-7280-46e6-8c3b-2b1589868bee admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:40.345384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:40.346037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.346315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.346705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.348095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:40.349750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:40.362316 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2973/5918] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:40.366904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:40.387391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d279-6646-4e20-892a-cc06ff1bdeb7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:40.398345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f29d5-2d40-400e-bba0-5481730fb582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:40.400062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f29d5-2d40-400e-bba0-5481730fb582 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.400663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f29d5-2d40-400e-bba0-5481730fb582 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.401943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f29d5-2d40-400e-bba0-5481730fb582 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.402916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f29d5-2d40-400e-bba0-5481730fb582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:40.404875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f29d5-2d40-400e-bba0-5481730fb582 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:40.420522 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2946/5919] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:40.424692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:40.435746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d723c2e-18fc-44fc-8c72-bb0b06c6ba3f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:40.442032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:40.443029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.443543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.444018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] PATH_INFO: `/v3/projects/fe1f640de9b242b3a5a958b5905a02bd/users/e687517a36234f6e9da65ba9796ef24e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.461760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1f640de9b242b3a5a958b5905a02bd, user_id=e687517a36234f6e9da65ba9796ef24e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:40.464897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:40.510874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.511083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.511325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.511643 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2974/5920] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:40 2022] PUT /identity/v3/projects/fe1f640de9b242b3a5a958b5905a02bd/users/e687517a36234f6e9da65ba9796ef24e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:40.567533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] MFA Rules not processed for user `e687517a36234f6e9da65ba9796ef24e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:40.568777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:40.745684 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2947/5921] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:12:40.746658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:40.925755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d7ed91-477a-4d6e-858d-74242fa279f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:40.942658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:40.945109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:40.945440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:40.945739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:40.946630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:40.949199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:41.021039 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2975/5922] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:40 2022] POST /identity/v3/projects => generated 393 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:41.025042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:41.039707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81808a50-8c3b-4dd8-98c2-246246026dc1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:41.239354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:41.247117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:41.248559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:41.249432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:41.250732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:41.263843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:41.331996 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2948/5923] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:41 2022] POST /identity/v3/users => generated 303 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:41.332733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:41.372171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33178-bea2-418f-b0f5-d76296975e49 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:41.405562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:41.407590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:41.407873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:41.408148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:41.408801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:41.421310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:41.455470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:41.471317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7423a2-141b-4620-a530-945e392253a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:41.481613 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2976/5924] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:12:41.515125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:41.516883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:41.517353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:41.517829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] PATH_INFO: `/v3/projects/9c5089ee5f6141048f905ddc96b57aa6/users/f29bed9a71eb49a7a9534440e103a538/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:41.574692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5089ee5f6141048f905ddc96b57aa6, user_id=f29bed9a71eb49a7a9534440e103a538, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:41.584169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:41.600334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:41.644562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:41.646136 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2949/5925] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:41 2022] PUT /identity/v3/projects/9c5089ee5f6141048f905ddc96b57aa6/users/f29bed9a71eb49a7a9534440e103a538/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:41.660249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f190-96a6-4470-bda1-e2fac8853a66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:41.789161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136b7b7-cb22-4fde-b5b5-f53ff1ed4b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:41.789938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b7b7-cb22-4fde-b5b5-f53ff1ed4b44 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:41.790439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b7b7-cb22-4fde-b5b5-f53ff1ed4b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:41.790892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136b7b7-cb22-4fde-b5b5-f53ff1ed4b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:41.791710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b7b7-cb22-4fde-b5b5-f53ff1ed4b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:41.793540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136b7b7-cb22-4fde-b5b5-f53ff1ed4b44 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:41.826198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:41.832892 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2977/5926] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:41.841213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba019ac-372b-4db6-88fc-c90167e84808 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:41.856823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:41.857882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:41.858925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:41.859546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] PATH_INFO: `/v3/projects/9c5089ee5f6141048f905ddc96b57aa6/users/f29bed9a71eb49a7a9534440e103a538/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:41.863396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5089ee5f6141048f905ddc96b57aa6, user_id=f29bed9a71eb49a7a9534440e103a538, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:41.868924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:41.897424 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2950/5927] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:41 2022] PUT /identity/v3/projects/9c5089ee5f6141048f905ddc96b57aa6/users/f29bed9a71eb49a7a9534440e103a538/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:41.909356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:41.910922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:41.911365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:41.960818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] MFA Rules not processed for user `f29bed9a71eb49a7a9534440e103a538`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:41.962367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:42.019607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:42.175231 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2978/5928] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:42.328843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:42.331148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:42.577518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccabef-3ee9-4f6c-ac1a-bc2356ed47aa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:42.595912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:42.597949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:42.598471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:42.598944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:42.618311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:42.620051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:42.633566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2951/5929] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:42 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:44.106309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:44.107813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:44.273435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b590a7c-4337-40be-92ba-87b9c9186ff5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:44.281093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:44.281982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:44.282516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:44.282875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:44.284963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:44.331797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:44.336327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:44.363661 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2979/5930] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:44.432658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:44.434397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:44.602882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61193d79-f31e-4df6-8048-a51e63eea502 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:44.608423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:44.609278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:44.609567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:44.609870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] PATH_INFO: `/v3/users/cc26b3ebcdfe4bea81cab484f092b401` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:44.611279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc26b3ebcdfe4bea81cab484f092b401)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:44.614234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:44.711207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc26b3ebcdfe4bea81cab484f092b401'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:44.734890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc26b3ebcdfe4bea81cab484f092b401'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:44.735987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc26b3ebcdfe4bea81cab484f092b401'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:44.755607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc26b3ebcdfe4bea81cab484f092b401'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:44.756419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fa84ded3-8251-4b27-a1eb-e9395a05339f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc26b3ebcdfe4bea81cab484f092b401'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:44.791421 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2952/5931] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:44 2022] DELETE /identity/v3/users/cc26b3ebcdfe4bea81cab484f092b401 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:45.822505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:45.836308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149c2bc-ba3c-4966-834e-7ce280ddc70a service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:45.915717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:45.915717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:45.916055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:45.916055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] PATH_INFO: `/v3/projects/393e2b2202cb46e8b1603038f079b9aa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:45.917583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=393e2b2202cb46e8b1603038f079b9aa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:45.919748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.016146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393e2b2202cb46e8b1603038f079b9aa', 'request_id': 'req-f2683025-83c9-4a33-9650-edb400ab64b6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:46.018081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:46.029290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393e2b2202cb46e8b1603038f079b9aa', 'request_id': 'req-f2683025-83c9-4a33-9650-edb400ab64b6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:46.037125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393e2b2202cb46e8b1603038f079b9aa', 'request_id': 'req-f2683025-83c9-4a33-9650-edb400ab64b6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:46.056765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] The token cache is being invalidate because project 393e2b2202cb46e8b1603038f079b9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:46.057062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:46.058122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f2683025-83c9-4a33-9650-edb400ab64b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:46.064970 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2980/5932] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:45 2022] DELETE /identity/v3/projects/393e2b2202cb46e8b1603038f079b9aa => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:46.066760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.067561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.067983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.079091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:46.094044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:46.095307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:46.242659 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2953/5933] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:46.243396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.243684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.243966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.282547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:46.283899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:46.303251 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2981/5934] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:12:46.309592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:46.322236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d99e6-1ac2-4a39-9e26-9a512295c387 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:46.328172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:46.328734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.329012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.330251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.330368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:46.330647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:46.333589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.353682 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2954/5935] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:12:46.354721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:46.372733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfa506-7a34-4170-8655-0beb01740b14 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:46.379293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:46.379293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.379699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.379771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.380391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:46.382387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.432096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:46.449197 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2982/5936] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:46 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:46.451919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9041a7-f5d1-4858-b44b-f43724a58c73 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:46.538661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:46.539671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.540125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.540688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.541542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:46.572977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.616254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2955/5937] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:46 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:46.619781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:46.633746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2a434-f3c8-43b9-aa60-f36bc64d07b7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:46.639850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:46.641204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.641204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.641379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.642074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:46.645657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.666508 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2983/5938] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:46.671179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:46.687124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982897-d76b-4c17-a0d8-01a279d2d67a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:46.696018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70edbf-61c1-4a8c-9703-1360e872c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:46.696747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70edbf-61c1-4a8c-9703-1360e872c89b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.697075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70edbf-61c1-4a8c-9703-1360e872c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.697384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70edbf-61c1-4a8c-9703-1360e872c89b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.698073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70edbf-61c1-4a8c-9703-1360e872c89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:46.707626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70edbf-61c1-4a8c-9703-1360e872c89b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.751401 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2956/5939] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:12:46.756085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:46.769421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dada1-e9f7-42e4-9844-82253c3427e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:46.775158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c3546-a4dd-4868-be4e-3fed60769fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:46.777149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c3546-a4dd-4868-be4e-3fed60769fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.777618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c3546-a4dd-4868-be4e-3fed60769fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.778005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c3546-a4dd-4868-be4e-3fed60769fc0 admin admin] PATH_INFO: `/v3/projects/aa0cc560e4e64377bfa3239d8e6d1570/users/b44e66d6ec5548789906a0f9e2f9f097/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.796859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c3546-a4dd-4868-be4e-3fed60769fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0cc560e4e64377bfa3239d8e6d1570, user_id=b44e66d6ec5548789906a0f9e2f9f097, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:46.800547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c3546-a4dd-4868-be4e-3fed60769fc0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:46.827774 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2984/5940] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:46 2022] PUT /identity/v3/projects/aa0cc560e4e64377bfa3239d8e6d1570/users/b44e66d6ec5548789906a0f9e2f9f097/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:46.838625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.839194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.839644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.878528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] MFA Rules not processed for user `b44e66d6ec5548789906a0f9e2f9f097`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:46.879985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:46.952025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:46.968643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:46.968969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:46.969203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:46.974068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2957/5941] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:46.997917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] MFA Rules not processed for user `b44e66d6ec5548789906a0f9e2f9f097`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:46.999970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:47.014857 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2985/5942] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:47.020104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:47.022433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:47.113224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313803-b4b1-4bda-879b-ca4df220cda5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:47.122840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497c25-e56f-45c8-ba55-6dd7e3701224 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:47.123581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497c25-e56f-45c8-ba55-6dd7e3701224 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:47.123921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497c25-e56f-45c8-ba55-6dd7e3701224 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:47.124254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497c25-e56f-45c8-ba55-6dd7e3701224 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:47.133528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497c25-e56f-45c8-ba55-6dd7e3701224 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:47.135240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497c25-e56f-45c8-ba55-6dd7e3701224 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:47.151901 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2958/5943] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:52.525552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:52.527048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:52.629312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca0299-002f-4856-b676-3f4a03f63406 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:52.634416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:52.635173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:52.635518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:52.635865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] PATH_INFO: `/v3/users/e687517a36234f6e9da65ba9796ef24e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:52.637187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e687517a36234f6e9da65ba9796ef24e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:52.639315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:52.696138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e687517a36234f6e9da65ba9796ef24e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:52.707372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e687517a36234f6e9da65ba9796ef24e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:52.708073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e687517a36234f6e9da65ba9796ef24e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:52.718275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e687517a36234f6e9da65ba9796ef24e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:52.719729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e687517a36234f6e9da65ba9796ef24e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:52.730347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:52.749893 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2986/5944] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:52 2022] DELETE /identity/v3/users/e687517a36234f6e9da65ba9796ef24e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:52.761742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:52.762318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:52.762318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:52.801735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:52.803080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:52.879840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2959/5945] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:52.912891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:52.914421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:53.037417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc2a45-d6ef-4142-8875-ad98d3b35ee9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:53.043184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:53.044049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:53.045636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:53.046179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:53.059208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:53.061186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:53.073866 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2987/5946] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:54.534548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:54.535811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:54.559480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6985468-e8d4-4359-84fb-30502d3d731d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:54.564499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:54.565377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:54.565897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:54.566310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] PATH_INFO: `/v3/projects/fe1f640de9b242b3a5a958b5905a02bd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:54.568782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1f640de9b242b3a5a958b5905a02bd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:54.572396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:54.641224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1f640de9b242b3a5a958b5905a02bd', 'request_id': 'req-36b6ae79-fc82-4148-9098-48b03ca0f466'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.652182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1f640de9b242b3a5a958b5905a02bd', 'request_id': 'req-36b6ae79-fc82-4148-9098-48b03ca0f466'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.661028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1f640de9b242b3a5a958b5905a02bd', 'request_id': 'req-36b6ae79-fc82-4148-9098-48b03ca0f466'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.680434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] The token cache is being invalidate because project fe1f640de9b242b3a5a958b5905a02bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:54.681099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.682761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.689308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2960/5947] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:54 2022] DELETE /identity/v3/projects/fe1f640de9b242b3a5a958b5905a02bd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:54.690271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:54.705468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45180a20-c23d-4e86-bdc1-f2f39cef280d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:54.797080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:54.797998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:54.798376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:54.798945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] PATH_INFO: `/v3/users/f29bed9a71eb49a7a9534440e103a538` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:54.800729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f29bed9a71eb49a7a9534440e103a538)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:54.802861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:54.879391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f29bed9a71eb49a7a9534440e103a538'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.891356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f29bed9a71eb49a7a9534440e103a538'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.892120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f29bed9a71eb49a7a9534440e103a538'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.901220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f29bed9a71eb49a7a9534440e103a538'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.902864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e5ccab38-96b5-41d3-9226-0bcb244a6482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f29bed9a71eb49a7a9534440e103a538'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:54.927896 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2988/5948] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:54 2022] DELETE /identity/v3/users/f29bed9a71eb49a7a9534440e103a538 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:12:55.349830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:55.354423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:55.370303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ae79-fc82-4148-9098-48b03ca0f466 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:55.376326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:55.461318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:55.463105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:55.463671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:55.464127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] PATH_INFO: `/v3/projects/9c5089ee5f6141048f905ddc96b57aa6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:55.465539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5089ee5f6141048f905ddc96b57aa6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:55.469259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:55.558079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5089ee5f6141048f905ddc96b57aa6', 'request_id': 'req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:55.577009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5089ee5f6141048f905ddc96b57aa6', 'request_id': 'req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:55.597911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5089ee5f6141048f905ddc96b57aa6', 'request_id': 'req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:55.624048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] The token cache is being invalidate because project 9c5089ee5f6141048f905ddc96b57aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:12:55.624550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:55.625419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-be7312f9-7f4b-4c16-b8e7-29c0e0d820b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:55.627512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2961/5949] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:55 2022] DELETE /identity/v3/projects/9c5089ee5f6141048f905ddc96b57aa6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:55.632646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:55.633270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:55.633764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:55.658928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:55.661144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:55.669216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:55.748861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:55.749163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:55.749600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:55.753544 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2989/5950] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:55.773859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:55.775410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:55.784040 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2962/5951] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:12:55.789078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:55.800334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16b039-a4e5-47d4-a7db-8682d6b959ad None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:55.806943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:55.807736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:55.808246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:55.808666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:55.809540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:12:55.810045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:55.811928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:55.834257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:55.843757 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2990/5952] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:12:55.846385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35059c-8bff-44df-acbb-1620e49576f5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:55.851471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:55.852359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:55.852845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:55.853469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:55.854385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:55.856522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:55.917645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:55.932272 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2963/5953] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:12:55 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:55.943583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f42ab-5611-4527-8f5a-e7a7da372dc3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:56.078674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:56.081025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:56.081589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:56.082874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:56.085473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:56.090274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:56.154829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:56.166140 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2991/5954] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:12:55 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:12:56.169414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce463533-b214-4735-9d25-07201d0a6bd6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:56.175429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:56.176341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:56.176771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:56.177245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:56.178437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:56.180231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:56.201073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:56.201780 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2964/5955] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:56.216754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4f210-6a64-405b-942e-6dd32463e36a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:56.231860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3dbdbb-4220-469b-b134-ca21975d8c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:56.232973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dbdbb-4220-469b-b134-ca21975d8c67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:56.232973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dbdbb-4220-469b-b134-ca21975d8c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:56.233170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3dbdbb-4220-469b-b134-ca21975d8c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:56.233657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dbdbb-4220-469b-b134-ca21975d8c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:56.235322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3dbdbb-4220-469b-b134-ca21975d8c67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:56.261576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2992/5956] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:12:56.263937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:56.280992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a2a20-070c-4720-8237-5dfaa9d78063 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:56.307212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:56.308019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:56.308988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:56.309414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] PATH_INFO: `/v3/projects/5d532fc66d254c5ca5c50190adbf366d/users/0d772fa0409649afb1f02eeed1b0ac66/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:56.360308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d532fc66d254c5ca5c50190adbf366d, user_id=0d772fa0409649afb1f02eeed1b0ac66, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:56.363687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:56.392286 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2965/5957] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:12:56 2022] PUT /identity/v3/projects/5d532fc66d254c5ca5c50190adbf366d/users/0d772fa0409649afb1f02eeed1b0ac66/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:56.408168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:56.408718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:56.408959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:56.487393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] MFA Rules not processed for user `0d772fa0409649afb1f02eeed1b0ac66`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:56.490852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:56.624467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2993/5958] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:56.652769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:56.657137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:56.735506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:56.782659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268d808-a1ca-4c81-ac19-c9049ca1c6ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:56.800361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23762c3d-8aa5-47dd-9de8-6aba020a6f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:56.801019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762c3d-8aa5-47dd-9de8-6aba020a6f0a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:56.801302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762c3d-8aa5-47dd-9de8-6aba020a6f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:56.802254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23762c3d-8aa5-47dd-9de8-6aba020a6f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:56.825974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762c3d-8aa5-47dd-9de8-6aba020a6f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:56.827588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23762c3d-8aa5-47dd-9de8-6aba020a6f0a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:56.843913 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2966/5959] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:58.575599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:58.577155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:58.586952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:12:58.649626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d1783f-67bf-4f01-aab0-86e85f08ebdb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:58.654328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:58.655000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:58.655276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:58.655551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] PATH_INFO: `/v3/users/e3a8404ef81d4bc19428fa21aab47dfa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:58.656699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a8404ef81d4bc19428fa21aab47dfa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:58.658661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:58.709747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a8404ef81d4bc19428fa21aab47dfa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:58.718286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a8404ef81d4bc19428fa21aab47dfa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:58.718961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a8404ef81d4bc19428fa21aab47dfa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:58.727706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a8404ef81d4bc19428fa21aab47dfa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:58.728267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a8404ef81d4bc19428fa21aab47dfa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:12:58.749829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2994/5960] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:12:58 2022] DELETE /identity/v3/users/e3a8404ef81d4bc19428fa21aab47dfa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:12:58.755412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:58.755937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:58.755937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:58.777951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:12:58.779015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:58.852964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2967/5961] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:12:58.870787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:58.872262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:58.983947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882c61-bce2-4761-8baa-52fd6fbe2b75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:58.989436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8a2b5-2c34-448d-af68-8d0f7c8c9e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:58.990232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8a2b5-2c34-448d-af68-8d0f7c8c9e18 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:58.990604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8a2b5-2c34-448d-af68-8d0f7c8c9e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:58.990971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8a2b5-2c34-448d-af68-8d0f7c8c9e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:59.001820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8a2b5-2c34-448d-af68-8d0f7c8c9e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:59.003394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8a2b5-2c34-448d-af68-8d0f7c8c9e18 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:12:59.020743 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2995/5962] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:12:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:12:59.869191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:12:59.870645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:12:59.911243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbbb5b-626d-42b9-9d2c-5884029182c2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:12:59.919468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:12:59.921213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:12:59.921792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:12:59.923219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] PATH_INFO: `/v3/projects/517f9d77809a436fb673cc9d70342053` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:12:59.944683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517f9d77809a436fb673cc9d70342053)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:12:59.958291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:00.100853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517f9d77809a436fb673cc9d70342053', 'request_id': 'req-d824031d-95fe-4685-975c-c34b92b16121'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:00.110446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517f9d77809a436fb673cc9d70342053', 'request_id': 'req-d824031d-95fe-4685-975c-c34b92b16121'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:00.125209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517f9d77809a436fb673cc9d70342053', 'request_id': 'req-d824031d-95fe-4685-975c-c34b92b16121'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:00.151602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] The token cache is being invalidate because project 517f9d77809a436fb673cc9d70342053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:00.152208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:00.162758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d824031d-95fe-4685-975c-c34b92b16121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:00.171318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.171851 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2968/5963] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:12:59 2022] DELETE /identity/v3/projects/517f9d77809a436fb673cc9d70342053 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:00.172274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.172757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.234989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:00.238092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:00.286349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:00.377413 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2996/5964] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:00.382581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.383041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.383534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.428564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:00.431170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:00.453424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:00.458276 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2969/5965] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:00.470780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a180aa2-dc6c-444c-b664-a59310c5f50f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:00.487661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:00.488739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.489089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.489546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.490342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:00.490726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:00.497316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:00.512421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2997/5966] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:13:00.516948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:00.531617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d77cb-dd49-4148-b20b-073072f888ba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:00.547949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:00.548171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.548358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.548630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.550279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:00.551379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:00.599638 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2970/5967] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:00 2022] POST /identity/v3/projects => generated 361 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:00.600582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:00.611748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43a9c-7c42-48f5-8238-aecde3438795 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:00.764921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:00.774428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.782070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.782070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.782923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:00.784811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:00.836791 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2998/5968] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:00 2022] POST /identity/v3/users => generated 281 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:13:00.841091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:00.871502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca44413b-8be2-4f87-8073-ff0bea35a0fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:00.884784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:00.885722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.886164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.887473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.888168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:00.891629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:00.911720 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2971/5969] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:00.914851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:00.928831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657ee2-d188-434a-a697-3a7a0fc46fdc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:00.939941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db77e34-fdc0-454b-8786-6d57e3d5c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:00.940492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77e34-fdc0-454b-8786-6d57e3d5c2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:00.940783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77e34-fdc0-454b-8786-6d57e3d5c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:00.941051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db77e34-fdc0-454b-8786-6d57e3d5c2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:00.941796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77e34-fdc0-454b-8786-6d57e3d5c2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:00.948212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db77e34-fdc0-454b-8786-6d57e3d5c2a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:00.976282 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 2999/5970] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:00.980444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:00.999160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639e05f-4535-415a-a8e8-7837ecdb47eb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:01.007330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:01.009270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:01.009710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:01.017304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] PATH_INFO: `/v3/projects/87124c1540f441c1b95acca6ef6216cf/users/1245d0e72fcd42f0a0c02fdccd517cc5/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:01.052219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87124c1540f441c1b95acca6ef6216cf, user_id=1245d0e72fcd42f0a0c02fdccd517cc5, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:01.055530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:01.068367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:01.081451 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2972/5971] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:00 2022] PUT /identity/v3/projects/87124c1540f441c1b95acca6ef6216cf/users/1245d0e72fcd42f0a0c02fdccd517cc5/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:01.093064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:01.093443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:01.093843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:01.134617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] MFA Rules not processed for user `1245d0e72fcd42f0a0c02fdccd517cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:01.136038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:01.260079 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3000/5972] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:01.288916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:01.295353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:01.402035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cc706-18e4-4585-8ffe-314aa44eb125 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:01.410530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:01.411342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:01.411733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:01.412115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:01.435808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:01.437679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:01.463921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2973/5973] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:09.252613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:09.254484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:09.301561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:09.345828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62f612-7206-4b63-99d3-52e3922aeb9c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:09.351003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:09.351754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:09.352122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:09.352574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] PATH_INFO: `/v3/users/bb414159a80d48f9bbce14d6f89b5334` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:09.353829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb414159a80d48f9bbce14d6f89b5334)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:09.355997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:09.410021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb414159a80d48f9bbce14d6f89b5334'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.419337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb414159a80d48f9bbce14d6f89b5334'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.420011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb414159a80d48f9bbce14d6f89b5334'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.429353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb414159a80d48f9bbce14d6f89b5334'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.430282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0c6fff7c-503e-465c-b531-38f3f6ef2064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb414159a80d48f9bbce14d6f89b5334'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.450043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3001/5974] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:09 2022] DELETE /identity/v3/users/bb414159a80d48f9bbce14d6f89b5334 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:09.730908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:09.744872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3007f-5fd4-4111-95b7-efc36ef29889 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:09.835485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:09.836333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:09.836787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:09.837284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] PATH_INFO: `/v3/projects/015cadf2cdfb4250b719b96a082024ce` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:09.838639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] RBAC: Authorizing `identity:delete_project(project_id=015cadf2cdfb4250b719b96a082024ce)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:09.844742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:09.924839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015cadf2cdfb4250b719b96a082024ce', 'request_id': 'req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.935729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015cadf2cdfb4250b719b96a082024ce', 'request_id': 'req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.945360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015cadf2cdfb4250b719b96a082024ce', 'request_id': 'req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.969190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] The token cache is being invalidate because project 015cadf2cdfb4250b719b96a082024ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:09.969531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.970228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f5b8f60-1fcc-42ca-881f-c7429c05d49a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:09.972793 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2974/5975] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:09 2022] DELETE /identity/v3/projects/015cadf2cdfb4250b719b96a082024ce => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:09.978741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:09.978741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:09.978741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.004635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:10.016595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:10.122502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3002/5976] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:10.130355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.131055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.131588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.167016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:10.168259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:10.183628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.185954 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2975/5977] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:10.205155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b1fa-d549-485d-8c8d-0947e861db07 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.214927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.215564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.215840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.216107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.216759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:10.217060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.218796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.240479 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3003/5978] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:13:10.241474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.251489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5e9a5-c19d-49e1-8566-f38484612341 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.256712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.257294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.257576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.257908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.258539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.260448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.297029 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2976/5979] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:10 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:10.300395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.311845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b39d17-67d6-4122-9e12-521a17c772da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.343483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:10.383760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.384391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.384671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.384945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.385613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.387901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.415816 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3004/5980] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:10 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:10.420004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.426149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:10.432326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45aebc3-81eb-4e15-bff2-d60cbb6f1b37 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.443726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.444844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.445045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.447927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.449294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.451244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.466814 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2977/5981] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:10.473138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.488078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f378e77-7ff7-43c6-b06f-298946d387ae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.493393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b387b57-6ddd-469f-9799-7c69a839cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.494053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387b57-6ddd-469f-9799-7c69a839cb52 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.494335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387b57-6ddd-469f-9799-7c69a839cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.494619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b387b57-6ddd-469f-9799-7c69a839cb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.495258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387b57-6ddd-469f-9799-7c69a839cb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.497068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b387b57-6ddd-469f-9799-7c69a839cb52 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.509358 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3005/5982] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:10.513951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.526572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c4bb0-3e1d-4f14-bcab-ee7aed9be75f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.531975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.532785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.533168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.533553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] PATH_INFO: `/v3/projects/552af5aaae3f49fdb5cc8ea8ec4ccdec/users/89a693133ded46eba2b9b70e899f38f9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.550752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=552af5aaae3f49fdb5cc8ea8ec4ccdec, user_id=89a693133ded46eba2b9b70e899f38f9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.554191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.572011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2978/5983] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:10 2022] PUT /identity/v3/projects/552af5aaae3f49fdb5cc8ea8ec4ccdec/users/89a693133ded46eba2b9b70e899f38f9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:10.577352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f4965-3c61-4f1e-bb50-72458da9bc2b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.578639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f4965-3c61-4f1e-bb50-72458da9bc2b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.578639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f4965-3c61-4f1e-bb50-72458da9bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.605944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-915f4965-3c61-4f1e-bb50-72458da9bc2b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:10.607399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-915f4965-3c61-4f1e-bb50-72458da9bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:10.672746 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3006/5984] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:10.691840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:10.694358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:10.762075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8174cc-d675-4e7c-976d-9765a7b67fd4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:10.765988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f02a0e-0acc-4144-8e52-65138d595a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:10.767148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f02a0e-0acc-4144-8e52-65138d595a6c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:10.767430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f02a0e-0acc-4144-8e52-65138d595a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:10.767708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f02a0e-0acc-4144-8e52-65138d595a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:10.781098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f02a0e-0acc-4144-8e52-65138d595a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:10.783432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f02a0e-0acc-4144-8e52-65138d595a6c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:10.796486 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2979/5985] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:20.663867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:20.790968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:21.752131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:21.752778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:21.752778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:21.824359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] MFA Rules not processed for user `89a693133ded46eba2b9b70e899f38f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:21.829844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:22.002964 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3007/5986] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:22.014760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300415bf-4fac-4380-9513-9d37faf7e187 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:22.015793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300415bf-4fac-4380-9513-9d37faf7e187 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:22.016813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300415bf-4fac-4380-9513-9d37faf7e187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:22.065147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-300415bf-4fac-4380-9513-9d37faf7e187 None None] MFA Rules not processed for user `89a693133ded46eba2b9b70e899f38f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:22.066442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-300415bf-4fac-4380-9513-9d37faf7e187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:22.082116 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2980/5987] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:22.098689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:22.100000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:22.211917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f7d77-ad4a-4662-82e1-87a73421bef2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:22.218193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:22.219119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:22.219606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:22.220081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:22.229608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:22.231605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:22.253992 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3008/5988] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:24.507444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8723146-1ca5-47af-b891-2d2e889f862b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:24.508350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8723146-1ca5-47af-b891-2d2e889f862b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:24.508877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8723146-1ca5-47af-b891-2d2e889f862b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:24.550276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8723146-1ca5-47af-b891-2d2e889f862b None None] MFA Rules not processed for user `89a693133ded46eba2b9b70e899f38f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:24.550276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8723146-1ca5-47af-b891-2d2e889f862b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:24.577794 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2981/5989] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:28.052359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:28.054676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.143573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718a6cb-289f-46e5-a1c1-ff963d22d292 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:28.149490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:28.150213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.150508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.150772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] PATH_INFO: `/v3/users/b44e66d6ec5548789906a0f9e2f9f097` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.152066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44e66d6ec5548789906a0f9e2f9f097)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:28.154132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:28.212748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:28.226499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44e66d6ec5548789906a0f9e2f9f097'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.237067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44e66d6ec5548789906a0f9e2f9f097'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.238444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44e66d6ec5548789906a0f9e2f9f097'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.247932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44e66d6ec5548789906a0f9e2f9f097'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.249053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44e66d6ec5548789906a0f9e2f9f097'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.269270 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3009/5990] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:28 2022] DELETE /identity/v3/users/b44e66d6ec5548789906a0f9e2f9f097 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:28.274888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.275391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.275500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.299726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:28.300970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.322370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:28.324033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.388311 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2982/5991] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:28.432690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:28.434192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.444332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5c685-2adc-44a3-ad9b-f7980c615c02 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:28.460208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:28.460884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.461170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.461451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] PATH_INFO: `/v3/users/1245d0e72fcd42f0a0c02fdccd517cc5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.463058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1245d0e72fcd42f0a0c02fdccd517cc5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:28.466388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:28.592569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1245d0e72fcd42f0a0c02fdccd517cc5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.603568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52044d7a-93f1-4a03-86a8-4d916b329f63 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:28.614482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1245d0e72fcd42f0a0c02fdccd517cc5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.617462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1245d0e72fcd42f0a0c02fdccd517cc5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.621549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:28.625696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.627034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.627719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.635676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.645348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1245d0e72fcd42f0a0c02fdccd517cc5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.647176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6912a036-c096-4ea0-b080-ee2a93806ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1245d0e72fcd42f0a0c02fdccd517cc5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:28.663186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:28.666638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:28.684957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3010/5992] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:28 2022] DELETE /identity/v3/users/1245d0e72fcd42f0a0c02fdccd517cc5 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:28.689853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.690205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.690480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.700946 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2983/5993] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:13:28.715457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:28.718239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.759430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:28.761079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.774109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:28.802450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd42c8-f866-4837-9c64-5768a416434e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:28.831014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3011/5994] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:28.862855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:28.864838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:28.977943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a2528-b497-413e-80ba-12c45434f257 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:28.983696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:28.984357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.984640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.984914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] PATH_INFO: `/v3/users/0d772fa0409649afb1f02eeed1b0ac66` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.985618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa9508-128f-425a-ba28-bcf64c0f6fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:28.986492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa9508-128f-425a-ba28-bcf64c0f6fcc service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:28.986965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa9508-128f-425a-ba28-bcf64c0f6fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:28.987371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa9508-128f-425a-ba28-bcf64c0f6fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:28.994668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d772fa0409649afb1f02eeed1b0ac66)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:28.996655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:29.001341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa9508-128f-425a-ba28-bcf64c0f6fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:29.005450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa9508-128f-425a-ba28-bcf64c0f6fcc service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:29.031741 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3012/5995] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:29.053842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:29.081517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d772fa0409649afb1f02eeed1b0ac66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.120520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d772fa0409649afb1f02eeed1b0ac66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.121724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d772fa0409649afb1f02eeed1b0ac66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.130183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d772fa0409649afb1f02eeed1b0ac66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.131791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d772fa0409649afb1f02eeed1b0ac66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.153658 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2984/5996] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:28 2022] DELETE /identity/v3/users/0d772fa0409649afb1f02eeed1b0ac66 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:29.158730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:29.159261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:29.159261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:29.183995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:29.183995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:29.256960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3013/5997] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:29.285571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:29.288627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:29.390128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebd47e-188b-4bf1-a020-1183188cdc4a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:29.394712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:29.395497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:29.396644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:29.396644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:29.408675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:29.410245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:29.421501 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2985/5998] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:29.616586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:29.618375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:29.631998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2113b-cb0b-480c-b4d7-07aef6ecae6c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:29.639136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:29.639988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:29.640268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:29.641495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] PATH_INFO: `/v3/projects/aa0cc560e4e64377bfa3239d8e6d1570` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:29.643803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0cc560e4e64377bfa3239d8e6d1570)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:29.647008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:29.758352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0cc560e4e64377bfa3239d8e6d1570', 'request_id': 'req-6561804f-82bf-4ab5-a124-54018c6ef158'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.776005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0cc560e4e64377bfa3239d8e6d1570', 'request_id': 'req-6561804f-82bf-4ab5-a124-54018c6ef158'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.786891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:29.788545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:29.790325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0cc560e4e64377bfa3239d8e6d1570', 'request_id': 'req-6561804f-82bf-4ab5-a124-54018c6ef158'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.806107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:29.811710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7b06a-b741-4dc2-9784-087a1dd15a2a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:29.812916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] The token cache is being invalidate because project aa0cc560e4e64377bfa3239d8e6d1570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:29.813571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.814541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6561804f-82bf-4ab5-a124-54018c6ef158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:29.821241 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3014/5999] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:29 2022] DELETE /identity/v3/projects/aa0cc560e4e64377bfa3239d8e6d1570 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:29.823402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58f593-e920-44f4-afe9-37facaf4e003 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:29.823908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58f593-e920-44f4-afe9-37facaf4e003 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:29.824364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58f593-e920-44f4-afe9-37facaf4e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:29.900554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fa58f593-e920-44f4-afe9-37facaf4e003 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:29.902941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa58f593-e920-44f4-afe9-37facaf4e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:29.939898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:29.940953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:29.941241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:29.941516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] PATH_INFO: `/v3/projects/87124c1540f441c1b95acca6ef6216cf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:29.942786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87124c1540f441c1b95acca6ef6216cf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:29.944737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:30.035551 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3015/6000] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:30.039460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.039753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.040112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.059678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:30.073750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87124c1540f441c1b95acca6ef6216cf', 'request_id': 'req-348f3dd4-f207-487b-9a14-5b8698b17d62'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.074673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:30.077819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.090842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87124c1540f441c1b95acca6ef6216cf', 'request_id': 'req-348f3dd4-f207-487b-9a14-5b8698b17d62'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.097490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87124c1540f441c1b95acca6ef6216cf', 'request_id': 'req-348f3dd4-f207-487b-9a14-5b8698b17d62'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.115682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] The token cache is being invalidate because project 87124c1540f441c1b95acca6ef6216cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:30.115979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.122891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-348f3dd4-f207-487b-9a14-5b8698b17d62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.124400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2986/6001] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:29 2022] DELETE /identity/v3/projects/87124c1540f441c1b95acca6ef6216cf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:30.129359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.129645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.129974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.165513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:30.166648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.230923 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3016/6002] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:30.232553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.239033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.296069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e0a2a-0a9f-44dc-811c-f1ecd3f9599d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:30.302383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:30.303226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.303482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.303755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] PATH_INFO: `/v3/projects/5d532fc66d254c5ca5c50190adbf366d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.304912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d532fc66d254c5ca5c50190adbf366d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:30.306888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:30.347818 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2987/6003] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:30.354225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.371904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044b10f-7c3d-4fc6-8a6d-0dd9f59bca77 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:30.398567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d532fc66d254c5ca5c50190adbf366d', 'request_id': 'req-9f381edd-cad3-4904-8ff7-c974c58e98b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.413827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d532fc66d254c5ca5c50190adbf366d', 'request_id': 'req-9f381edd-cad3-4904-8ff7-c974c58e98b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.422173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d532fc66d254c5ca5c50190adbf366d', 'request_id': 'req-9f381edd-cad3-4904-8ff7-c974c58e98b7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.443350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] The token cache is being invalidate because project 5d532fc66d254c5ca5c50190adbf366d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:30.445428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.446379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9f381edd-cad3-4904-8ff7-c974c58e98b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:30.450086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3017/6004] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:30 2022] DELETE /identity/v3/projects/5d532fc66d254c5ca5c50190adbf366d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:30.452685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.452685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.453714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.481928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:30.483329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.501669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:30.587837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:30.588480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.588763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.589050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.589698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:30.590031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:30.591652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6e140-8776-42b2-a34f-3ac51cd8b629 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:30.615244 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2988/6005] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:13:30.616738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.617026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.617609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.646588 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3018/6006] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:30.647573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.652173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.664166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:30.665448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.674451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ddb7f-f8b3-4f2f-9d5f-6b9ec3d7d243 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:30.684026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2989/6007] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:30.685010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.695285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:30.697509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.698167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.698695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.700531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:30.702997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:30.705673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ea69a-5c09-4b43-8ae5-3b58f592f97c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:30.730691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:30.731348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.731654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.731915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.732585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:30.732894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:30.734560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d5bf1-6f6e-4894-be73-4777ebca6155 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:30.756929 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2990/6008] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:13:30.758660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.759517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.759991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.766601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3019/6009] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:30.770389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.823499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:30.825265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:30.885363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c60015-7ef7-4f3a-bb3f-88af98c52c0c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:30.890237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:30.890861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:30.891139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:30.891408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:30.892169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:30.894330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:30.913483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:30.934631 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3020/6010] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:30.935558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.964532 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2991/6011] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:30.964532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:30.976068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40e3ff-abee-4094-8a97-3ce37166633c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.039906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68241ef6-c864-4870-b884-7130564b5cfd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.067321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.068380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.069071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.069700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.070757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.072964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.105618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.106303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.106595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.106872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.107805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.110113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.118948 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3021/6012] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:31.120202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.141562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd0efe-da0c-4210-94ad-247dedebe87c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.148641 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2992/6013] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:30 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:31.150708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.154249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.154889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.155166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.155437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.156094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:31.156394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.158026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.160950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:31.166974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a693ad-4c90-4611-8a21-c5a95d579670 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.175688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.176414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.177355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.177671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.178334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.180049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.193115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2993/6014] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:31.193115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.195571 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3022/6015] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:13:31.196940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.211457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0141b5-b8a2-4f20-a53a-568b46953c41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.213002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2f252-5f24-40e5-a49a-45063471064a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.217263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.217836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.218121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.218393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.219088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.220984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.221537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.222452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.223142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.223646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.225198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.233755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.247585 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2994/6016] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:31.252959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.270807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831551af-ae90-4f9a-877b-0d5f6eed2aa7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.282447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.284208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.285109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.287076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.288390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.291384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.305971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3023/6017] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:31 2022] POST /identity/v3/projects => generated 359 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:31.307027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.322921 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2995/6018] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:31.322921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.327903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:31.345423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585af3f-338f-4b65-aedf-2c5ee98ce6ee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.434971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460b19-ad98-4f22-987d-502d39b8b29f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.440088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.440523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.441095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.441095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.441392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.442093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.443328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.443781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.443896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.444299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] PATH_INFO: `/v3/users/248edcc92caa4be9959a03aca93cfef7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.445891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248edcc92caa4be9959a03aca93cfef7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.448849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.460139 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3024/6019] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:31.460139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.473095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc1cf4d-b249-41ad-9855-f8daade90ace admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.480445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.481075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.481351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.481779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.482436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.484576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.515136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3025/6020] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:31 2022] POST /identity/v3/users => generated 280 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:31.516432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.531318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52719179-ed99-48bb-8207-09279a6a3d77 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.532192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:31.539971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.551307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.551714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.552430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] PATH_INFO: `/v3/projects/bec6f8b74a4d44b2be4eee296a42a953/users/ded3fc6d1e7a42ecae088c96856add61/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.560964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248edcc92caa4be9959a03aca93cfef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:31.587216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec6f8b74a4d44b2be4eee296a42a953, user_id=ded3fc6d1e7a42ecae088c96856add61, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.587866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248edcc92caa4be9959a03aca93cfef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:31.590279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248edcc92caa4be9959a03aca93cfef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:31.591840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.602419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248edcc92caa4be9959a03aca93cfef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:31.608823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248edcc92caa4be9959a03aca93cfef7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:31.617001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3026/6021] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:31 2022] PUT /identity/v3/projects/bec6f8b74a4d44b2be4eee296a42a953/users/ded3fc6d1e7a42ecae088c96856add61/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:31.618401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.629937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:31.635884 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2996/6022] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:31 2022] DELETE /identity/v3/users/248edcc92caa4be9959a03aca93cfef7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:31.636899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.638393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:31.741199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c173df-d47a-4b96-8818-10815183589f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.742988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262eba0-0261-4a59-a4e1-b8d05c218af2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:31.748236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14a955-81a5-4489-8ce6-143331ca76a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.749270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14a955-81a5-4489-8ce6-143331ca76a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.749772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14a955-81a5-4489-8ce6-143331ca76a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.750281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14a955-81a5-4489-8ce6-143331ca76a2 admin admin] PATH_INFO: `/v3/projects/c80a04e7396c4f3488d41847220a1b26/users/e35c9bf66ca64085ae78a5ed755f9f39/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.750417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ba253-3b7f-4466-a3dc-29fa0295e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:31.751215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba253-3b7f-4466-a3dc-29fa0295e965 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.751650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba253-3b7f-4466-a3dc-29fa0295e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.752226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ba253-3b7f-4466-a3dc-29fa0295e965 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.753288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba253-3b7f-4466-a3dc-29fa0295e965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.756444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ba253-3b7f-4466-a3dc-29fa0295e965 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.779957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2997/6023] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:31.783511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.784492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.784492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.787670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14a955-81a5-4489-8ce6-143331ca76a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80a04e7396c4f3488d41847220a1b26, user_id=e35c9bf66ca64085ae78a5ed755f9f39, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:31.791155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14a955-81a5-4489-8ce6-143331ca76a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:31.817076 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3027/6024] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:31 2022] PUT /identity/v3/projects/c80a04e7396c4f3488d41847220a1b26/users/e35c9bf66ca64085ae78a5ed755f9f39/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:31.828240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] MFA Rules not processed for user `ded3fc6d1e7a42ecae088c96856add61`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:31.828473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a286-3d31-4b90-87ef-c8078b97a652 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:31.828753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a286-3d31-4b90-87ef-c8078b97a652 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:31.829032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350a286-3d31-4b90-87ef-c8078b97a652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:31.829511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:31.863892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c350a286-3d31-4b90-87ef-c8078b97a652 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:31.865396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c350a286-3d31-4b90-87ef-c8078b97a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:31.880709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:31.960600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2998/6025] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:31.961330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:31.994198 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3028/6026] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:31.998908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.002435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.005207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.071775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] MFA Rules not processed for user `e35c9bf66ca64085ae78a5ed755f9f39`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:32.073356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:32.090109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:32.159931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad017a-2815-4d44-b209-249f5fa8914e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:32.172060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:32.174251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.176922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.177432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.180058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:32.185774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:32.211361 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3029/6027] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:32.211361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:32.212781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:32.214919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 2999/6028] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:32.215816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:32.225558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:32.363629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a00a19-b375-45d9-8551-344c94e63533 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:32.371225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:32.371872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.372151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.372477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.382749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:32.384583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:32.410233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3030/6029] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:32.423406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb45060-71b4-446d-b167-327f223cbbfd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:32.424611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:32.435751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:32.436545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.436828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.437099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.447340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86f64f-610e-4067-825c-da12d9f54d93 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:32.453448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8ed0b-73d0-4d77-bf75-2c88757d7fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:32.455133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ed0b-73d0-4d77-bf75-2c88757d7fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.455133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ed0b-73d0-4d77-bf75-2c88757d7fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.455133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8ed0b-73d0-4d77-bf75-2c88757d7fe4 admin admin] PATH_INFO: `/v3/projects/e9a9cf2dee5548bb9b9f948f71cf2651/users/9bd99ebba80a4ec5b5ccfb59e66730bc/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.457345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:32.458853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:32.481001 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3000/6030] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:32.481751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:32.496436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ed0b-73d0-4d77-bf75-2c88757d7fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a9cf2dee5548bb9b9f948f71cf2651, user_id=9bd99ebba80a4ec5b5ccfb59e66730bc, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:32.499658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8ed0b-73d0-4d77-bf75-2c88757d7fe4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:32.504047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b7c35-2c3c-4d3e-a228-64becc4390f0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:32.513338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:32.513923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.514201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.514471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.529652 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3031/6031] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:32 2022] PUT /identity/v3/projects/e9a9cf2dee5548bb9b9f948f71cf2651/users/9bd99ebba80a4ec5b5ccfb59e66730bc/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:32.562647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.562942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.563165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:32.563299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:32.564543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:32.577594 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3001/6032] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:32.581869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:32.630686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] MFA Rules not processed for user `9bd99ebba80a4ec5b5ccfb59e66730bc`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:32.632280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:32.756805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:32.758309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:32.775007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3032/6033] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:32.825047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:32.967390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24413f25-9f6f-4773-aed1-e5b7a5eb86f1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:32.976245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:32.978421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:32.978784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:32.982892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:33.003521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cc3dd-ddf4-4205-903d-e2ca6dde3d78 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:33.011226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:33.013098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:33.035668 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3033/6034] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:13:33.168718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:33.180860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:33.183478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:33.184139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:33.184576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:33.189574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:33.210333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:33.212814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:33.245515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3002/6035] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:33.647901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:33.650091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:33.735766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2aaad2-1b6f-4970-9fb9-ef79186abae4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:33.741652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:33.742757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:33.743137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:33.743780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] PATH_INFO: `/v3/projects/7e8b790eaaee4e5abe0b8bbd2671f83c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:33.745159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8b790eaaee4e5abe0b8bbd2671f83c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:33.747366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:33.797982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:33.829152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8b790eaaee4e5abe0b8bbd2671f83c', 'request_id': 'req-ce5b756f-b5db-412f-a169-045ae409cfe5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:33.838636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8b790eaaee4e5abe0b8bbd2671f83c', 'request_id': 'req-ce5b756f-b5db-412f-a169-045ae409cfe5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:33.847942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8b790eaaee4e5abe0b8bbd2671f83c', 'request_id': 'req-ce5b756f-b5db-412f-a169-045ae409cfe5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:33.866377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] The token cache is being invalidate because project 7e8b790eaaee4e5abe0b8bbd2671f83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:33.867016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:33.868447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:33.871679 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3034/6036] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:33 2022] DELETE /identity/v3/projects/7e8b790eaaee4e5abe0b8bbd2671f83c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:33.887057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:33.906596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d7532-2d88-4dab-8be5-40e66c23e5af service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:33.999131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:33.999779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:34.000055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:34.000323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] PATH_INFO: `/v3/users/a4b85e4bdfdd441295f5eb993388b2b8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:34.001980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4b85e4bdfdd441295f5eb993388b2b8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:34.004258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:34.105250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4b85e4bdfdd441295f5eb993388b2b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:34.203324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4b85e4bdfdd441295f5eb993388b2b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:34.204259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4b85e4bdfdd441295f5eb993388b2b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:34.221109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4b85e4bdfdd441295f5eb993388b2b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:34.224096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a4fe31aa-e587-4361-8c01-310e3829c88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4b85e4bdfdd441295f5eb993388b2b8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:34.262933 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3003/6037] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:33 2022] DELETE /identity/v3/users/a4b85e4bdfdd441295f5eb993388b2b8 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:35.026598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.029205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:35.061328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b756f-b5db-412f-a169-045ae409cfe5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.143548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.144219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.144499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.144845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] PATH_INFO: `/v3/projects/6d6ef803c239451bbca0bc18565f9e0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.146143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6ef803c239451bbca0bc18565f9e0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:35.148417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:35.209601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6ef803c239451bbca0bc18565f9e0c', 'request_id': 'req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:35.218987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6ef803c239451bbca0bc18565f9e0c', 'request_id': 'req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:35.240478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6ef803c239451bbca0bc18565f9e0c', 'request_id': 'req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:35.269779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] The token cache is being invalidate because project 6d6ef803c239451bbca0bc18565f9e0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:35.270153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:35.271016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-21b2ab11-ff75-4e65-971f-fb3c9b5e352b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:35.274290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3035/6038] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:35 2022] DELETE /identity/v3/projects/6d6ef803c239451bbca0bc18565f9e0c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:35.279328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.281736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.284691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.321200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:35.325161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:35.404102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3004/6039] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:35.412690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.413221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.414224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.465736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:35.468187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:35.481655 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3036/6040] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:35.485706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.498794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e942068-b325-48c0-897b-dc48495aaa8b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.508323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.509097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.509377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.509643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.510429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:35.510731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:35.512571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:35.522439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:35.535160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.539633 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3005/6041] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:13:35.570128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f529c11-7841-4754-9cb4-1f8495f57231 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.576862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.577501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.577779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.578099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.578742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:35.582246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:35.624626 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3037/6042] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:35 2022] POST /identity/v3/projects => generated 397 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:35.629587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.650262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d71a51-1c15-4c44-80e2-578f6a4ba225 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.746871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.747904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.748218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.748498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.749135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:35.751376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:35.795541 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3006/6043] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:35 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:35.798161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.814238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e75884-a832-4560-84e7-d51c3d47543b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.826928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.828283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.828568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.828842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.832111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:35.837063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:35.879154 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3038/6044] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:35.884732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.904936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d09a2-7ba8-454b-ad15-42e126d71232 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.922612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b1316-0599-49a4-a163-37f98aaebc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.923376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b1316-0599-49a4-a163-37f98aaebc5c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.923658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b1316-0599-49a4-a163-37f98aaebc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.931216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b1316-0599-49a4-a163-37f98aaebc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:35.932201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b1316-0599-49a4-a163-37f98aaebc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:35.933881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b1316-0599-49a4-a163-37f98aaebc5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:35.957657 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3007/6045] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:35.964482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:35.977379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b073ce-68ad-4773-9ae5-46bd83526a15 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:35.983305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:35.984225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:35.984637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:35.985012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] PATH_INFO: `/v3/projects/176f7e43a06e4a7f970b062faef5f3de/users/0691f33a4e2a46c3bd5bf774bc001f35/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:36.003840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:36.006833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176f7e43a06e4a7f970b062faef5f3de, user_id=0691f33a4e2a46c3bd5bf774bc001f35, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:36.012851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:36.046968 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3039/6046] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:35 2022] PUT /identity/v3/projects/176f7e43a06e4a7f970b062faef5f3de/users/0691f33a4e2a46c3bd5bf774bc001f35/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:36.050305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:36.050704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:36.051087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:36.103584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] MFA Rules not processed for user `0691f33a4e2a46c3bd5bf774bc001f35`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:36.104956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:36.215227 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3008/6047] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:36.237948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:36.240880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:36.376628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ba5b8-a503-4763-9299-48f49b99d3f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:36.380809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:36.381571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:36.382005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:36.382371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:36.397128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:36.399331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:36.426611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3040/6048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:42.913294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:42.917160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:43.193497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504988-125a-4e10-adb8-2dbdcd5c33a0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:43.200956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:43.201927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:43.202381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:43.203200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:43.205599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:43.216736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:43.222784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:43.225873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b164d-0fea-444d-b9f9-181010de2007 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:43.241604 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3009/6049] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:46.386991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:46.387740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:46.603298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b4c7b-f10d-4f8b-9ecd-367b46499438 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:46.608186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:46.608850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:46.609133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:46.609408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] PATH_INFO: `/v3/users/ded3fc6d1e7a42ecae088c96856add61` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:46.610965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded3fc6d1e7a42ecae088c96856add61)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:46.623943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:46.747127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded3fc6d1e7a42ecae088c96856add61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:46.758975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded3fc6d1e7a42ecae088c96856add61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:46.759853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded3fc6d1e7a42ecae088c96856add61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:46.780668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded3fc6d1e7a42ecae088c96856add61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:46.782651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded3fc6d1e7a42ecae088c96856add61'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:46.836596 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3041/6050] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:46 2022] DELETE /identity/v3/users/ded3fc6d1e7a42ecae088c96856add61 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:46.837877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:46.838337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:46.838491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:46.878430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:46.879691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:47.064737 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3010/6051] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:47.187728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:47.189445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:47.219515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:47.347051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345a681-7848-42b4-bb83-7a3afdb18c35 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:47.354493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:47.356827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:47.357318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:47.357596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:47.381514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:47.383483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:47.399997 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3042/6052] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:51.335553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:51.337060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:51.510126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7eb6e-7d47-4b6f-a126-bf82fda9354f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:51.525032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:51.528846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:51.531803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:51.532234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:51.535610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:51.537114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:51.539077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:51.560932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8687e-1f14-494e-abbf-ec961fa84689 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:51.573290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:51.574288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:51.576144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:51.576635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] PATH_INFO: `/v3/projects/bec6f8b74a4d44b2be4eee296a42a953` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:51.578883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec6f8b74a4d44b2be4eee296a42a953)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:51.584100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:51.642333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:51.644383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7c614-a04a-4e27-8bb1-6043c3cdc771 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:51.656608 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3011/6053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:51.700805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec6f8b74a4d44b2be4eee296a42a953', 'request_id': 'req-8db9ace1-3413-4aa6-898c-16fa502a8144'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:51.715606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec6f8b74a4d44b2be4eee296a42a953', 'request_id': 'req-8db9ace1-3413-4aa6-898c-16fa502a8144'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:51.733305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec6f8b74a4d44b2be4eee296a42a953', 'request_id': 'req-8db9ace1-3413-4aa6-898c-16fa502a8144'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:51.763571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] The token cache is being invalidate because project bec6f8b74a4d44b2be4eee296a42a953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:51.764649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:51.765612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8db9ace1-3413-4aa6-898c-16fa502a8144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:51.767613 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3043/6054] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:51 2022] DELETE /identity/v3/projects/bec6f8b74a4d44b2be4eee296a42a953 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:13:51.774238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:51.774438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:51.774667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:51.817563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:51.818883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:51.938289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:52.005209 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3012/6055] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:52.014520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.014806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.015087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.054718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:52.055976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:52.075754 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3044/6056] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:52.076752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:52.087601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac105dc-d6bf-4346-b4f3-61516d15d05f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:52.104663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:52.105311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.105595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.106070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.106743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:52.107049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:52.108687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:52.146879 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3013/6057] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:13:52.151077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:52.161020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be69d4-77ab-4e83-949d-f325ca9a4b77 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:52.195560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:52.196204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.196476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.196744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.197382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:52.199364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:52.305920 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3045/6058] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:52 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:52.306872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:52.325559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672b82d-7c8f-4ec0-9a1c-c04ae577457d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:52.535605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:52.536978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.537446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.537936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.538958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:52.546376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:52.630838 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3014/6059] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:52 2022] POST /identity/v3/users => generated 287 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:52.633211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:52.658433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157cb0-261b-4970-a75f-fb61f9db7494 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:52.675523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:52.676084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.676571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.676826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.677483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:52.682075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:52.721767 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3046/6060] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:52.722826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:52.738810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e35f6-fc5b-4b95-a20d-3af3b908a59c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:52.770065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bc3a4-38fa-4fd1-bfe8-f7c60403832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:52.770571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc3a4-38fa-4fd1-bfe8-f7c60403832f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.770853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc3a4-38fa-4fd1-bfe8-f7c60403832f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.771125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bc3a4-38fa-4fd1-bfe8-f7c60403832f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.771770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bc3a4-38fa-4fd1-bfe8-f7c60403832f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:52.773380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bc3a4-38fa-4fd1-bfe8-f7c60403832f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:52.816372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3015/6061] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:52.817616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:52.834690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128731-753f-4f7f-8c00-bc450ace3148 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:52.857000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:52.860784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.862145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.863519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] PATH_INFO: `/v3/projects/ff71f55176d94b55b937fdf89dc10212/users/06e7a1dc95eb405997ff02934a0899fe/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:52.920856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff71f55176d94b55b937fdf89dc10212, user_id=06e7a1dc95eb405997ff02934a0899fe, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:52.934573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:52.977447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3047/6062] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:52 2022] PUT /identity/v3/projects/ff71f55176d94b55b937fdf89dc10212/users/06e7a1dc95eb405997ff02934a0899fe/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:52.980133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:52.984812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:52.985312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:53.039489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] MFA Rules not processed for user `06e7a1dc95eb405997ff02934a0899fe`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:53.046735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:53.259807 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3016/6063] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:53.264519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:53.365230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:53.430463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8800fc4-ebab-48a4-966d-05d453956718 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:53.447982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:53.448945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:53.449237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:53.449516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:53.450274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:53.452219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:53.517104 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3048/6064] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:53 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:53.521005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:53.545221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd3c51-7319-4789-adb4-ba9b1ac2a399 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:53.627262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:53.709836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:53.709836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:53.712322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:53.712689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:53.713425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:53.720676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:53.755989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:53.759622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:53.761759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3017/6065] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:53 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:53.765593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:53.779118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cd432-0507-4c84-a9a0-85cd0a106ce7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:53.795125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:53.795962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:53.796426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:53.797508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:53.798270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:53.800248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:53.816544 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3018/6066] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:53.822624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:53.848436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b1546-9e6d-45ab-994e-524d3a1ac1d8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:53.861128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:53.861732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:53.862094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:53.862379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] PATH_INFO: `/v3/projects/cd0b460b3929413e86b5f16d76cd00bd/users/e4688fd3ee104106b35b2599f67e8801/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:53.924877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0b460b3929413e86b5f16d76cd00bd, user_id=e4688fd3ee104106b35b2599f67e8801, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:53.937278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f2f6c-a4ec-47e3-a4e4-8524b74b84d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:53.954583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:53.955528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:53.956022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:53.956653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:53.957881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:53.959431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:53.995072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:53.997325 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3019/6067] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:53 2022] PUT /identity/v3/projects/cd0b460b3929413e86b5f16d76cd00bd/users/e4688fd3ee104106b35b2599f67e8801/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:13:53.998153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:53.998471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:54.022811 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3049/6068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:54.188256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c4be4-0b10-4f13-96dc-2bfdcaab5e30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:54.196664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec09368-1acc-4509-8ae3-6b4251f278e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:54.200007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec09368-1acc-4509-8ae3-6b4251f278e4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:54.202590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec09368-1acc-4509-8ae3-6b4251f278e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:54.207515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec09368-1acc-4509-8ae3-6b4251f278e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:54.208362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec09368-1acc-4509-8ae3-6b4251f278e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:54.210357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec09368-1acc-4509-8ae3-6b4251f278e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:54.223478 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3020/6069] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:54.227536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:54.262879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d33043-02dc-4ef6-b067-b3cfc60b64f3 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:54.284342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:54.285150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:54.285487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:54.285777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] PATH_INFO: `/v3/projects/cd0b460b3929413e86b5f16d76cd00bd/users/e4688fd3ee104106b35b2599f67e8801/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:54.289714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0b460b3929413e86b5f16d76cd00bd, user_id=e4688fd3ee104106b35b2599f67e8801, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:54.295750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:54.332563 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3050/6070] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:54 2022] PUT /identity/v3/projects/cd0b460b3929413e86b5f16d76cd00bd/users/e4688fd3ee104106b35b2599f67e8801/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:54.334631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:54.335551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:54.335838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:54.404324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] MFA Rules not processed for user `e4688fd3ee104106b35b2599f67e8801`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:54.407727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:54.589370 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3021/6071] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:54.590695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:54.611730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159474-6ecf-469b-beef-e542daecf2bf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:54.636242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:54.636242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:54.636242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:54.636516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:54.636516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:54.639845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:54.690908 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3051/6072] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:13:54 2022] POST /identity/v3/domains => generated 246 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:54.695540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:54.707138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5da2e-3a07-41fa-a55f-b4ee0d5e9d09 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:54.748786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:54.897468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:54.899962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:54.900391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:54.900677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:54.901491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:54.903675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:54.976767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3022/6073] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:54 2022] POST /identity/v3/projects => generated 408 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:54.980649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:54.997266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22b7ab-76cb-4a76-84cd-2af165e6a89d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:55.106629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:55.108643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.108959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.110029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.112744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:55.120621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:55.186755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3052/6074] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:54 2022] POST /identity/v3/users => generated 348 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:55.189517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:55.211597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc258-61db-4df6-bbfc-9869d39e55a9 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:55.232847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0cac8-7601-4a8b-8957-4225722f5480 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:55.233685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0cac8-7601-4a8b-8957-4225722f5480 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.234012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0cac8-7601-4a8b-8957-4225722f5480 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.234544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0cac8-7601-4a8b-8957-4225722f5480 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.235888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0cac8-7601-4a8b-8957-4225722f5480 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:55.241551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d0cac8-7601-4a8b-8957-4225722f5480 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:55.277387 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3023/6075] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:55.278317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:55.294094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a363c7-1555-4ece-b2f8-14fc73cdd736 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:55.307270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e9465-d53b-4612-95b7-98acd888485d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:55.315166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9465-d53b-4612-95b7-98acd888485d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.316596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9465-d53b-4612-95b7-98acd888485d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.318047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e9465-d53b-4612-95b7-98acd888485d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/projects/e10e85c2408b406f84a10e0aff969d6e/users/972a88c2b8fa4002b76425872728d3a4/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.336009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:55.345557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9465-d53b-4612-95b7-98acd888485d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e10e85c2408b406f84a10e0aff969d6e, user_id=972a88c2b8fa4002b76425872728d3a4, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:55.349531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e9465-d53b-4612-95b7-98acd888485d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:55.383975 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3053/6076] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:55 2022] PUT /identity/v3/projects/e10e85c2408b406f84a10e0aff969d6e/users/972a88c2b8fa4002b76425872728d3a4/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:55.386508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.386800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.387090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.620274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] MFA Rules not processed for user `972a88c2b8fa4002b76425872728d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:55.624022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:55.644919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3024/6077] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:55.656052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.656052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.656322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.684036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] MFA Rules not processed for user `972a88c2b8fa4002b76425872728d3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:55.685315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:55.699651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:55.699917 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3054/6078] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:55.715909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52c626-67f1-4464-a205-2ec4ea6119cb None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:55.726010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '972a88c2b8fa4002b76425872728d3a4', 'user_domain_id': '1251ac15ce38415ba8ebb387a78c944f', 'system_scope': None, 'project_id': 'e10e85c2408b406f84a10e0aff969d6e', 'project_domain_id': '1251ac15ce38415ba8ebb387a78c944f', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:55.726903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.727357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.727781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.739930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:55.743313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:55.773897 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3025/6079] 10.222.0.16 () {56 vars in 1284 bytes} [Sat Oct 29 03:13:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:55.778621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:55.906743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9050d2-5bb0-47eb-a8d1-16197618ac5d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:55.913037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:55.913702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:55.914014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:55.914286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/users/972a88c2b8fa4002b76425872728d3a4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:55.915440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:delete_user(user_id=972a88c2b8fa4002b76425872728d3a4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:55.917368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:56.025537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972a88c2b8fa4002b76425872728d3a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.066822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972a88c2b8fa4002b76425872728d3a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.069214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972a88c2b8fa4002b76425872728d3a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.099963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972a88c2b8fa4002b76425872728d3a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.100962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972a88c2b8fa4002b76425872728d3a4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.167605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3055/6080] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:55 2022] DELETE /identity/v3/users/972a88c2b8fa4002b76425872728d3a4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:13:56.171541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:56.188309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baba852-e3cc-4aae-b2f0-604de0829468 tempest-test_project-697956116 tempest-user-1769852531] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:56.202383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:56.204055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:56.274246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:56.323723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f50e4-dd63-4ebd-932a-88b37625a44d tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:56.325733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:56.326037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:56.326417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:56.326729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/projects/e10e85c2408b406f84a10e0aff969d6e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:56.328944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e10e85c2408b406f84a10e0aff969d6e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:56.331263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:56.343234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:56.343934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:56.344217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:56.344491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] PATH_INFO: `/v3/users/e35c9bf66ca64085ae78a5ed755f9f39` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:56.353533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35c9bf66ca64085ae78a5ed755f9f39)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:56.356839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:56.375227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:56.437164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35c9bf66ca64085ae78a5ed755f9f39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.440371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e10e85c2408b406f84a10e0aff969d6e', 'request_id': 'req-36cf328a-ca1e-487b-b9d4-f85f844d0171'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.447557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35c9bf66ca64085ae78a5ed755f9f39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.448453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35c9bf66ca64085ae78a5ed755f9f39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.451843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e10e85c2408b406f84a10e0aff969d6e', 'request_id': 'req-36cf328a-ca1e-487b-b9d4-f85f844d0171'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.457716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35c9bf66ca64085ae78a5ed755f9f39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.459751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58721ef9-8a34-44fc-81cf-9854e5279621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35c9bf66ca64085ae78a5ed755f9f39'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.466313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e10e85c2408b406f84a10e0aff969d6e', 'request_id': 'req-36cf328a-ca1e-487b-b9d4-f85f844d0171'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.487291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] The token cache is being invalidate because project e10e85c2408b406f84a10e0aff969d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:56.487894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.490841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.496000 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3026/6081] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:56 2022] DELETE /identity/v3/projects/e10e85c2408b406f84a10e0aff969d6e => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:56.501034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:56.501832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3056/6082] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:56 2022] DELETE /identity/v3/users/e35c9bf66ca64085ae78a5ed755f9f39 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:56.503173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:56.504963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:56.505290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:56.505592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:56.535243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:56.536716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:56.644150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf328a-ca1e-487b-b9d4-f85f844d0171 tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:56.684836 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3057/6083] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:13:56.700772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:56.702529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:56.786510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:56.787140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:56.787553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:56.787829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/domains/1251ac15ce38415ba8ebb387a78c944f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:56.789082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1251ac15ce38415ba8ebb387a78c944f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:56.791744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:56.802552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba340cf-3edf-426f-a20d-b35cea75799a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:56.808765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:56.809632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:56.810219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:56.810651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:56.814753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:56.827478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.829920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.832773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:56.835525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:56.859611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3058/6084] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:13:56.910957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.911711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:56.915071 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3027/6085] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:13:56 2022] PATCH /identity/v3/domains/1251ac15ce38415ba8ebb387a78c944f => generated 247 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:13:56.919205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:56.937591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b9358-ac9f-4419-afbe-232cd4084537 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:57.012797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:57.091162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4688fd3ee104106b35b2599f67e8801', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd0b460b3929413e86b5f16d76cd00bd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:57.091886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:57.092211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:57.092502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] PATH_INFO: `/v3/domains/1251ac15ce38415ba8ebb387a78c944f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:57.110007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1251ac15ce38415ba8ebb387a78c944f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:57.112375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:57.172798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:57.172798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:57.185572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.204708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.330747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533dfc6-266e-4695-9bf3-950f5361d38f tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:57.349433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f', 'request_id': 'req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.407659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f', 'request_id': 'req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.431515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f', 'request_id': 'req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.464420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] The token cache is being invalidate because project 1251ac15ce38415ba8ebb387a78c944f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:57.465178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.469209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.501292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:57.503884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:57.505388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:57.506702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] PATH_INFO: `/v3/projects/c80a04e7396c4f3488d41847220a1b26` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:57.511223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80a04e7396c4f3488d41847220a1b26)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:57.515735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:57.532747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f', 'request_id': 'req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.536657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f', 'request_id': 'req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.546951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1251ac15ce38415ba8ebb387a78c944f', 'request_id': 'req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.563128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3059/6086] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:13:56 2022] DELETE /identity/v3/domains/1251ac15ce38415ba8ebb387a78c944f => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:57.568871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:57.579933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:57.610176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aab1f2-1152-4cc1-808b-9e7c8267b98e tempest-TestDefaultProjectId-1540008587 tempest-TestDefaultProjectId-1540008587-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:57.637759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80a04e7396c4f3488d41847220a1b26', 'request_id': 'req-b082dd74-5e41-455c-bb22-3b21b18b1225'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.649605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80a04e7396c4f3488d41847220a1b26', 'request_id': 'req-b082dd74-5e41-455c-bb22-3b21b18b1225'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.662109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80a04e7396c4f3488d41847220a1b26', 'request_id': 'req-b082dd74-5e41-455c-bb22-3b21b18b1225'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.684087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] The token cache is being invalidate because project c80a04e7396c4f3488d41847220a1b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:57.684649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.686036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b082dd74-5e41-455c-bb22-3b21b18b1225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.688457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3028/6087] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:57 2022] DELETE /identity/v3/projects/c80a04e7396c4f3488d41847220a1b26 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:13:57.694640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ccc8-fd81-4a95-9013-762ef7cd0887 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:57.695057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ccc8-fd81-4a95-9013-762ef7cd0887 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:57.695481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5ccc8-fd81-4a95-9013-762ef7cd0887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:57.723143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-86e5ccc8-fd81-4a95-9013-762ef7cd0887 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:57.725907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86e5ccc8-fd81-4a95-9013-762ef7cd0887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:57.737838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:57.738402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:57.738675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:57.738780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:57.739069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] PATH_INFO: `/v3/users/06e7a1dc95eb405997ff02934a0899fe` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:57.744886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e7a1dc95eb405997ff02934a0899fe)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:57.747160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:57.754581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:57.832833 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3029/6088] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:57.845939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e7a1dc95eb405997ff02934a0899fe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.848011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:57.849001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:57.849434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:57.878903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e7a1dc95eb405997ff02934a0899fe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.882136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e7a1dc95eb405997ff02934a0899fe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.904181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e7a1dc95eb405997ff02934a0899fe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.906122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6b65b9c3-e0d8-44ef-9888-687e63b5f76a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e7a1dc95eb405997ff02934a0899fe'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:57.922965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:57.928157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:57.951237 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3060/6089] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:57 2022] DELETE /identity/v3/users/06e7a1dc95eb405997ff02934a0899fe => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:57.953127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:57.953516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:57.953920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:57.955466 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3030/6090] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:57.959673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:57.974602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2ca2b-bd18-40c0-a5a0-2bae07fac13d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:57.994429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:57.999108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:58.074199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.075047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.075336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.076403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.076777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:13:58.077086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.080712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.098078 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3031/6091] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:13:58.099911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3061/6092] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:58.103080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:58.113527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:58.116612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:58.120988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d4edf-442c-4580-9f9c-1dc1c519544f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:58.137768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.138431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.138810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.139266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.141546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.143628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.193176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd5a95-8f20-4985-b060-490e0ad6e28a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:58.199539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.200507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.200883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.201255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.214851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.216628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.218425 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3032/6093] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:13:58 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:13:58.222813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:58.231945 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3062/6094] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:13:58.343493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bfa6c5-84c4-4fd3-b4ee-b144f1bfab2e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:58.350171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.351345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.351716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.351995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.352909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.355672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.397194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3033/6095] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:13:58 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:13:58.400981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:58.428411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf9ba9-4c9d-4313-acf8-b28616fc5cd4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:58.438693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.439600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.440139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.440448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.441343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.443036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.463053 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3063/6096] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:58.464973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:58.480504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1502d-c60b-4009-8e4e-f62369820cc0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:58.486082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b177e7-05d2-4df7-827e-3dbfd802a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.487949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b177e7-05d2-4df7-827e-3dbfd802a1be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.488241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b177e7-05d2-4df7-827e-3dbfd802a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.488519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b177e7-05d2-4df7-827e-3dbfd802a1be admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.489508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b177e7-05d2-4df7-827e-3dbfd802a1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.491233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b177e7-05d2-4df7-827e-3dbfd802a1be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.499456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:58.512507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3034/6097] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:13:58.515050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:58.532232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb692f32-b281-471d-8b8a-67cd31e777a0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:58.546587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:58.549319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.550775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.551303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] PATH_INFO: `/v3/projects/db10eed47fe340eb89f4c23211d30e82/users/98b6a4444c3948c8ac05da2282ba57c6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.583990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:58.595911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db10eed47fe340eb89f4c23211d30e82, user_id=98b6a4444c3948c8ac05da2282ba57c6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:58.614001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:58.643606 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3064/6098] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:13:58 2022] PUT /identity/v3/projects/db10eed47fe340eb89f4c23211d30e82/users/98b6a4444c3948c8ac05da2282ba57c6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:13:58.649321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:58.649745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:58.650321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:58.714876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] MFA Rules not processed for user `98b6a4444c3948c8ac05da2282ba57c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:58.716489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:58.847207 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3035/6099] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:58.905254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:59.080897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea4d7d-a772-49ad-b2df-5a9f0f564fe1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:59.093617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:59.094470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:59.098278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:59.098964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:59.111139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:59.113454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:59.145452 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3065/6100] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:13:59.170564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:59.286125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:59.287769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:59.390610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200fa81-eb36-4c95-95ef-bdeca412aa33 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:59.414331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:59.417132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:59.417501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:59.418609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] PATH_INFO: `/v3/users/98b6a4444c3948c8ac05da2282ba57c6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:59.420497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b6a4444c3948c8ac05da2282ba57c6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:59.429081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:59.561750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b6a4444c3948c8ac05da2282ba57c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.590848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b6a4444c3948c8ac05da2282ba57c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.591711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b6a4444c3948c8ac05da2282ba57c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.603115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b6a4444c3948c8ac05da2282ba57c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.603922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5bc279a6-360e-46e5-a3f1-c28c7a6e0f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b6a4444c3948c8ac05da2282ba57c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.608246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719f0ea-38de-43db-9b51-118634e3d0bb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:59.617629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:13:59.618482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:59.618948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:59.619316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] PATH_INFO: `/v3/projects/ff71f55176d94b55b937fdf89dc10212` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:59.620792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff71f55176d94b55b937fdf89dc10212)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:13:59.623462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:13:59.635354 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3036/6101] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:59 2022] DELETE /identity/v3/users/98b6a4444c3948c8ac05da2282ba57c6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:59.637830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:13:59.638276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:13:59.638619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:13:59.664731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:13:59.667650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:59.680819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:13:59.749743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff71f55176d94b55b937fdf89dc10212', 'request_id': 'req-505d0605-09b7-4249-9f03-814d83532f06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.771855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff71f55176d94b55b937fdf89dc10212', 'request_id': 'req-505d0605-09b7-4249-9f03-814d83532f06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.792419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff71f55176d94b55b937fdf89dc10212', 'request_id': 'req-505d0605-09b7-4249-9f03-814d83532f06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.799726 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3037/6102] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:13:59.832719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] The token cache is being invalidate because project ff71f55176d94b55b937fdf89dc10212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:13:59.835117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.839711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:13:59.850970 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3066/6103] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:13:59 2022] DELETE /identity/v3/projects/ff71f55176d94b55b937fdf89dc10212 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:13:59.853996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:59.854174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:13:59.859283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:59.860494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:13:59.906626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d41d0-f7ae-41be-b158-d84d22bd539c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:13:59.939425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:00.080430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d0605-09b7-4249-9f03-814d83532f06 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:00.104341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:00.105183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:00.105617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:00.106191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:00.108509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:00.129629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:00.130608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:00.130608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:00.130861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] PATH_INFO: `/v3/users/e4688fd3ee104106b35b2599f67e8801` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:00.133093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4688fd3ee104106b35b2599f67e8801)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:00.135280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:00.260131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4688fd3ee104106b35b2599f67e8801'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:00.289614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4688fd3ee104106b35b2599f67e8801'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:00.290437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4688fd3ee104106b35b2599f67e8801'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:00.330208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:00.332596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:00.336726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4688fd3ee104106b35b2599f67e8801'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:00.337485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fc3da6d3-e0eb-4ed6-aeb2-19048d0ec3e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4688fd3ee104106b35b2599f67e8801'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:00.350446 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3067/6104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:00.365858 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3038/6105] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:13:59 2022] DELETE /identity/v3/users/e4688fd3ee104106b35b2599f67e8801 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:01.700403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:01.702076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:01.734003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e9d3f-b35f-45dc-afce-134aa1b5f494 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:01.897430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:01.900692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:01.901927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:01.902218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] PATH_INFO: `/v3/projects/db10eed47fe340eb89f4c23211d30e82` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:01.905215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db10eed47fe340eb89f4c23211d30e82)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:01.908262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:02.056599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db10eed47fe340eb89f4c23211d30e82', 'request_id': 'req-9e1181fb-b0cc-4746-9520-acbf295acfc1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.078099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db10eed47fe340eb89f4c23211d30e82', 'request_id': 'req-9e1181fb-b0cc-4746-9520-acbf295acfc1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.111731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db10eed47fe340eb89f4c23211d30e82', 'request_id': 'req-9e1181fb-b0cc-4746-9520-acbf295acfc1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.150176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] The token cache is being invalidate because project db10eed47fe340eb89f4c23211d30e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:02.150873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.152049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.159878 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3068/6106] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:01 2022] DELETE /identity/v3/projects/db10eed47fe340eb89f4c23211d30e82 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:02.160750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049cd71-3aa1-4b5b-bdd1-6b0aca649e62 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.161225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049cd71-3aa1-4b5b-bdd1-6b0aca649e62 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.161392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049cd71-3aa1-4b5b-bdd1-6b0aca649e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.206295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0049cd71-3aa1-4b5b-bdd1-6b0aca649e62 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:02.220377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0049cd71-3aa1-4b5b-bdd1-6b0aca649e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:02.233305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:02.235956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:02.241946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:02.302467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:02.375254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3039/6107] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:02.383949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.384222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.384516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.402934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1181fb-b0cc-4746-9520-acbf295acfc1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:02.418213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:02.419487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:02.421645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:02.422794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.422794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.425382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] PATH_INFO: `/v3/projects/cd0b460b3929413e86b5f16d76cd00bd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.429852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0b460b3929413e86b5f16d76cd00bd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:02.430044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3040/6108] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:02.433524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:02.435946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:02.447982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd86142-1300-4d90-95d0-4fd62363975e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:02.457664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:02.458381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.458660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.458930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.459584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:02.459885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:02.461493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:02.496698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3041/6109] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:14:02.503654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:02.528480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0b460b3929413e86b5f16d76cd00bd', 'request_id': 'req-92350b7b-702d-4690-9e22-eee2c7f240c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.529089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0f11d-0553-4829-bc34-478d4e94eb15 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:02.537504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0b460b3929413e86b5f16d76cd00bd', 'request_id': 'req-92350b7b-702d-4690-9e22-eee2c7f240c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.545655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0b460b3929413e86b5f16d76cd00bd', 'request_id': 'req-92350b7b-702d-4690-9e22-eee2c7f240c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.571628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] The token cache is being invalidate because project cd0b460b3929413e86b5f16d76cd00bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:02.572265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.573203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-92350b7b-702d-4690-9e22-eee2c7f240c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:02.575490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3069/6110] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:02 2022] DELETE /identity/v3/projects/cd0b460b3929413e86b5f16d76cd00bd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:02.585079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db439-5c94-4a64-8468-3772f4ec103a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.585505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db439-5c94-4a64-8468-3772f4ec103a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.586078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439db439-5c94-4a64-8468-3772f4ec103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.688018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-439db439-5c94-4a64-8468-3772f4ec103a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:02.695536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-439db439-5c94-4a64-8468-3772f4ec103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:02.699344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:02.699993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.700278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.700553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.701199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:02.707570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:02.745310 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3070/6111] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:02.753226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:02.753661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:02.754121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:02.785906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3042/6112] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:02 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:02.787243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:02.791684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:02.839931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:02.841191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:03.058271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf0809-57ea-47f6-9b1a-8e776af0aa22 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.069698 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3071/6113] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:03.075245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.076851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.077707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.082682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.082682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.083424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.085762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.101945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc793caf-33f9-4142-8898-f0e2d0bbdaa6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.119973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.120619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.120907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.121190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.121843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:03.125915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.129976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.149985 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3043/6114] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:02 2022] POST /identity/v3/users => generated 289 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:03.154348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.174806 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3072/6115] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:03.175802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.180978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf700aeb-2ca1-496f-bff4-469ace7a54a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.193197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.194215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.194499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.207929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6838a20-139d-4d3b-ae99-ae8a05ea2543 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.209572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.210537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.212574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.230780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.232902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.235071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.239490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.240358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.243341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.255773 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3044/6116] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:14:03.258156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.287605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902d4e8-731f-4deb-9b98-f7d8ef3405d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.291646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:03.306042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.306682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.306963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.307240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.307894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.309519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.329309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3073/6117] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:03 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:03.331136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.344351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3045/6118] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:03.353138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.371803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:03.387433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a7146-9c98-4d1c-be5c-318826e44e92 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.525493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67822b9b-37e7-4321-98dd-2fe03f29d7af admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.545190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.546994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.548515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.549225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.550090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.558474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.567399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bebc36-bb28-47a7-b03c-d875513dd01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.568407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bebc36-bb28-47a7-b03c-d875513dd01e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.568733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bebc36-bb28-47a7-b03c-d875513dd01e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.569016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bebc36-bb28-47a7-b03c-d875513dd01e admin admin] PATH_INFO: `/v3/projects/39308db60e56458fbcd6a80a92e21254/users/1b52df4896664b1580344f91e6738ebf/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.603411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bebc36-bb28-47a7-b03c-d875513dd01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39308db60e56458fbcd6a80a92e21254, user_id=1b52df4896664b1580344f91e6738ebf, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.611907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bebc36-bb28-47a7-b03c-d875513dd01e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.624493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3074/6119] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:03 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:03.628373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.648360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118d130-c22b-45cb-b79a-cddebf13e7dd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.658872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.660710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.660994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.662435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.663125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.667829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.688196 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3046/6120] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:03 2022] PUT /identity/v3/projects/39308db60e56458fbcd6a80a92e21254/users/1b52df4896664b1580344f91e6738ebf/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:03.710265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fba10-2f9e-4c64-b903-b818d5a44357 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.710265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fba10-2f9e-4c64-b903-b818d5a44357 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.710461 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3075/6121] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:14:03.710541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fba10-2f9e-4c64-b903-b818d5a44357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.710612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.738512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fe977-8489-4ec5-b236-cd85a5b25291 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.786707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ec0fba10-2f9e-4c64-b903-b818d5a44357 None None] MFA Rules not processed for user `1b52df4896664b1580344f91e6738ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:03.788181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec0fba10-2f9e-4c64-b903-b818d5a44357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:03.823999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.825570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.826864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.827165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.827836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.829527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.867002 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3076/6122] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:03.872676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:03.898048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86a4b7-9b49-4bbb-b6be-c03af2b64866 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:03.910850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:03.911675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.911870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.912092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] PATH_INFO: `/v3/projects/7190b463f66d49a2b546728c22dcd58e/users/f3d49d93361e4809be033ddc17a04814/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:03.933725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7190b463f66d49a2b546728c22dcd58e, user_id=f3d49d93361e4809be033ddc17a04814, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:03.940338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:03.958795 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3047/6123] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:03.961905 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3077/6124] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:03 2022] PUT /identity/v3/projects/7190b463f66d49a2b546728c22dcd58e/users/f3d49d93361e4809be033ddc17a04814/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:03.975925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:03.976216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:03.976488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:04.042314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] MFA Rules not processed for user `f3d49d93361e4809be033ddc17a04814`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:04.055546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:04.056693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:04.058645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:04.190720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:04.220541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8e21-6a4c-4f15-bf3b-a0ff10963cea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:04.227216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:04.228728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:04.229075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:04.229453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:04.259334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3048/6125] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:04.264300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:04.271690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:04.403970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:04.405400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0931e9ca-feea-4046-8951-794ba59ea7db None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:04.407177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:04.423669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:04.424385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:04.424727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:04.425069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:04.425877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:04.431784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:04.479900 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3078/6126] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:04.504981 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3049/6127] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:04 2022] POST /identity/v3/projects => generated 385 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:04.506478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:04.523088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:04.562461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa353c73-efb6-44d0-a2cd-0a2144ac9576 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:04.708828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128a2e5-69de-4e1f-9144-42a435d728df admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:04.715861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:04.716645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:04.717081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:04.717457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] PATH_INFO: `/v3/users/1b52df4896664b1580344f91e6738ebf` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:04.719240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b52df4896664b1580344f91e6738ebf)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:04.722088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:04.804986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:04.805624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:04.806449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:04.806449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:04.806819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:04.808773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:04.822039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b52df4896664b1580344f91e6738ebf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:04.850948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b52df4896664b1580344f91e6738ebf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:04.852211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b52df4896664b1580344f91e6738ebf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:04.861913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3079/6128] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:04 2022] POST /identity/v3/users => generated 299 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:04.874919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:04.875183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b52df4896664b1580344f91e6738ebf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:04.876293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34da4bf9-5278-4454-83ee-0b838df9e53a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b52df4896664b1580344f91e6738ebf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:04.876780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:04.898850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda5f7e-a6a4-4365-ab70-bec90d540c4e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:04.908907 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3050/6129] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:04 2022] DELETE /identity/v3/users/1b52df4896664b1580344f91e6738ebf => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:04.913409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:04.914320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:04.914876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:04.949436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:04.952985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:04.967341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:05.044463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.045396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.045853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.046291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.047124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.049085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.071715 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3080/6130] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:05.075769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.079901 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3051/6131] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:05.090959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.094505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:05.096077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379a5b-5f08-4bf2-b926-fbc64bf06164 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.114675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.115678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.116135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.116575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] PATH_INFO: `/v3/projects/764491ff9d364178a589370b8ea8c14c/users/430c78b6b6544e1c85b527f74cc228f2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.147307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764491ff9d364178a589370b8ea8c14c, user_id=430c78b6b6544e1c85b527f74cc228f2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.150512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.162669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:05.176132 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3081/6132] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:05 2022] PUT /identity/v3/projects/764491ff9d364178a589370b8ea8c14c/users/430c78b6b6544e1c85b527f74cc228f2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:05.180820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.238307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4861f-751d-4397-9023-bbcff530fdbe None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.338899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3090f-1b71-4788-9392-1d09f1703fe7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.344659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.345370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.345651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.345948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.367943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.369551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.374201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2f3c5-da05-4cf9-9009-cb7630b6408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.374850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2f3c5-da05-4cf9-9009-cb7630b6408a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.375131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2f3c5-da05-4cf9-9009-cb7630b6408a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.375403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2f3c5-da05-4cf9-9009-cb7630b6408a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.376060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2f3c5-da05-4cf9-9009-cb7630b6408a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.380946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2f3c5-da05-4cf9-9009-cb7630b6408a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.387135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3052/6133] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:05.408738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3082/6134] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:05.413081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.430096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a2a4-9171-413b-9dfa-b827ad5b8685 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.437208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.453158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.454967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.455411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] PATH_INFO: `/v3/projects/764491ff9d364178a589370b8ea8c14c/users/430c78b6b6544e1c85b527f74cc228f2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.465850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=764491ff9d364178a589370b8ea8c14c, user_id=430c78b6b6544e1c85b527f74cc228f2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.468577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.505776 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3053/6135] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:05 2022] PUT /identity/v3/projects/764491ff9d364178a589370b8ea8c14c/users/430c78b6b6544e1c85b527f74cc228f2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:05.517058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.517844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.518505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.582900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] MFA Rules not processed for user `430c78b6b6544e1c85b527f74cc228f2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:05.583313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:05.709610 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3083/6136] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:05.714213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.730197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d5c7b-85c3-4eab-9d3c-6dbfb79c40b1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.743254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.743923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.744214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.744494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.745868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.747556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.795482 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3054/6137] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:05 2022] POST /identity/v3/services => generated 289 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:05.797668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.810216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c181-6d0c-4387-8b34-97b3d70bcf53 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.847599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.848933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.849933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.851075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.853250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.856277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: On instance['enabled']: Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: On instance['enabled']: Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: 'False' Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.875177 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 03:14:05.877180 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Oct 29 03:14:05.878250 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:05.878774 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3084/6138] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:14:05 2022] POST /identity/v3/endpoints => generated 283 bytes in 82 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:14:05.883396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.903117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd364dc-0de2-4376-b2a3-f69ddcc601c7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.920933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.921686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.922097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.922626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.923477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.925453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: On instance['enabled']: Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: On instance['enabled']: Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: 'True' Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise error Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'True' Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.938028 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 03:14:05.940245 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application 'True' Oct 29 03:14:05.941500 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:05.957253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3055/6139] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:14:05 2022] POST /identity/v3/endpoints => generated 281 bytes in 70 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:14:05.958739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:05.974062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc719c-fcde-4f53-8a57-bda540c367a3 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:05.991733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:05.992575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:05.992857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:05.993194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:05.993894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:05.995517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.031448 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-995777340. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:14:06.031448 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:14:06.031448 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:06.087764 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3085/6140] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:14:05 2022] POST /identity/v3/endpoints => generated 359 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:06.089179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.120397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f1234-4bab-49d3-8536-81c74d5f993f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.146587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.147466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.147958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.148306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/regions/tempest-region-995777340` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.149385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-995777340)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.150680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.153251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3056/6141] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 03:14:06 2022] GET /identity/v3/regions/tempest-region-995777340 => generated 178 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:06.157399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.173722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35055668-3a8b-4611-8de9-64901fe1929f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.187088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.188085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.188532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.189047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints/1e4ec101579f4a3792ef691f08707902` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.209617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=1e4ec101579f4a3792ef691f08707902)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.211573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: On instance['enabled']: Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: On instance['enabled']: Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: 'False' Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.220840 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 03:14:06.222530 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'False' Oct 29 03:14:06.223714 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.231276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3086/6142] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Oct 29 03:14:06 2022] PATCH /identity/v3/endpoints/1e4ec101579f4a3792ef691f08707902 => generated 283 bytes in 74 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:14:06.235036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.250480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd4012-26f0-4e05-a432-281dac99b8e7 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.257074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.257890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.258414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.258933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints/1e4ec101579f4a3792ef691f08707902` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.260716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=1e4ec101579f4a3792ef691f08707902)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.262991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.276466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '1e4ec101579f4a3792ef691f08707902', 'request_id': 'req-65cd8c68-cdb5-44a9-8200-b21130082088'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:06.288852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3057/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:06 2022] DELETE /identity/v3/endpoints/1e4ec101579f4a3792ef691f08707902 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:06.293450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.306875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5932fb-afd8-49e7-b576-5584353fac25 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.329206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.331788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.332193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.332795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/regions/tempest-region-995777340` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.334672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-995777340)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.339202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.342476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:06.366360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3087/6144] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:14:06 2022] DELETE /identity/v3/regions/tempest-region-995777340 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:06.374169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.383641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:06.389218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd8c68-cdb5-44a9-8200-b21130082088 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.435942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.436221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.436479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.436879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.437564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.443027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.486930 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1123885424. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:14:06.486930 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:14:06.486930 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:06.570591 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3058/6145] 10.222.0.16 () {60 vars in 1156 bytes} [Sat Oct 29 03:14:06 2022] POST /identity/v3/endpoints => generated 360 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:06.573169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.595427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbe0ec-489c-4d5f-a1b6-eee0a88da0d2 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.645924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.653214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:06.656108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.656768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.657051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.657322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/regions/tempest-region-1123885424` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.658180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1123885424)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.659223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.667340 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3088/6146] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Oct 29 03:14:06 2022] GET /identity/v3/regions/tempest-region-1123885424 => generated 180 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:06.672322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.698518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110b77a-fca3-4bf9-bbba-6a59cc68504f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.713540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.714276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.714560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.714840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints/5417b203a17e4f0ca32077b1ffd1bb8b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.727309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=5417b203a17e4f0ca32077b1ffd1bb8b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.729903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: On instance['enabled']: Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: On instance['enabled']: Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: 'True' Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise error Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'True' Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.737708 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 29 03:14:06.739492 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application On instance['enabled']: Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application 'True' Oct 29 03:14:06.740639 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:06.757245 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3089/6147] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Oct 29 03:14:06 2022] PATCH /identity/v3/endpoints/5417b203a17e4f0ca32077b1ffd1bb8b => generated 281 bytes in 88 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 29 03:14:06.758133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.780379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc4a62-a78e-4d42-871f-42b8aa8949be tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.790547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.791313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.791602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.791877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/endpoints/5417b203a17e4f0ca32077b1ffd1bb8b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.802773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=5417b203a17e4f0ca32077b1ffd1bb8b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.804427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.823701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '5417b203a17e4f0ca32077b1ffd1bb8b', 'request_id': 'req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:06.845036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3090/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:14:06 2022] DELETE /identity/v3/endpoints/5417b203a17e4f0ca32077b1ffd1bb8b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:06.846540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:06.849206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f1d96-82cd-458e-8574-434bc67dd95d tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.871198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.872153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.872290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.872746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] PATH_INFO: `/v3/projects/39308db60e56458fbcd6a80a92e21254` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.874956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39308db60e56458fbcd6a80a92e21254)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.877897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.921437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6fd2-5d19-4d3e-a96b-8d81cb35d28f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:06.939645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:06.940639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:06.941194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:06.941647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/regions/tempest-region-1123885424` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:06.943868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1123885424)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:06.945705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:06.985445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39308db60e56458fbcd6a80a92e21254', 'request_id': 'req-887b96e2-7f6d-4977-8989-7826c81b0685'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:06.996140 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1123885424. To ensure interoperability, identifiers should be a valid uuid. Oct 29 03:14:06.996140 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 29 03:14:06.996140 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:07.007777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39308db60e56458fbcd6a80a92e21254', 'request_id': 'req-887b96e2-7f6d-4977-8989-7826c81b0685'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.026063 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3091/6149] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 03:14:06 2022] DELETE /identity/v3/regions/tempest-region-1123885424 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:07.026490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39308db60e56458fbcd6a80a92e21254', 'request_id': 'req-887b96e2-7f6d-4977-8989-7826c81b0685'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.031074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:07.051334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] The token cache is being invalidate because project 39308db60e56458fbcd6a80a92e21254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:07.051646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.063313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-887b96e2-7f6d-4977-8989-7826c81b0685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.065994 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3059/6150] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:06 2022] DELETE /identity/v3/projects/39308db60e56458fbcd6a80a92e21254 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:07.071890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6124e-c357-4485-8382-d9cd5152ae5c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.072272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6124e-c357-4485-8382-d9cd5152ae5c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.072873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6124e-c357-4485-8382-d9cd5152ae5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.085237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074500c5-737f-4989-87f4-73160808b6c8 tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:07.135217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-72c6124e-c357-4485-8382-d9cd5152ae5c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:07.136450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72c6124e-c357-4485-8382-d9cd5152ae5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:07.186520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:07.258668 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3060/6151] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3373 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:07.268095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.268707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.269084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.282373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '430c78b6b6544e1c85b527f74cc228f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '764491ff9d364178a589370b8ea8c14c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:07.282971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.283403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.283876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] PATH_INFO: `/v3/services/ba7651d678464833adab4607c1cd6ffb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.284571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ba7651d678464833adab4607c1cd6ffb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:07.286238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:07.343697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3092/6152] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:07 2022] DELETE /identity/v3/services/ba7651d678464833adab4607c1cd6ffb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:07.350457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:07.357014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:07.358309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:07.368380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:07.417504 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3061/6153] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:07.421937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:07.435034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f39f45-0acc-42a4-b3e4-ad2319d4ae6f tempest-EndpointsNegativeTestJSON-892928208 tempest-EndpointsNegativeTestJSON-892928208-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:07.446757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:07.447430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.447769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.447904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] PATH_INFO: `/v3/users/f3d49d93361e4809be033ddc17a04814` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.453479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad25a1-fab4-40aa-9481-a3f9cc553ed1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:07.453821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d49d93361e4809be033ddc17a04814)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:07.454769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:07.462361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:07.463008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.463293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.463563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.467794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:07.467794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:07.467794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:07.516161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3062/6154] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:07.517312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:07.544767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70e2c6-5943-4acd-8d41-fca58122aae2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:07.566153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:07.567409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.567409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.570322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.570473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:07.572200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:07.577095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:07.597980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d49d93361e4809be033ddc17a04814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.622656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d49d93361e4809be033ddc17a04814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.623489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d49d93361e4809be033ddc17a04814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.640843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d49d93361e4809be033ddc17a04814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.642477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b49996db-3acd-472f-9696-af79b4c61364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d49d93361e4809be033ddc17a04814'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:07.653399 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3063/6155] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:07 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:07.660280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:07.670184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:07.701398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3093/6156] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:07 2022] DELETE /identity/v3/users/f3d49d93361e4809be033ddc17a04814 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:07.706657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:07.706939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:07.707214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:07.759734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:07.762767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:07.850571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9185c528-ca48-4271-adeb-52a0d63d872f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:07.907844 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3094/6157] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:07.931019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:07.934352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:08.049942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:08.052443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.054133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.057348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.058350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:08.060937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:08.125868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3064/6158] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:07 2022] POST /identity/v3/users => generated 291 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:08.131570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:08.153338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea96f-4aed-4bb7-8dab-00713ee6c9d8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:08.157058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243cb60-7394-46c4-a660-46df24aa10da admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:08.158858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:08.159728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.160217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.160658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.172233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:08.173059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.173490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.173898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.174664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:08.176664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:08.181310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:08.185651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:08.189718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:08.209358 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3095/6159] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:08.214279 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3065/6160] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:08.215552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:08.227843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbd47-e274-44c1-987d-4f9c3711aede service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:08.233839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2be59a0-d7e5-442d-be7d-e5d258b9f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:08.236852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be59a0-d7e5-442d-be7d-e5d258b9f279 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.237590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be59a0-d7e5-442d-be7d-e5d258b9f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.238083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2be59a0-d7e5-442d-be7d-e5d258b9f279 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.238931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be59a0-d7e5-442d-be7d-e5d258b9f279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:08.241032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2be59a0-d7e5-442d-be7d-e5d258b9f279 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:08.259548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:08.278453 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3096/6161] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:08.285163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d152c9f-1d12-4140-892c-02db10aeca1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:08.300271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:08.301379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.301848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.302531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] PATH_INFO: `/v3/projects/b35f8f3f480544858c18a92d3fc924e5/users/620180eeccbb42e4aa788c8a5f369f04/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.342920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35f8f3f480544858c18a92d3fc924e5, user_id=620180eeccbb42e4aa788c8a5f369f04, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:08.349078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:08.400685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3066/6162] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:08 2022] PUT /identity/v3/projects/b35f8f3f480544858c18a92d3fc924e5/users/620180eeccbb42e4aa788c8a5f369f04/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:08.401606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.401918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.402193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.449917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] MFA Rules not processed for user `620180eeccbb42e4aa788c8a5f369f04`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:08.451159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:08.493351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:08.602348 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3097/6163] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:08.607815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:08.797006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205c086-db4e-4dfe-baa0-5c84d0d4ed0b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:08.805282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:08.806164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:08.806545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:08.806916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:08.807697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:08.809791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:08.877716 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3067/6164] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:08 2022] POST /identity/v3/projects => generated 381 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:08.881546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:08.909261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95920e53-e0d4-41cd-adb1-ed0449deaf53 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:09.048992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:09.050168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.050690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.051207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.052185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:09.060314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:09.112642 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3098/6165] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:08 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:09.116345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:09.135776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236835c0-f0bd-4957-8796-56c9af544a25 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:09.148102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:09.148921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.149428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.149991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.150896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:09.153957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:09.186098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3068/6166] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:09.190595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:09.208167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c1f35-e404-428b-9c0e-dd091bb03df1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:09.219568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:09.223817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.224498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.225003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] PATH_INFO: `/v3/projects/f2bae5aad7264c37900cd415d5ab11df/users/60e9dd5841134145960e0bcb012a4d59/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.266132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bae5aad7264c37900cd415d5ab11df, user_id=60e9dd5841134145960e0bcb012a4d59, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:09.270277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:09.299976 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3099/6167] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:09 2022] PUT /identity/v3/projects/f2bae5aad7264c37900cd415d5ab11df/users/60e9dd5841134145960e0bcb012a4d59/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:09.303859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:09.322728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b72ef3-1c15-4666-9e56-e5e25040b7d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:09.490969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb3513-078a-42de-a651-8ff70d203f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:09.491705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3513-078a-42de-a651-8ff70d203f84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.491988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3513-078a-42de-a651-8ff70d203f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.492779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb3513-078a-42de-a651-8ff70d203f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.493428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb3513-078a-42de-a651-8ff70d203f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:09.498057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb3513-078a-42de-a651-8ff70d203f84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:09.519967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3069/6168] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:09.524284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:09.539139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c9d89-4b6c-4843-ad28-a66e0b2ee0e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:09.551265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:09.552239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.552597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.552940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] PATH_INFO: `/v3/projects/f2bae5aad7264c37900cd415d5ab11df/users/60e9dd5841134145960e0bcb012a4d59/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.558723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2bae5aad7264c37900cd415d5ab11df, user_id=60e9dd5841134145960e0bcb012a4d59, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:09.561275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:09.594020 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3100/6169] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:09 2022] PUT /identity/v3/projects/f2bae5aad7264c37900cd415d5ab11df/users/60e9dd5841134145960e0bcb012a4d59/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:09.606187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.606550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.606889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.655156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] MFA Rules not processed for user `60e9dd5841134145960e0bcb012a4d59`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:09.656647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:09.720002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:09.801982 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3070/6170] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:09 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:09.815241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:09.818875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:09.972956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5f3909-8098-42a1-8ce5-aa41534b8f76 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:09.976996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:09.977834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:09.978234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:09.978613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:09.990355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:09.992770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:10.018284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3101/6171] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:09 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:10.135208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:10.152169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46e96c-5314-4c66-88f2-d7579b5e7902 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:10.157869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:10.159293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:10.159737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:10.161950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:10.286197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:10.288957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:10.319192 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3071/6172] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:10.329114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:10.331564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:10.364114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:10.534818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ec821-6810-44a4-bd60-d5432bfb325e service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:10.540624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:10.546948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:10.548578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:10.550765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:10.551081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:10.551362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] PATH_INFO: `/v3/users/0691f33a4e2a46c3bd5bf774bc001f35` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:10.552993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=0691f33a4e2a46c3bd5bf774bc001f35)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:10.561770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:10.592660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963a7d2-cf54-4d85-9e85-a752ffb3b0bd service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:10.616793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:10.617872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:10.619314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:10.619655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] PATH_INFO: `/v3/projects/7190b463f66d49a2b546728c22dcd58e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:10.624271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7190b463f66d49a2b546728c22dcd58e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:10.628522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:10.667649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0691f33a4e2a46c3bd5bf774bc001f35'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.691156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0691f33a4e2a46c3bd5bf774bc001f35'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.692933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0691f33a4e2a46c3bd5bf774bc001f35'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.724171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0691f33a4e2a46c3bd5bf774bc001f35'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.726489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-636b299c-c9ea-4d46-82bb-5563aade60ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0691f33a4e2a46c3bd5bf774bc001f35'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.795317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7190b463f66d49a2b546728c22dcd58e', 'request_id': 'req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.803953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3102/6173] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:10 2022] DELETE /identity/v3/users/0691f33a4e2a46c3bd5bf774bc001f35 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:10.808204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:10.809326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:10.811410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:10.831488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7190b463f66d49a2b546728c22dcd58e', 'request_id': 'req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.841625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:10.843058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:10.845683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7190b463f66d49a2b546728c22dcd58e', 'request_id': 'req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.878898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] The token cache is being invalidate because project 7190b463f66d49a2b546728c22dcd58e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:10.879914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.881122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:10.885016 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3072/6174] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:10 2022] DELETE /identity/v3/projects/7190b463f66d49a2b546728c22dcd58e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:10.890387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:10.894365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:11.044277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3103/6175] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:11.063774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:11.065745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:11.091733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:11.135560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ffae1-5ad8-4475-9ad0-a97b2f877248 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:11.166530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:11.168345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:11.168781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:11.169512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] PATH_INFO: `/v3/users/430c78b6b6544e1c85b527f74cc228f2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:11.173782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=430c78b6b6544e1c85b527f74cc228f2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:11.176918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:11.180843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:11.264610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef87a0d-ca6c-46c0-b28a-2d9cd6d6f5a8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:11.274095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:11.275644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:11.291475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:11.291773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:11.306755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:11.307244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '430c78b6b6544e1c85b527f74cc228f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:11.308617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:11.321206 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3104/6176] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:11.341483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '430c78b6b6544e1c85b527f74cc228f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:11.344579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '430c78b6b6544e1c85b527f74cc228f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:11.366615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '430c78b6b6544e1c85b527f74cc228f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:11.368047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '430c78b6b6544e1c85b527f74cc228f2'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:11.390058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3073/6177] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:10 2022] DELETE /identity/v3/users/430c78b6b6544e1c85b527f74cc228f2 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:12.017951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.020105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:12.022139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.024821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:12.047057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd742c-c20b-4350-af8b-fd762c44adb9 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:12.178065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c610c8-289c-40c3-a112-3168d7172b10 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:12.191655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:12.192242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.193293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.193586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] PATH_INFO: `/v3/projects/764491ff9d364178a589370b8ea8c14c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.195196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764491ff9d364178a589370b8ea8c14c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:12.197135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:12.204927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:12.205632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.206418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.206694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] PATH_INFO: `/v3/projects/176f7e43a06e4a7f970b062faef5f3de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.208228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] RBAC: Authorizing `identity:delete_project(project_id=176f7e43a06e4a7f970b062faef5f3de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:12.211912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:12.292913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764491ff9d364178a589370b8ea8c14c', 'request_id': 'req-220125f0-ced0-4f75-960f-44a977ede404'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.319403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764491ff9d364178a589370b8ea8c14c', 'request_id': 'req-220125f0-ced0-4f75-960f-44a977ede404'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.331623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764491ff9d364178a589370b8ea8c14c', 'request_id': 'req-220125f0-ced0-4f75-960f-44a977ede404'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.352978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176f7e43a06e4a7f970b062faef5f3de', 'request_id': 'req-7185dc3a-9a6a-4a6c-8b88-cd2192070902'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.354223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] The token cache is being invalidate because project 764491ff9d364178a589370b8ea8c14c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:12.354825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.355671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-220125f0-ced0-4f75-960f-44a977ede404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.366126 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3074/6178] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:12 2022] DELETE /identity/v3/projects/764491ff9d364178a589370b8ea8c14c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:12.371223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176f7e43a06e4a7f970b062faef5f3de', 'request_id': 'req-7185dc3a-9a6a-4a6c-8b88-cd2192070902'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.371586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d6bf6-f32c-4c05-b254-3883406b6995 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.372057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d6bf6-f32c-4c05-b254-3883406b6995 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.372525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d6bf6-f32c-4c05-b254-3883406b6995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.384115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:12.386914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176f7e43a06e4a7f970b062faef5f3de', 'request_id': 'req-7185dc3a-9a6a-4a6c-8b88-cd2192070902'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.410030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cd7d6bf6-f32c-4c05-b254-3883406b6995 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:12.412029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cd7d6bf6-f32c-4c05-b254-3883406b6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:12.412384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] The token cache is being invalidate because project 176f7e43a06e4a7f970b062faef5f3de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:12.412859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.414488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7185dc3a-9a6a-4a6c-8b88-cd2192070902 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:12.417760 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3105/6179] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:12 2022] DELETE /identity/v3/projects/176f7e43a06e4a7f970b062faef5f3de => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:12.423478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3bfec-ec08-4fa7-be41-368d7051b420 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.424001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3bfec-ec08-4fa7-be41-368d7051b420 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.424393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3bfec-ec08-4fa7-be41-368d7051b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.475401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a4f3bfec-ec08-4fa7-be41-368d7051b420 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:12.479998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4f3bfec-ec08-4fa7-be41-368d7051b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:12.548627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3075/6180] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:12.553560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.553925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.554163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.588251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:12.589911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:12.605662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3076/6181] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:12.607412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.619190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf092e-8a98-40be-a215-7bf989bdf63a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:12.628403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:12.629533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.645829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3106/6182] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:12.647395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.647918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.650486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:12.651082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.652327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:12.653616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.654372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.660769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:12.679648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:12.711858 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3077/6183] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:12.717669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.730253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:12.745605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:12.764936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40c379-44a0-4cec-b919-2f35d2a56bac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:12.775274 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3107/6184] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:12.781203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.786310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:12.790575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.790979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.791357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.795596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:12.803803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:12.820831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5befe1-a949-40c2-a16b-6666f43909b6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:12.837641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:12.841505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:12.842645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:12.844343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:12.845426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:12.847748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:12.850628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:12.881524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3108/6185] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:12.886530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.898619 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3078/6186] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/projects => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:12.899610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:12.908448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb7079-79e6-42ee-a9ac-0361230d29d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.059358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cb3bf-70de-443c-a0f3-0533f20e7880 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.068359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.068999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.069273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.069542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.070207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.072526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.105000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.108802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.110916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.112659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.119571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.120033 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3079/6187] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/users => generated 284 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:13.121112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.125107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.133857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59dbaf-1a2d-49de-b3c4-da298cd42674 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.139702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.140870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.141559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.142056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.142992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.144935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.158903 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3080/6188] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:13.167530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.181511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6de400-a89e-4ff4-8f81-fd94c89a2bd7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.188428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.189744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.190242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.190688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.191580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.193489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.200872 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3109/6189] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:12 2022] POST /identity/v3/projects => generated 383 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:13.205258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.211953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3081/6190] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:13.216827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.228693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca03cd-3e99-4413-93a7-6a27e42bbab4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.263997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:13.309035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5d18-0ed6-4a4c-974b-0b5003d18e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.310074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d18-0ed6-4a4c-974b-0b5003d18e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.310504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d18-0ed6-4a4c-974b-0b5003d18e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.310956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d18-0ed6-4a4c-974b-0b5003d18e9f admin admin] PATH_INFO: `/v3/projects/263f92fe50884620bf558f64c830db26/users/c9895fc5c6344e3983fe258ef6689600/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.332758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5d18-0ed6-4a4c-974b-0b5003d18e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=263f92fe50884620bf558f64c830db26, user_id=c9895fc5c6344e3983fe258ef6689600, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.336366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf5d18-0ed6-4a4c-974b-0b5003d18e9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.347934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53134c4d-6b86-43fd-a735-96bee16463c7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.354949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.355865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.356405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.356835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.357653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.361234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.388785 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3082/6191] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:13 2022] PUT /identity/v3/projects/263f92fe50884620bf558f64c830db26/users/c9895fc5c6344e3983fe258ef6689600/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:13.393774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.394377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.394685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.404241 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3110/6192] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:13 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:13.410925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.434973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd919f4-b8d6-4981-8d01-6410028a58d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.474216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] MFA Rules not processed for user `c9895fc5c6344e3983fe258ef6689600`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:13.475475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:13.575308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.576418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.577078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.577713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.581648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.586090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.589389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:13.609038 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3083/6193] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:13.617398 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3111/6194] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:13.617592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.619339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.631752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c8a02-9796-4a1e-bb02-4ec4317f0db8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.637412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.638434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.638926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.639416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.640341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.642887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.650069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04b802-8c99-4085-9594-021d0684adf9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.665747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3112/6195] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:13.667648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.679053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.679844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.680039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.680295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.680918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.683468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efceb2-e901-4396-abc7-5b32aab5438a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:13.685286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.698142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15463-eacb-469e-a4b3-809a7a5b634f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:13.699275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15463-eacb-469e-a4b3-809a7a5b634f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.699765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15463-eacb-469e-a4b3-809a7a5b634f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.707167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15463-eacb-469e-a4b3-809a7a5b634f admin admin] PATH_INFO: `/v3/projects/fb3eab610a9c47ffb7d01c95088e2e1c/users/1eb7ae55614a4fb6bd90c93422fdaec7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.751451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15463-eacb-469e-a4b3-809a7a5b634f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3eab610a9c47ffb7d01c95088e2e1c, user_id=1eb7ae55614a4fb6bd90c93422fdaec7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:13.752021 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3084/6196] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:13 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:13.753147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:13.763043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15463-eacb-469e-a4b3-809a7a5b634f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:13.797276 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3113/6197] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:13 2022] PUT /identity/v3/projects/fb3eab610a9c47ffb7d01c95088e2e1c/users/1eb7ae55614a4fb6bd90c93422fdaec7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:13.814317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:13.814815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:13.815877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:13.897141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] MFA Rules not processed for user `1eb7ae55614a4fb6bd90c93422fdaec7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:13.898420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:13.953983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cfc283-367f-400a-b02f-91b95ef08e36 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.027055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:14.102609 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3114/6198] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:14.113971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.116624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:14.126700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.127345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.127628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.127898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.128537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.130530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.177766 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3085/6199] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:13 2022] POST /identity/v3/users => generated 289 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:14.182238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.216107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee30c5-2279-4c5c-865b-3f785539c9b2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.233581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.234246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.234550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.234797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.235465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.237209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.260824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d597550-c9dd-443d-aaac-963f93d65a70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.267268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.267915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.268189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.268460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.272558 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3086/6200] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:14.276427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.284475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.286144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.305292 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3115/6201] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:14.310387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41a09-8b41-45a0-8fba-5d07b116855a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.318418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.319200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.319445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.319764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] PATH_INFO: `/v3/projects/25e0a36c232648b58f93a8aab83168ef/users/1e062e59a6014718a7b02573d7f3ee7e/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.350228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e0a36c232648b58f93a8aab83168ef, user_id=1e062e59a6014718a7b02573d7f3ee7e, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.353169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.376562 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3087/6202] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:14 2022] PUT /identity/v3/projects/25e0a36c232648b58f93a8aab83168ef/users/1e062e59a6014718a7b02573d7f3ee7e/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:14.377583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.389536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078b76-8f15-4104-b275-eb72ca34e177 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.481629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:14.507061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddb64d-5222-4f02-8dec-859f45de43ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.507713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb64d-5222-4f02-8dec-859f45de43ac admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.507994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb64d-5222-4f02-8dec-859f45de43ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.508268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddb64d-5222-4f02-8dec-859f45de43ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.508926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddb64d-5222-4f02-8dec-859f45de43ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.511095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddb64d-5222-4f02-8dec-859f45de43ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.549860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.550619 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3116/6203] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:14.575728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa3f06-6071-4657-bba9-24a6569cf627 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.585761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.591433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.591792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.592355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] PATH_INFO: `/v3/projects/25e0a36c232648b58f93a8aab83168ef/users/1e062e59a6014718a7b02573d7f3ee7e/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.594394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e0a36c232648b58f93a8aab83168ef, user_id=1e062e59a6014718a7b02573d7f3ee7e, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.597833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.629731 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3088/6204] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:14 2022] PUT /identity/v3/projects/25e0a36c232648b58f93a8aab83168ef/users/1e062e59a6014718a7b02573d7f3ee7e/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:14.641125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.641419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.641696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.697477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] MFA Rules not processed for user `1e062e59a6014718a7b02573d7f3ee7e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:14.699662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:14.851535 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3117/6205] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:14.854622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.868264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc22f7-2b8b-4a35-bac4-5b0529d119c1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.873076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.873700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.874019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.874292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.874971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.876765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:14.901847 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3089/6206] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:14 2022] POST /identity/v3/roles => generated 235 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:14.905786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:14.928251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428e74-000f-4f1c-a513-8aa04e205b71 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:14.935126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:14.935767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:14.936239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:14.936915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:14.937753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:14.976295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.012861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3118/6207] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:14 2022] POST /identity/v3/roles => generated 234 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:15.016519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.027518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe77e61-ab9f-419b-8547-e86f914d8e01 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.044360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.045009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.045293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.045567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.046282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.047903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.081649 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3090/6208] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/roles => generated 234 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:15.086208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.103996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a010f7-c350-4290-9acf-4198defd9388 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.118878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.121687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.122116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.122808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.123793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.129575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.182034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3119/6209] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/domains => generated 277 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:15.182916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.198257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057d441-aa89-4669-b881-87d41febbf79 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.364914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.365551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.365850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.367869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.368611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.375897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.469440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.483673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c45f0d-a0de-4d36-9cd3-f19e55b73bbb tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.486617 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3091/6210] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/projects => generated 400 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:15.635048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.635482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.636028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.636306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.636953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.639009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.674092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.681374 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3120/6211] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/groups => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:15.691572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639802b4-fe66-4124-bb6c-83abf4aa905c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.703766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.704489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.704770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.705061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.705768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.709837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.746888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.755209 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3092/6212] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/roles => generated 234 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:15.760539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a35c7-b503-4f1b-9763-23e343c37ae6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.771195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.771953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.772234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.772828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.777020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.783185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.837404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.844558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:15.869185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7050b73-ee90-42ee-a8c4-f23467376c72 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.871559 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3121/6213] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/users => generated 442 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:15.877688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.878415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.878723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.880116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:15.880813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:15.881904 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:15.881904 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:15.881904 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:15.882829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:15.906091 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3093/6214] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:15 2022] POST /identity/v3/roles => generated 270 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:15.910411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:15.952396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80038c-2470-47b2-84c1-3b96c19178b2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:15.970581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:15.971428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:15.971814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:15.972196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/a71e2a18d9f148a2b28c8fee1fc32315` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:16.007801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=a71e2a18d9f148a2b28c8fee1fc32315)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:16.013314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:16.035912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:16.052452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:16.053308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3122/6215] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:15 2022] PUT /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/a71e2a18d9f148a2b28c8fee1fc32315 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:16.066317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6fdce-205e-4e9a-8452-1cad4f663fe6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:16.143829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:16.153231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:16.153770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:16.154218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:16.155575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Adding query filter params (scope.project.id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user.id=8bc5f746c0bb473b8bb5c75208ee0fd3) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:16.156069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:16.160909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:16.326360 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3094/6216] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:14:16 2022] GET /identity/v3/role_assignments?scope.project.id=3ebf4fc3d79e4bdda1d92ad8c90b8454&user.id=8bc5f746c0bb473b8bb5c75208ee0fd3&effective => generated 228 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:16.330515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:16.360306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55404356-5ca4-4812-9c7a-f3014004aadf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:16.371850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:16.372761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:16.374752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:16.375181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/a71e2a18d9f148a2b28c8fee1fc32315` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:16.386474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=a71e2a18d9f148a2b28c8fee1fc32315)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:16.390060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:16.408071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role a71e2a18d9f148a2b28c8fee1fc32315 was removed from user 8bc5f746c0bb473b8bb5c75208ee0fd3 on project 3ebf4fc3d79e4bdda1d92ad8c90b8454. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:16.409038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:16.409875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:16.433738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3123/6217] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:14:16 2022] DELETE /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/a71e2a18d9f148a2b28c8fee1fc32315 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:16.440881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:16.442816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:16.472527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e71d00-09d0-4f85-add6-5c9b30be8601 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:16.642408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:16.643086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:16.643356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:16.643629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/a71e2a18d9f148a2b28c8fee1fc32315` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:16.649680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a71e2a18d9f148a2b28c8fee1fc32315)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:16.651309 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:16.651309 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:16.651309 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:16.652598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:16.752372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role a71e2a18d9f148a2b28c8fee1fc32315 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:16.752722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:16.754701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:16.758231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3095/6218] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:16 2022] DELETE /identity/v3/roles/a71e2a18d9f148a2b28c8fee1fc32315 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:16.765532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:16.782412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543e02-d947-4812-9ac7-d9d9d5737f78 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:16.912333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:16.912333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:16.912333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:16.912874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/e6cad79f6e034f3dad13d7c6d02232b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:16.920136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=e6cad79f6e034f3dad13d7c6d02232b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:16.924020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:16.958133 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3124/6219] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:16 2022] PUT /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/e6cad79f6e034f3dad13d7c6d02232b0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:16.959307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:16.960776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:16.985965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4839e2b9-9e9a-4b4a-a3e8-35af8b67f873 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:17.008965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:17.169234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:17.172331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:17.172504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:17.172780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:17.176678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:17.179369 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:17.179369 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:17.179369 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:17.182933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:17.252128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3096/6220] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:16 2022] PUT /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 520 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:17.256356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:17.270843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f00bb9b-be03-4a97-81db-ea42e43a2c0a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:17.420331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:17.423193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:17.425176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:17.425467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:17.426264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Adding query filter params (scope.project.id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user.id=8bc5f746c0bb473b8bb5c75208ee0fd3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:17.432222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:17.438739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:17.632467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3125/6221] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:14:17 2022] GET /identity/v3/role_assignments?scope.project.id=3ebf4fc3d79e4bdda1d92ad8c90b8454&user.id=8bc5f746c0bb473b8bb5c75208ee0fd3&effective => generated 1061 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:17.636590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:17.660567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffad28-655a-424f-854f-e3fbbde03200 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:17.667184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:17.667403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:17.667691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:17.667974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:17.670658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:17.673396 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:17.673396 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:17.673396 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:17.674546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:17.697429 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3097/6222] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:17 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:17.702483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:17.729106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45570dac-af24-492e-923d-576eb5cd3e7f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:17.834130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:17.937223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:17.938013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:17.938484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:17.938944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:17.940106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Adding query filter params (scope.project.id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user.id=8bc5f746c0bb473b8bb5c75208ee0fd3) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:17.940656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:17.942668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.101386 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3126/6223] 10.222.0.16 () {58 vars in 1356 bytes} [Sat Oct 29 03:14:17 2022] GET /identity/v3/role_assignments?scope.project.id=3ebf4fc3d79e4bdda1d92ad8c90b8454&user.id=8bc5f746c0bb473b8bb5c75208ee0fd3&effective => generated 577 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:18.107976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:18.137724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bee405-aba0-4335-a961-d0e43aefd1ff tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:18.160853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:18.161790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:18.162184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:18.163416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:18.167117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:18.184885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708.: keystone.exception.ImpliedRoleNotFound: e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708. Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = query.one() Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._iter().one() Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._only_one_row( Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:18.226389 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 29 03:14:18.227501 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 29 03:14:18.228437 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 29 03:14:18.228437 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 29 03:14:18.228437 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 29 03:14:18.228437 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708. Oct 29 03:14:18.228437 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:18.230068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3098/6224] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:18 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 137 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:14:18.232244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:18.253109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1c8f2-65b1-4941-ad21-5f69428f2a8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:18.270972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:18.271819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:18.272167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:18.272521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/e6cad79f6e034f3dad13d7c6d02232b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:18.279563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=e6cad79f6e034f3dad13d7c6d02232b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:18.282332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.291189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role e6cad79f6e034f3dad13d7c6d02232b0 was removed from user 8bc5f746c0bb473b8bb5c75208ee0fd3 on project 3ebf4fc3d79e4bdda1d92ad8c90b8454. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:18.292281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:18.294067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:18.322299 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3127/6225] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:14:18 2022] DELETE /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/e6cad79f6e034f3dad13d7c6d02232b0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:18.323818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:18.325689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:18.356085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa51c-23f5-4e60-a10f-139b039e907e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:18.495947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:18.496644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:18.496933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:18.497418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:18.497912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:18.500359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.531175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3099/6226] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:18 2022] POST /identity/v3/roles => generated 270 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:18.537780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:18.569360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faee37a-1374-4d7f-8922-e07573e6eaac tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:18.581697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:18.582957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:18.583451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:18.583924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:18.584869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Adding query filter params (domain_id=f140d623098848ba85808b4acc47c86c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:18.585392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:18.586985 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:18.586985 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:18.586985 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:18.589344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.605867 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3128/6227] 10.222.0.16 () {58 vars in 1207 bytes} [Sat Oct 29 03:14:18 2022] GET /identity/v3/roles?domain_id=f140d623098848ba85808b4acc47c86c => generated 407 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:18.606041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:18.625733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d70a63-0433-4466-9694-dbf9b0158d5c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:18.633053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:18.633720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:18.634046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:18.634332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/a083fee1b4014b3cbfd222b191561989` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:18.636325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=a083fee1b4014b3cbfd222b191561989)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:18.639144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.718157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role a083fee1b4014b3cbfd222b191561989 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:18.718853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:18.720602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:18.724543 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3100/6228] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:18 2022] DELETE /identity/v3/roles/a083fee1b4014b3cbfd222b191561989 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:18.730666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:18.736302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:18.817301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6beb53b-0500-43ab-9314-72545646015e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:18.946434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:18.947441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:18.947945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:18.948381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:18.949982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Adding query filter params (domain_id=f140d623098848ba85808b4acc47c86c) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:18.952438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:18.956899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:18.983686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3129/6229] 10.222.0.16 () {58 vars in 1207 bytes} [Sat Oct 29 03:14:18 2022] GET /identity/v3/roles?domain_id=f140d623098848ba85808b4acc47c86c => generated 148 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:18.989833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:19.006026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45feb70-910a-4526-842b-869048ec9300 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:19.022602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:19.023704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:19.026656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:19.027691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/a083fee1b4014b3cbfd222b191561989` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:19.099523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Could not find role: a083fee1b4014b3cbfd222b191561989.: keystone.exception.RoleNotFound: Could not find role: a083fee1b4014b3cbfd222b191561989. Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 29 03:14:19.133323 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:14:19.134264 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: a083fee1b4014b3cbfd222b191561989. Oct 29 03:14:19.135191 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:19.150597 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3101/6230] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:18 2022] DELETE /identity/v3/roles/a083fee1b4014b3cbfd222b191561989 => generated 110 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:14:19.156766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:19.172498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7cb17f-cd56-4840-b9e4-4d4394864ca8 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:19.198636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:19.199332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:19.199619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:19.199901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:19.215921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f140d623098848ba85808b4acc47c86c, group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:19.218753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:19.251538 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3130/6231] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:19 2022] PUT /identity/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:19.256069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:19.274192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618022-0323-43e3-8f1f-73ff3d2f1b74 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:19.340951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:19.577330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:19.581444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:19.584899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:19.585473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:19.587549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f140d623098848ba85808b4acc47c86c, group_id=6593ab1e8e2a437d8751cfdf3afc50e1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:19.590864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:19.620209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:19.665166 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3102/6232] 10.222.0.16 () {58 vars in 1365 bytes} [Sat Oct 29 03:14:19 2022] GET /identity/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles => generated 409 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:19.682127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f6b6f-263f-4955-9fb8-c2134485bf6e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:19.709280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:19.710092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:19.710768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:19.711968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:19.718749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f140d623098848ba85808b4acc47c86c, group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:19.724705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:19.745765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3131/6233] 10.222.0.16 () {58 vars in 1465 bytes} [Sat Oct 29 03:14:19 2022] HEAD /identity/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:19.750927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:19.770680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77311405-e248-4e38-bca9-b9cb20b0b2aa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:19.795393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:19.796435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:19.796913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:19.797423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:19.805486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f140d623098848ba85808b4acc47c86c, group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:19.809249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:19.828301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role d8788dd22a99423ab70e8133b66461b0 was removed from group 6593ab1e8e2a437d8751cfdf3afc50e1 on domain f140d623098848ba85808b4acc47c86c. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:19.828823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:19.831559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:19.883462 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3103/6234] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:14:19 2022] DELETE /identity/v3/domains/f140d623098848ba85808b4acc47c86c/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:19.886436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:19.888347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:19.918283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769294b7-300e-4185-916f-ed3986fdedbf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:20.011793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:20.077579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:20.077579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:20.077579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:20.078022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:20.080430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:20.092303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:20.124252 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3132/6235] 10.222.0.16 () {60 vars in 1486 bytes} [Sat Oct 29 03:14:19 2022] PUT /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:20.128562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:20.147561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a884219-6f8b-47c5-ab7f-e0e133fdc936 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:20.321509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd879e00-7d71-4fa9-85b0-216816d2610a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:20.322398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879e00-7d71-4fa9-85b0-216816d2610a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:20.322792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879e00-7d71-4fa9-85b0-216816d2610a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:20.323171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879e00-7d71-4fa9-85b0-216816d2610a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:20.326622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd879e00-7d71-4fa9-85b0-216816d2610a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_grants(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, group_id=6593ab1e8e2a437d8751cfdf3afc50e1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:20.334840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd879e00-7d71-4fa9-85b0-216816d2610a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:20.361370 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3104/6236] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Oct 29 03:14:20 2022] GET /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles => generated 410 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:20.365311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:20.378375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c676a-3b5a-4e24-9378-85a2e729856a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:20.394746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:20.395588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:20.395977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:20.396356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/groups/6593ab1e8e2a437d8751cfdf3afc50e1/users/8bc5f746c0bb473b8bb5c75208ee0fd3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:20.404554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:20.406758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:20.451193 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3133/6237] 10.222.0.16 () {60 vars in 1360 bytes} [Sat Oct 29 03:14:20 2022] PUT /identity/v3/groups/6593ab1e8e2a437d8751cfdf3afc50e1/users/8bc5f746c0bb473b8bb5c75208ee0fd3 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:20.457754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:20.458313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:20.458688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:20.541720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] MFA Rules not processed for user `8bc5f746c0bb473b8bb5c75208ee0fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:20.543131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:20.687789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:20.769727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3105/6238] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:20.774208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:20.950673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942de6c3-e7a9-419b-bf3c-95c364b9ce13 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:20.966843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:20.967545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:20.967835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:20.968100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:20.976069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:20.978782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:20.998156 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3134/6239] 10.222.0.16 () {58 vars in 1468 bytes} [Sat Oct 29 03:14:20 2022] HEAD /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.002417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.023835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bc49e-d739-4d43-be78-a3fff9b1b505 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.037030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.037982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.038362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.038737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.043585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.049629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.067272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role d8788dd22a99423ab70e8133b66461b0 was removed from group 6593ab1e8e2a437d8751cfdf3afc50e1 on project 3ebf4fc3d79e4bdda1d92ad8c90b8454. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:21.067759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:21.070529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:21.093727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3106/6240] 10.222.0.16 () {58 vars in 1470 bytes} [Sat Oct 29 03:14:21 2022] DELETE /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.098347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.100243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:21.132102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f865e0-7275-4eb5-ad16-c487835c249a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.262381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.263495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.264024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.264579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/groups/6593ab1e8e2a437d8751cfdf3afc50e1/users/8bc5f746c0bb473b8bb5c75208ee0fd3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.267090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.270646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.287318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '8bc5f746c0bb473b8bb5c75208ee0fd3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:21.310268 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3135/6241] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:14:21 2022] DELETE /identity/v3/groups/6593ab1e8e2a437d8751cfdf3afc50e1/users/8bc5f746c0bb473b8bb5c75208ee0fd3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.315896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.331750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43f249f-82a3-4663-88db-149a45d5b692 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.454306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.456935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.457531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.457833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.461899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.463637 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:21.463637 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:21.463637 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:21.464894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.475879 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3107/6242] 10.222.0.16 () {60 vars in 1381 bytes} [Sat Oct 29 03:14:21 2022] PUT /identity/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.479789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.499478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58734029-c678-4458-a15a-85aaa5f6e9a0 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.528148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.530719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.531681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.534186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.537336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.542449 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:21.542449 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:21.542449 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:21.546961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.584364 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3136/6243] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:14:21 2022] GET /identity/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles => generated 375 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:21.589152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.608850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f573ae-d0ff-47d7-86e8-af6a4228500e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.627401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.628759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.629264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.629847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.644947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.648099 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:21.648099 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:21.648099 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:21.649453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.714723 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3108/6244] 10.222.0.16 () {58 vars in 1363 bytes} [Sat Oct 29 03:14:21 2022] HEAD /identity/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.718765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.734943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ae8b5-3e9c-49ed-b9a6-02beda9edeb7 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.748895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.749573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.749906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.750187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.754646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.755951 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:21.755951 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:21.755951 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:21.756905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.777826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3137/6245] 10.222.0.16 () {58 vars in 1365 bytes} [Sat Oct 29 03:14:21 2022] DELETE /identity/v3/system/groups/6593ab1e8e2a437d8751cfdf3afc50e1/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.778476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.789696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee058a-bf05-4ff3-9432-fdbc552136bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.805359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.806539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.806997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.807538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.813595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f140d623098848ba85808b4acc47c86c, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.819906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:21.849140 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3109/6246] 10.222.0.16 () {60 vars in 1480 bytes} [Sat Oct 29 03:14:21 2022] PUT /identity/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:21.853735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:21.860916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:21.871547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448f56e-fb3c-4dc8-b2d1-22fae171732b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:21.971073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:21.972019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:21.972510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:21.974689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:21.977045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f140d623098848ba85808b4acc47c86c, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:21.979922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.001603 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3138/6247] 10.222.0.16 () {58 vars in 1362 bytes} [Sat Oct 29 03:14:21 2022] GET /identity/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles => generated 408 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:22.002048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.019205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fc772-5273-4a16-9ac2-e4c317d1b1cf tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.033754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:22.034768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:22.035196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:22.035640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:22.043465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f140d623098848ba85808b4acc47c86c, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:22.053485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.077904 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3110/6248] 10.222.0.16 () {58 vars in 1462 bytes} [Sat Oct 29 03:14:22 2022] HEAD /identity/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:22.082538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.096537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0363c8-0003-4219-840b-0521d75f698e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.105651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:22.106260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:22.106555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:22.109671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:22.114007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f140d623098848ba85808b4acc47c86c, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:22.116732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.141875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role d8788dd22a99423ab70e8133b66461b0 was removed from user 8bc5f746c0bb473b8bb5c75208ee0fd3 on domain f140d623098848ba85808b4acc47c86c. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:22.142200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:22.146294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:22.187998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3139/6249] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Oct 29 03:14:22 2022] DELETE /identity/v3/domains/f140d623098848ba85808b4acc47c86c/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:22.189007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.191127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:22.214349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee5661-292b-4c9d-a4c5-58bf425a809f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.412226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:22.412936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:22.413226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:22.413530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:22.415978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:22.418803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.445891 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3111/6250] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:22 2022] PUT /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:22.450325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.471703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ab0a97-29c3-41d3-a4c0-1eea460159fc tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.656596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:22.659992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:22.660417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:22.660759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:22.664995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_grants(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:22.674199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.714467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3140/6251] 10.222.0.16 () {58 vars in 1365 bytes} [Sat Oct 29 03:14:22 2022] GET /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles => generated 409 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:22.715789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.730319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fde91-b94c-4c79-b9fe-0226a7983387 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.751832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:22.752531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:22.752818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:22.753098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:22.763473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:22.766224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.787042 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3112/6252] 10.222.0.16 () {58 vars in 1465 bytes} [Sat Oct 29 03:14:22 2022] HEAD /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:22.793033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.809415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b1bd-1d64-4511-ade3-59a3535ba508 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.815564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:22.816254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:22.816537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:22.816811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:22.819998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454, user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:22.828885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:22.838897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role d8788dd22a99423ab70e8133b66461b0 was removed from user 8bc5f746c0bb473b8bb5c75208ee0fd3 on project 3ebf4fc3d79e4bdda1d92ad8c90b8454. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:22.839791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:22.840681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:22.867474 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3141/6253] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Oct 29 03:14:22 2022] DELETE /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:22.868634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:22.870437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:22.896275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4c024-cdeb-4611-8bfb-cd39ab8c0eba tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:22.916640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:23.029201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.029906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.030194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.030476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.038662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.039746 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:23.039746 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:23.039746 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:23.040623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.054957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3113/6254] 10.222.0.16 () {60 vars in 1378 bytes} [Sat Oct 29 03:14:22 2022] PUT /identity/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:23.064593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.086279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1738ae-9b67-4027-abd0-c525f2dc7f10 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.109643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.110681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.110806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.111021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.112539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=8bc5f746c0bb473b8bb5c75208ee0fd3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.115043 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:23.115043 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:23.115043 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:23.117514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.169767 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3142/6255] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:14:23 2022] GET /identity/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles => generated 374 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:23.174018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.189716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f08528-7110-4a6f-9e84-04c6518b8327 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.202858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.203543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.203832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.204141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.206288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.207486 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:23.207486 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:23.207486 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:23.208717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.223073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3114/6256] 10.222.0.16 () {58 vars in 1360 bytes} [Sat Oct 29 03:14:23 2022] HEAD /identity/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:23.227132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.247033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc7dbf-d3ac-4201-a7fb-0b0b0b94e3f9 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.259942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.260629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.260914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.261191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.264992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=8bc5f746c0bb473b8bb5c75208ee0fd3, role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.270495 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:23.270495 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:23.270495 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:23.270495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.301843 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3143/6257] 10.222.0.16 () {58 vars in 1362 bytes} [Sat Oct 29 03:14:23 2022] DELETE /identity/v3/system/users/8bc5f746c0bb473b8bb5c75208ee0fd3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:23.304376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.328574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2fe12-45a0-45dd-a27c-72128e5996ce tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.338866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.339597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.339952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.340298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.341120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.342805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.394503 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3115/6258] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:23 2022] POST /identity/v3/roles => generated 269 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:23.398919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.417821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37336d-6090-48a1-992c-119a327da698 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.433567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.437234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.437703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.438280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.440337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.442675 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:23.442675 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:23.442675 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:23.446659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.486791 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3144/6259] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:23 2022] POST /identity/v3/roles => generated 269 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:23.488049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.503815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835e2d7-1856-4083-8e29-8cc964fb9d67 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.518360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.519446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.524949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.524949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/dde59227833e4874803b731af412e2d0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.528022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9c50288ca4eb49e1a32ff9211c35710b, implied_role_id=dde59227833e4874803b731af412e2d0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.531962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.630057 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3116/6260] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:23 2022] PUT /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/dde59227833e4874803b731af412e2d0 => generated 529 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:23.631418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.650012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30e51-49d7-4a50-9c93-bfa95d0c01c6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:23.686432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:23.802419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:23.803747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:23.804227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:23.804703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:23.805618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:23.807644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:23.829629 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3145/6261] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:14:23 2022] POST /identity/v3/domains => generated 277 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:23.833763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:23.850469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec7ba4-c83c-4ba0-ba0d-40af5032bc4b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:24.015146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:24.015970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:24.016413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:24.017025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:24.017894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:24.020956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:24.045369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3117/6262] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:23 2022] POST /identity/v3/roles => generated 269 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:24.046647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:24.060845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a0243-6bbd-423f-980a-4292decc859b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:24.077711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:24.078330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:24.078618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:24.078892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/47c8c51068b24d219113669b3f078a63` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:24.082377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9c50288ca4eb49e1a32ff9211c35710b, implied_role_id=47c8c51068b24d219113669b3f078a63)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:24.083422 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:24.083422 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:24.083422 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:24.084337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:24.153980 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3146/6263] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:24 2022] PUT /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/47c8c51068b24d219113669b3f078a63 => generated 529 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:24.155250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:24.173125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a50-a21b-41c1-bd59-d1d228d9ce7c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:24.260241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:24.272987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:24.274085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:24.274527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:24.275008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:24.277225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9c50288ca4eb49e1a32ff9211c35710b, implied_role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:24.279713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:24.338571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3118/6264] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:24 2022] PUT /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/d8788dd22a99423ab70e8133b66461b0 => generated 524 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:24.339585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:24.362084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2186444a-2645-44ce-9d90-66d36f4b78d4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:24.538908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:24.539968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:24.540460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:24.540934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/d8788dd22a99423ab70e8133b66461b0/implies/9c50288ca4eb49e1a32ff9211c35710b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:24.545388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=d8788dd22a99423ab70e8133b66461b0, implied_role_id=9c50288ca4eb49e1a32ff9211c35710b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:24.551122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] 9c50288ca4eb49e1a32ff9211c35710b cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 9c50288ca4eb49e1a32ff9211c35710b cannot be an implied roles. Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 29 03:14:24.610673 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 29 03:14:24.611479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:14:24.611479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:14:24.611479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 29 03:14:24.611479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 29 03:14:24.611479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 9c50288ca4eb49e1a32ff9211c35710b cannot be an implied roles. Oct 29 03:14:24.611479 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:24.615990 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3147/6265] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:24 2022] PUT /identity/v3/roles/d8788dd22a99423ab70e8133b66461b0/implies/9c50288ca4eb49e1a32ff9211c35710b => generated 116 bytes in 277 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Oct 29 03:14:24.616320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:24.630111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99900c48-3967-4377-b7ef-e8b8f0ff2660 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:24.648761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:24.649452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:24.649738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:24.650042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:24.654049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9c50288ca4eb49e1a32ff9211c35710b, implied_role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:24.655754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:24.678054 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3119/6266] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:24 2022] DELETE /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:24.681094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:24.702336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978623f3-b644-4cad-8ed6-892f4bfe58e1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:24.825645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:24.826459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:24.826791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:24.828329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/47c8c51068b24d219113669b3f078a63` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:24.832423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9c50288ca4eb49e1a32ff9211c35710b, implied_role_id=47c8c51068b24d219113669b3f078a63)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:24.833670 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:24.833670 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:24.833670 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:24.837160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:24.861664 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3148/6267] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:24 2022] DELETE /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/47c8c51068b24d219113669b3f078a63 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:24.865477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:24.886102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565c2a4-651e-4668-8ffc-f22a63ac7347 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:25.003723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:25.004582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:25.004972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:25.005362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/47c8c51068b24d219113669b3f078a63` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:25.018366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=47c8c51068b24d219113669b3f078a63)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:25.020162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:25.078382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role 47c8c51068b24d219113669b3f078a63 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:25.080325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.082031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.091868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3120/6268] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:24 2022] DELETE /identity/v3/roles/47c8c51068b24d219113669b3f078a63 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:25.095997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:25.098124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:25.128630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3564-ab70-4d8e-9f03-75c43e57c12f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:25.135638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:25.264979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:25.266303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:25.266828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:25.268306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/380b0795669c402db2fb204be095ea81` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:25.317755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=380b0795669c402db2fb204be095ea81)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:25.319569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:25.386831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '380b0795669c402db2fb204be095ea81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.387597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '380b0795669c402db2fb204be095ea81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.448822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '380b0795669c402db2fb204be095ea81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.449566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '380b0795669c402db2fb204be095ea81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.454152 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3149/6269] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:14:25 2022] PATCH /identity/v3/domains/380b0795669c402db2fb204be095ea81 => generated 278 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:14:25.458058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:25.482433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc144d-9a59-433a-9e18-cc5d5d846e80 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:25.606454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:25.607646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:25.608170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:25.608768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/380b0795669c402db2fb204be095ea81` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:25.636651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=380b0795669c402db2fb204be095ea81)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:25.638750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:25.680991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '380b0795669c402db2fb204be095ea81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.691314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:25.704951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '380b0795669c402db2fb204be095ea81'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.798363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380b0795669c402db2fb204be095ea81', 'request_id': 'req-a6796914-5d1c-4a56-a98e-8d9eace26635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.811314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380b0795669c402db2fb204be095ea81', 'request_id': 'req-a6796914-5d1c-4a56-a98e-8d9eace26635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.843781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380b0795669c402db2fb204be095ea81', 'request_id': 'req-a6796914-5d1c-4a56-a98e-8d9eace26635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.874194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] The token cache is being invalidate because project 380b0795669c402db2fb204be095ea81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:25.876542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.879357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.909282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '380b0795669c402db2fb204be095ea81', 'request_id': 'req-a6796914-5d1c-4a56-a98e-8d9eace26635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.917351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '380b0795669c402db2fb204be095ea81', 'request_id': 'req-a6796914-5d1c-4a56-a98e-8d9eace26635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.918899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '380b0795669c402db2fb204be095ea81', 'request_id': 'req-a6796914-5d1c-4a56-a98e-8d9eace26635'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:25.951817 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3121/6270] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:14:25 2022] DELETE /identity/v3/domains/380b0795669c402db2fb204be095ea81 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:25.956038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:25.957589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:25.980001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e727cee1-5fe1-4846-94a3-6edd42dbaf1e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:26.140328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:26.141270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:26.141593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:26.141896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/dde59227833e4874803b731af412e2d0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:26.166436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9c50288ca4eb49e1a32ff9211c35710b, implied_role_id=dde59227833e4874803b731af412e2d0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:26.168013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:26.184123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3150/6271] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:25 2022] DELETE /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b/implies/dde59227833e4874803b731af412e2d0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:26.188032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:26.190202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:26.214145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6796914-5d1c-4a56-a98e-8d9eace26635 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:26.384250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:26.384923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:26.385212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:26.385491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/dde59227833e4874803b731af412e2d0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:26.388809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=dde59227833e4874803b731af412e2d0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:26.395356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:26.506620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role dde59227833e4874803b731af412e2d0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:26.507083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:26.507649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:26.512705 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3122/6272] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:26 2022] DELETE /identity/v3/roles/dde59227833e4874803b731af412e2d0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:26.514084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:26.515913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:26.550419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67272-36ff-4ad1-a525-cbd462192a8d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:26.754380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:26.755126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:26.755471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:26.755818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/9c50288ca4eb49e1a32ff9211c35710b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:26.757091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9c50288ca4eb49e1a32ff9211c35710b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:26.758243 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:26.758243 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:26.758243 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:26.759242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:26.761994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:26.854759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role 9c50288ca4eb49e1a32ff9211c35710b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:26.855422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:26.856379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:26.859151 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3151/6273] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:26 2022] DELETE /identity/v3/roles/9c50288ca4eb49e1a32ff9211c35710b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:26.865157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:26.884508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cbc35-a819-4ad7-a0f5-97673fdaeec6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:26.987659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:27.048772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.049763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.050334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.050763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.052711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.054728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.092504 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3123/6274] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:26 2022] PUT /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 520 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:27.098431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.100268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:27.124879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8f813-53a6-4971-a6bc-10c60a3c75fd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:27.339670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.340624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.340913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.341198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.344349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.345843 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:27.345843 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:27.345843 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:27.347582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.349284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.350767 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:27.350767 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:27.350767 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:27.352167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.359259 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3152/6275] 10.222.0.16 () {58 vars in 1345 bytes} [Sat Oct 29 03:14:27 2022] HEAD /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:27.363385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.381962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a5076-b16c-4e2d-bb3e-47a9a4582cd6 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:27.394155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.394846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.395126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.395399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.399265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.400221 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:27.400221 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:27.400221 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:27.401549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.428626 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3124/6276] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:14:27 2022] GET /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 520 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:27.432444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.444306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed37659-bf77-41fb-ae83-11c5ea319799 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:27.449890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.450841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.451281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.451719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.454837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.456903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.475245 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3153/6277] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:27 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:27.482312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.507362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59403e3-4ec1-4492-8cfe-ce7de0660710 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:27.706743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.707442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.707913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.708193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.710059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.712331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708.: keystone.exception.ImpliedRoleNotFound: e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708. Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = query.one() Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._iter().one() Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._only_one_row( Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:27.725136 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 29 03:14:27.726704 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 29 03:14:27.727599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 29 03:14:27.727599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708. Oct 29 03:14:27.727599 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:27.735526 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3125/6278] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Oct 29 03:14:27 2022] GET /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 137 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:14:27.736691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.761579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb2b38-ca63-432e-961d-8ef4b1bd9c50 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:27.778088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.778782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.779181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.779490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.781858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.786429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708.: keystone.exception.ImpliedRoleNotFound: e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708. Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = query.one() Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._iter().one() Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._only_one_row( Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:27.815342 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 29 03:14:27.816851 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 29 03:14:27.818071 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 29 03:14:27.818071 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 29 03:14:27.818071 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 29 03:14:27.818071 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: e6cad79f6e034f3dad13d7c6d02232b0 does not imply 8b1a9175c85e43f9b668cdc7bcdc1708. Oct 29 03:14:27.818071 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:14:27.825656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.854866 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3154/6279] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:27 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 137 bytes in 119 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:14:27.862351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab4733-9fea-4a16-a03d-d44d829b9a6d tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:27.886900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:27.888605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:27.889069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:27.889495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:27.893724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:27.900520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:27.960934 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3126/6280] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:27 2022] PUT /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 520 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:27.965450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:27.984144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cbcaa-a6d8-4c45-91d7-4ff719c6d734 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:28.120321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:28.121960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:28.122425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:28.122853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:28.124752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=883facd560ad43598ae5a29d054df7e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:28.126869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:28.175598 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3155/6281] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:27 2022] PUT /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4 => generated 520 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:28.179848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:28.194810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbbd51c-cacb-448c-b2bb-59d5aeb644bd tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:28.346404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:28.347088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:28.348696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:28.349011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:28.352470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=883facd560ad43598ae5a29d054df7e4, implied_role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:28.354497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:28.390549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:28.409417 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3127/6282] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:28 2022] PUT /identity/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0 => generated 519 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:28.411800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:28.428592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8a3fb-84d1-482f-9a9f-9ac6ac2f08d2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:28.517132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:28.604849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:28.605707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:28.605972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:28.606292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:28.606966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:28.608726 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:28.608726 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:28.608726 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:28.609636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:28.640574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:28.643517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:28.670795 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3156/6283] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:14:28 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:28.676365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:28.700991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a463519-4d57-4641-a3bb-b8ef768e529b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:28.716866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:28.717767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:28.719108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:28.719451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:28.724549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=883facd560ad43598ae5a29d054df7e4, implied_role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:28.729535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:28.761053 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3157/6284] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:28 2022] DELETE /identity/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:28.763793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:28.867801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adfe145-fa1a-46ca-8571-6b3b405de410 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:28.973212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028513d-3166-4547-b084-8f06e0aa6615 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:28.988430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:28.989275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:28.989655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:28.991312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:28.999029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=883facd560ad43598ae5a29d054df7e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.001060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.022200 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3158/6285] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:28 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:29.026409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.035961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.036643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.038440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.038750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] PATH_INFO: `/v3/users/620180eeccbb42e4aa788c8a5f369f04` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.041649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620180eeccbb42e4aa788c8a5f369f04)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.048941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.166990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a48574-90be-4d86-9f0c-881fca9077f5 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.178776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.179338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620180eeccbb42e4aa788c8a5f369f04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.179462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.179727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.179997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.187325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.189090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.206161 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3159/6286] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:29 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:29.211364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.212013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620180eeccbb42e4aa788c8a5f369f04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.213626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620180eeccbb42e4aa788c8a5f369f04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.230450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620180eeccbb42e4aa788c8a5f369f04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.232461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-34d2971b-2a74-411c-94e8-0057eaed86b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620180eeccbb42e4aa788c8a5f369f04'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.278290 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3128/6287] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:28 2022] DELETE /identity/v3/users/620180eeccbb42e4aa788c8a5f369f04 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:29.282394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.287062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.287444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.291513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:29.344235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:29.346049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:29.350542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd5c46-9501-46a1-9c58-0f128ec95d9b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.450527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:29.478472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.479109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.479397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.479677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.480330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.482015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.508121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3160/6288] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:29 2022] GET /identity/v3/roles => generated 2321 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:14:29.510001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.514674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:29.553367 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3129/6289] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:29.554681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc7685-8e87-40a6-8c18-bad914f0976e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.567605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.568256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.568538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.568837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.569507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.571164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.600093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.601695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:29.605560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3161/6290] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:14:29 2022] POST /identity/v3/roles => generated 233 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:29.606642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.627573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda45cb-b9cd-4e93-a318-6fd71686b6f1 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.636348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.637015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.637301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.637586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/c7af82e1a386449b95b689df5462975f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.642872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:update_role(role_id=c7af82e1a386449b95b689df5462975f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.643932 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:29.643932 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:29.643932 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:29.645022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.702596 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3162/6291] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Oct 29 03:14:29 2022] PATCH /identity/v3/roles/c7af82e1a386449b95b689df5462975f => generated 237 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:29.703972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.731314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069841-35b1-4dc9-9fbc-9d7435c8797b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.737094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.738054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.738401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.738687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/c7af82e1a386449b95b689df5462975f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.742846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c8e11-bf60-4e7d-bded-fa40fc62cae5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.750562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.751375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.753106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.753492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.756457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:get_role(role_id=c7af82e1a386449b95b689df5462975f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.757517 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:29.757517 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:14:29.757517 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:14:29.758456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.762869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3163/6292] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:14:29 2022] GET /identity/v3/roles/c7af82e1a386449b95b689df5462975f => generated 237 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:14:29.763743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.787988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91750-650b-42dc-8a71-e26da74f9764 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.800802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.801092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.801740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.802054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.802333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.802991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.804609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.808044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.841188 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3164/6293] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:29 2022] GET /identity/v3/roles => generated 2549 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:29.845011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:29.850960 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3130/6294] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:29.873957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842dc40-6b00-4724-b0a8-deaa0b59b48f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:29.890489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:29.891052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:29.891327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:29.891741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/c7af82e1a386449b95b689df5462975f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:29.896093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c7af82e1a386449b95b689df5462975f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:29.897729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:29.974007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role c7af82e1a386449b95b689df5462975f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:29.974308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.975328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:29.987562 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3165/6295] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:29 2022] DELETE /identity/v3/roles/c7af82e1a386449b95b689df5462975f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:29.992712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:30.014728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5637c5a-c91b-4c9d-91aa-352176025c93 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:30.207236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:30.209670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:30.210242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:30.210774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:30.213883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:30.216344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:30.280331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3131/6296] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:29 2022] PUT /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 520 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:30.284112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:30.285751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:30.319372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bee60-a72c-45a8-a17a-99822c6cca7b tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:30.459216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:30.496762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:30.497473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:30.497759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:30.498062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:30.504977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=883facd560ad43598ae5a29d054df7e4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:30.506975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:30.576920 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3166/6297] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:30 2022] PUT /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4 => generated 520 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:30.581039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:30.594429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f23df-64a7-4f99-a096-0f6a29332e6c tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:30.731146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:30.747236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:30.748444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:30.748876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:30.749293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:30.753005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=883facd560ad43598ae5a29d054df7e4, implied_role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:30.756523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:30.789305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:30.791146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:30.819133 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3132/6298] 10.222.0.16 () {60 vars in 1363 bytes} [Sat Oct 29 03:14:30 2022] PUT /identity/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0 => generated 519 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:30.821359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.007478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959d60e-0853-42ae-9130-f4b24f40768a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.067945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d1e49-6c18-4ab8-bd62-653a6cc92ef2 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.088785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.089538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.089760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.094225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/883facd560ad43598ae5a29d054df7e4/implies` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.099382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=883facd560ad43598ae5a29d054df7e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.106434 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:14:31.106434 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:14:31.106434 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:14:31.113469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:31.144435 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3133/6299] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:14:30 2022] GET /identity/v3/roles/883facd560ad43598ae5a29d054df7e4/implies => generated 488 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:31.150660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.151331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.151485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.151683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.152072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] PATH_INFO: `/v3/users/1eb7ae55614a4fb6bd90c93422fdaec7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.162681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb7ae55614a4fb6bd90c93422fdaec7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.164680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:31.185085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581d0e6-f315-44a8-9fad-71331de974c4 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.196839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.197515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.198237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.198237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.205928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.214939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:31.244092 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3134/6300] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:14:31 2022] GET /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies => generated 659 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:31.251731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.268951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb7ae55614a4fb6bd90c93422fdaec7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:31.280883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb7ae55614a4fb6bd90c93422fdaec7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:31.281565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb7ae55614a4fb6bd90c93422fdaec7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:31.294180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb7ae55614a4fb6bd90c93422fdaec7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:31.297307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10931c68-41f4-4eb4-b550-e4f9ea91a044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb7ae55614a4fb6bd90c93422fdaec7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:31.312251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:31.331629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91882a7c-33b3-43cd-9af7-1c18700e4426 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.341301 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3167/6301] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:30 2022] DELETE /identity/v3/users/1eb7ae55614a4fb6bd90c93422fdaec7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:31.346271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.346805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.347242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.358461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.363836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.364072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.364354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.378140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=883facd560ad43598ae5a29d054df7e4, implied_role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.384420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:31.394229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:31.395754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:31.419887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3135/6302] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:31 2022] DELETE /identity/v3/roles/883facd560ad43598ae5a29d054df7e4/implies/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:31.421656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.430470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:31.527415 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3168/6303] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:31.538907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.540375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:31.600688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50471f-ea3c-4580-b9f2-3d9355ea8b26 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.610251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.612979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.616216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.616610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.620300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=883facd560ad43598ae5a29d054df7e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.629888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:31.655053 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3136/6304] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:31 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/883facd560ad43598ae5a29d054df7e4 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:31.660425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.698367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044d4cc-9b3d-47aa-a2e8-5d86b6bfdc19 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.795722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:31.821758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7d77-85ac-4079-865c-d914f12ac27a tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:31.835098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.836286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:31.836731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.836908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:31.837192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.837467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.839204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:31.839900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:31.844239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e6cad79f6e034f3dad13d7c6d02232b0, implied_role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.848849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:31.874625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3137/6305] 10.222.0.16 () {58 vars in 1347 bytes} [Sat Oct 29 03:14:31 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0/implies/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:31.875770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:31.987867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:31.995609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:31.997300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:32.018164 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3169/6306] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:32.019165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:32.027049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:32.050975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa94f80-22e6-49cc-815d-1d5b5a04e7c2 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:32.053284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ba4b6-baa6-4cbe-954a-705480b9dd8f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:32.059403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:32.060008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:32.060376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:32.060718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/380b0795669c402db2fb204be095ea81` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:32.079875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Could not find domain: 380b0795669c402db2fb204be095ea81.: keystone.exception.DomainNotFound: Could not find domain: 380b0795669c402db2fb204be095ea81. Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 380b0795669c402db2fb204be095ea81. Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:14:32.086387 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:14:32.087489 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 380b0795669c402db2fb204be095ea81. Oct 29 03:14:32.090893 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:14:32.092043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3138/6307] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:14:31 2022] PATCH /identity/v3/domains/380b0795669c402db2fb204be095ea81 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:14:32.094597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:32.119576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a88898-06f8-4b5e-9d87-84358c77cc57 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:32.136189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:32.141251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:32.141550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:32.142904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/users/8bc5f746c0bb473b8bb5c75208ee0fd3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:32.143160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_user(user_id=8bc5f746c0bb473b8bb5c75208ee0fd3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:32.145306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:32.172942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:32.173921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:32.174198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:32.174478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] PATH_INFO: `/v3/projects/b35f8f3f480544858c18a92d3fc924e5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:32.186775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35f8f3f480544858c18a92d3fc924e5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:32.189147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:32.290236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc5f746c0bb473b8bb5c75208ee0fd3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.297214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35f8f3f480544858c18a92d3fc924e5', 'request_id': 'req-eea14e19-adab-4240-ae6c-2d6b55c343ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.350224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc5f746c0bb473b8bb5c75208ee0fd3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.351028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc5f746c0bb473b8bb5c75208ee0fd3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.365058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35f8f3f480544858c18a92d3fc924e5', 'request_id': 'req-eea14e19-adab-4240-ae6c-2d6b55c343ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.390897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35f8f3f480544858c18a92d3fc924e5', 'request_id': 'req-eea14e19-adab-4240-ae6c-2d6b55c343ab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.396163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc5f746c0bb473b8bb5c75208ee0fd3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.414457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] The token cache is being invalidate because project b35f8f3f480544858c18a92d3fc924e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:32.415205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.416158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.421355 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3170/6308] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:32 2022] DELETE /identity/v3/projects/b35f8f3f480544858c18a92d3fc924e5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:32.430467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc5f746c0bb473b8bb5c75208ee0fd3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.434281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:32.438756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:32.483235 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3139/6309] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:32 2022] DELETE /identity/v3/users/8bc5f746c0bb473b8bb5c75208ee0fd3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:32.491653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:32.497622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:32.603967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea14e19-adab-4240-ae6c-2d6b55c343ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:32.683287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:32.700697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:32.713466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb453f-7916-4894-afc7-b8f1ad2b6c20 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:32.729105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:32.730881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:32.731810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:32.732491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/d8788dd22a99423ab70e8133b66461b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:32.737117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d8788dd22a99423ab70e8133b66461b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:32.739135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:32.816528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:32.817362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:32.817674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:32.817942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] PATH_INFO: `/v3/users/60e9dd5841134145960e0bcb012a4d59` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:32.820248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role d8788dd22a99423ab70e8133b66461b0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:32.820579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.821890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e9dd5841134145960e0bcb012a4d59)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:32.823001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.827867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:32.850307 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3140/6310] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:32 2022] DELETE /identity/v3/roles/d8788dd22a99423ab70e8133b66461b0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:32.852852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:32.856455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:32.917545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e9dd5841134145960e0bcb012a4d59'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.931611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e9dd5841134145960e0bcb012a4d59'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.932627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e9dd5841134145960e0bcb012a4d59'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.967272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e9dd5841134145960e0bcb012a4d59'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:32.970387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e9dd5841134145960e0bcb012a4d59'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.021385 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3171/6311] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:32 2022] DELETE /identity/v3/users/60e9dd5841134145960e0bcb012a4d59 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:33.023456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:33.025260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:33.050151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56354455-6657-4d4b-8221-d642a689ac99 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:33.181535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb6a5a7-82c6-43b4-87fe-a54f8e3e9355 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:33.196655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:33.197158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:33.202625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.202917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.204855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.205185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/groups/6593ab1e8e2a437d8751cfdf3afc50e1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.206347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.208342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] PATH_INFO: `/v3/projects/fb3eab610a9c47ffb7d01c95088e2e1c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.214787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6593ab1e8e2a437d8751cfdf3afc50e1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:33.214891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3eab610a9c47ffb7d01c95088e2e1c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:33.218047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:33.222937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:33.364311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3172/6312] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:14:33 2022] DELETE /identity/v3/groups/6593ab1e8e2a437d8751cfdf3afc50e1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:33.369695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:33.392694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3eab610a9c47ffb7d01c95088e2e1c', 'request_id': 'req-533fbccd-d990-4ca2-b3d7-6a1a53227e75'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.423603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:33.429316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3eab610a9c47ffb7d01c95088e2e1c', 'request_id': 'req-533fbccd-d990-4ca2-b3d7-6a1a53227e75'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.450222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3eab610a9c47ffb7d01c95088e2e1c', 'request_id': 'req-533fbccd-d990-4ca2-b3d7-6a1a53227e75'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.462237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:33.481302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] The token cache is being invalidate because project fb3eab610a9c47ffb7d01c95088e2e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:33.481906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.484597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-533fbccd-d990-4ca2-b3d7-6a1a53227e75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.488848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3141/6313] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:32 2022] DELETE /identity/v3/projects/fb3eab610a9c47ffb7d01c95088e2e1c => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:33.498263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7af09-87d4-41fd-95fb-259e5c2725ce None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.498650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7af09-87d4-41fd-95fb-259e5c2725ce None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.499854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b7af09-87d4-41fd-95fb-259e5c2725ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.575895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e8b7af09-87d4-41fd-95fb-259e5c2725ce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:33.577180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8b7af09-87d4-41fd-95fb-259e5c2725ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:33.586080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae47749e-8bd1-423a-9d13-d75d4c3cb400 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:33.600549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:33.603035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.603367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.603926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.608297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3ebf4fc3d79e4bdda1d92ad8c90b8454)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:33.612707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:33.708536 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3142/6314] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:33.716490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.717740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.718109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.723761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ebf4fc3d79e4bdda1d92ad8c90b8454', 'request_id': 'req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.738559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ebf4fc3d79e4bdda1d92ad8c90b8454', 'request_id': 'req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.753425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ebf4fc3d79e4bdda1d92ad8c90b8454', 'request_id': 'req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.773095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:33.776703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:33.781865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] The token cache is being invalidate because project 3ebf4fc3d79e4bdda1d92ad8c90b8454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:33.783014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.784942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:33.788424 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3173/6315] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:33 2022] DELETE /identity/v3/projects/3ebf4fc3d79e4bdda1d92ad8c90b8454 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:33.793312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:33.797094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:33.929496 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3143/6316] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:33.934832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:33.956311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f642b-5eac-481a-b6f6-ebbba9ae1441 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:33.957787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbe7d3-0361-429f-9460-60528aebed7c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:33.968602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:33.972340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.972744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:33.973067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.974058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.974817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:33.975057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:33.975436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:33.976466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:33.976679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:33.978632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f140d623098848ba85808b4acc47c86c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:33.979749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:33.981457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:34.012331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3144/6317] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:34.014264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:34.027187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f140d623098848ba85808b4acc47c86c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.028422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f140d623098848ba85808b4acc47c86c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.041339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f341485-df34-45e0-87ea-bf82fa46ef93 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:34.060987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f140d623098848ba85808b4acc47c86c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.062082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f140d623098848ba85808b4acc47c86c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.064845 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3174/6318] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:14:33 2022] PATCH /identity/v3/domains/f140d623098848ba85808b4acc47c86c => generated 278 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:34.068533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:34.070542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:34.081892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:34.200022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825b464-548f-4e0b-a517-6f0dfd01b69f tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:34.200970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:34.201692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.205150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.209092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.209092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:34.218890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:34.219836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.220299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.220727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/domains/f140d623098848ba85808b4acc47c86c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.221321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:34.234340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f140d623098848ba85808b4acc47c86c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:34.237317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:34.284971 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3145/6319] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:34 2022] POST /identity/v3/projects => generated 373 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:34.286553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:34.287083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f140d623098848ba85808b4acc47c86c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.290477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:34.305283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:34.314443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f140d623098848ba85808b4acc47c86c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.397278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f140d623098848ba85808b4acc47c86c', 'request_id': 'req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.410582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f140d623098848ba85808b4acc47c86c', 'request_id': 'req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.420061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d5f43-aba1-492b-a67c-b92bbfad95fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:34.429751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f140d623098848ba85808b4acc47c86c', 'request_id': 'req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.451704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] The token cache is being invalidate because project f140d623098848ba85808b4acc47c86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:34.451898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.452537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.473438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f140d623098848ba85808b4acc47c86c', 'request_id': 'req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.474247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f140d623098848ba85808b4acc47c86c', 'request_id': 'req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.484177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f140d623098848ba85808b4acc47c86c', 'request_id': 'req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.502517 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3175/6320] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:14:34 2022] DELETE /identity/v3/domains/f140d623098848ba85808b4acc47c86c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:34.515487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:34.520673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:34.522887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:34.523613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.524026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.524396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] PATH_INFO: `/v3/projects/f2bae5aad7264c37900cd415d5ab11df` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.526685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2bae5aad7264c37900cd415d5ab11df)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:34.530407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:34.579434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a6dfc-7b2f-44ca-8e11-8f8f59db6c18 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:34.589282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdaa76-4eae-4633-aee2-7b1795df6b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:34.590569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdaa76-4eae-4633-aee2-7b1795df6b08 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.592267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdaa76-4eae-4633-aee2-7b1795df6b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.593696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdaa76-4eae-4633-aee2-7b1795df6b08 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.593696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdaa76-4eae-4633-aee2-7b1795df6b08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:34.601939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdaa76-4eae-4633-aee2-7b1795df6b08 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:34.608257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2bae5aad7264c37900cd415d5ab11df', 'request_id': 'req-cec0d31b-d70d-4fcc-aae2-4c122ac13470'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.618355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2bae5aad7264c37900cd415d5ab11df', 'request_id': 'req-cec0d31b-d70d-4fcc-aae2-4c122ac13470'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.626395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2bae5aad7264c37900cd415d5ab11df', 'request_id': 'req-cec0d31b-d70d-4fcc-aae2-4c122ac13470'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.644588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] The token cache is being invalidate because project f2bae5aad7264c37900cd415d5ab11df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:34.645347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.646259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.648048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3146/6321] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:34 2022] DELETE /identity/v3/projects/f2bae5aad7264c37900cd415d5ab11df => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:34.649341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:34.652247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:34.661450 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3176/6322] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:34 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:34.661450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.661450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.661450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.715611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:34.716869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:34.741878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:34.773313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:34.786483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0d31b-d70d-4fcc-aae2-4c122ac13470 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:34.799617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:34.801462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.801861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.803000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/883facd560ad43598ae5a29d054df7e4` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.806641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_role(role_id=883facd560ad43598ae5a29d054df7e4)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:34.808274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:34.864637 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3177/6323] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:34.867969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:34.871988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:34.884845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role 883facd560ad43598ae5a29d054df7e4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:34.885172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.887571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a016a20f-5442-4e69-874d-14ff8b6f8afa tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:34.895330 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3147/6324] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:34 2022] DELETE /identity/v3/roles/883facd560ad43598ae5a29d054df7e4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:34.897344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:34.897647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:34.900688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c74e3-fa40-4ccb-9a98-6b096c94c8a7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:34.900845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:34.943644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:34.946394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.015318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.015960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.016251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.016589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.017303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.019061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.032241 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3178/6325] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:34 2022] GET /identity/v3/roles => generated 1871 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:35.034305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.036701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.066407 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3148/6326] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:35.070856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.074837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.118276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b797ab2-956a-4282-b9b2-332b343f382e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.133207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.136579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.136865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.137143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.137825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.146885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.193562 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3149/6327] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:35 2022] GET /identity/v3/roles => generated 1871 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:35.195296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.211929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180bab-82f3-42c8-8fe5-5f27bdc59007 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.212538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272eb5e-db98-440b-a416-8e879533296e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.224718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.225455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.225587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.225836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.226119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/8b1a9175c85e43f9b668cdc7bcdc1708` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.226437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.226807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.227086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.227738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:35.228041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.229648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.229935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8b1a9175c85e43f9b668cdc7bcdc1708)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.231693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.269106 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3150/6328] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:35.269988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.290454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad3773-a9bc-4136-a556-e9af07eac25d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.308294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.309147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.309304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.309515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] PATH_INFO: `/v3/projects/1696097f0bd140c4895adbc4ac18224d/users/f49c7e81b2ba4b5f913af33e3bad2776/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.334061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role 8b1a9175c85e43f9b668cdc7bcdc1708 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:35.335740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.336653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.341045 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3179/6329] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:35 2022] DELETE /identity/v3/roles/8b1a9175c85e43f9b668cdc7bcdc1708 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:35.342314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.346875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.363376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1696097f0bd140c4895adbc4ac18224d, user_id=f49c7e81b2ba4b5f913af33e3bad2776, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.368265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.394278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3151/6330] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:35 2022] PUT /identity/v3/projects/1696097f0bd140c4895adbc4ac18224d/users/f49c7e81b2ba4b5f913af33e3bad2776/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:35.395270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.397790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.413615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:35.468620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdffc6-522d-4fba-b33d-3196844df996 tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.490200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb65d1-7fc1-4791-bbc6-923a78ea80ad admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.496167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e062e59a6014718a7b02573d7f3ee7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25e0a36c232648b58f93a8aab83168ef', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.496971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.497255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.497527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] PATH_INFO: `/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.499001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e6cad79f6e034f3dad13d7c6d02232b0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.501100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.507935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:35.570936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invalidating the token cache because role e6cad79f6e034f3dad13d7c6d02232b0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:35.570936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.570936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5ba48de3-ede2-4aec-a90d-4c0eb97ce47e tempest-RolesV3TestJSON-735735809 tempest-RolesV3TestJSON-735735809-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.572458 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3152/6331] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:35 2022] DELETE /identity/v3/roles/e6cad79f6e034f3dad13d7c6d02232b0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:35.575133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.575480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.575754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.598351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.599002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.599276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.599544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.601528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.607387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.653369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] MFA Rules not processed for user `f49c7e81b2ba4b5f913af33e3bad2776`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:35.655313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.678983 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3180/6332] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:35 2022] POST /identity/v3/projects => generated 381 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:35.678983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.682808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.751460 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3153/6333] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:35.752499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.764693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.823933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f6f4c-6810-423b-af52-f4c7f81b53f0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.837224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.838151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.838770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.839085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] PATH_INFO: `/v3/users/c9895fc5c6344e3983fe258ef6689600` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.841415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9895fc5c6344e3983fe258ef6689600)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.846569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.901760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d733e5d-3486-4154-966c-31a2ea2f9cb6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:35.907595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:35.908578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:35.909072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:35.909565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:35.910456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:35.913294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:35.937242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9895fc5c6344e3983fe258ef6689600'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.944014 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3154/6334] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:35 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:35.945603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:35.948014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:35.953113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9895fc5c6344e3983fe258ef6689600'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.955387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9895fc5c6344e3983fe258ef6689600'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.972121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9895fc5c6344e3983fe258ef6689600'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.974753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9895fc5c6344e3983fe258ef6689600'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:35.976403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:36.017686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:36.028787 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3181/6335] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:35 2022] DELETE /identity/v3/users/c9895fc5c6344e3983fe258ef6689600 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:36.030037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:36.035457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:36.041225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f7321-6964-4721-917a-7b2d486fce20 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.117327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.118595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.119369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.119810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.121871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:36.161094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d2cc4-9d7c-4ac6-8ce1-1f43ed6738f0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.174553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b17b1a-fc37-4597-813c-ca9a855a104a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.175188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17b1a-fc37-4597-813c-ca9a855a104a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.175462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17b1a-fc37-4597-813c-ca9a855a104a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.175875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b17b1a-fc37-4597-813c-ca9a855a104a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.176529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17b1a-fc37-4597-813c-ca9a855a104a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.178183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b17b1a-fc37-4597-813c-ca9a855a104a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:36.201348 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3182/6336] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:36.205458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.205690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.206015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.265730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:36.273299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:36.277923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.280516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:36.300765 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3183/6337] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:36.304151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:36.319449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c8fe0-992a-456c-b1e8-82bd9af350ea None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.326843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3155/6338] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:36.327715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:36.333071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.333926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.334377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.335482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.336288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.343662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:36.347403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:36.366387 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3184/6339] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:36.370982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:36.380521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e28f8-3d3b-4d4d-a705-b186707427f9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.392840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e35df-542b-476c-bdcf-186ee6c54749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.393494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e35df-542b-476c-bdcf-186ee6c54749 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.393775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e35df-542b-476c-bdcf-186ee6c54749 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.394081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e35df-542b-476c-bdcf-186ee6c54749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.397496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea8573-ca01-4c4a-bd19-b1fd3bde2c51 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.407727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e35df-542b-476c-bdcf-186ee6c54749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.409163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e35df-542b-476c-bdcf-186ee6c54749 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:36.413848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.414444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.414724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.414997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] PATH_INFO: `/v3/projects/031bc33561de49d5b64b196e78944a73/users/fa565a7e2cc64c36b938376d39002476/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.435764 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3156/6340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:36.437121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] RBAC: Authorizing `identity:create_grant(project_id=031bc33561de49d5b64b196e78944a73, user_id=fa565a7e2cc64c36b938376d39002476, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.439938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:36.468616 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3185/6341] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:36 2022] PUT /identity/v3/projects/031bc33561de49d5b64b196e78944a73/users/fa565a7e2cc64c36b938376d39002476/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:36.480993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.481312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.481551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.562774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] MFA Rules not processed for user `fa565a7e2cc64c36b938376d39002476`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:36.563994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:36.668200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:36.668822 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3157/6342] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:36.783181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b352d58-a43f-4726-a85e-0be5ccf9084d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.788351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.788989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.789392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.789676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.790360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.792306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:36.831983 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3186/6343] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:36 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:36.838196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:36.859441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c11f45-adff-48c6-bb24-16eb356643c2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:36.902295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:36.983738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:36.984653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:36.985880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:36.986893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:36.987688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:36.989891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:37.030946 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3158/6344] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:36 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:37.034751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.054209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a0881-355f-4293-bbfe-7f378f3eda4f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.066572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.067294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.067786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.068059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.068817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:37.071268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:37.103919 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3187/6345] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:37.107612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.121870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b59a6-611d-46a3-9c8e-ec4aaba8d999 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.135296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.136246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.136529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.136831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] PATH_INFO: `/v3/projects/54ab1016a7bd4c2db6c453884212d6c9/users/917acf08674f4db98905f47fe566b310/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.160412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab1016a7bd4c2db6c453884212d6c9, user_id=917acf08674f4db98905f47fe566b310, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:37.164298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:37.172307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.174303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:37.194229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230dcf9-290e-4cd0-bb27-1a929bf486e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.205791 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3159/6346] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:37 2022] PUT /identity/v3/projects/54ab1016a7bd4c2db6c453884212d6c9/users/917acf08674f4db98905f47fe566b310/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:37.209953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.213644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:37.371366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.372040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.372313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.372582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] PATH_INFO: `/v3/projects/263f92fe50884620bf558f64c830db26` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.381396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263f92fe50884620bf558f64c830db26)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:37.383383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:37.407807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966a04a-8a17-41db-a628-3da26a4b0f32 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.424705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.425345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.425624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.425918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.426561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:37.428192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:37.451468 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3160/6347] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:37 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:37.458328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.477071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20185-be13-431e-a460-c37d3c2eb0c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.493160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039dbba8-b254-4705-a328-f18937fc9b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.493886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dbba8-b254-4705-a328-f18937fc9b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.494169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dbba8-b254-4705-a328-f18937fc9b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.494444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039dbba8-b254-4705-a328-f18937fc9b42 admin admin] PATH_INFO: `/v3/projects/54ab1016a7bd4c2db6c453884212d6c9/users/917acf08674f4db98905f47fe566b310/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.497963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dbba8-b254-4705-a328-f18937fc9b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ab1016a7bd4c2db6c453884212d6c9, user_id=917acf08674f4db98905f47fe566b310, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:37.502163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039dbba8-b254-4705-a328-f18937fc9b42 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:37.541069 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3161/6348] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:37 2022] PUT /identity/v3/projects/54ab1016a7bd4c2db6c453884212d6c9/users/917acf08674f4db98905f47fe566b310/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:37.543665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.544048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.544242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.546716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263f92fe50884620bf558f64c830db26', 'request_id': 'req-cfe57b24-9b7c-4b14-9067-b575c750bbf6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:37.564365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263f92fe50884620bf558f64c830db26', 'request_id': 'req-cfe57b24-9b7c-4b14-9067-b575c750bbf6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:37.583556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263f92fe50884620bf558f64c830db26', 'request_id': 'req-cfe57b24-9b7c-4b14-9067-b575c750bbf6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:37.601833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] The token cache is being invalidate because project 263f92fe50884620bf558f64c830db26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:37.602497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:37.603402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:37.606614 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3188/6349] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:37 2022] DELETE /identity/v3/projects/263f92fe50884620bf558f64c830db26 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:37.610666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.612585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:37.615365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] MFA Rules not processed for user `917acf08674f4db98905f47fe566b310`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:37.616609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:37.776868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:37.781417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe57b24-9b7c-4b14-9067-b575c750bbf6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.785495 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3162/6350] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:37.798770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:37.801547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:37.907411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012184c-1d85-4d61-840c-22531dd2c9cd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:37.910919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:37.914288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.915719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.915980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.916465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.921334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:37.943559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:37.944326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:37.944609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:37.947235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] PATH_INFO: `/v3/users/1e062e59a6014718a7b02573d7f3ee7e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:37.948468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e062e59a6014718a7b02573d7f3ee7e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:37.950459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:38.060865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e062e59a6014718a7b02573d7f3ee7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.081328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e062e59a6014718a7b02573d7f3ee7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.082070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e062e59a6014718a7b02573d7f3ee7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.086324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:38.088153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:38.098254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e062e59a6014718a7b02573d7f3ee7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.100023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f5136173-2f11-4618-97e3-3b84177de69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e062e59a6014718a7b02573d7f3ee7e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.111040 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3163/6351] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:38.111881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:38.113819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:38.140603 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3189/6352] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:37 2022] DELETE /identity/v3/users/1e062e59a6014718a7b02573d7f3ee7e => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:38.144405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf3bbd-846b-4072-818d-f7d6fdf6d0f8 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:38.254352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:38.255099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:38.256677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:38.256677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] PATH_INFO: `/v3/users/f49c7e81b2ba4b5f913af33e3bad2776` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:38.257756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49c7e81b2ba4b5f913af33e3bad2776)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:38.260233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:38.382567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49c7e81b2ba4b5f913af33e3bad2776'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.399229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:38.418418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49c7e81b2ba4b5f913af33e3bad2776'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.420849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49c7e81b2ba4b5f913af33e3bad2776'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.463011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49c7e81b2ba4b5f913af33e3bad2776'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.465012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49c7e81b2ba4b5f913af33e3bad2776'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:38.541324 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3164/6353] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:38 2022] DELETE /identity/v3/users/f49c7e81b2ba4b5f913af33e3bad2776 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:38.561597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:38.562186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:38.562413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:38.587508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:38.589088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:38.716416 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3190/6354] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:38.729497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:38.730927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:38.854255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396ed9d-1419-46c9-b6ba-4235601ee955 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:38.861029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:38.861679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:38.861994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:38.862268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:38.885366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:38.886814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:38.911168 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3165/6355] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:39.327166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:39.328944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:39.376012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708ace-4213-4319-97b6-7bcea7b2d9bd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:39.383930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:39.385044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.385420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.385864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] PATH_INFO: `/v3/projects/25e0a36c232648b58f93a8aab83168ef` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.387313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e0a36c232648b58f93a8aab83168ef)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:39.389511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:39.484232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:39.487252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:39.488105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:39.502473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e0a36c232648b58f93a8aab83168ef', 'request_id': 'req-ba42a59a-1438-4718-953e-ba90cd71b647'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.513888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e0a36c232648b58f93a8aab83168ef', 'request_id': 'req-ba42a59a-1438-4718-953e-ba90cd71b647'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.521674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ce87b-21ab-404f-a2b0-bd184904e93b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:39.526922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e0a36c232648b58f93a8aab83168ef', 'request_id': 'req-ba42a59a-1438-4718-953e-ba90cd71b647'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.545874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] The token cache is being invalidate because project 25e0a36c232648b58f93a8aab83168ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:39.546281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.546992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ba42a59a-1438-4718-953e-ba90cd71b647 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.552126 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3191/6356] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:39 2022] DELETE /identity/v3/projects/25e0a36c232648b58f93a8aab83168ef => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:39.558948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc9826-bb45-4233-aca7-fb5e5375b9d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.559388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc9826-bb45-4233-aca7-fb5e5375b9d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.559771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc9826-bb45-4233-aca7-fb5e5375b9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.586635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-52cc9826-bb45-4233-aca7-fb5e5375b9d2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:39.588326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52cc9826-bb45-4233-aca7-fb5e5375b9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:39.664450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:39.665555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.665704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.665950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] PATH_INFO: `/v3/projects/1696097f0bd140c4895adbc4ac18224d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.667146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1696097f0bd140c4895adbc4ac18224d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:39.669320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:39.698059 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3192/6357] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:39.704870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.705364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.705912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.747559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:39.748928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:39.757556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1696097f0bd140c4895adbc4ac18224d', 'request_id': 'req-d889d853-9727-4c2d-9dc0-86d767923be6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.765537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1696097f0bd140c4895adbc4ac18224d', 'request_id': 'req-d889d853-9727-4c2d-9dc0-86d767923be6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.772240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1696097f0bd140c4895adbc4ac18224d', 'request_id': 'req-d889d853-9727-4c2d-9dc0-86d767923be6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.790383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] The token cache is being invalidate because project 1696097f0bd140c4895adbc4ac18224d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:39.790687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.791520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d889d853-9727-4c2d-9dc0-86d767923be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:39.796649 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3166/6358] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:39 2022] DELETE /identity/v3/projects/1696097f0bd140c4895adbc4ac18224d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:39.798402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7101e-9bf5-487a-b570-dacb67586b9b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.798674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7101e-9bf5-487a-b570-dacb67586b9b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.799100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7101e-9bf5-487a-b570-dacb67586b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.811010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:39.846637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-82e7101e-9bf5-487a-b570-dacb67586b9b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:39.848873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82e7101e-9bf5-487a-b570-dacb67586b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:39.897841 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3193/6359] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:39.903083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:39.923063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc9f3-b338-4b05-a436-99d27d1cc33f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:39.928735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:39.929367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.929648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.930071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.930791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:39.931930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:39.933742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:39.961922 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3167/6360] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:39.964255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.964801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.965413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.968412 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3194/6361] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:14:39.971940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:39.988188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01a3a3-440d-46ab-87c6-3da42f62b289 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:39.993942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:39.995252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:39.995548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:39.995802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:39.996599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:39.998675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.008134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:40.010887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:40.029569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3168/6362] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:40.030835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.049175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e168e3-04a9-43ab-b686-cb93b3f3dfc4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.061037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.061452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.061716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.062104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.062725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:40.063070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.064891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.083645 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3169/6363] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:40.086698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.118221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3195/6364] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:39 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:40.119157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.145828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b1a14-6615-42ab-b1ea-3a79094dcd5e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.208870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:40.257071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.258504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.258942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.259313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.260353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.262778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.277733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e94b-c901-4aa4-b612-2548761f4981 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.295026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.301696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.302279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.303765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.305467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.309749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.317313 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3170/6365] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:40 2022] POST /identity/v3/projects => generated 383 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:40.321826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.362090 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3196/6366] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:40 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:40.364011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.380811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed941ad4-755e-4d44-a906-f06c7b71b34a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.456365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177911d-629e-4aab-9d82-cf839eee5082 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.464151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.464855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.465249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.465585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.466272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.468359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.488325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.489369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.489747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.491241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.493794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:40.495217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.497768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.503645 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3171/6367] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:40 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:40.508546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.514030 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3197/6368] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:14:40.518480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.521314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0dede-9122-47d1-aec6-63a69baca2e9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.527462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.528306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.528730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.529169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.529997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.531983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.534485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621cba6-e96b-4709-be6e-470d83a2ad24 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.541445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.542370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.542794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.543212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] PATH_INFO: `/v3/projects/d4cc123c596842feb9176db93af77cfa/users/de9baf5e91854dcfbb586a6bdec416d1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.552494 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3172/6369] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:40.555606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.571039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b954af-b922-46d8-bd33-ed4bb58277e0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.575311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4cc123c596842feb9176db93af77cfa, user_id=de9baf5e91854dcfbb586a6bdec416d1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.578000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.578709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.579259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.579799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.580133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.580624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.582436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.598326 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3173/6370] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:40.603568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.604349 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3198/6371] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:40 2022] PUT /identity/v3/projects/d4cc123c596842feb9176db93af77cfa/users/de9baf5e91854dcfbb586a6bdec416d1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:40.605826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.616537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b945d12-cc85-4580-8281-e63e29064a27 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.719723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff05cc-e05f-4122-99ca-a66316ef332a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.724375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300b47d-350d-4380-9e29-ae45cd07111b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.726019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b47d-350d-4380-9e29-ae45cd07111b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.726302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b47d-350d-4380-9e29-ae45cd07111b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.726578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300b47d-350d-4380-9e29-ae45cd07111b admin admin] PATH_INFO: `/v3/projects/fe75175f875b4a97b3d9d03fd917bf1a/users/897c97d833444a29ae8460a9335ac925/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.734483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.735329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.735787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.737260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.738118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.741544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.767663 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3199/6372] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:40.774442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:40.781942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300b47d-350d-4380-9e29-ae45cd07111b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe75175f875b4a97b3d9d03fd917bf1a, user_id=897c97d833444a29ae8460a9335ac925, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.785252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300b47d-350d-4380-9e29-ae45cd07111b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.795167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372c8ef-4499-43c7-b1a5-b095207a269f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:40.801121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a3b142-22df-4adf-9d26-037fb3049051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:40.801975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b142-22df-4adf-9d26-037fb3049051 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.802349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b142-22df-4adf-9d26-037fb3049051 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.802885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3b142-22df-4adf-9d26-037fb3049051 admin admin] PATH_INFO: `/v3/projects/d4cc123c596842feb9176db93af77cfa/users/de9baf5e91854dcfbb586a6bdec416d1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.805071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3b142-22df-4adf-9d26-037fb3049051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4cc123c596842feb9176db93af77cfa, user_id=de9baf5e91854dcfbb586a6bdec416d1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:40.808852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a3b142-22df-4adf-9d26-037fb3049051 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:40.819503 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3174/6373] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:40 2022] PUT /identity/v3/projects/fe75175f875b4a97b3d9d03fd917bf1a/users/897c97d833444a29ae8460a9335ac925/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:40.827740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.828217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.828844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:40.845996 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3200/6374] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:40 2022] PUT /identity/v3/projects/d4cc123c596842feb9176db93af77cfa/users/de9baf5e91854dcfbb586a6bdec416d1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:40.959436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] MFA Rules not processed for user `897c97d833444a29ae8460a9335ac925`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:40.960694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:40.960815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:40.961320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:40.961789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:41.087973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] MFA Rules not processed for user `de9baf5e91854dcfbb586a6bdec416d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:41.089406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:41.113924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:41.235225 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3175/6375] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:41.236502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:41.374433 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3201/6376] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:41.377545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:41.400874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:41.458951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7734e3f-317e-403c-a2d8-58416afa5933 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:41.477614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:41.478325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:41.479902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:41.480182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:41.483265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:41.489644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:41.560647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d294a5-e8e5-41ea-84c9-3be20c9b7d7f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:41.569453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:41.570558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:41.571082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:41.571582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:41.572488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:41.575238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:41.582026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3176/6377] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:41 2022] POST /identity/v3/projects => generated 383 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:41.591885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:41.662511 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3202/6378] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:41 2022] POST /identity/v3/projects => generated 381 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:41.667055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:41.853108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97c4af-3b14-4969-8657-4ab085619164 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:41.867489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:41.868424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:41.870492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:41.870884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:41.871635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:41.875386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:41.878621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05767e63-cd22-4602-b0f4-c397ea74dee8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:41.895364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:41.896862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:41.897326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:41.898901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:41.899761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:41.906124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:41.930117 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3177/6379] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:41 2022] POST /identity/v3/users => generated 298 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:41.931213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:41.956467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c733b-8877-41e7-914e-7549bedcd1f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:41.971474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:41.975246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:41.975246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:41.975246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:41.975246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:41.977008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3203/6380] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:41 2022] POST /identity/v3/users => generated 291 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:41.981664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:41.982019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.018009 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3178/6381] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:42.019563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.025981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f4f73-5547-46b5-8942-44e0982af5e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:42.043391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0d4ba-20d6-4fd4-9caa-d9bdac6b2839 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:42.046612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:42.047994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.048867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.049559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.054013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:42.057091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:42.062538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:42.063445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.063847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.065512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] PATH_INFO: `/v3/projects/911e59a7b767452eb5bc7e7c08a7aae8/users/385ba6e46f5344cf86daa0f002bc9734/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.085624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3204/6382] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:42.091745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.115970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911e59a7b767452eb5bc7e7c08a7aae8, user_id=385ba6e46f5344cf86daa0f002bc9734, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:42.121348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb9067-731f-469b-b9cb-5579c083283b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:42.121583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:42.138014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:42.167466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.167829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.168106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.168805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:42.170483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:42.176096 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3179/6383] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:42 2022] PUT /identity/v3/projects/911e59a7b767452eb5bc7e7c08a7aae8/users/385ba6e46f5344cf86daa0f002bc9734/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:42.182356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.188494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:42.230008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3205/6384] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:42.230992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.273674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29026efe-3a94-43c1-a5ac-6c4fd37c54d0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:42.446006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5fff3-62d8-48d0-8dd4-ff16f7607430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:42.447036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5fff3-62d8-48d0-8dd4-ff16f7607430 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.447606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5fff3-62d8-48d0-8dd4-ff16f7607430 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.448056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5fff3-62d8-48d0-8dd4-ff16f7607430 admin admin] PATH_INFO: `/v3/projects/e6aedc8679b940a6b050dbb657c06180/users/758ede11152e40018afd000ccac2ca8e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.458380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb3523-9e1c-443d-8910-75b5dd495fe2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:42.466859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5fff3-62d8-48d0-8dd4-ff16f7607430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6aedc8679b940a6b050dbb657c06180, user_id=758ede11152e40018afd000ccac2ca8e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:42.470410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5fff3-62d8-48d0-8dd4-ff16f7607430 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:42.480299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:42.483940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.485335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.487360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.488755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:42.498758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:42.508929 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3206/6385] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:42 2022] PUT /identity/v3/projects/e6aedc8679b940a6b050dbb657c06180/users/758ede11152e40018afd000ccac2ca8e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:42.520079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.520697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.521220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.548875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3180/6386] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:42.555786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.578893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8fea1b-32a5-45b6-aa6a-80da51d63ab6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:42.629122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] MFA Rules not processed for user `758ede11152e40018afd000ccac2ca8e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:42.633310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:42.647169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:42.747348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064521e-2219-4fc1-9f92-bcd37744d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:42.748035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064521e-2219-4fc1-9f92-bcd37744d342 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.748316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064521e-2219-4fc1-9f92-bcd37744d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.748731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064521e-2219-4fc1-9f92-bcd37744d342 admin admin] PATH_INFO: `/v3/projects/911e59a7b767452eb5bc7e7c08a7aae8/users/385ba6e46f5344cf86daa0f002bc9734/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.752468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064521e-2219-4fc1-9f92-bcd37744d342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=911e59a7b767452eb5bc7e7c08a7aae8, user_id=385ba6e46f5344cf86daa0f002bc9734, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:42.760689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7064521e-2219-4fc1-9f92-bcd37744d342 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:42.785854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3207/6387] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:42.799483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:42.800993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:42.804139 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3181/6388] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:42 2022] PUT /identity/v3/projects/911e59a7b767452eb5bc7e7c08a7aae8/users/385ba6e46f5344cf86daa0f002bc9734/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:42.932308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:42.933006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:42.933006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:42.970666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] MFA Rules not processed for user `385ba6e46f5344cf86daa0f002bc9734`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:42.972441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:42.975792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed18578-66c1-4d77-9ff3-10d17e1b6de0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:43.006644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:43.098384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:43.098914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:43.099245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:43.099520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:43.196305 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3182/6389] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:43.207282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:43.208839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:43.264931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:43.266612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:43.290607 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3208/6390] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:43.343177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89762a7d-e307-4bfb-b030-e6ffab42f0c5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:43.357628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:43.358378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:43.358755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:43.359123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:43.377005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:43.378637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:43.402535 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3183/6391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:43.631402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:43.633028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:43.657761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382241d-57a8-49e4-9566-9f6f04746dff service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:43.670376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:43.671126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:43.671415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:43.671693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:43.835151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:43.836700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:43.848271 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3209/6392] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:44.589795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:44.653127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:44.665595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ebb04-e179-48a1-8c83-58af9dba66c6 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:44.672754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:44.673886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:44.674419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:44.674880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:44.677585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:44.724083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:44.744334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab37fa-81dc-4297-a4a1-68a962078466 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:44.749847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:44.751364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:44.751652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:44.751927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] PATH_INFO: `/v3/users/de9baf5e91854dcfbb586a6bdec416d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:44.753528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9baf5e91854dcfbb586a6bdec416d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:44.755686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:44.830711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9baf5e91854dcfbb586a6bdec416d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:44.850042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9baf5e91854dcfbb586a6bdec416d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:44.850792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9baf5e91854dcfbb586a6bdec416d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:44.861124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9baf5e91854dcfbb586a6bdec416d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:44.862265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e47c2610-a8a4-4a3e-83c2-18d070c42d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9baf5e91854dcfbb586a6bdec416d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:44.906636 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3184/6393] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:44 2022] DELETE /identity/v3/users/de9baf5e91854dcfbb586a6bdec416d1 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:44.908339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:44.908624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:44.908896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:44.915280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:44.917007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:44.939635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:44.946981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:44.948716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:44.958688 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3210/6394] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:45.082797 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3185/6395] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:45.124432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:45.127651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:45.287412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace948d-e6dd-4bcf-9233-e79214365bdf service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:45.390613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:45.391282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:45.391561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:45.391846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:45.414640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:45.416092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:45.429701 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3211/6396] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:48.021108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:48.022802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:48.071303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718ae1f-f077-4512-b9f8-e9d06f09051c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:48.090687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:48.091364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:48.091643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:48.091913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] PATH_INFO: `/v3/projects/d4cc123c596842feb9176db93af77cfa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:48.097366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4cc123c596842feb9176db93af77cfa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:48.099369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:48.226538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4cc123c596842feb9176db93af77cfa', 'request_id': 'req-3074389d-aeec-4596-993e-570d866176d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.246438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4cc123c596842feb9176db93af77cfa', 'request_id': 'req-3074389d-aeec-4596-993e-570d866176d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.260457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:48.280914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4cc123c596842feb9176db93af77cfa', 'request_id': 'req-3074389d-aeec-4596-993e-570d866176d4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.356130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] The token cache is being invalidate because project d4cc123c596842feb9176db93af77cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:48.356467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.357909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.363418 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3186/6397] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:48 2022] DELETE /identity/v3/projects/d4cc123c596842feb9176db93af77cfa => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:48.364000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:48.381446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a867753-0918-43be-b55f-5b5bcafad44d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:48.563597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:48.564531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:48.564960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:48.565379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] PATH_INFO: `/v3/users/758ede11152e40018afd000ccac2ca8e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:48.570961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=758ede11152e40018afd000ccac2ca8e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:48.573132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:48.729252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758ede11152e40018afd000ccac2ca8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.751485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758ede11152e40018afd000ccac2ca8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.752379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758ede11152e40018afd000ccac2ca8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.776826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:48.794844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758ede11152e40018afd000ccac2ca8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.794844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5a5ee06-2030-4e61-ba7d-adf687daff23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758ede11152e40018afd000ccac2ca8e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:48.863713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3212/6398] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:48 2022] DELETE /identity/v3/users/758ede11152e40018afd000ccac2ca8e => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:49.271787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:49.273387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:49.299318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074389d-aeec-4596-993e-570d866176d4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:49.463589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:49.466492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:49.467793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:49.468229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] PATH_INFO: `/v3/users/9bd99ebba80a4ec5b5ccfb59e66730bc` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:49.471152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd99ebba80a4ec5b5ccfb59e66730bc)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:49.474431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:49.614449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd99ebba80a4ec5b5ccfb59e66730bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:49.660377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd99ebba80a4ec5b5ccfb59e66730bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:49.661373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd99ebba80a4ec5b5ccfb59e66730bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:49.687248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd99ebba80a4ec5b5ccfb59e66730bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:49.689336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd99ebba80a4ec5b5ccfb59e66730bc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:49.722113 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3187/6399] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:49 2022] DELETE /identity/v3/users/9bd99ebba80a4ec5b5ccfb59e66730bc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:49.725176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:49.726631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:49.727555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:49.789935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:49.791165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.001377 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3213/6400] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:50.023851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:50.026520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.056426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:50.058984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.078026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51770f-7b85-4fc1-a53b-7d111ef39d7b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:50.093323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:50.094021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:50.094344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:50.094634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] PATH_INFO: `/v3/projects/e6aedc8679b940a6b050dbb657c06180` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:50.096356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6aedc8679b940a6b050dbb657c06180)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:50.100196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:50.194662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306e8fc-5e26-4e31-bb2b-59c88d0ec556 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:50.216309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6aedc8679b940a6b050dbb657c06180', 'request_id': 'req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:50.232210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6aedc8679b940a6b050dbb657c06180', 'request_id': 'req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:50.240063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:50.253365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6aedc8679b940a6b050dbb657c06180', 'request_id': 'req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:50.280265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] The token cache is being invalidate because project e6aedc8679b940a6b050dbb657c06180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:50.280900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:50.282785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d635cfec-8ecb-4ee1-a273-0b385cc2fed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:50.290408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3214/6401] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:50 2022] DELETE /identity/v3/projects/e6aedc8679b940a6b050dbb657c06180 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:50.296340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:50.296884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:50.297372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:50.323363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:50.328318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:50.329177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:50.329550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:50.333018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.416336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:50.417572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.482780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:50.485694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46428cc5-dc77-443e-b8df-62d8fb631335 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:50.503229 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3188/6402] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:50.545555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:50.611393 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3215/6403] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:50.621164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:50.621450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:50.621721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:50.686150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:50.687401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.728331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:50.730243 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3189/6404] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:50.739343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef93ad5-569b-487b-a551-00f3f6e64049 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:50.771907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:50.772544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:50.772991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:50.773428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:50.774283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:50.774726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:50.776524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:50.822751 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3216/6405] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:50.824195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:50.844432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b3c18-3a6e-48d0-86ce-7a63daefaada None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:50.850011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:50.850932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:50.851359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:50.851789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:50.852582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:50.854702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:50.892780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:50.894563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:50.916904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fd9eb-45c2-45b4-af87-4a1b7a8d0e89 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:50.921227 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3190/6406] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:50 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:50.922280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.064963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.065793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.066091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.066363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] PATH_INFO: `/v3/projects/e9a9cf2dee5548bb9b9f948f71cf2651` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.082520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a9cf2dee5548bb9b9f948f71cf2651)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.084579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.091530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54e2ed-aae7-47cb-bd7d-bd99af64ded2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.104900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.105544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.105842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.106118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.106751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.111464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.167918 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3191/6407] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:50 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:51.168926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.186965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a89d37-bc91-4ff4-b05d-d9846880b033 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.214849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a9cf2dee5548bb9b9f948f71cf2651', 'request_id': 'req-3290ff11-75a3-457e-bc1c-27a9088d79c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:51.228801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a9cf2dee5548bb9b9f948f71cf2651', 'request_id': 'req-3290ff11-75a3-457e-bc1c-27a9088d79c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:51.243964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a9cf2dee5548bb9b9f948f71cf2651', 'request_id': 'req-3290ff11-75a3-457e-bc1c-27a9088d79c1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:51.246516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:51.276258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] The token cache is being invalidate because project e9a9cf2dee5548bb9b9f948f71cf2651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:51.276598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:51.277267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3290ff11-75a3-457e-bc1c-27a9088d79c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:51.282354 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3217/6408] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:50 2022] DELETE /identity/v3/projects/e9a9cf2dee5548bb9b9f948f71cf2651 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:51.284054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037ca0b-5cdb-4a38-9dfb-554ec4c4eeb0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.284339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037ca0b-5cdb-4a38-9dfb-554ec4c4eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.284615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037ca0b-5cdb-4a38-9dfb-554ec4c4eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.322695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7037ca0b-5cdb-4a38-9dfb-554ec4c4eeb0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:51.323938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7037ca0b-5cdb-4a38-9dfb-554ec4c4eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:51.329246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.330084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.330345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.330607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.331946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.335583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.353354 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3218/6409] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:51.354940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.355224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.355498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.389249 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3192/6410] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:51.396462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.397841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:51.399656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:51.401151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:51.423577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3219/6411] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:14:51.424731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.427964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09976470-9266-4b4c-a936-a5601e5ac69a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.439805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.440882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.441182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.441454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.442138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.443769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.444335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc086f5e-f58b-4c59-9e09-ddf5f86854dc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.454959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.455779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.456149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.457140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.457976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:51.458359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.462570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.495572 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3220/6412] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:14:51.497308 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3193/6413] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:51.497788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.503258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.521598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481a64d4-780d-469e-854d-b53cc38eda8d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.528384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094cb1b0-b232-4d49-a9c2-5f5f6598766a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.533699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.534425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.534780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.535121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.535842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.537871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.550180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b9f62-a336-41f5-9250-0d18408e9e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.551147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b9f62-a336-41f5-9250-0d18408e9e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.551607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b9f62-a336-41f5-9250-0d18408e9e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.552029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b9f62-a336-41f5-9250-0d18408e9e83 admin admin] PATH_INFO: `/v3/projects/dfdad664e0e9479ea0500e50c1d88711/users/e849829b18ef463986ba2457ab38c778/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.589968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b9f62-a336-41f5-9250-0d18408e9e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfdad664e0e9479ea0500e50c1d88711, user_id=e849829b18ef463986ba2457ab38c778, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.595166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b9f62-a336-41f5-9250-0d18408e9e83 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.619343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3221/6414] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:51 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:51.621007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.636112 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3194/6415] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:51 2022] PUT /identity/v3/projects/dfdad664e0e9479ea0500e50c1d88711/users/e849829b18ef463986ba2457ab38c778/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:51.649292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054078de-adf7-468f-b531-c22da91717f6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.649667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054078de-adf7-468f-b531-c22da91717f6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.649987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054078de-adf7-468f-b531-c22da91717f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.673829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:51.706808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-054078de-adf7-468f-b531-c22da91717f6 None None] MFA Rules not processed for user `e849829b18ef463986ba2457ab38c778`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:51.708517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-054078de-adf7-468f-b531-c22da91717f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:51.757319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec95ac5-552b-4fa2-bc3f-48fcc6dafcb8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.848206 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3195/6416] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:51.858931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054078de-adf7-468f-b531-c22da91717f6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.860810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-054078de-adf7-468f-b531-c22da91717f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:51.893038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.894506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.894790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.895062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.896195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.899206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.938336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3222/6417] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:51 2022] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:51.945497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:51.961270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054078de-adf7-468f-b531-c22da91717f6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.967012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ac7159-1506-4588-842d-3726b029bfea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:51.972107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.972557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.972727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.974342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.977597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:51.978398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:51.981043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:51.981356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:51.984306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:51.988147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:51.999917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:52.002086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:52.013163 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3223/6418] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:51 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:52.017119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:52.021648 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3196/6419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:52.044985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ad2b6-3de5-4995-81c2-7c3b724953b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:52.055720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:52.062421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.062935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.063429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.064250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:52.066221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:52.100085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:52.100289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3224/6420] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:14:52.116533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:52.118731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:52.119753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f8add-bc3c-48c7-abec-13a74d97149f service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:52.144661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e2705-ff2b-407f-ba58-6bb07176d281 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:52.148334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:52.149582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.150058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.150271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:52.150655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] PATH_INFO: `/v3/projects/081614647a1a4e37b900cac2a5d64ffe/users/151159e7f3a34a7794952d2113046e9e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.151419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.151793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.152166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] PATH_INFO: `/v3/users/897c97d833444a29ae8460a9335ac925` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.154258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=897c97d833444a29ae8460a9335ac925)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:52.157216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:52.187003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=081614647a1a4e37b900cac2a5d64ffe, user_id=151159e7f3a34a7794952d2113046e9e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:52.196021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:52.212520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:52.220581 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3197/6421] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:52 2022] PUT /identity/v3/projects/081614647a1a4e37b900cac2a5d64ffe/users/151159e7f3a34a7794952d2113046e9e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:52.222444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:52.258928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897c97d833444a29ae8460a9335ac925'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.278574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897c97d833444a29ae8460a9335ac925'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.279276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897c97d833444a29ae8460a9335ac925'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.294800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897c97d833444a29ae8460a9335ac925'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.296220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5e2c827c-9115-473a-a9e5-826e1f319856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897c97d833444a29ae8460a9335ac925'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.336803 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3225/6422] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:52 2022] DELETE /identity/v3/users/897c97d833444a29ae8460a9335ac925 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:52.342894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac65a-91c3-4900-9b55-8d1f436e447c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.343263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac65a-91c3-4900-9b55-8d1f436e447c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.343603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ac65a-91c3-4900-9b55-8d1f436e447c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.353722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:52.362635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8827d-106d-4580-93e2-e17052d81f49 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:52.407560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cc8ac65a-91c3-4900-9b55-8d1f436e447c None None] MFA Rules not processed for user `151159e7f3a34a7794952d2113046e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:52.408934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cc8ac65a-91c3-4900-9b55-8d1f436e447c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:52.522674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:52.523335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.523615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.523881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] PATH_INFO: `/v3/users/e849829b18ef463986ba2457ab38c778` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.530609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e849829b18ef463986ba2457ab38c778)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:52.532865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:52.608762 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3226/6423] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:52.612354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.612579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.612862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.650880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:52.651075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e849829b18ef463986ba2457ab38c778'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.657668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:52.697432 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3227/6424] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:52.698407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:52.704629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:52.707897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e849829b18ef463986ba2457ab38c778'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.709555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e849829b18ef463986ba2457ab38c778'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.731088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e849829b18ef463986ba2457ab38c778'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.731870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e849829b18ef463986ba2457ab38c778'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:52.757103 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3198/6425] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:52 2022] DELETE /identity/v3/users/e849829b18ef463986ba2457ab38c778 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:52.758222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:52.759776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:52.814848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:52.880331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00536c9c-a134-43ad-bbd5-4c9699cb3a09 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:52.895906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee303c14-6a68-45cd-8c59-b0dd562dc961 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:52.898414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:52.899057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.899330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.899595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.907227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:52.915610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:52.917060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:52.917060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:52.917060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:52.924753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:53.167981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:53.169382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4b769-85e2-4754-82d8-9fde09e8b7a1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:53.195945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:53.197479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:53.205985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3228/6426] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:53.207435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:53.214024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:53.214521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:53.239167 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3199/6427] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:53.259458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:53.261701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:53.284577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3229/6428] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:53.297086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:53.304989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:53.337790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c1af9-7f33-408e-802e-2d59db6aa934 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:53.347878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:53.348583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:53.348872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:53.349307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:53.371531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:53.372990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:53.401983 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3200/6429] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:53.807317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:53.810468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:53.839917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76bf7a2-0028-47ec-9fd3-ee11cea4bbe8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:53.854529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:53.855453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:53.855736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:53.856011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] PATH_INFO: `/v3/projects/fe75175f875b4a97b3d9d03fd917bf1a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:53.857162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe75175f875b4a97b3d9d03fd917bf1a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:53.859110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:53.912068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:53.937590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe75175f875b4a97b3d9d03fd917bf1a', 'request_id': 'req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:53.946245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe75175f875b4a97b3d9d03fd917bf1a', 'request_id': 'req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:53.953762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe75175f875b4a97b3d9d03fd917bf1a', 'request_id': 'req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:53.973733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] The token cache is being invalidate because project fe75175f875b4a97b3d9d03fd917bf1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:53.974260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:53.975533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:53.977793 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3230/6430] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:53 2022] DELETE /identity/v3/projects/fe75175f875b4a97b3d9d03fd917bf1a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:53.982070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:54.008129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16b4cc-bf87-47e7-8788-27ec2d363f0d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:54.137292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753812-750f-490d-8369-da521978ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:54.138354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753812-750f-490d-8369-da521978ae08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:54.138821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753812-750f-490d-8369-da521978ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:54.139298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753812-750f-490d-8369-da521978ae08 admin admin] PATH_INFO: `/v3/users/385ba6e46f5344cf86daa0f002bc9734` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:54.140969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753812-750f-490d-8369-da521978ae08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=385ba6e46f5344cf86daa0f002bc9734)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:54.143765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753812-750f-490d-8369-da521978ae08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:54.251398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '385ba6e46f5344cf86daa0f002bc9734'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.268133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '385ba6e46f5344cf86daa0f002bc9734'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.269371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '385ba6e46f5344cf86daa0f002bc9734'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.270827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:54.287236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '385ba6e46f5344cf86daa0f002bc9734'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.297526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '385ba6e46f5344cf86daa0f002bc9734'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.308487 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3201/6431] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:53 2022] DELETE /identity/v3/users/385ba6e46f5344cf86daa0f002bc9734 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:54.669385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:54.670890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:54.692673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d196ed3-736c-4386-92cf-3e5d0dd5c1b6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:54.780052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:54.780977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:54.781262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:54.781594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] PATH_INFO: `/v3/users/e6ce6f5da87248398915ddef45d38566` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:54.784084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ce6f5da87248398915ddef45d38566)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:54.786365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:54.904479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ce6f5da87248398915ddef45d38566'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.921298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ce6f5da87248398915ddef45d38566'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.922845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ce6f5da87248398915ddef45d38566'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.929597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:54.931390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:54.945327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ce6f5da87248398915ddef45d38566'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.949340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-51e7cb93-79a4-4dc3-9eed-18c37bf79089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ce6f5da87248398915ddef45d38566'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:54.956033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753812-750f-490d-8369-da521978ae08 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:54.963391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:54.964148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:54.965287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:54.965664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] PATH_INFO: `/v3/projects/dfdad664e0e9479ea0500e50c1d88711` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:54.967082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfdad664e0e9479ea0500e50c1d88711)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:54.971942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:54.980297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3231/6432] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:54 2022] DELETE /identity/v3/users/e6ce6f5da87248398915ddef45d38566 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:54.989033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:54.989554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:54.990023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.034315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:55.035940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.075884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfdad664e0e9479ea0500e50c1d88711', 'request_id': 'req-b60c280e-689e-4e8e-81eb-32616ec851cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.085145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:55.093052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfdad664e0e9479ea0500e50c1d88711', 'request_id': 'req-b60c280e-689e-4e8e-81eb-32616ec851cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.104646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfdad664e0e9479ea0500e50c1d88711', 'request_id': 'req-b60c280e-689e-4e8e-81eb-32616ec851cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.130598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] The token cache is being invalidate because project dfdad664e0e9479ea0500e50c1d88711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:55.131138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.133964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b60c280e-689e-4e8e-81eb-32616ec851cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.136559 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3202/6433] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:54 2022] DELETE /identity/v3/projects/dfdad664e0e9479ea0500e50c1d88711 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:55.146267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083292b-d9a2-47aa-9980-5630d41cbff4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.147183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083292b-d9a2-47aa-9980-5630d41cbff4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.147658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083292b-d9a2-47aa-9980-5630d41cbff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.162512 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3232/6434] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:55.172695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.174292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.180206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e083292b-d9a2-47aa-9980-5630d41cbff4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:55.182554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e083292b-d9a2-47aa-9980-5630d41cbff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.192855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3203/6435] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:55.201134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.201625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.202217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.248138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:55.249399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.271567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f7917-7562-42ca-ad0d-1e2ef286afce None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.275630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.276303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.276584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.276929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.278542 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3204/6436] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:55.280243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.283047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.299533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.301004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.315380 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3233/6437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:55.316400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.326529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979f174-10eb-4e58-b55a-1b23d5f03542 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.331655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.332283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.332562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.332835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.334014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:55.334336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.335939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.336968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f548b08-1410-4af3-ae4e-762644678430 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.349735 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3234/6438] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:55.354297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.355481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.360740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.361640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.362224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] PATH_INFO: `/v3/projects/911e59a7b767452eb5bc7e7c08a7aae8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.365340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=911e59a7b767452eb5bc7e7c08a7aae8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.366064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f7f73-46db-42f1-b6f1-6659b1cd0c42 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.371800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.372423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.372699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.372972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.373400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.374235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.376183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.427772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3235/6439] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:55.428797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.463101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911e59a7b767452eb5bc7e7c08a7aae8', 'request_id': 'req-515d55be-b9ee-445b-8da5-a8f30e32bc8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.471228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911e59a7b767452eb5bc7e7c08a7aae8', 'request_id': 'req-515d55be-b9ee-445b-8da5-a8f30e32bc8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.478847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911e59a7b767452eb5bc7e7c08a7aae8', 'request_id': 'req-515d55be-b9ee-445b-8da5-a8f30e32bc8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.497157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] The token cache is being invalidate because project 911e59a7b767452eb5bc7e7c08a7aae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:55.497408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.498350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-515d55be-b9ee-445b-8da5-a8f30e32bc8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:55.500453 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3205/6440] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:55 2022] DELETE /identity/v3/projects/911e59a7b767452eb5bc7e7c08a7aae8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:55.505720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83725c7-78a3-41af-96d4-3767f3f947b0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.506350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83725c7-78a3-41af-96d4-3767f3f947b0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.506819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83725c7-78a3-41af-96d4-3767f3f947b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.527798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41fcfcb-36df-42b3-a488-3c7d8a69fa3d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.530163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c83725c7-78a3-41af-96d4-3767f3f947b0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:55.531908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c83725c7-78a3-41af-96d4-3767f3f947b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.581438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:55.649619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:55.657566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3206/6441] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:55.665604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.665927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.666199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.676105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.678217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.678506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.678779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.679876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.681566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.709365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:55.710945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.731863 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3236/6442] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:55.733426 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3207/6443] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:55.742638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.742866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.745139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:55.761131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c450d-edf8-4a85-b8d8-0b3f597a4654 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.768491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56241e5d-348c-4cc2-ad45-0e59c522c82e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.777021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.777719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.778035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.778312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.778730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.778976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.780664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.780664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.782412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.783030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:55.783776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.785299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.787617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.800173 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3237/6444] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:55.801618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.815316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaccb6d-8ece-423c-b4a4-8ee355bd6f8e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.825596 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3208/6445] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:55.826999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.827265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.827552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.827829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.828714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.829320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.831534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.845050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3238/6446] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:55.849320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:55.881767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788a05c-a666-438a-88b4-1d3945254db8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.885619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f9782-2dc7-4416-b962-9990a881fe41 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:55.889634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.893622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.894015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.894318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] PATH_INFO: `/v3/projects/beafff318bac44218638c78b22e10830/users/5f46aefcc08d4bb39fee84f83e41fb92/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.898855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:55.899410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:55.899762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:55.900717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:55.901530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.904840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.962399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beafff318bac44218638c78b22e10830, user_id=5f46aefcc08d4bb39fee84f83e41fb92, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:55.966126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:55.994597 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3209/6447] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:55 2022] POST /identity/v3/projects => generated 409 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:55.996464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.003682 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3239/6448] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:55 2022] PUT /identity/v3/projects/beafff318bac44218638c78b22e10830/users/5f46aefcc08d4bb39fee84f83e41fb92/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:14:56.004593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.005529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:56.119653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26240f6a-1e49-420d-b85c-38f786521e72 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.128635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:56.130000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.130933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.131648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] PATH_INFO: `/v3/projects/b6274033b3c24ed586953d2e5d955c88` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.133266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6274033b3c24ed586953d2e5d955c88)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:56.136760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:56.157750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671fd5c-829b-49c9-836e-e3d437817ad4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.194531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36141539-b4a8-4528-915d-7141acd6d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:56.197398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36141539-b4a8-4528-915d-7141acd6d937 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.197584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36141539-b4a8-4528-915d-7141acd6d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.198440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36141539-b4a8-4528-915d-7141acd6d937 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.201214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36141539-b4a8-4528-915d-7141acd6d937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:56.212655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36141539-b4a8-4528-915d-7141acd6d937 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:56.268179 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3240/6449] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:56 2022] POST /identity/v3/users => generated 305 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:56.270120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136f730-1002-4067-9985-3522669dba3a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.270496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136f730-1002-4067-9985-3522669dba3a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.271200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136f730-1002-4067-9985-3522669dba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.294013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6274033b3c24ed586953d2e5d955c88', 'request_id': 'req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:56.306014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6274033b3c24ed586953d2e5d955c88', 'request_id': 'req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:56.322273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6274033b3c24ed586953d2e5d955c88', 'request_id': 'req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:56.340951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2136f730-1002-4067-9985-3522669dba3a None None] MFA Rules not processed for user `5f46aefcc08d4bb39fee84f83e41fb92`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:56.343346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2136f730-1002-4067-9985-3522669dba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:56.348228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] The token cache is being invalidate because project b6274033b3c24ed586953d2e5d955c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:14:56.348528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:56.349668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:56.353434 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3210/6450] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:14:55 2022] DELETE /identity/v3/projects/b6274033b3c24ed586953d2e5d955c88 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:56.354568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.358618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:56.421551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:56.550018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3241/6451] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:56.557914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.557914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.557914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.572069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316a7b6-47fd-4ec5-8dde-bb5667e9ecd7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.592281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:56.593467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.594079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.595734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.596986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:56.599092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:56.611656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:56.614403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:56.665232 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3211/6452] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:56.666251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.668998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3242/6453] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:56.670160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.677991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:56.685024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3a96e-7f80-4519-9fa1-3f0a48d18000 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.693593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343f24f-c125-423f-a007-b63996dc2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:56.695183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f24f-c125-423f-a007-b63996dc2f6f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.695856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f24f-c125-423f-a007-b63996dc2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.696319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343f24f-c125-423f-a007-b63996dc2f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.697394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f24f-c125-423f-a007-b63996dc2f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:56.699552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343f24f-c125-423f-a007-b63996dc2f6f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:56.701594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:56.717681 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3243/6454] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:56.720112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.720410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.720673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.773202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:56.774756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:56.789937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24f235-20b9-46ee-85eb-a05a9844faa6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.791579 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3244/6455] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:56.793368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.801281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:56.803522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.803819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.804097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.806867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55ff01-7084-4821-b5ca-24044514742d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.817085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af176916-242e-4239-ae44-2ed91aff04ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:56.819246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176916-242e-4239-ae44-2ed91aff04ef admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.819533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176916-242e-4239-ae44-2ed91aff04ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.821336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176916-242e-4239-ae44-2ed91aff04ef admin admin] PATH_INFO: `/v3/projects/d730da47b3874ab68b93d8ba4ef33578/users/5640b00365514b7783066144b2d94a01/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:56.839219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:56.844656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:56.859815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af176916-242e-4239-ae44-2ed91aff04ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d730da47b3874ab68b93d8ba4ef33578, user_id=5640b00365514b7783066144b2d94a01, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:56.863947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af176916-242e-4239-ae44-2ed91aff04ef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:56.875910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3212/6456] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:56 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:56.879121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:56.895631 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3245/6457] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:56 2022] PUT /identity/v3/projects/d730da47b3874ab68b93d8ba4ef33578/users/5640b00365514b7783066144b2d94a01/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:56.902902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c64a2e-e15d-4767-b4ee-c2db5c31a610 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:56.909319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:56.911258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:56.911605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.019649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] MFA Rules not processed for user `5640b00365514b7783066144b2d94a01`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:57.025975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:57.130644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.131922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.131922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.131922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.132452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:14:57.132758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.134422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.180196 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3213/6458] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:14:57.184412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.210702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6386883c-2e7f-4fac-b9c8-8fbebb55b6be admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.231028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.231664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.231944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.232217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.232858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.236721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.303557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3246/6459] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:57.304469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.321043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3214/6460] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:57 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:57.322119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.330658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecd873-e679-4445-b8f5-96c548c605d3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.405141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:57.458974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.462100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.464039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.464039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.465041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.467964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.507890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3247/6461] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:14:57 2022] POST /identity/v3/projects => generated 407 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:57.508835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.511314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fcdb3-fa12-4cb8-ada2-1b3de18d3874 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.514138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:57.571689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:57.621453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffed5b6-0ef2-4fd8-8475-80ae1b57e1fb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.629163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.630036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.630411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.630812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] PATH_INFO: `/v3/users/5f46aefcc08d4bb39fee84f83e41fb92` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.632936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f46aefcc08d4bb39fee84f83e41fb92)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.635720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.654467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.655028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.655325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.655583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.656222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.660871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.711159 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3215/6462] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:57 2022] POST /identity/v3/users => generated 291 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:14:57.711159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.738118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938377b-0f5b-49f1-82a5-2ff2bb5cae31 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.742845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f46aefcc08d4bb39fee84f83e41fb92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:57.751958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.752734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.753020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.753295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.754099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.757083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f46aefcc08d4bb39fee84f83e41fb92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:57.758129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.758322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f46aefcc08d4bb39fee84f83e41fb92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:57.775972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f46aefcc08d4bb39fee84f83e41fb92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:57.776854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f46aefcc08d4bb39fee84f83e41fb92'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:57.810327 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3216/6463] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:14:57 2022] POST /identity/v3/users => generated 310 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:14:57.811811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.815997 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3248/6464] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:57 2022] DELETE /identity/v3/users/5f46aefcc08d4bb39fee84f83e41fb92 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:57.816993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:57.819239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:57.820718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:57.855825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea9141-b638-4566-9fae-bbeb19c02d04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.934250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352e241-b274-4a6f-8d20-4048207db56b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:57.950639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6b04d-f539-4669-ae2c-4a7d52030d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.951443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b04d-f539-4669-ae2c-4a7d52030d60 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.952248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b04d-f539-4669-ae2c-4a7d52030d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.952385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6b04d-f539-4669-ae2c-4a7d52030d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.952952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6b04d-f539-4669-ae2c-4a7d52030d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.954697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6b04d-f539-4669-ae2c-4a7d52030d60 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:57.982867 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3249/6465] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:57.984277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.984601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.985050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.986125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:57.986971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:57.987090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:57.987290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:57.988002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:57.989608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.017126 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3217/6466] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:57 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:58.018428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.031139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:58.037784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:58.043855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813458c-650d-4d60-9224-e7ec253bc387 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.054450 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3250/6467] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:58.055513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.056527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.056810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.057088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] PATH_INFO: `/v3/projects/4bc3bb250aee48618e2c9113c9c093d1/users/fe1210d1fd20485e9c9701a9731b93b5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.060584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.084850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ee9bf-6025-487d-8b9e-86dcbc364403 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.097567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc3bb250aee48618e2c9113c9c093d1, user_id=fe1210d1fd20485e9c9701a9731b93b5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.099418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.100389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.100736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.100864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.101182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.101888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.105145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.134512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3218/6468] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:58 2022] PUT /identity/v3/projects/4bc3bb250aee48618e2c9113c9c093d1/users/fe1210d1fd20485e9c9701a9731b93b5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:58.137525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.138000 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3251/6469] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:58.138928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.142668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:58.160317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011ce8bf-6b4a-496e-a83d-f7e33bc3147a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.209333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:58.244950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:58.300778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda27256-677e-4835-bc9e-1712585561c2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.305235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.306177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.306567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.307020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.307453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.308273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.308662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.311072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.312324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.312608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.332658 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3252/6470] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:14:58.333909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.350696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d9675-d40f-49e5-b68b-999c7dd24f9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.360527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.364907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.374725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5f271-fa64-4f8e-aa04-ac65f46d30e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.375643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5f271-fa64-4f8e-aa04-ac65f46d30e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.376033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5f271-fa64-4f8e-aa04-ac65f46d30e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.377289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5f271-fa64-4f8e-aa04-ac65f46d30e9 admin admin] PATH_INFO: `/v3/projects/139e9504a17f47ec9feb637ebb297e6b/users/42b835360ce0454b949a4a0b9818edcd/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.398008 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3219/6471] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:58.399143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.427625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5f271-fa64-4f8e-aa04-ac65f46d30e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139e9504a17f47ec9feb637ebb297e6b, user_id=42b835360ce0454b949a4a0b9818edcd, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.437671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5f271-fa64-4f8e-aa04-ac65f46d30e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.445598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142adf13-adab-46fc-b96c-ed8c3ec1078e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.461932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd259d-357b-4aee-906f-229dcbe02d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.462836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd259d-357b-4aee-906f-229dcbe02d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.463266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd259d-357b-4aee-906f-229dcbe02d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.463688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd259d-357b-4aee-906f-229dcbe02d39 admin admin] PATH_INFO: `/v3/projects/4bc3bb250aee48618e2c9113c9c093d1/users/fe1210d1fd20485e9c9701a9731b93b5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.470132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd259d-357b-4aee-906f-229dcbe02d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc3bb250aee48618e2c9113c9c093d1, user_id=fe1210d1fd20485e9c9701a9731b93b5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.473920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd259d-357b-4aee-906f-229dcbe02d39 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.479785 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3253/6472] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:58 2022] PUT /identity/v3/projects/139e9504a17f47ec9feb637ebb297e6b/users/42b835360ce0454b949a4a0b9818edcd/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:58.493240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.493919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.494310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.498422 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3220/6473] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:14:58 2022] PUT /identity/v3/projects/4bc3bb250aee48618e2c9113c9c093d1/users/fe1210d1fd20485e9c9701a9731b93b5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:58.509151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.509445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.509768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.565363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] MFA Rules not processed for user `42b835360ce0454b949a4a0b9818edcd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:58.569867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:58.606699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] MFA Rules not processed for user `fe1210d1fd20485e9c9701a9731b93b5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:58.607899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:58.834766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3254/6474] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:58.847106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.848564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:58.854125 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3221/6475] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:58.865679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:58.868640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:58.968610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07bee2-a3e0-48e5-b06f-17a9f81e7ee0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:58.972858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:58.974125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:58.974840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:58.975345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:58.985461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:58.989112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:58.997631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cfc62-6639-46ea-b7e7-cfe1f21e5b40 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:59.002381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:59.003583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:59.004276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:59.005281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:59.012610 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3255/6476] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:14:59.033292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:59.035084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:59.038345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:59.068309 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3222/6477] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:59.163298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:59.232299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d3d82a-5b13-4609-9a99-a996489c0298 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:59.255092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:59.257941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:59.259642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:59.259642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] PATH_INFO: `/v3/users/42b835360ce0454b949a4a0b9818edcd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:59.263363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42b835360ce0454b949a4a0b9818edcd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:59.269209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:59.415935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42b835360ce0454b949a4a0b9818edcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:59.450586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42b835360ce0454b949a4a0b9818edcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:59.452938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42b835360ce0454b949a4a0b9818edcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:59.470230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42b835360ce0454b949a4a0b9818edcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:59.484519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-019bcb57-e668-40e8-9750-4e05a7729613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42b835360ce0454b949a4a0b9818edcd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:14:59.529185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:59.530801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:59.562386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16017e2a-4bf2-40b6-9902-752b7f20a5e1 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:14:59.568700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:14:59.569863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:59.570235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:59.570615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:59.575195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:59.578175 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3256/6478] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:14:59 2022] DELETE /identity/v3/users/42b835360ce0454b949a4a0b9818edcd => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:14:59.587915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:14:59.588192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:14:59.588470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:14:59.620931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:14:59.622245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:59.732501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:14:59.771590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:14:59.773139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:14:59.795986 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3223/6479] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:59 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:14:59.809779 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3257/6480] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:14:59.820437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:14:59.822027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:14:59.848167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1d8af-1d3a-4e00-a587-132268e3cdd8 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:00.051409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6658291-06d6-4351-baa4-c377f13c652a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:00.058572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6658291-06d6-4351-baa4-c377f13c652a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:00.058869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6658291-06d6-4351-baa4-c377f13c652a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:00.059155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6658291-06d6-4351-baa4-c377f13c652a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:00.094119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6658291-06d6-4351-baa4-c377f13c652a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:00.096999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6658291-06d6-4351-baa4-c377f13c652a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:00.130970 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3224/6481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:00.606661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:00.608123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:00.634150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20231066-cf34-4cef-bcb1-15fe6b509a9b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:00.655842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:00.656679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:00.657021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:00.657298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] PATH_INFO: `/v3/projects/beafff318bac44218638c78b22e10830` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:00.667019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] RBAC: Authorizing `identity:delete_project(project_id=beafff318bac44218638c78b22e10830)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:00.668982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:00.846666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beafff318bac44218638c78b22e10830', 'request_id': 'req-fa2f2997-676d-497f-91ee-808bfdf8534e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:00.871044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beafff318bac44218638c78b22e10830', 'request_id': 'req-fa2f2997-676d-497f-91ee-808bfdf8534e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:00.874325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:00.903557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beafff318bac44218638c78b22e10830', 'request_id': 'req-fa2f2997-676d-497f-91ee-808bfdf8534e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:00.943873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] The token cache is being invalidate because project beafff318bac44218638c78b22e10830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:00.944277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:00.947684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:00.949703 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3258/6482] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:00 2022] DELETE /identity/v3/projects/beafff318bac44218638c78b22e10830 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:00.955359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3a97-3f24-4b23-95e8-0af7a81babeb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:00.956126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3a97-3f24-4b23-95e8-0af7a81babeb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:00.956574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f3a97-3f24-4b23-95e8-0af7a81babeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:00.986540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee4f3a97-3f24-4b23-95e8-0af7a81babeb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:00.992686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee4f3a97-3f24-4b23-95e8-0af7a81babeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:01.123549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.125616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:01.156967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3225/6483] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:01.162260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.162557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.162832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.229870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:01.231075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:01.257430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f2997-676d-497f-91ee-808bfdf8534e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.272056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.272887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.273256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.273677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] PATH_INFO: `/v3/projects/139e9504a17f47ec9feb637ebb297e6b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.274879 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3226/6484] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:01.275675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=139e9504a17f47ec9feb637ebb297e6b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.279017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.279406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.297241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce06e66-ab57-4a8d-9a9a-984f26c63faf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.307785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.308309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.308901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.309236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.310036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:01.310345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.312692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.342051 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3227/6485] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:01.346529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.379743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e411581-54b2-4c4f-9451-ee34bddb1d61 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.395059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.395776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.396058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.396457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.397159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.400180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.448775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139e9504a17f47ec9feb637ebb297e6b', 'request_id': 'req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:01.464872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139e9504a17f47ec9feb637ebb297e6b', 'request_id': 'req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:01.491798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139e9504a17f47ec9feb637ebb297e6b', 'request_id': 'req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:01.516837 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3228/6486] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:01 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:01.538500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.564059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] The token cache is being invalidate because project 139e9504a17f47ec9feb637ebb297e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:01.564374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:01.565329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d876eba9-7ea4-4fd1-b9b1-3b5446b294ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:01.570229 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3259/6487] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:01 2022] DELETE /identity/v3/projects/139e9504a17f47ec9feb637ebb297e6b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:01.575485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e194b6-fd7f-4696-b85f-71f1306710be None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.575859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e194b6-fd7f-4696-b85f-71f1306710be None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.576063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e194b6-fd7f-4696-b85f-71f1306710be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.617457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:01.653141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c3e194b6-fd7f-4696-b85f-71f1306710be None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:01.654518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c3e194b6-fd7f-4696-b85f-71f1306710be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:01.678778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b0165-41b9-41ad-81f9-d14c988a3164 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.694400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.698627 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3260/6488] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:01.702831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.703462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.703926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.704765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.705004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.705434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.705883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.708921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.758895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3229/6489] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:01 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:01.764152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.768499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:01.802509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f36622-9b4f-4dce-ab5c-8ef432db28ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.808721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.813550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.814162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.814648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.815556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.818254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.819096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:01.820342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:01.835380 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3230/6490] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:01.836526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.846720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3261/6491] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:01.850307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.862834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66561123-3a7b-4e10-89f8-21d3a5319005 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.869595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.872039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.872570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.873110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.874023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:01.874737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.878260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.883640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43e576-d72a-4aec-b8b7-1779b4d2ea54 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.908951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.909584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.909905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.910193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.910825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.912479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.929350 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3262/6492] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:01.931519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:01.961627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5764de71-9a2b-4fe1-9c71-216e1ebb684c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:01.975905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:01.978611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:01.979086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:01.980204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:01.983845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:01.989434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:01.993774 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3231/6493] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:01.994821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:02.028744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54456d-1db2-4a77-9c49-4f21d12ace95 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:02.048884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:02.049940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:02.050412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:02.051120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] PATH_INFO: `/v3/projects/8e5777b9d26f46b3a7ba7f309de040b8/users/b0ef2697dbca43e7929fd13e16ddec96/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:02.070070 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3263/6494] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:01 2022] POST /identity/v3/projects => generated 359 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:02.075685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:02.086607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5777b9d26f46b3a7ba7f309de040b8, user_id=b0ef2697dbca43e7929fd13e16ddec96, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:02.099651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:02.148246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:02.165919 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3232/6495] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:01 2022] PUT /identity/v3/projects/8e5777b9d26f46b3a7ba7f309de040b8/users/b0ef2697dbca43e7929fd13e16ddec96/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:02.165919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:02.165919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:02.229663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf19a13-cf02-4d94-96b4-ba2d22ea98a8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:02.355474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7b5dd-6c07-49b9-a953-ff563a902a7f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:02.361792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:02.362734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:02.363211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:02.363570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] PATH_INFO: `/v3/users/fa565a7e2cc64c36b938376d39002476` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:02.364784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa565a7e2cc64c36b938376d39002476)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:02.368127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:02.368995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa52b4-2654-4a36-8f5c-56de1eb300f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:02.369851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa52b4-2654-4a36-8f5c-56de1eb300f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:02.386330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa52b4-2654-4a36-8f5c-56de1eb300f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:02.386944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa52b4-2654-4a36-8f5c-56de1eb300f2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:02.387999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa52b4-2654-4a36-8f5c-56de1eb300f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:02.390210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa52b4-2654-4a36-8f5c-56de1eb300f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:02.433707 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3264/6496] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:02 2022] POST /identity/v3/users => generated 280 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:02.435473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049cb5-d352-4670-8130-af7f46ecdbe8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:02.435863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049cb5-d352-4670-8130-af7f46ecdbe8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:02.436323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049cb5-d352-4670-8130-af7f46ecdbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:02.473190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa565a7e2cc64c36b938376d39002476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:02.554438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9049cb5-d352-4670-8130-af7f46ecdbe8 None None] MFA Rules not processed for user `b0ef2697dbca43e7929fd13e16ddec96`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:02.555841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9049cb5-d352-4670-8130-af7f46ecdbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:02.574464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa565a7e2cc64c36b938376d39002476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:02.579086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa565a7e2cc64c36b938376d39002476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:02.600193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa565a7e2cc64c36b938376d39002476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:02.601301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa565a7e2cc64c36b938376d39002476'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:02.650740 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3233/6497] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:02 2022] DELETE /identity/v3/users/fa565a7e2cc64c36b938376d39002476 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:02.654279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:02.659425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:02.698663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:02.790321 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3265/6498] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:02.791920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:02.792810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:02.793231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:02.842907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:02.846005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:02.896225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fd775-bb41-45e2-b069-e07dc13d897e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:02.932887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:02.933537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:02.933830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:02.934134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:02.934787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:02.936415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:02.965003 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3234/6499] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:02.978341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:02.983364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:03.010706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:03.020303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35ee18-6196-4b59-9f6b-9540670710ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:03.053174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:03.053632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.053950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.054223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.054862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:03.056988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:03.066116 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3266/6500] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:03.068187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:03.101612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29f93-c673-4859-940b-39905fd6d076 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:03.116118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:03.116985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.118090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.119678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.121347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:03.125686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:03.158607 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3267/6501] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:03.161542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:03.168007 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3235/6502] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:02 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:03.169034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:03.169158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:03.352764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3d004-81af-45a6-b491-2dea2a521fe7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:03.359659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:03.360374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.360862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.361149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] PATH_INFO: `/v3/projects/3c84f31469284febafbd9f8125a43531/users/71ba70bcfcf24f2db21cbe68cec3654f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.381737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c84f31469284febafbd9f8125a43531, user_id=71ba70bcfcf24f2db21cbe68cec3654f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:03.385362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:03.393082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0287ff6-aee3-4f18-b44d-0f27a8c3eac0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:03.431377 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3236/6503] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:03 2022] PUT /identity/v3/projects/3c84f31469284febafbd9f8125a43531/users/71ba70bcfcf24f2db21cbe68cec3654f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:03.432317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:03.660836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c75f8e-4f89-4785-a709-747cc8ab8044 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:03.676538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f00d6f-bd75-44ab-b6d7-4c8cdf1a7e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:03.677227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00d6f-bd75-44ab-b6d7-4c8cdf1a7e45 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.677594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00d6f-bd75-44ab-b6d7-4c8cdf1a7e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.677892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f00d6f-bd75-44ab-b6d7-4c8cdf1a7e45 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.681588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00d6f-bd75-44ab-b6d7-4c8cdf1a7e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:03.688875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f00d6f-bd75-44ab-b6d7-4c8cdf1a7e45 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:03.715390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:03.741933 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3237/6504] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:03 2022] POST /identity/v3/users => generated 298 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:03.743591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.743871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.744143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.810796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] MFA Rules not processed for user `71ba70bcfcf24f2db21cbe68cec3654f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:03.812269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:03.931127 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3238/6505] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:03.932044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:03.937838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:03.940255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.940558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.941021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.958827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11613531-8b75-4415-81f5-e1bbacbd4882 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:03.971328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:03.975374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:03.979569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:03.980205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:03.980479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:03.980747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:03.983345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:03.987505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:04.001578 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3268/6506] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 842 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:04.002312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:04.013019 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3239/6507] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:04.018071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:04.029687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda564e-1d19-4cb2-9070-082ee2302362 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:04.032690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d2a24-c459-4223-91c6-4388ea158b42 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:04.076662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:04.077456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:04.077733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:04.083287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] PATH_INFO: `/v3/projects/b802314604664cd3946be64f63901645/users/185a9b10438d4d3abf04a88542f05556/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:04.156214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b802314604664cd3946be64f63901645, user_id=185a9b10438d4d3abf04a88542f05556, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:04.192988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:04.272306 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3240/6508] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:04 2022] PUT /identity/v3/projects/b802314604664cd3946be64f63901645/users/185a9b10438d4d3abf04a88542f05556/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:04.274106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:04.313455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:04.314029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:04.314344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:04.314344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:04.368280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:04.369729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:04.433659 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3269/6509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:04.499957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752b6bb-7d43-4fc8-b873-29e2c58608a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:04.506133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978dab7-eccb-4f85-b58d-da596e95c021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:04.506998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978dab7-eccb-4f85-b58d-da596e95c021 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:04.507330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978dab7-eccb-4f85-b58d-da596e95c021 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:04.507648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978dab7-eccb-4f85-b58d-da596e95c021 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:04.508316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978dab7-eccb-4f85-b58d-da596e95c021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:04.510084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978dab7-eccb-4f85-b58d-da596e95c021 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:04.525787 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3241/6510] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:04.529662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:04.570433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089aa05-81a3-48bb-8423-3d85c78c8ef3 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:04.577661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:04.578494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:04.582958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:04.583190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] PATH_INFO: `/v3/projects/b802314604664cd3946be64f63901645/users/185a9b10438d4d3abf04a88542f05556/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:04.589407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b802314604664cd3946be64f63901645, user_id=185a9b10438d4d3abf04a88542f05556, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:04.607770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:04.653178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3270/6511] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:04 2022] PUT /identity/v3/projects/b802314604664cd3946be64f63901645/users/185a9b10438d4d3abf04a88542f05556/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:04.669128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:04.669350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:04.669551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:04.769245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] MFA Rules not processed for user `185a9b10438d4d3abf04a88542f05556`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:04.770607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:04.915620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:05.061619 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3242/6512] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:05.077336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:05.176908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:05.245353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578f79-9b07-43fd-947d-20f90e13b78e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:05.256092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:05.259129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:05.259433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:05.261979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:05.431572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:05.436232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:05.567368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:05.568827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:05.591067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3271/6513] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:05.706144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8efc-22fa-45c8-983e-29b5c18e190a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:05.721028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:05.723015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:05.724522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:05.727364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] PATH_INFO: `/v3/projects/031bc33561de49d5b64b196e78944a73` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:05.733531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=031bc33561de49d5b64b196e78944a73)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:05.737703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:05.890145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '031bc33561de49d5b64b196e78944a73', 'request_id': 'req-fcc41167-f582-49f9-a2b4-69e5c5f65790'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:05.911099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '031bc33561de49d5b64b196e78944a73', 'request_id': 'req-fcc41167-f582-49f9-a2b4-69e5c5f65790'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:05.948121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '031bc33561de49d5b64b196e78944a73', 'request_id': 'req-fcc41167-f582-49f9-a2b4-69e5c5f65790'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:05.991597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] The token cache is being invalidate because project 031bc33561de49d5b64b196e78944a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:05.991883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:05.995216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fcc41167-f582-49f9-a2b4-69e5c5f65790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:05.999832 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3243/6514] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:05 2022] DELETE /identity/v3/projects/031bc33561de49d5b64b196e78944a73 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:06.001114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:06.018477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b25569d-7e35-409c-929c-0f9e9e63ef47 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:06.148207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:06.148879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:06.149160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:06.153042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] PATH_INFO: `/v3/users/917acf08674f4db98905f47fe566b310` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:06.154778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917acf08674f4db98905f47fe566b310)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:06.156832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:06.299441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917acf08674f4db98905f47fe566b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:06.319189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917acf08674f4db98905f47fe566b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:06.319968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917acf08674f4db98905f47fe566b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:06.352416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917acf08674f4db98905f47fe566b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:06.357605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917acf08674f4db98905f47fe566b310'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:06.429985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3272/6515] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:06 2022] DELETE /identity/v3/users/917acf08674f4db98905f47fe566b310 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:08.281496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:08.283553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:08.284279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:08.325369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] MFA Rules not processed for user `89a693133ded46eba2b9b70e899f38f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:08.327191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:08.395144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:08.424953 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3244/6516] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:09.009075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:09.010629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:09.020052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:09.183081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566f8c-3ea7-4ab9-aec5-516ec740f8b1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:09.187105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:09.187855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:09.188194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:09.188535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:09.190522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:09.234412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:09.236053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:09.324367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:09.326080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7585a006-5f2b-4d4d-ac1a-b14d98839c2c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:09.351650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3273/6517] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:09.420869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e818ea1-103b-448b-9f4b-451ce72cf0c4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:09.434958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:09.435702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:09.436050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:09.436423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] PATH_INFO: `/v3/projects/54ab1016a7bd4c2db6c453884212d6c9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:09.437932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ab1016a7bd4c2db6c453884212d6c9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:09.443970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:09.561403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ab1016a7bd4c2db6c453884212d6c9', 'request_id': 'req-dcb81772-e60c-46d6-906c-17572d2496d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:09.570588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ab1016a7bd4c2db6c453884212d6c9', 'request_id': 'req-dcb81772-e60c-46d6-906c-17572d2496d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:09.584798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ab1016a7bd4c2db6c453884212d6c9', 'request_id': 'req-dcb81772-e60c-46d6-906c-17572d2496d9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:09.638134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] The token cache is being invalidate because project 54ab1016a7bd4c2db6c453884212d6c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:09.639820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:09.647222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-dcb81772-e60c-46d6-906c-17572d2496d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:09.648334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3245/6518] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:09 2022] DELETE /identity/v3/projects/54ab1016a7bd4c2db6c453884212d6c9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:09.652697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:09.652892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:09.653216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:09.718446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:09.719848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:09.850336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3274/6519] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:09.852942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:09.853426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:09.853920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:09.916365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:09.922714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:09.971094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3246/6520] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:09.975748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.006612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178c977-17e9-4734-b5e1-27dc9cbb7f3d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:10.021664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:10.022336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.022606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.022876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.023529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:10.023831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:10.025448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:10.063718 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3275/6521] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:10.065455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.081519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413912e1-6172-4d8d-b003-76ad2ab9b0a0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:10.103452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:10.103452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.103452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.103452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.103933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:10.103933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:10.192164 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3247/6522] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:10 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:10.196791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.221344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776fefa-6199-4259-ae04-9308b4b46d06 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:10.361239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:10.422661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:10.423311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.423592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.423930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.427126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:10.430957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:10.462038 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3276/6523] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:10 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:10.466437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.481194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbe3a4-1576-43f2-bc52-32e0e7a2fbe1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:10.487466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:10.488350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.488814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.489234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.490673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:10.493695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:10.511020 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3248/6524] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:10.512486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.525193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9bfe8d-3274-4471-af62-83992b821c88 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:10.531956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3a456-ea8d-4336-8358-85699561eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:10.533063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a456-ea8d-4336-8358-85699561eb90 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.533844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a456-ea8d-4336-8358-85699561eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.534278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3a456-ea8d-4336-8358-85699561eb90 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.535173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3a456-ea8d-4336-8358-85699561eb90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:10.537043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3a456-ea8d-4336-8358-85699561eb90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:10.571768 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3277/6525] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:10.572948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.589560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7033-4940-402b-85e6-9b920e504d85 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:10.602776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:10.603920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.604530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.604970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] PATH_INFO: `/v3/projects/6368cdbcf33d460a9a3085c77e7e3de8/users/16dd8ceff2644510b51dfca87f8ea389/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.633266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6368cdbcf33d460a9a3085c77e7e3de8, user_id=16dd8ceff2644510b51dfca87f8ea389, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:10.641028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:10.665846 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3249/6526] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:10 2022] PUT /identity/v3/projects/6368cdbcf33d460a9a3085c77e7e3de8/users/16dd8ceff2644510b51dfca87f8ea389/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:10.671513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:10.674262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:10.674583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:10.711430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] MFA Rules not processed for user `16dd8ceff2644510b51dfca87f8ea389`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:10.713562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:10.841595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:10.841855 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3278/6527] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:10.888102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:10.977435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f9e3d-39b8-499c-83fd-daf722548172 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:11.007832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:11.008391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.008672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.008942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.009577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:11.011782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:11.068762 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3250/6528] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:10 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:11.072766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:11.093269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a1f02-7121-4c3b-90ee-8a85e3d25e5f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:11.239332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:11.239966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.240625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.240625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.241392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:11.244369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:11.272648 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3279/6529] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:11 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:11.276256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:11.296287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a007d4-aebb-426c-8b3f-9385c6f38911 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:11.301289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:11.301954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.302234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.302506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.303155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:11.304775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:11.346500 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3251/6530] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:11.347850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:11.359452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cbdbef-3c5a-426c-bacd-88bc66fece5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:11.377592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:11.378327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.378608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.378887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] PATH_INFO: `/v3/projects/8602f54023674f2cb11a99e0a49952ea/users/9e38a46c1e044cc2a1ba32a860bc17ee/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.421193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8602f54023674f2cb11a99e0a49952ea, user_id=9e38a46c1e044cc2a1ba32a860bc17ee, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:11.424261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:11.448494 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3280/6531] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:11 2022] PUT /identity/v3/projects/8602f54023674f2cb11a99e0a49952ea/users/9e38a46c1e044cc2a1ba32a860bc17ee/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:11.449900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:11.472032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8709613-ee84-4306-9f20-781be2fd0f38 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:11.605880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a01437-e25c-4587-ba68-d4be08770c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:11.606662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01437-e25c-4587-ba68-d4be08770c78 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.607983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01437-e25c-4587-ba68-d4be08770c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.608388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a01437-e25c-4587-ba68-d4be08770c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.609162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01437-e25c-4587-ba68-d4be08770c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:11.611519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a01437-e25c-4587-ba68-d4be08770c78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:11.646923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:11.648254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3252/6532] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:15:11.662569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac69676-5be8-43a5-987e-7c069cacda90 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:11.686035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:11.695143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.695143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.695143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] PATH_INFO: `/v3/projects/8602f54023674f2cb11a99e0a49952ea/users/9e38a46c1e044cc2a1ba32a860bc17ee/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.698838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8602f54023674f2cb11a99e0a49952ea, user_id=9e38a46c1e044cc2a1ba32a860bc17ee, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:11.699833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:11.757890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3281/6533] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:11 2022] PUT /identity/v3/projects/8602f54023674f2cb11a99e0a49952ea/users/9e38a46c1e044cc2a1ba32a860bc17ee/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:11.760864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:11.761159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:11.761873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:11.849636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] MFA Rules not processed for user `9e38a46c1e044cc2a1ba32a860bc17ee`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:11.853274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:12.024406 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3253/6534] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:12.030499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:12.033735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:12.048863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:12.134811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a92c6-ac61-4088-b199-c9815b94970a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:12.147158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:12.147921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:12.148272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:12.148620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:12.163109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:12.181482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:12.235491 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3282/6535] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:12.674228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:12.677624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:12.742007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:12.862983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779d9d2-c772-4c42-b530-0cbf46c6bca0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:12.875697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:12.880291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:12.882146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:12.882655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:12.891726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:13.096966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:13.103728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ae59f-bf34-4069-b66b-1572adb3d090 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:13.161247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3254/6536] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:13.232582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:13.258843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea5a3d-f45f-4bf0-a60c-7e4538ee0d05 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:13.276267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:13.276954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:13.277233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:13.277508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] PATH_INFO: `/v3/users/16dd8ceff2644510b51dfca87f8ea389` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:13.280877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16dd8ceff2644510b51dfca87f8ea389)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:13.286322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:13.419679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16dd8ceff2644510b51dfca87f8ea389'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:13.440078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16dd8ceff2644510b51dfca87f8ea389'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:13.440749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16dd8ceff2644510b51dfca87f8ea389'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:13.460117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16dd8ceff2644510b51dfca87f8ea389'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:13.461010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16dd8ceff2644510b51dfca87f8ea389'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:13.496932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3283/6537] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:13 2022] DELETE /identity/v3/users/16dd8ceff2644510b51dfca87f8ea389 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:13.502511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:13.502796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:13.503074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:13.552900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:13.555042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:13.722462 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3255/6538] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:13.764806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:13.766680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:13.881582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40920b-7c29-42a9-be40-c7e4085f0eb0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:13.897444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:13.898473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:13.898925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:13.899345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:13.917217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:13.918937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:13.948032 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3284/6539] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:15.418197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:15.419698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:15.468582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee192c5-54d6-4cd2-adf2-53688d2bcaf7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:15.483263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:15.488071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:15.488621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:15.488920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] PATH_INFO: `/v3/projects/6368cdbcf33d460a9a3085c77e7e3de8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:15.490957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6368cdbcf33d460a9a3085c77e7e3de8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:15.498042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:15.707403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6368cdbcf33d460a9a3085c77e7e3de8', 'request_id': 'req-ec4caa62-2476-48af-9289-e3251fc324e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:15.725465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6368cdbcf33d460a9a3085c77e7e3de8', 'request_id': 'req-ec4caa62-2476-48af-9289-e3251fc324e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:15.735247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6368cdbcf33d460a9a3085c77e7e3de8', 'request_id': 'req-ec4caa62-2476-48af-9289-e3251fc324e3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:15.738736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:15.763652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] The token cache is being invalidate because project 6368cdbcf33d460a9a3085c77e7e3de8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:15.764234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:15.765095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:15.767658 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3256/6540] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:15 2022] DELETE /identity/v3/projects/6368cdbcf33d460a9a3085c77e7e3de8 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:15.771447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:15.786009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29b7a3-c5ba-4ba7-b5df-7fe0521952bf service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:15.808736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:15.907596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:15.908665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:15.908665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:15.908965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] PATH_INFO: `/v3/users/9e38a46c1e044cc2a1ba32a860bc17ee` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:15.910563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e38a46c1e044cc2a1ba32a860bc17ee)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:15.913409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:16.031933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e38a46c1e044cc2a1ba32a860bc17ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.065789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e38a46c1e044cc2a1ba32a860bc17ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.067200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e38a46c1e044cc2a1ba32a860bc17ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.095397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e38a46c1e044cc2a1ba32a860bc17ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.096520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d4bf08b2-0954-4409-a7d1-849ec7722c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e38a46c1e044cc2a1ba32a860bc17ee'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.140652 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3285/6541] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:15 2022] DELETE /identity/v3/users/9e38a46c1e044cc2a1ba32a860bc17ee => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:16.628979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:16.630757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:16.649587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4caa62-2476-48af-9289-e3251fc324e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:16.748333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:16.748658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:16.748948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:16.749223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] PATH_INFO: `/v3/users/5640b00365514b7783066144b2d94a01` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:16.751045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5640b00365514b7783066144b2d94a01)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:16.762804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:16.842552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5640b00365514b7783066144b2d94a01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.857906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5640b00365514b7783066144b2d94a01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.858777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5640b00365514b7783066144b2d94a01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.867984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5640b00365514b7783066144b2d94a01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.868893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5640b00365514b7783066144b2d94a01'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:16.897103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:16.897768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:16.898091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:16.901068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3257/6542] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:16 2022] DELETE /identity/v3/users/5640b00365514b7783066144b2d94a01 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:16.920708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:16.922336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:17.006629 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3286/6543] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:17.024245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:17.033088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:17.114813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a10fdf-6418-483f-a34f-83e7b2b889f3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:17.119031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:17.119764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:17.120149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:17.120667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:17.132646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:17.134423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:17.149995 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3258/6544] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:17.661487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:17.663469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:17.681318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39279a-3399-4fa8-8b4f-a6819894923e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:17.698023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:17.698996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:17.699237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:17.699843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] PATH_INFO: `/v3/projects/8602f54023674f2cb11a99e0a49952ea` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:17.701165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8602f54023674f2cb11a99e0a49952ea)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:17.704822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:17.735079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:17.737597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:17.764551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00623b24-2f86-4735-b3eb-b1ee39faa4ca service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:17.766651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:17.784020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:17.784231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8602f54023674f2cb11a99e0a49952ea', 'request_id': 'req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.793540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8602f54023674f2cb11a99e0a49952ea', 'request_id': 'req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.801664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8602f54023674f2cb11a99e0a49952ea', 'request_id': 'req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.825127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] The token cache is being invalidate because project 8602f54023674f2cb11a99e0a49952ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:17.825529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.826170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d8afb0a5-e2c3-4a49-b828-ed64901dfa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.831215 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3287/6545] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:17 2022] DELETE /identity/v3/projects/8602f54023674f2cb11a99e0a49952ea => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:17.836142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb79a4-597d-4c00-adf9-80eb4d2487f8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:17.837177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb79a4-597d-4c00-adf9-80eb4d2487f8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:17.837467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb79a4-597d-4c00-adf9-80eb4d2487f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:17.858351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:17.859635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:17.860079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:17.860665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] PATH_INFO: `/v3/projects/d730da47b3874ab68b93d8ba4ef33578` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:17.862166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d730da47b3874ab68b93d8ba4ef33578)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:17.865278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:17.871476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-52bb79a4-597d-4c00-adf9-80eb4d2487f8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:17.872823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-52bb79a4-597d-4c00-adf9-80eb4d2487f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:17.888064 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3288/6546] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:17.897114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:17.897762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:17.897762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:17.921315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:17.922610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:17.930998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd730da47b3874ab68b93d8ba4ef33578', 'request_id': 'req-646b036c-f1a8-484c-85f0-1ef1b8badcf7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.939250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd730da47b3874ab68b93d8ba4ef33578', 'request_id': 'req-646b036c-f1a8-484c-85f0-1ef1b8badcf7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.947378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd730da47b3874ab68b93d8ba4ef33578', 'request_id': 'req-646b036c-f1a8-484c-85f0-1ef1b8badcf7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.978693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] The token cache is being invalidate because project d730da47b3874ab68b93d8ba4ef33578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:17.979492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.980756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:17.984021 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3259/6547] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:17 2022] DELETE /identity/v3/projects/d730da47b3874ab68b93d8ba4ef33578 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:17.988559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:17.990818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:18.044043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3289/6548] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:18.049317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.059246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311571f-a32f-41ee-85f4-fe2f425b9a7d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.066340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.067030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.067428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.068273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.068944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:18.069296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.073266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.086834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b036c-f1a8-484c-85f0-1ef1b8badcf7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.092116 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3290/6549] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:18.092767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.093642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.094084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.094418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] PATH_INFO: `/v3/users/fe1210d1fd20485e9c9701a9731b93b5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.096349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1210d1fd20485e9c9701a9731b93b5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.097045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.099097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.112498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073fafd-01d7-4cf2-aae4-7f64b11b44df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.121637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.122301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.122585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.122859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.123611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.126452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.157969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:18.159662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1210d1fd20485e9c9701a9731b93b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:18.173320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3291/6550] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:18 2022] POST /identity/v3/projects => generated 373 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:18.174769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.178975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1210d1fd20485e9c9701a9731b93b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:18.180206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1210d1fd20485e9c9701a9731b93b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:18.189561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1210d1fd20485e9c9701a9731b93b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:18.190466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1210d1fd20485e9c9701a9731b93b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:18.215608 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3260/6551] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:17 2022] DELETE /identity/v3/users/fe1210d1fd20485e9c9701a9731b93b5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:18.259029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49271495-ffa4-4f9b-81e9-744a24142129 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.310789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:18.372695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.373530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.374744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.375167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.375960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.378993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.419363 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3292/6552] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:18 2022] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:18.423163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.425023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:18.445448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33e194-90dc-4153-b9f8-f3ab29763774 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.450290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.450912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.451188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.452456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.452456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.453952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.468045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3261/6553] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:18.472028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.483933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3c606-a11c-4c9e-99e6-9b8e4c67658f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.490502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccaceb-db3a-4878-a8ef-f0412b6bfb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.491150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccaceb-db3a-4878-a8ef-f0412b6bfb04 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.491492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccaceb-db3a-4878-a8ef-f0412b6bfb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.491776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccaceb-db3a-4878-a8ef-f0412b6bfb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.492737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccaceb-db3a-4878-a8ef-f0412b6bfb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.495072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccaceb-db3a-4878-a8ef-f0412b6bfb04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.510612 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3293/6554] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:18.511331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.523795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc59af0-1dab-4176-ad0d-1a149c775436 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.529042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.529823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.530113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.530959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] PATH_INFO: `/v3/projects/7d49d53548784fe8831195af26956c79/users/3eb906eeed83492c95cf2299dd9f3551/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.562955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d49d53548784fe8831195af26956c79, user_id=3eb906eeed83492c95cf2299dd9f3551, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.567619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.592398 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3262/6555] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:18 2022] PUT /identity/v3/projects/7d49d53548784fe8831195af26956c79/users/3eb906eeed83492c95cf2299dd9f3551/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:18.603406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.603605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.603896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.637310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] MFA Rules not processed for user `3eb906eeed83492c95cf2299dd9f3551`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:18.639631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:18.767124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3294/6556] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:18.772616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.870360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194a8e6-ca63-4cf4-85da-ff890e16ffa8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:18.876108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:18.877563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:18.878004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:18.878380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:18.879121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:18.881170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:18.921939 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3263/6557] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:18 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:18.922972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:18.953096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940469e5-ffc0-4221-99f3-5d72212cc0c1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.039920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.040959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.041412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.041857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.042754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:19.045161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:19.081909 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3295/6558] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:18 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:19.085657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:19.097708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500537d-a3ac-41e8-be0f-15e3ad95fe59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.103879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.104196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.104456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.104742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.105412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:19.107572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:19.120895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3264/6559] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:19.124749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:19.135459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b9bd9-c9e0-47ac-997c-020f7e867489 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.144803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.145518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.145775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.146153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] PATH_INFO: `/v3/projects/9d9545f39cbe487ba3eb474e26bd9e96/users/7464830e2b6f44be8c546647ae8827a6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.167112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9545f39cbe487ba3eb474e26bd9e96, user_id=7464830e2b6f44be8c546647ae8827a6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:19.170015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:19.207553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3296/6560] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:19 2022] PUT /identity/v3/projects/9d9545f39cbe487ba3eb474e26bd9e96/users/7464830e2b6f44be8c546647ae8827a6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:19.208815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:19.223051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033da43a-d706-41f4-807f-8340e71c3da9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.310772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccf457-72a6-4a22-8af9-98e63edd026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.311962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccf457-72a6-4a22-8af9-98e63edd026e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.312367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccf457-72a6-4a22-8af9-98e63edd026e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.313310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccf457-72a6-4a22-8af9-98e63edd026e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.313604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccf457-72a6-4a22-8af9-98e63edd026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:19.315596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccf457-72a6-4a22-8af9-98e63edd026e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:19.318201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:19.331608 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3265/6561] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:19.335527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:19.345482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:19.352159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a23f2c-c825-495f-b9a2-cebde6e02112 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.360459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.361290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.361670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.362088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] PATH_INFO: `/v3/projects/9d9545f39cbe487ba3eb474e26bd9e96/users/7464830e2b6f44be8c546647ae8827a6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.364310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9545f39cbe487ba3eb474e26bd9e96, user_id=7464830e2b6f44be8c546647ae8827a6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:19.367632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:19.386684 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3297/6562] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:19 2022] PUT /identity/v3/projects/9d9545f39cbe487ba3eb474e26bd9e96/users/7464830e2b6f44be8c546647ae8827a6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:19.400560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.401061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.401633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.413848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:19.416900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:19.488348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] MFA Rules not processed for user `7464830e2b6f44be8c546647ae8827a6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:19.488754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:19.605046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee568099-1f5e-4234-bbc1-a20c2751b7fc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.619428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.620473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.621570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.621990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] PATH_INFO: `/v3/projects/4bc3bb250aee48618e2c9113c9c093d1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.626711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc3bb250aee48618e2c9113c9c093d1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:19.628805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:19.654450 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3266/6563] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:19.655551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:19.657232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:19.751906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc3bb250aee48618e2c9113c9c093d1', 'request_id': 'req-db063e8b-ac4b-41a2-b343-c54599af7826'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:19.766954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc3bb250aee48618e2c9113c9c093d1', 'request_id': 'req-db063e8b-ac4b-41a2-b343-c54599af7826'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:19.784920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc3bb250aee48618e2c9113c9c093d1', 'request_id': 'req-db063e8b-ac4b-41a2-b343-c54599af7826'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:19.799648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b12dff-637b-4ad6-8c0a-6e647e701d52 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:19.817265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] The token cache is being invalidate because project 4bc3bb250aee48618e2c9113c9c093d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:19.817605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:19.818529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-db063e8b-ac4b-41a2-b343-c54599af7826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:19.820644 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3298/6564] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:19 2022] DELETE /identity/v3/projects/4bc3bb250aee48618e2c9113c9c093d1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:19.826397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf16e-048d-4837-bece-7f04d1947952 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.826945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf16e-048d-4837-bece-7f04d1947952 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.827400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbf16e-048d-4837-bece-7f04d1947952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.873009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c8cbf16e-048d-4837-bece-7f04d1947952 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:19.874299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8cbf16e-048d-4837-bece-7f04d1947952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:19.875176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:19.876629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:19.876852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:19.877762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:19.880164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:20.027567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:20.036193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.037779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.054344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3299/6565] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:20.056411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.059107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.059383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.060237 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3267/6566] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:20.108800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:20.110137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:20.119438 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3300/6567] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:20.123554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:20.142310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be553f-b853-49d2-bbc5-3b98f2ee2117 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:20.152790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:20.153715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.154052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.154368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.155000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:20.155309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.157051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.178712 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3268/6568] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:15:20.183032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:20.195450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2aaa1-bda0-43d7-a380-076ba0a46518 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:20.209697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:20.210490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.210765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.211031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.211668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.213972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.243763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:20.288505 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3301/6569] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:20 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:20.292848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:20.307692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462d4d3-bab8-4f3b-bfc0-5c0f126572b3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:20.454312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:20.456150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.456288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.456501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.457583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.461437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.525233 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3269/6570] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:20 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:20.526578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:20.551121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615a473-0137-4e46-b28d-082d44b6899e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:20.559132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:20.559776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.560108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.560382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.561109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.565541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.586842 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3302/6571] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:20.590828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:20.602537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426e893-97b8-43cb-ab85-9373fe2d9071 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:20.629071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a367a-268a-47fc-8373-3b53363ee118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:20.629687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a367a-268a-47fc-8373-3b53363ee118 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.630009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a367a-268a-47fc-8373-3b53363ee118 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.630280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a367a-268a-47fc-8373-3b53363ee118 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.630930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a367a-268a-47fc-8373-3b53363ee118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.632817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a367a-268a-47fc-8373-3b53363ee118 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.660571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3270/6572] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:20.665355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:20.678920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91ea4b-b61b-49f3-be30-7f1db0fd4fb9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:20.686841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:20.687818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.688063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.688468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] PATH_INFO: `/v3/projects/9bbda688bf8f4763b5f6cd46530c0e44/users/4802a76fa4d1475aa201d46cbcf8b7ae/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.716874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbda688bf8f4763b5f6cd46530c0e44, user_id=4802a76fa4d1475aa201d46cbcf8b7ae, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:20.720600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:20.739282 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3303/6573] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:20 2022] PUT /identity/v3/projects/9bbda688bf8f4763b5f6cd46530c0e44/users/4802a76fa4d1475aa201d46cbcf8b7ae/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:20.752333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:20.752441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:20.752786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:20.810521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] MFA Rules not processed for user `4802a76fa4d1475aa201d46cbcf8b7ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:20.815180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:20.981783 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3271/6574] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:20.984754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:21.115755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611dee0-fc3d-4411-8ba3-2a9b31a74687 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:21.125378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:21.126137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.126400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.126671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.127329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:21.129262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:21.195889 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3304/6575] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:20 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:21.201108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:21.218665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0d487-6737-4bdf-baee-1c0faa45f828 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:21.295825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:21.334704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:21.335349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.336054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.336338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.336992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:21.340787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:21.381090 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3272/6576] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:21 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:21.383364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:21.404053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41bcc1e-2809-4c33-8925-d9fbbf2e08c6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:21.418759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:21.419404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.419686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.419961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.420609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:21.426180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:21.460991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:21.468442 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3305/6577] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:21.476246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24159276-19f2-478d-b6f6-e87dc174acc3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:21.488424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:21.489129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.489409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.489679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] PATH_INFO: `/v3/projects/b16c75ae69534efdbd8da0046509ef7e/users/07b3453302a142d394e53a6069e7f6b3/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.528220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c75ae69534efdbd8da0046509ef7e, user_id=07b3453302a142d394e53a6069e7f6b3, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:21.531192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:21.571714 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3273/6578] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:21 2022] PUT /identity/v3/projects/b16c75ae69534efdbd8da0046509ef7e/users/07b3453302a142d394e53a6069e7f6b3/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:21.575734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:21.591545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cedf7d5-3907-4baa-b1da-a4f6415686ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:21.792997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9476c-8faa-413c-a1a3-52f5852c2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:21.794170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9476c-8faa-413c-a1a3-52f5852c2ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.794455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9476c-8faa-413c-a1a3-52f5852c2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.794734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9476c-8faa-413c-a1a3-52f5852c2ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.795391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9476c-8faa-413c-a1a3-52f5852c2ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:21.797060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9476c-8faa-413c-a1a3-52f5852c2ca3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:21.819912 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3306/6579] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:21.821500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:21.837472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725b6d-c513-422c-880f-17fa50d5f732 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:21.851510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:21.852861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.853145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.854144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] PATH_INFO: `/v3/projects/b16c75ae69534efdbd8da0046509ef7e/users/07b3453302a142d394e53a6069e7f6b3/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.865610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b16c75ae69534efdbd8da0046509ef7e, user_id=07b3453302a142d394e53a6069e7f6b3, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:21.870029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:21.906090 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3274/6580] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:21 2022] PUT /identity/v3/projects/b16c75ae69534efdbd8da0046509ef7e/users/07b3453302a142d394e53a6069e7f6b3/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:21.913194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:21.913518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:21.913744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:21.963244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] MFA Rules not processed for user `07b3453302a142d394e53a6069e7f6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:21.965365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:22.010384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:22.149209 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3307/6581] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:21 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:22.162518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:22.164538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:22.268044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e55e52-a3b9-41aa-9877-b2e0a82531f5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:22.273685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:22.274461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:22.274744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:22.275094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:22.351536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:22.352948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:22.364218 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3275/6582] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:25.628694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:25.631159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:25.780023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c65fab-70e2-422e-ab3b-4adf4e4aae82 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:25.786207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:25.787336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:25.787715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:25.788090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] PATH_INFO: `/v3/users/4aab5eb9a3764e75863bf930c2bbd8bd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:25.789536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aab5eb9a3764e75863bf930c2bbd8bd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:25.792441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:25.969640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aab5eb9a3764e75863bf930c2bbd8bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:25.990114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aab5eb9a3764e75863bf930c2bbd8bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:25.991625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aab5eb9a3764e75863bf930c2bbd8bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:26.028701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aab5eb9a3764e75863bf930c2bbd8bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:26.030281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-929403cf-97f8-4cab-9b17-a760a7155a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aab5eb9a3764e75863bf930c2bbd8bd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:26.112687 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3308/6583] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:25 2022] DELETE /identity/v3/users/4aab5eb9a3764e75863bf930c2bbd8bd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:27.661217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:27.662748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:27.700038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39258227-d5a9-4819-ba62-9640b99b21ba service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:27.788347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:27.797747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:27.798878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:27.799446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:27.799924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] PATH_INFO: `/v3/users/3eb906eeed83492c95cf2299dd9f3551` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:27.801322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb906eeed83492c95cf2299dd9f3551)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:27.803647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:27.899484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb906eeed83492c95cf2299dd9f3551'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:27.914285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb906eeed83492c95cf2299dd9f3551'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:27.915278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb906eeed83492c95cf2299dd9f3551'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:27.923759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb906eeed83492c95cf2299dd9f3551'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:27.925058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb906eeed83492c95cf2299dd9f3551'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:27.949793 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3276/6584] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:27 2022] DELETE /identity/v3/users/3eb906eeed83492c95cf2299dd9f3551 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:27.954254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:27.954786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:27.954887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:27.991104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:27.992654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:28.048802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:28.129001 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3309/6585] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:28.146402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:28.148489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:28.317295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e481155-41ff-4d4c-a123-e76242e2ad9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:28.320962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1eb8-9aa3-4530-8207-960b8a74c7ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:28.321587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1eb8-9aa3-4530-8207-960b8a74c7ee service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:28.322096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1eb8-9aa3-4530-8207-960b8a74c7ee service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:28.322375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1eb8-9aa3-4530-8207-960b8a74c7ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:28.333291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1eb8-9aa3-4530-8207-960b8a74c7ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:28.335296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1eb8-9aa3-4530-8207-960b8a74c7ee service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:28.351382 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3277/6586] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:28.358123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:28.359690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:28.389400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb40f3-a5b2-4911-9bd3-b30cc6e537f2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:28.407722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:28.408403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:28.408682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:28.408955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] PATH_INFO: `/v3/projects/70185f31a11248d79b722001900d890a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:28.410130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70185f31a11248d79b722001900d890a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:28.413617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:28.483435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70185f31a11248d79b722001900d890a', 'request_id': 'req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:28.491023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70185f31a11248d79b722001900d890a', 'request_id': 'req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:28.502549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70185f31a11248d79b722001900d890a', 'request_id': 'req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:28.537698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] The token cache is being invalidate because project 70185f31a11248d79b722001900d890a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:28.538060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:28.542151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c0fccfd7-cb24-46cc-ace7-fd6f727e8ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:28.548552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3310/6587] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:28 2022] DELETE /identity/v3/projects/70185f31a11248d79b722001900d890a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:28.554685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:28.555092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:28.555464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:28.606325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:28.607691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:28.692962 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3278/6588] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:28.694137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:28.694422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:28.694720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:28.736483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:28.737782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:28.752851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3311/6589] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:28.754294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:28.765620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8f8da-94fd-4e93-9c26-a08aacc31f7d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:28.773371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:28.774587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:28.775071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:28.775545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:28.776556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:28.777059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:28.781976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:28.805319 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3279/6590] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:28.807149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:28.820416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab3eda-da33-40c7-be87-9f78dacc97ca None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:28.839186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:28.839984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:28.840275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:28.840577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:28.842035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:28.844532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:28.914131 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3312/6591] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:28 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:28.918076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:28.925696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:28.934573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c20698-c292-42b6-8e9d-ff738578c903 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:29.058884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:29.059445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:29.059727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:29.059998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:29.060644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:29.062943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:29.105322 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3280/6592] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:28 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:29.109269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:29.128320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e7b8-8334-4b5f-92d2-9bf426812754 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:29.137609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:29.138593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:29.139053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:29.139511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:29.140400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:29.142902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:29.156801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3313/6593] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:29.160993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:29.172323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f11b61-06d8-4853-93e4-c6979b08eb68 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:29.177344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a0118-d719-45d5-9ffa-63054dda0489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:29.178019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0118-d719-45d5-9ffa-63054dda0489 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:29.178298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0118-d719-45d5-9ffa-63054dda0489 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:29.178566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a0118-d719-45d5-9ffa-63054dda0489 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:29.179205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a0118-d719-45d5-9ffa-63054dda0489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:29.180829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a0118-d719-45d5-9ffa-63054dda0489 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:29.197121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3281/6594] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:29.198568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:29.211776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95d04-1a8b-4127-a378-a482ed35218f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:29.217130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:29.218010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:29.218645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:29.219072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] PATH_INFO: `/v3/projects/b9abafce931f45438286305af9b7a64a/users/d2867c5be8974c028f933d1c8fe2c2fa/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:29.237322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9abafce931f45438286305af9b7a64a, user_id=d2867c5be8974c028f933d1c8fe2c2fa, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:29.240584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:29.267351 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3314/6595] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:29 2022] PUT /identity/v3/projects/b9abafce931f45438286305af9b7a64a/users/d2867c5be8974c028f933d1c8fe2c2fa/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:29.272359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:29.272713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:29.272980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:29.308337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:29.309542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:29.454000 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3282/6596] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:29.491198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:29.494449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:29.621404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cd320-58ac-476a-bfd6-73b5bbec4eb7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:29.627429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:29.628272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:29.628646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:29.629016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:29.637627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:29.646065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:29.648081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:29.661852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3315/6597] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:30.304907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:30.306630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:30.344204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe48fc-3539-4ba7-bd75-ad6b03777c88 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:30.353355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:30.354424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:30.355046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:30.355657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] PATH_INFO: `/v3/projects/7d49d53548784fe8831195af26956c79` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:30.361100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d49d53548784fe8831195af26956c79)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:30.398016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:30.519044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d49d53548784fe8831195af26956c79', 'request_id': 'req-fb44f755-0ee1-42ea-b620-824142b2836e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.528696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d49d53548784fe8831195af26956c79', 'request_id': 'req-fb44f755-0ee1-42ea-b620-824142b2836e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.558484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d49d53548784fe8831195af26956c79', 'request_id': 'req-fb44f755-0ee1-42ea-b620-824142b2836e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.584514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] The token cache is being invalidate because project 7d49d53548784fe8831195af26956c79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:30.585257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.586308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.592603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:30.594928 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3283/6598] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:30 2022] DELETE /identity/v3/projects/7d49d53548784fe8831195af26956c79 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:30.606004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9c89b-845c-4193-bf29-b22c3e493fb1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:30.733399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:30.734144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:30.734478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:30.734772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] PATH_INFO: `/v3/users/7464830e2b6f44be8c546647ae8827a6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:30.735974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7464830e2b6f44be8c546647ae8827a6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:30.738008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:30.838235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7464830e2b6f44be8c546647ae8827a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.857739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7464830e2b6f44be8c546647ae8827a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.858520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7464830e2b6f44be8c546647ae8827a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.882533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7464830e2b6f44be8c546647ae8827a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.890342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7464830e2b6f44be8c546647ae8827a6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:30.927682 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3316/6599] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:30 2022] DELETE /identity/v3/users/7464830e2b6f44be8c546647ae8827a6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:31.201679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:31.204107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:31.232836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f755-0ee1-42ea-b620-824142b2836e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:31.240564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:31.415653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:31.419614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:31.420014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:31.420520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] PATH_INFO: `/v3/users/151159e7f3a34a7794952d2113046e9e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:31.422248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151159e7f3a34a7794952d2113046e9e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:31.430015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:31.498181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:31.499751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:31.521672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bebabb-c4cc-4e5d-9f49-bc4cf25dd48a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:31.534773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:31.536069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:31.536657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:31.537084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] PATH_INFO: `/v3/projects/9d9545f39cbe487ba3eb474e26bd9e96` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:31.538401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9545f39cbe487ba3eb474e26bd9e96)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:31.540460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:31.572956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151159e7f3a34a7794952d2113046e9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.596636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151159e7f3a34a7794952d2113046e9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.597484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151159e7f3a34a7794952d2113046e9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.628715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151159e7f3a34a7794952d2113046e9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.631207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6cac1109-64ec-4c9f-b987-5e69effb5010 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151159e7f3a34a7794952d2113046e9e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.650222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9545f39cbe487ba3eb474e26bd9e96', 'request_id': 'req-7549bcae-d32b-40f8-8f16-5696358ba6fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.673676 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3284/6600] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:31 2022] DELETE /identity/v3/users/151159e7f3a34a7794952d2113046e9e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:31.677796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9545f39cbe487ba3eb474e26bd9e96', 'request_id': 'req-7549bcae-d32b-40f8-8f16-5696358ba6fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.678117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:31.678407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:31.678685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:31.712118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9545f39cbe487ba3eb474e26bd9e96', 'request_id': 'req-7549bcae-d32b-40f8-8f16-5696358ba6fc'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.722652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:31.724630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:31.725899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:31.760606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] The token cache is being invalidate because project 9d9545f39cbe487ba3eb474e26bd9e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:31.760905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.763636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7549bcae-d32b-40f8-8f16-5696358ba6fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:31.776016 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3317/6601] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:31 2022] DELETE /identity/v3/projects/9d9545f39cbe487ba3eb474e26bd9e96 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:31.778814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccbd24-b57c-48a0-96c8-6e44845696f0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:31.779093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccbd24-b57c-48a0-96c8-6e44845696f0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:31.779559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccbd24-b57c-48a0-96c8-6e44845696f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:31.839012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-51ccbd24-b57c-48a0-96c8-6e44845696f0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:31.840256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51ccbd24-b57c-48a0-96c8-6e44845696f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:31.862595 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3285/6602] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:31.879986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:31.881705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:31.940297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:31.972929 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3318/6603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:32.020523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eee42a-45d0-4bff-876c-9b6690bca736 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.030304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.031428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.031825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.032195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.056325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.057999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.080776 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3286/6604] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:15:32.086483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.086863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.087084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.131022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:32.132519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:32.142220 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3319/6605] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:32.146527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.159439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c42e6f-1c3f-4b57-9193-0c866d28f2ba service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.176577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.177516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.177899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.178267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.179007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:32.179405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.181311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.202617 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3287/6606] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:32.207517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.221745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104283c-edd6-457a-958a-3016eb95daf9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.230113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.230747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.231027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.231344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.232000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.234122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.310105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.311886 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3320/6607] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:32 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:32.334973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600806b-55e8-441b-9775-03c4274584d4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.438703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.440693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:32.454710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.456052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.456510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.456988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.457897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.459434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf6a5-5abe-42cf-8e84-8dbaa215df63 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.461782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.466008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.466804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.467155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.467499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] PATH_INFO: `/v3/users/b0ef2697dbca43e7929fd13e16ddec96` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.469524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ef2697dbca43e7929fd13e16ddec96)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.472768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.503029 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3288/6608] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:32 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:32.508183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.528108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38dcb-897e-4987-8774-14016e8ccd3a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.563935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.564632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.564912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.565183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.565876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.567573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.593508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ef2697dbca43e7929fd13e16ddec96'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.596812 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3289/6609] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:32.601320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.615020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ef2697dbca43e7929fd13e16ddec96'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.615747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ef2697dbca43e7929fd13e16ddec96'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.629514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b478d0-82d9-4efd-afe3-93b09b93dfab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.629652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ef2697dbca43e7929fd13e16ddec96'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.630448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ef2697dbca43e7929fd13e16ddec96'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.639402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.640324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.640737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.641080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.642103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.659511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.687537 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3290/6610] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:32.687537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.689116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:32.709911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b95192-c900-41e8-b0b7-fad476b37c7a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.716124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:32.716333 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3321/6611] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:32 2022] DELETE /identity/v3/users/b0ef2697dbca43e7929fd13e16ddec96 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:32.717398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.717774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.718415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] PATH_INFO: `/v3/projects/081614647a1a4e37b900cac2a5d64ffe` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.719925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=081614647a1a4e37b900cac2a5d64ffe)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:32.721536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:32.722718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:32.724411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:32.804155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:32.805455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081614647a1a4e37b900cac2a5d64ffe', 'request_id': 'req-8f78f479-6cc7-4887-baa1-68a4139bbfdb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.832992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ae1d7-3a17-469b-8572-0b0599cf0f21 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:32.833935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081614647a1a4e37b900cac2a5d64ffe', 'request_id': 'req-8f78f479-6cc7-4887-baa1-68a4139bbfdb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.844905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081614647a1a4e37b900cac2a5d64ffe', 'request_id': 'req-8f78f479-6cc7-4887-baa1-68a4139bbfdb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.876371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] The token cache is being invalidate because project 081614647a1a4e37b900cac2a5d64ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:32.876873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.879510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f78f479-6cc7-4887-baa1-68a4139bbfdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:32.883475 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3291/6612] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:32 2022] DELETE /identity/v3/projects/081614647a1a4e37b900cac2a5d64ffe => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:32.885170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04154df-7cf9-49f1-88a9-0fc5d79ca9e1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:32.889726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04154df-7cf9-49f1-88a9-0fc5d79ca9e1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:32.890232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04154df-7cf9-49f1-88a9-0fc5d79ca9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:32.926334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:32.942319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b04154df-7cf9-49f1-88a9-0fc5d79ca9e1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:32.947453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b04154df-7cf9-49f1-88a9-0fc5d79ca9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:33.007116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76a72f-d98a-43ae-81c7-834aad451097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.008962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a72f-d98a-43ae-81c7-834aad451097 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.010612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a72f-d98a-43ae-81c7-834aad451097 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.010612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76a72f-d98a-43ae-81c7-834aad451097 admin admin] PATH_INFO: `/v3/projects/e42bde1143b840069ff04329df093ffd/users/2850ba97d871402d9d266beb753cb657/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.048882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a72f-d98a-43ae-81c7-834aad451097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42bde1143b840069ff04329df093ffd, user_id=2850ba97d871402d9d266beb753cb657, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.052047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76a72f-d98a-43ae-81c7-834aad451097 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.079122 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3322/6613] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:32 2022] PUT /identity/v3/projects/e42bde1143b840069ff04329df093ffd/users/2850ba97d871402d9d266beb753cb657/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:33.080668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.081056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.081424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.127908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:33.129360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:33.139073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3292/6614] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:33.140215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173682-d7a1-4b08-8241-6bab406d3354 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.140928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173682-d7a1-4b08-8241-6bab406d3354 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.141212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173682-d7a1-4b08-8241-6bab406d3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.201458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d0173682-d7a1-4b08-8241-6bab406d3354 None None] MFA Rules not processed for user `2850ba97d871402d9d266beb753cb657`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:33.202942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d0173682-d7a1-4b08-8241-6bab406d3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:33.267014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3323/6615] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:33.267014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.268678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:33.339529 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3293/6616] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:33.341150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.344730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.345205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.385465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcfcaa-85ac-476c-9099-03c80ba89756 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.395636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:33.396803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.397557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.397934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.398275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.399329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:33.417075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.418728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.425831 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3294/6617] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:33.427701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.431677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:33.444039 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3324/6618] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:33.445160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.468570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076776ce-d467-44dc-8807-7fabd6e36188 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.473690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.474424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.474773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.475121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.475841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:33.476199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.478466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.504738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:33.512794 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3325/6619] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:33.517468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.541874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cec3b-1202-48b6-81e6-e8b8abb46e1a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.546935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.547658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.547937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.548207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.548844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.550802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.590419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac903e7-10a0-4a3c-a94e-aa2b43c1935e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.600123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.601021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.603340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.604035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.610154 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3326/6620] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:33 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:33.614261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.630498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.632008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.660946 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3295/6621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:33.736577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117491f-00cf-4f44-9553-a2bedc5a8417 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.747056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.747700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.747992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.748253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.748951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.758127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.794308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3327/6622] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:33 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:33.795926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.812831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12857d7c-e18f-4587-bd0b-7674bdd23f2c service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.825685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.827504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.829705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.830311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.831153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.834678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.865571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3296/6623] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:33.867412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.882164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee765a12-27ec-418f-a6c9-8540c827e355 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.905247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6c68a-2c2c-4ae5-81e5-8f8f4e278eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.906819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6c68a-2c2c-4ae5-81e5-8f8f4e278eec admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.907104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6c68a-2c2c-4ae5-81e5-8f8f4e278eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.907380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6c68a-2c2c-4ae5-81e5-8f8f4e278eec admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:33.908035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6c68a-2c2c-4ae5-81e5-8f8f4e278eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:33.914471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6c68a-2c2c-4ae5-81e5-8f8f4e278eec admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:33.943451 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3328/6624] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:33.947809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:33.962436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b95dcc-da0e-4d64-a250-5ea9d6d5214a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:33.976490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:33.979168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:33.979404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:33.979725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] PATH_INFO: `/v3/projects/81e64392606843c6a66f532adeaf3bac/users/6f23784b1611492ea18bf82cc3f81065/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:34.028051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81e64392606843c6a66f532adeaf3bac, user_id=6f23784b1611492ea18bf82cc3f81065, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:34.032874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:34.057590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:34.084293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:34.084668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:34.084960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:34.088195 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3297/6625] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:33 2022] PUT /identity/v3/projects/81e64392606843c6a66f532adeaf3bac/users/6f23784b1611492ea18bf82cc3f81065/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:34.142375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] MFA Rules not processed for user `6f23784b1611492ea18bf82cc3f81065`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:34.143627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:34.244335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:34.246521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:34.345824 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3329/6626] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:34.346832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:34.391285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab743f-0c85-4dd0-b986-4f9df84b6c9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:34.424046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:34.424828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:34.425106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:34.425378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] PATH_INFO: `/v3/projects/8e5777b9d26f46b3a7ba7f309de040b8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:34.435254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5777b9d26f46b3a7ba7f309de040b8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:34.441058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:34.505674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:34.551019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7144fe4-1139-4d7b-a5a9-c0e8e00c0f11 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:34.583622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5777b9d26f46b3a7ba7f309de040b8', 'request_id': 'req-ec88dc1b-ca40-4396-abfc-9d8a31c35000'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:34.595379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5777b9d26f46b3a7ba7f309de040b8', 'request_id': 'req-ec88dc1b-ca40-4396-abfc-9d8a31c35000'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:34.602945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5777b9d26f46b3a7ba7f309de040b8', 'request_id': 'req-ec88dc1b-ca40-4396-abfc-9d8a31c35000'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:34.626857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] The token cache is being invalidate because project 8e5777b9d26f46b3a7ba7f309de040b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:34.627156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:34.635866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:34.638365 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3298/6627] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:34 2022] DELETE /identity/v3/projects/8e5777b9d26f46b3a7ba7f309de040b8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:34.641345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:34.646127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:34.685031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:34.686109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:34.686649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:34.687371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:34.688275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:34.691641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:34.746677 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3330/6628] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:34 2022] POST /identity/v3/projects => generated 363 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:34.747994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:34.751554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:34.774498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88dc1b-ca40-4396-abfc-9d8a31c35000 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:34.856609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:34.901315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004e963-a451-4504-8825-9e9ca57579e4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:34.910231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:34.911037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:34.911417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:34.911811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] PATH_INFO: `/v3/users/71ba70bcfcf24f2db21cbe68cec3654f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:34.913772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:34.916163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ba70bcfcf24f2db21cbe68cec3654f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:34.917394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:34.917394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:34.920208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] PATH_INFO: `/v3/users/185a9b10438d4d3abf04a88542f05556` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:34.920974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:34.923873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=185a9b10438d4d3abf04a88542f05556)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:34.927360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.050416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '185a9b10438d4d3abf04a88542f05556'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.051142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ba70bcfcf24f2db21cbe68cec3654f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.071050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '185a9b10438d4d3abf04a88542f05556'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.071922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '185a9b10438d4d3abf04a88542f05556'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.095321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '185a9b10438d4d3abf04a88542f05556'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.096137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ba70bcfcf24f2db21cbe68cec3654f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.097171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ba70bcfcf24f2db21cbe68cec3654f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.097625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '185a9b10438d4d3abf04a88542f05556'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.124733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ba70bcfcf24f2db21cbe68cec3654f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.132456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a5c61e9-9673-4e85-8b99-66ae6ba756d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ba70bcfcf24f2db21cbe68cec3654f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.134159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:35.152434 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3331/6629] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:34 2022] DELETE /identity/v3/users/185a9b10438d4d3abf04a88542f05556 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:35.170116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.178896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.186082 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3299/6630] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:34 2022] DELETE /identity/v3/users/71ba70bcfcf24f2db21cbe68cec3654f => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:35.201876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.202508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.206351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.270852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:35.272470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.426691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f14431-01f3-4ca2-8a13-12476c6c9ded admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:35.458444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3300/6631] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:35.489366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.490809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.517959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:35.518592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.518865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.519134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.519772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:35.521810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.586696 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3332/6632] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:35 2022] POST /identity/v3/users => generated 288 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:35.591867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.594888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.624747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad36bf6a-b77e-4da6-841b-fba8550a1956 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:35.626730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1361fb7-c173-424d-bc5a-2d5f0da153cf admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:35.630909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:35.632279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.632750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.633367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.635692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:35.636457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.636804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.637141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.638026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:35.640051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.664278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3333/6633] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:15:35.664278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.666049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.683764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a08e5-0df8-4ecb-84bd-76f7446f792f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:35.687808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:35.689518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.690348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:35.691335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.691736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.692115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] PATH_INFO: `/v3/projects/b802314604664cd3946be64f63901645` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.693450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b802314604664cd3946be64f63901645)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:35.695542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:35.695765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.714207 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3301/6634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:15:35.715718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.729771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f0dd9-41a5-4afb-a9fb-f13cf94d611c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:35.736899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:35.738499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.745514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.746262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] PATH_INFO: `/v3/projects/b38a47eae5f747aa8c5d5824fac87b71/users/6b5a984c9cbd433d96783457a560efa5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.766698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38a47eae5f747aa8c5d5824fac87b71, user_id=6b5a984c9cbd433d96783457a560efa5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:35.770350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.783414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b802314604664cd3946be64f63901645', 'request_id': 'req-e121a842-67f1-4705-a130-b2d82830a154'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.792794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b802314604664cd3946be64f63901645', 'request_id': 'req-e121a842-67f1-4705-a130-b2d82830a154'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.797717 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3302/6635] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:35 2022] PUT /identity/v3/projects/b38a47eae5f747aa8c5d5824fac87b71/users/6b5a984c9cbd433d96783457a560efa5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:35.801619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b802314604664cd3946be64f63901645', 'request_id': 'req-e121a842-67f1-4705-a130-b2d82830a154'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.802117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.828264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] The token cache is being invalidate because project b802314604664cd3946be64f63901645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:35.828554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.832064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e121a842-67f1-4705-a130-b2d82830a154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:35.834812 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3334/6636] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:35 2022] DELETE /identity/v3/projects/b802314604664cd3946be64f63901645 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:35.840764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.841059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.841351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.863842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:35.872209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:35.875938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.917410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b127d-efc3-4ac9-9eb6-cf2892e513b6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:35.926174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:35.926922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:35.927294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:35.927794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:35.928705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:35.930305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:35.949907 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3303/6637] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:35.951517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:35.953819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:35.993126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261da01-69bb-468d-9662-5eb2fb3aa1dd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.027885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b163c-50b6-4831-83f5-6ff880c26464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.031856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b163c-50b6-4831-83f5-6ff880c26464 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.032212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b163c-50b6-4831-83f5-6ff880c26464 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.032588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b163c-50b6-4831-83f5-6ff880c26464 admin admin] PATH_INFO: `/v3/projects/b38a47eae5f747aa8c5d5824fac87b71/users/6b5a984c9cbd433d96783457a560efa5/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.032813 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3335/6638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:36.039462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.041159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.050753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b163c-50b6-4831-83f5-6ff880c26464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38a47eae5f747aa8c5d5824fac87b71, user_id=6b5a984c9cbd433d96783457a560efa5, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.053477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b163c-50b6-4831-83f5-6ff880c26464 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.055630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21862ff1-6d73-4ebc-af89-6efec847bf91 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.063229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.064606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.065062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.066094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] PATH_INFO: `/v3/projects/3c84f31469284febafbd9f8125a43531` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.067504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c84f31469284febafbd9f8125a43531)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.078190 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3304/6639] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:35 2022] PUT /identity/v3/projects/b38a47eae5f747aa8c5d5824fac87b71/users/6b5a984c9cbd433d96783457a560efa5/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:36.078190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6f14-e0d0-4075-bab1-729b0e8c18ce None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.078190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6f14-e0d0-4075-bab1-729b0e8c18ce None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.078190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab6f14-e0d0-4075-bab1-729b0e8c18ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.092658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0dab6f14-e0d0-4075-bab1-729b0e8c18ce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:36.094969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.095217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0dab6f14-e0d0-4075-bab1-729b0e8c18ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.182912 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3305/6640] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:36.184278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c84f31469284febafbd9f8125a43531', 'request_id': 'req-7cb5dca7-dff7-4a89-ba30-b29a58b82885'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:36.189139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c636-3520-453d-b393-51d2d8bbb008 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.189515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c636-3520-453d-b393-51d2d8bbb008 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.189794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7c636-3520-453d-b393-51d2d8bbb008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.192788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c84f31469284febafbd9f8125a43531', 'request_id': 'req-7cb5dca7-dff7-4a89-ba30-b29a58b82885'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:36.200718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c84f31469284febafbd9f8125a43531', 'request_id': 'req-7cb5dca7-dff7-4a89-ba30-b29a58b82885'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:36.217721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] The token cache is being invalidate because project 3c84f31469284febafbd9f8125a43531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:36.218114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:36.219072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:36.221918 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3336/6641] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:36 2022] DELETE /identity/v3/projects/3c84f31469284febafbd9f8125a43531 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:36.223284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.224899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.260258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39c7c636-3520-453d-b393-51d2d8bbb008 None None] MFA Rules not processed for user `6b5a984c9cbd433d96783457a560efa5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:36.261725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39c7c636-3520-453d-b393-51d2d8bbb008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.356705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5dca7-dff7-4a89-ba30-b29a58b82885 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.361056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:36.373470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.374193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.374513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.374951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.376015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:36.376544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.384038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.414488 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3306/6642] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:36.414488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.414488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.414488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.420797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3337/6643] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:36.422070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.459529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:36.463245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.469203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e85e603-bfa9-475f-8e45-b4eb975e27d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.482520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f6b75-58f7-47c7-9b42-6511ffde34db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.483164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6b75-58f7-47c7-9b42-6511ffde34db admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.483448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6b75-58f7-47c7-9b42-6511ffde34db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.483822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f6b75-58f7-47c7-9b42-6511ffde34db admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.484159 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3307/6644] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:36.485048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.486591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.494840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f6b75-58f7-47c7-9b42-6511ffde34db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.496849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f6b75-58f7-47c7-9b42-6511ffde34db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.559297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3338/6645] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:36 2022] POST /identity/v3/projects => generated 409 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:36.561270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.562648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.567326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.578458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:36.603777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:36.605449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:36.632451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7aa2f-e605-4c6c-ae79-79b4a1be6b5c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.753143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.757519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.758766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.759406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.844704 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3339/6646] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:36.845538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.865287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55448cf-3230-44ca-b53a-64aa28483499 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.879323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.879975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.880936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.881138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.881771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.883753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.906801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.911040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.944192 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3340/6647] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:36 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:36.944192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.949700 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3308/6648] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:36.953222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:36.963754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225e6be-bc8d-463d-a0b1-f84f552feb99 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.974744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1617c3ee-584b-4a40-a8e6-1624b3c55ceb service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:36.976971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.977738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.978258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.978538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.979720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:36.980745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.986122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:36.989117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:36.990526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:36.991306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:36.993211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:36.999662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:36.999662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.018956 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3341/6649] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:37.026904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.035503 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3309/6650] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:37.038721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.077215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b56e4-1a89-4a41-919b-5741faee1087 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.084786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cde9aa-574a-43d6-8b56-d46c26a80cc9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.089669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.090430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.090777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.091134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.092045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.096159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.099499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.100211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.100566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.100907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.101704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.108087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.156550 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3342/6651] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:37 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:37.157849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.158868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3310/6652] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:37.159753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.161680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:37.186798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de657264-e0c7-44fd-9b14-6031feb17282 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.231963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:37.320141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61424b37-46b1-4dd7-9706-29f5089f05be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.330303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.332409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.333008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.333739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.339254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:37.340673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.342184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.342695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.343560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.344366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.349409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.389351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3311/6653] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:37 2022] POST /identity/v3/users => generated 303 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:37.390828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.405280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cbc44-3bb2-49d3-9cbf-1e8a1d59d647 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.425563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.426912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.427653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.428139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] PATH_INFO: `/v3/projects/4c83139ca88c4b268db467045c7c598d/users/9788535a6a6b4f52b158f10d5590cb65/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.456109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c83139ca88c4b268db467045c7c598d, user_id=9788535a6a6b4f52b158f10d5590cb65, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.459468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.480718 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3312/6654] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:37 2022] PUT /identity/v3/projects/4c83139ca88c4b268db467045c7c598d/users/9788535a6a6b4f52b158f10d5590cb65/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:37.481993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.498447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.501941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce65381-9f65-45ed-8c2c-d7a6553d95cb service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.526403 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3343/6655] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:37.527920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.528155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.528998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.547797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:37.598132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] MFA Rules not processed for user `9788535a6a6b4f52b158f10d5590cb65`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:37.602369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:37.641468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0185f08-78e6-4bc3-b0da-a169340ddd85 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.653217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.654586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.657065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.657395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.658095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.665700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.704662 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3313/6656] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:37.707624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.714015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:37.808047 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3344/6657] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:37 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:37.811053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.826232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ab45e-abe1-460c-8415-c31fa8f63987 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.833244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.834209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.834543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.834868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.836044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.837532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.853831 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3345/6658] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:37.854966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.891118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377dca04-7e21-4d33-a43b-08b4445ebe3e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.901954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.903645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.903929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.904900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.905986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:37.909079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:37.953393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d336a-fa15-4fd6-8e5f-26f34a9a68d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:37.963074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:37.964185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:37.964471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:37.964801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:37.967765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:37.970686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3346/6659] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:37 2022] POST /identity/v3/projects => generated 411 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:37.971413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:37.993486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:38.076191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.078921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.088432 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3314/6660] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:15:38.092639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:38.103221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f155ed-4d02-4132-80f2-896562f2ac32 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.111380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeba74b-ebfb-455e-a530-e4c90b95d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.111823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeba74b-ebfb-455e-a530-e4c90b95d33c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.112221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeba74b-ebfb-455e-a530-e4c90b95d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.112706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeba74b-ebfb-455e-a530-e4c90b95d33c admin admin] PATH_INFO: `/v3/projects/50b8a863a5404cb78a3ea96810094379/users/04d718633619467e8c01f60b20db5bcb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.124363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be836f-4660-466d-9793-0eaa6d36532c service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.144340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.145158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.145509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.146318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.147079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.149355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.166109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeba74b-ebfb-455e-a530-e4c90b95d33c admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b8a863a5404cb78a3ea96810094379, user_id=04d718633619467e8c01f60b20db5bcb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.178231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeba74b-ebfb-455e-a530-e4c90b95d33c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.204030 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3315/6661] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:38 2022] POST /identity/v3/users => generated 312 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:38.205978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:38.207699 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3347/6662] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:37 2022] PUT /identity/v3/projects/50b8a863a5404cb78a3ea96810094379/users/04d718633619467e8c01f60b20db5bcb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:38.212987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.213289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.213572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.224771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81ec0e-09df-454c-9f0b-6b43d7606c07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.304700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:38.305938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:38.378635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.379275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.382943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.383235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.384121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.385757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.403833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:38.417750 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3316/6663] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:38.419294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:38.443990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0679ec-cd24-4c4e-a4df-cabba303dcac admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.456324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.457023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.457303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.457685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] PATH_INFO: `/v3/projects/7f2e4209d88449d19fbf6e6ad8bf8439/users/bd67f54ce7e743018d7c7f8ef6520b53/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.469577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3348/6664] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:38.482490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:38.489634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:38.534956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2e4209d88449d19fbf6e6ad8bf8439, user_id=bd67f54ce7e743018d7c7f8ef6520b53, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.537665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.593975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3317/6665] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:38 2022] PUT /identity/v3/projects/7f2e4209d88449d19fbf6e6ad8bf8439/users/bd67f54ce7e743018d7c7f8ef6520b53/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:38.599758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:38.711663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c310687-2509-470f-b265-ca362b3ade5c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.821228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e4db-3138-4e40-aad3-0bb201e62d59 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.827557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.828659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.828979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.830638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.831441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.833498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.853206 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3318/6666] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:38.856665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bd583-d751-4ad1-a90d-24cdc6b4bbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.857293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd583-d751-4ad1-a90d-24cdc6b4bbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.857576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd583-d751-4ad1-a90d-24cdc6b4bbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.857872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd583-d751-4ad1-a90d-24cdc6b4bbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.859729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:38.875417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:38.880505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bd583-d751-4ad1-a90d-24cdc6b4bbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.881950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ba6b-7fe9-4f87-ae35-552bbaa0f3ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:38.882094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bd583-d751-4ad1-a90d-24cdc6b4bbd2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.903095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:38.903804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.906324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.906611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] PATH_INFO: `/v3/projects/7f2e4209d88449d19fbf6e6ad8bf8439/users/bd67f54ce7e743018d7c7f8ef6520b53/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:38.911065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2e4209d88449d19fbf6e6ad8bf8439, user_id=bd67f54ce7e743018d7c7f8ef6520b53, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:38.918891 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3349/6667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:15:38.922063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:38.960288 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3319/6668] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:38 2022] PUT /identity/v3/projects/7f2e4209d88449d19fbf6e6ad8bf8439/users/bd67f54ce7e743018d7c7f8ef6520b53/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:38.962037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be1da-3390-4016-847e-134e0c1a71a7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:38.962503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be1da-3390-4016-847e-134e0c1a71a7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:38.962930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3be1da-3390-4016-847e-134e0c1a71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:39.018713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dc3be1da-3390-4016-847e-134e0c1a71a7 None None] MFA Rules not processed for user `bd67f54ce7e743018d7c7f8ef6520b53`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:39.019947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dc3be1da-3390-4016-847e-134e0c1a71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:39.179082 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3350/6669] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:38 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:39.206439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:39.208335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:39.368331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691082e0-113d-4a0c-a1a6-84a744cbb337 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:39.379849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:39.384366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:39.384698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:39.385537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:39.438415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:39.440401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:39.468310 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3320/6670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:39 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:40.127879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:40.128434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:40.128434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:40.211372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] MFA Rules not processed for user `04d718633619467e8c01f60b20db5bcb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:40.212909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:40.261511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:40.417783 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3351/6671] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:40.423463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:40.589740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7c2f43-641e-4548-a651-51f6d23c4736 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:40.608992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:40.610268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:40.610773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:40.611279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:40.612302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:40.620932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:40.687458 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3321/6672] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:40 2022] POST /identity/v3/projects => generated 405 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:40.691086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:40.712619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988bae7-985b-4c98-9a14-9b84aa1ef89a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:40.942514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:40.943294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:40.943623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:40.943900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:40.944648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:40.956936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:41.024288 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3352/6673] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:40 2022] POST /identity/v3/users => generated 309 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:41.027621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:41.052894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a782f-91da-4e4e-b8d9-2aa1831461a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:41.075210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:41.075865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.076149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.076423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.077078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:41.094235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:41.131855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3322/6674] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:41.135763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:41.161696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fbfaad-e1a2-42a3-827b-4cc80b78fe01 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:41.170902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:41.173554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:41.200929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:41.201707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.202123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.202616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] PATH_INFO: `/v3/projects/1a5def8be3ff449c8324e11d933dcc49/users/7f84912fbb484e468dc8285893b0174e/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.221623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5def8be3ff449c8324e11d933dcc49, user_id=7f84912fbb484e468dc8285893b0174e, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:41.224817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:41.230102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0547da-f0e9-433b-a94c-22d4b09cc0ff admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:41.255981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:41.257241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.259494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.260039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] PATH_INFO: `/v3/users/6f23784b1611492ea18bf82cc3f81065` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.261557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f23784b1611492ea18bf82cc3f81065)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:41.272214 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3353/6675] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:41 2022] PUT /identity/v3/projects/1a5def8be3ff449c8324e11d933dcc49/users/7f84912fbb484e468dc8285893b0174e/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:41.273564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:41.280761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:41.416921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f23784b1611492ea18bf82cc3f81065'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:41.448334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:41.450677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f23784b1611492ea18bf82cc3f81065'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:41.452791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f23784b1611492ea18bf82cc3f81065'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:41.458185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101fa72-555d-40f4-b418-517d16b92674 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:41.466374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f23784b1611492ea18bf82cc3f81065'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:41.466953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c2b050d9-0102-433a-9570-a7b791fa9884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f23784b1611492ea18bf82cc3f81065'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:41.470770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:41.471394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.472857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.473136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.473784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:41.476310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:41.496592 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3323/6676] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:41 2022] DELETE /identity/v3/users/6f23784b1611492ea18bf82cc3f81065 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:41.503559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531992bb-fad5-45fb-99a1-d8852043d685 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.503886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531992bb-fad5-45fb-99a1-d8852043d685 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.504163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531992bb-fad5-45fb-99a1-d8852043d685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.513756 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3354/6677] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:41.514879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:41.520820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:41.570254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee58c5-734d-4ab8-a7e2-81216a9ee2e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:41.571360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-531992bb-fad5-45fb-99a1-d8852043d685 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:41.573093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-531992bb-fad5-45fb-99a1-d8852043d685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:41.606853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:41.735953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:41.736582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.736856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.737130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] PATH_INFO: `/v3/projects/1a5def8be3ff449c8324e11d933dcc49/users/7f84912fbb484e468dc8285893b0174e/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.740907 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3324/6678] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:41.745258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a5def8be3ff449c8324e11d933dcc49, user_id=7f84912fbb484e468dc8285893b0174e, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:41.752276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.752537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.752727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:41.757625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:41.801850 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3355/6679] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:41 2022] PUT /identity/v3/projects/1a5def8be3ff449c8324e11d933dcc49/users/7f84912fbb484e468dc8285893b0174e/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:41.801850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:41.801850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:41.825836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] MFA Rules not processed for user `d2867c5be8974c028f933d1c8fe2c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:41.826189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:41.947667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1dfad-f599-4258-a91d-7aa92f2fcd5a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:41.957679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:41.958662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:41.958944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:41.959600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:42.045829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3325/6680] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:42.069617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:42.072158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:42.161396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:42.162913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:42.209446 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3356/6681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:42.300359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:42.430373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fdf06-d311-4286-8d64-3ee00236227f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:42.443813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:42.444445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:42.444720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:42.445028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:42.459210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:42.474567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:42.488025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3326/6682] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:15:43.412888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:43.419118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:43.448723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26940264-44ea-4557-a607-a0e98f52462c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:43.466581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:43.467631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:43.468207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:43.468704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] PATH_INFO: `/v3/projects/81e64392606843c6a66f532adeaf3bac` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:43.478783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81e64392606843c6a66f532adeaf3bac)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:43.481479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:43.519302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:43.520816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:43.562968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511de59-fc6e-4282-990c-71b29ede4eb5 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:43.568480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:43.569562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:43.570096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:43.570740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] PATH_INFO: `/v3/users/2850ba97d871402d9d266beb753cb657` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:43.572159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2850ba97d871402d9d266beb753cb657)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:43.574589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:43.659346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81e64392606843c6a66f532adeaf3bac', 'request_id': 'req-5907c167-cc1d-4bb8-ae89-6ede5a039117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.676937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2850ba97d871402d9d266beb753cb657'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.689446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81e64392606843c6a66f532adeaf3bac', 'request_id': 'req-5907c167-cc1d-4bb8-ae89-6ede5a039117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.694453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:43.702687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81e64392606843c6a66f532adeaf3bac', 'request_id': 'req-5907c167-cc1d-4bb8-ae89-6ede5a039117'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.703031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2850ba97d871402d9d266beb753cb657'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.706220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2850ba97d871402d9d266beb753cb657'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.725117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2850ba97d871402d9d266beb753cb657'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.725981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] The token cache is being invalidate because project 81e64392606843c6a66f532adeaf3bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:43.726698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.728664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a858cb5f-db5e-4dfa-8987-a8d091199726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2850ba97d871402d9d266beb753cb657'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.729213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:43.731036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3357/6683] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:43 2022] DELETE /identity/v3/projects/81e64392606843c6a66f532adeaf3bac => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:43.735284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:43.739761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:43.773911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3327/6684] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:43 2022] DELETE /identity/v3/users/2850ba97d871402d9d266beb753cb657 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:43.779062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef4f24-a51c-42f6-9c20-62848d8da048 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:43.779423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef4f24-a51c-42f6-9c20-62848d8da048 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:43.781961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef4f24-a51c-42f6-9c20-62848d8da048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:43.893022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907c167-cc1d-4bb8-ae89-6ede5a039117 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:43.913746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-daef4f24-a51c-42f6-9c20-62848d8da048 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:43.914936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-daef4f24-a51c-42f6-9c20-62848d8da048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:43.987883 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3328/6685] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:43.989864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:43.990487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:43.990923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:44.029836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:44.030802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:44.031185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:44.031565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] PATH_INFO: `/v3/users/6b5a984c9cbd433d96783457a560efa5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:44.033310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b5a984c9cbd433d96783457a560efa5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:44.034992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:44.049948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] MFA Rules not processed for user `7f84912fbb484e468dc8285893b0174e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:44.051193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:44.142429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:44.167393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b5a984c9cbd433d96783457a560efa5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:44.185216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b5a984c9cbd433d96783457a560efa5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:44.186169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b5a984c9cbd433d96783457a560efa5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:44.210306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b5a984c9cbd433d96783457a560efa5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:44.214877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b5a984c9cbd433d96783457a560efa5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:44.252460 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3329/6686] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:44.253519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:44.259793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:44.268471 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3358/6687] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:43 2022] DELETE /identity/v3/users/6b5a984c9cbd433d96783457a560efa5 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:44.509392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3948f0-05a8-4362-8267-d5c930324b75 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:44.612494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:44.613298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:44.614018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:44.614625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:44.616740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:44.707715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:44.709425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:44.724062 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3330/6688] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:45.008041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:45.010184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.032364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9dfa6-f74b-4925-8960-937d63d7bd38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:45.047196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:45.048064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.048486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.048984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] PATH_INFO: `/v3/users/9788535a6a6b4f52b158f10d5590cb65` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.052793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9788535a6a6b4f52b158f10d5590cb65)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:45.055061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:45.071406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:45.163644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9788535a6a6b4f52b158f10d5590cb65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.175399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9788535a6a6b4f52b158f10d5590cb65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.176371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9788535a6a6b4f52b158f10d5590cb65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.188263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9788535a6a6b4f52b158f10d5590cb65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.190600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e762eceb-18a5-4ede-91ef-50607ed1a62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9788535a6a6b4f52b158f10d5590cb65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.193481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:45.195054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.211424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761007a-7c3c-4564-b670-65784f54e0c4 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:45.227776 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3359/6689] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:45 2022] DELETE /identity/v3/users/9788535a6a6b4f52b158f10d5590cb65 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:45.231113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:45.231825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.231977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.232114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.232389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.232503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.232878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] PATH_INFO: `/v3/projects/b38a47eae5f747aa8c5d5824fac87b71` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.234248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38a47eae5f747aa8c5d5824fac87b71)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:45.236552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:45.278391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:45.279626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.318342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:45.354723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38a47eae5f747aa8c5d5824fac87b71', 'request_id': 'req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.373103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38a47eae5f747aa8c5d5824fac87b71', 'request_id': 'req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.391527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38a47eae5f747aa8c5d5824fac87b71', 'request_id': 'req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.400008 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3360/6690] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:45.415947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:45.417427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.421247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] The token cache is being invalidate because project b38a47eae5f747aa8c5d5824fac87b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:45.425513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.426429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0bad6e8c-93ac-4761-bcb0-85d174dc76c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:45.435760 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3331/6691] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:45 2022] DELETE /identity/v3/projects/b38a47eae5f747aa8c5d5824fac87b71 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:45.437317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44067f4b-ea56-4333-aa2f-3d4ce375b1a3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.437599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44067f4b-ea56-4333-aa2f-3d4ce375b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.437905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44067f4b-ea56-4333-aa2f-3d4ce375b1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.500256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-44067f4b-ea56-4333-aa2f-3d4ce375b1a3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:45.503576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-44067f4b-ea56-4333-aa2f-3d4ce375b1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.558592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32770-166a-46e0-b9b0-bc9b47f5635c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:45.652770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:45.679543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:45.680184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.680462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.680734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.682565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.696401 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3332/6692] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:45.705176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.705530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.705974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.708927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:45.710698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:45.731393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:45.732710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:45.737185 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3361/6693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:15:45.745397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3333/6694] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:45.746391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:45.757003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28089513-4c22-4c6d-b808-ad8d81d4db32 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:45.774477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:45.775642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.775642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.786202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.786803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:45.787128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:45.788779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:45.817877 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3362/6695] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:15:45.823004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:45.839434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645b3ac-947e-41fe-bab7-12605f501249 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:45.849385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:45.850353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:45.850831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:45.851284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:45.853146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:45.855536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:45.907134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:45.909142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3334/6696] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:45 2022] POST /identity/v3/projects => generated 399 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:45.919561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e8556-622f-45e1-a324-3a21dc6c5bc5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.025988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.027859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:46.056561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.058295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.059550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.060140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.060972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.063576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.098383 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3363/6697] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:45 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:46.102482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.141386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb249b-0060-40b3-9ffe-7eb4013e418a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.155147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.156198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.156902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.157608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.159338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.162142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.179632 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3364/6698] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:46.183434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.217000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c243d-29ab-4023-9212-6d6a4525d6a4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.227396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.228290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.229373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.229897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.230702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.232559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.237072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2de25d-6d69-4ac1-98b6-e01368ea1dee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.250061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.251035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.251305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.251578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] PATH_INFO: `/v3/projects/e42bde1143b840069ff04329df093ffd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.252826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42bde1143b840069ff04329df093ffd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.254793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.257763 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3365/6699] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:15:46.261670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.274390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92cd3b-e05e-471d-aab1-637c9df67140 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.283721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a3ac2-69f9-450f-b89c-c4d5425c6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.284638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a3ac2-69f9-450f-b89c-c4d5425c6bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.285159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a3ac2-69f9-450f-b89c-c4d5425c6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.285586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a3ac2-69f9-450f-b89c-c4d5425c6bd8 admin admin] PATH_INFO: `/v3/projects/25d8cb72f63a465a9afa2605efae8242/users/6d289eb930f946c2a6dda938c4dad813/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.310886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a3ac2-69f9-450f-b89c-c4d5425c6bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25d8cb72f63a465a9afa2605efae8242, user_id=6d289eb930f946c2a6dda938c4dad813, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.315073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a3ac2-69f9-450f-b89c-c4d5425c6bd8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.341086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:46.355346 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3366/6700] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:46 2022] PUT /identity/v3/projects/25d8cb72f63a465a9afa2605efae8242/users/6d289eb930f946c2a6dda938c4dad813/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:46.365550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.366005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.366296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.389168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42bde1143b840069ff04329df093ffd', 'request_id': 'req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:46.411422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42bde1143b840069ff04329df093ffd', 'request_id': 'req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:46.451828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] MFA Rules not processed for user `6d289eb930f946c2a6dda938c4dad813`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:46.455210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:46.476072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42bde1143b840069ff04329df093ffd', 'request_id': 'req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:46.493505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] The token cache is being invalidate because project e42bde1143b840069ff04329df093ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:46.494805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:46.495631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eba5f1b1-707e-4c0a-ba7e-1d69c713cdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:46.502503 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3335/6701] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:46 2022] DELETE /identity/v3/projects/e42bde1143b840069ff04329df093ffd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:46.506718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d616a-22f6-41af-b9e4-71137e076ec0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.507042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d616a-22f6-41af-b9e4-71137e076ec0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.507318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d616a-22f6-41af-b9e4-71137e076ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.559255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0e0d616a-22f6-41af-b9e4-71137e076ec0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:46.571453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e0d616a-22f6-41af-b9e4-71137e076ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:46.684021 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3367/6702] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:46.684961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.697833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:46.711292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:46.782523 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3336/6703] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:46.792981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.793449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.793928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.836451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:46.838487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:46.850383 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3337/6704] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:46.854691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.856432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe2c2a-9eaf-49d3-bd4d-ae6e1c66d096 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.866845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0f8ba-14f3-40a0-8012-9a433b77f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.867807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f8ba-14f3-40a0-8012-9a433b77f903 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.868084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f8ba-14f3-40a0-8012-9a433b77f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.869063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0f8ba-14f3-40a0-8012-9a433b77f903 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.870145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f8ba-14f3-40a0-8012-9a433b77f903 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.871913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba0f8ba-14f3-40a0-8012-9a433b77f903 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.915497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ccb9e-505c-4f87-9a51-9fca41fff10c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.929428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:46.930136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.930418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.930693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.931882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:46.938460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:46.940458 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3368/6705] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:46 2022] POST /identity/v3/projects => generated 401 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:46.941615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:46.945674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:46.946049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:46.946383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:46.956572 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3338/6706] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:46.957686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:46.976939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] MFA Rules not processed for user `d2867c5be8974c028f933d1c8fe2c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:46.978152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b984e0c-b898-412c-b609-ce4d52c691a6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:46.978653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.083608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.083890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3369/6707] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:47.084360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.084707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.085045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.085748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.085933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.088272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.123279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130d105-8868-4786-8471-d02ffcbcf267 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.144351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.144990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.145281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.145540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.146209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.148133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.157600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3339/6708] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:46 2022] POST /identity/v3/users => generated 307 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:47.157600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.160381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.186064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcfd7b4-c48d-43d9-b246-3da46b185425 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.199417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.200212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.200622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.201004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] PATH_INFO: `/v3/projects/4c83139ca88c4b268db467045c7c598d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.204057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c83139ca88c4b268db467045c7c598d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.209898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.233858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3370/6709] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:47 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:47.233858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.255566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.306926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c83139ca88c4b268db467045c7c598d', 'request_id': 'req-8b5e936a-f927-4b08-9779-f8056ab35bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.316213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c83139ca88c4b268db467045c7c598d', 'request_id': 'req-8b5e936a-f927-4b08-9779-f8056ab35bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.324849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c83139ca88c4b268db467045c7c598d', 'request_id': 'req-8b5e936a-f927-4b08-9779-f8056ab35bc4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.325139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21620905-3e6e-448c-aa7f-3d58cfa476f2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.335341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.347958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] The token cache is being invalidate because project 4c83139ca88c4b268db467045c7c598d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:47.349117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.350745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.352680 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3340/6710] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:47 2022] DELETE /identity/v3/projects/4c83139ca88c4b268db467045c7c598d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:47.353940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.356207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.415887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.416551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.416823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.417105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.417784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.419483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.431307 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3371/6711] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:47.432136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.435491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.462966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e936a-f927-4b08-9779-f8056ab35bc4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.465628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474e06e-88f0-4548-b37d-d97a7ee4c20e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.467801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.468663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.469115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.469692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.471012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.471703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.472051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.472391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.472568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.473163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.475232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.516065 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3372/6712] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:47 2022] POST /identity/v3/users => generated 287 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:47.516065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.516885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.552226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d414db-1fd2-4751-aa95-37b2d0893a47 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.562807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.564180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.564459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.564783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] PATH_INFO: `/v3/users/bd67f54ce7e743018d7c7f8ef6520b53` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.571041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd67f54ce7e743018d7c7f8ef6520b53)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.573737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.619595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.621371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.647137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd67f54ce7e743018d7c7f8ef6520b53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.663559 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3341/6713] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:47.664569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.666260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd67f54ce7e743018d7c7f8ef6520b53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.666956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd67f54ce7e743018d7c7f8ef6520b53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.672314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.676510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd67f54ce7e743018d7c7f8ef6520b53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.677974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd67f54ce7e743018d7c7f8ef6520b53'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:47.690570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00939eee-529f-4fa4-8e3c-a2652d627c0b service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.700358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.701051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.701341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.701752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] PATH_INFO: `/v3/projects/d7197f9576a74655b68b67dbfea39cae/users/57ac706cae1c40e3a44669da982d415f/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.723805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7197f9576a74655b68b67dbfea39cae, user_id=57ac706cae1c40e3a44669da982d415f, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.726795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.733256 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3373/6714] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:47 2022] DELETE /identity/v3/users/bd67f54ce7e743018d7c7f8ef6520b53 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:47.734390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.740343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.745456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3342/6715] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:47 2022] PUT /identity/v3/projects/d7197f9576a74655b68b67dbfea39cae/users/57ac706cae1c40e3a44669da982d415f/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:47.749688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.752070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:47.798130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.887295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87faec2-b7db-480c-9e55-f74bc7e03eca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.889692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fc5e-64c7-4de4-a65b-678eb07e9797 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.900473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.901119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.901397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.901665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.902888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.905022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.908893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.912379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.913267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.913718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.914605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.922368 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3374/6716] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:47.922798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.923554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:47.927626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.953854 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3343/6717] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:47.957053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e4082-d54e-4c19-acb3-820f33cb7f62 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.958305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:47.971838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec931c-af8d-4c56-bd77-c9bb4578cda9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:47.973845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.974732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.975108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.975477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.976456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:47.978743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:47.988525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:47.989334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:47.990704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:47.991083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] PATH_INFO: `/v3/projects/d7197f9576a74655b68b67dbfea39cae/users/57ac706cae1c40e3a44669da982d415f/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:47.997880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3375/6718] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:47.998825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7197f9576a74655b68b67dbfea39cae, user_id=57ac706cae1c40e3a44669da982d415f, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:48.002774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:48.003580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:48.027068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150c497-83bd-4c00-be0f-d4d87888c817 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:48.030991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3344/6719] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:47 2022] PUT /identity/v3/projects/d7197f9576a74655b68b67dbfea39cae/users/57ac706cae1c40e3a44669da982d415f/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:48.151880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:48.154016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.206985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af5e2e0-3969-4291-a4ab-7fc0ffb095e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:48.208142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5e2e0-3969-4291-a4ab-7fc0ffb095e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.208434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5e2e0-3969-4291-a4ab-7fc0ffb095e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.208784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af5e2e0-3969-4291-a4ab-7fc0ffb095e0 admin admin] PATH_INFO: `/v3/projects/b67b758e83034d5f903c6ca9dfa5c883/users/29f3383c209340adb16a7074c291b191/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.239998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5e2e0-3969-4291-a4ab-7fc0ffb095e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67b758e83034d5f903c6ca9dfa5c883, user_id=29f3383c209340adb16a7074c291b191, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:48.243899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af5e2e0-3969-4291-a4ab-7fc0ffb095e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:48.263013 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3376/6720] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:48 2022] PUT /identity/v3/projects/b67b758e83034d5f903c6ca9dfa5c883/users/29f3383c209340adb16a7074c291b191/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:48.264485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0d9f3-4431-4d11-b4c6-129cf24f5354 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.264929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0d9f3-4431-4d11-b4c6-129cf24f5354 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.265365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0d9f3-4431-4d11-b4c6-129cf24f5354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.327673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-05a0d9f3-4431-4d11-b4c6-129cf24f5354 None None] MFA Rules not processed for user `57ac706cae1c40e3a44669da982d415f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:48.328851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-05a0d9f3-4431-4d11-b4c6-129cf24f5354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.383756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c7f31-b7be-4427-8242-f6dc50945dd3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:48.509478 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3377/6721] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:48.509478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ec5d-e9c0-459e-bb45-d76bf2aa1725 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.509478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ec5d-e9c0-459e-bb45-d76bf2aa1725 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.509478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1ec5d-e9c0-459e-bb45-d76bf2aa1725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.570958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:48.571957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.572235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.572514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] PATH_INFO: `/v3/projects/7f2e4209d88449d19fbf6e6ad8bf8439` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.573668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2e4209d88449d19fbf6e6ad8bf8439)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:48.576343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:48.587346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-55b1ec5d-e9c0-459e-bb45-d76bf2aa1725 None None] MFA Rules not processed for user `29f3383c209340adb16a7074c291b191`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:48.589031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55b1ec5d-e9c0-459e-bb45-d76bf2aa1725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.683206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2e4209d88449d19fbf6e6ad8bf8439', 'request_id': 'req-49843feb-cec4-40a9-82b5-6428e67b747d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:48.696927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2e4209d88449d19fbf6e6ad8bf8439', 'request_id': 'req-49843feb-cec4-40a9-82b5-6428e67b747d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:48.705129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:48.708415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2e4209d88449d19fbf6e6ad8bf8439', 'request_id': 'req-49843feb-cec4-40a9-82b5-6428e67b747d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:48.713479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:48.736832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] The token cache is being invalidate because project 7f2e4209d88449d19fbf6e6ad8bf8439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:48.737779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:48.738818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:48.741220 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3345/6722] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:48 2022] DELETE /identity/v3/projects/7f2e4209d88449d19fbf6e6ad8bf8439 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:48.745144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:48.749889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.752370 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3378/6723] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:48.754139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.754616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.755110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.788339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:48.790858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.897407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49843feb-cec4-40a9-82b5-6428e67b747d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:48.902768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:48.903667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.904114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.904496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.905882 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3379/6724] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:48.907345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:48.908973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.916518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:48.922625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad0a77-766d-4170-a1c0-fd10f3bbc56a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:48.931746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:48.932827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:48.933476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:48.934008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:48.936039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:48.940480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:48.994985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3380/6725] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:48 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:48.996973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.001262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.003412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.004941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f7ad5-23a9-4ff2-adb3-22379061cb72 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.017299 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3346/6726] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:49.030166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.030753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.032103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.105057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:49.107745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.110579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c44a-4943-4eb1-a517-6efcc79998fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.117569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.118371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.118724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.119141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] PATH_INFO: `/v3/users/04d718633619467e8c01f60b20db5bcb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.120424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d718633619467e8c01f60b20db5bcb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.122161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3347/6727] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:49.125701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.135296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.149027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98aed5-c8e7-43cb-ab19-2c8c0696d335 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.164001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.165298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.165298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.165473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.166503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.170186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.220328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d718633619467e8c01f60b20db5bcb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:49.233327 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3348/6728] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:49 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:49.234722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.247708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6925dd4-9339-4fce-9872-488a13e0f583 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.250665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d718633619467e8c01f60b20db5bcb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:49.252021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d718633619467e8c01f60b20db5bcb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:49.253779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.254722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.255732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.256249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.257371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:49.257928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.261791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.265633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d718633619467e8c01f60b20db5bcb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:49.267174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d718633619467e8c01f60b20db5bcb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:49.269530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:49.289955 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3349/6729] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:49.293445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.298082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.310247 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3381/6730] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:48 2022] DELETE /identity/v3/users/04d718633619467e8c01f60b20db5bcb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:49.311938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.314297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.398860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1929e8d6-9b8f-4f6a-a204-89d8513dce30 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.416018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf433b-c1cc-4cc1-bc75-748e4eec53c9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.420011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.420765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.421220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.421585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.424139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.450757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:49.530130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.531917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.544477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.545249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.551812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.634834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.636789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.697291 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3382/6731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:49.699633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.702432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.722922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.724412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.747124 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3350/6732] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:49 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:49.752973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.757101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.854960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db0eb2-7794-41cd-acd0-2c8709a22276 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.868222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.868904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.869188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.869558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.870248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.871890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.889338 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3383/6733] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:49.889338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:49.892548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:49.922510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4958fd-adf9-4da0-a916-f9e0472b5c4f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:49.957503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:49.959257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:49.959704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:49.960245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] PATH_INFO: `/v3/projects/50b8a863a5404cb78a3ea96810094379` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:49.963019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b8a863a5404cb78a3ea96810094379)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:49.965449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:49.999516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c211b1-741d-4867-8dfd-3b6cf280c832 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.010574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.011267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:50.011991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.013459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.013836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.016621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.020824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.067054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b8a863a5404cb78a3ea96810094379', 'request_id': 'req-070b898c-e919-43b8-a56e-d850dc7582f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.080264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b8a863a5404cb78a3ea96810094379', 'request_id': 'req-070b898c-e919-43b8-a56e-d850dc7582f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.088167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b8a863a5404cb78a3ea96810094379', 'request_id': 'req-070b898c-e919-43b8-a56e-d850dc7582f6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.091738 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3351/6734] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:49 2022] POST /identity/v3/projects => generated 389 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:50.092687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.135929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] The token cache is being invalidate because project 50b8a863a5404cb78a3ea96810094379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:50.136240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.136949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.143831 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3384/6735] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:49 2022] DELETE /identity/v3/projects/50b8a863a5404cb78a3ea96810094379 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:50.144698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.149765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:50.220896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:50.225672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0338bd7a-cce4-455a-9219-906a113f73a5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.249644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.252232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.252515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.252792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] PATH_INFO: `/v3/projects/3a7bba4b1f53412d8a190228d922c443/users/3efdad253d1840ceb4e902c63cb1c05a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.292304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7bba4b1f53412d8a190228d922c443, user_id=3efdad253d1840ceb4e902c63cb1c05a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.296586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.339580 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3352/6736] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:50 2022] PUT /identity/v3/projects/3a7bba4b1f53412d8a190228d922c443/users/3efdad253d1840ceb4e902c63cb1c05a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:50.342635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.345644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:50.353460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b898c-e919-43b8-a56e-d850dc7582f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.466272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.467605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.468911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.469418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.470209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c487b-08a2-42f3-a5e1-899780984eec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.470748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.473124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.476138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.477321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.477682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.478311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] PATH_INFO: `/v3/users/7f84912fbb484e468dc8285893b0174e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.484468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f84912fbb484e468dc8285893b0174e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.493415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.511928 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3385/6737] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:50 2022] POST /identity/v3/users => generated 295 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:50.512850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.525829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:50.554755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec694c-360f-4754-b370-eb738a6cd10e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.567260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.567977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.568397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.568804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.569701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.571835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.588097 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3386/6738] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:50.589192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.592223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f84912fbb484e468dc8285893b0174e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.610567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff572f8b-2fc5-44ef-ad94-72fd75ccd5ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.620970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f84912fbb484e468dc8285893b0174e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.621759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f84912fbb484e468dc8285893b0174e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.628632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.629449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.629866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.630172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f84912fbb484e468dc8285893b0174e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.630582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.630906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f84912fbb484e468dc8285893b0174e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:50.631292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.633053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.649425 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3353/6739] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:50 2022] DELETE /identity/v3/users/7f84912fbb484e468dc8285893b0174e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:50.650371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.657868 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3387/6740] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:50.662034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:50.663221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.668232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:50.698774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2f408-49d1-42d5-8b67-c7fe46c93950 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.733247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:50.847198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.848299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.848756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.849178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.849997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.855413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.856161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e7744-f253-4685-a6a4-df6c1b7c8f0c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.872992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74cb19-4f62-441a-9a0e-5290d3005cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:50.874343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74cb19-4f62-441a-9a0e-5290d3005cfb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.874639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74cb19-4f62-441a-9a0e-5290d3005cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.874920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74cb19-4f62-441a-9a0e-5290d3005cfb admin admin] PATH_INFO: `/v3/projects/3a7bba4b1f53412d8a190228d922c443/users/3efdad253d1840ceb4e902c63cb1c05a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:50.877549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74cb19-4f62-441a-9a0e-5290d3005cfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7bba4b1f53412d8a190228d922c443, user_id=3efdad253d1840ceb4e902c63cb1c05a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:50.880300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74cb19-4f62-441a-9a0e-5290d3005cfb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:50.884565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:50.900179 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3388/6741] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:50.908461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:50.943726 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3354/6742] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:50 2022] PUT /identity/v3/projects/3a7bba4b1f53412d8a190228d922c443/users/3efdad253d1840ceb4e902c63cb1c05a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:50.944468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c14f25-d35f-4fbb-b439-f3481d7c6e64 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:50.956609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2ab3-63ea-4a9a-a378-5cb61f3002a5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:50.957227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2ab3-63ea-4a9a-a378-5cb61f3002a5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:50.957704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c2ab3-63ea-4a9a-a378-5cb61f3002a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.024786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1d5c2ab3-63ea-4a9a-a378-5cb61f3002a5 None None] MFA Rules not processed for user `3efdad253d1840ceb4e902c63cb1c05a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:51.027408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d5c2ab3-63ea-4a9a-a378-5cb61f3002a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.064794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.066437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.066847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.067134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] PATH_INFO: `/v3/projects/4e60d80fdb3a4367bdc7b68878654814/users/9cf32d3e1c8d4237be8bd165d992134e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.097747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e60d80fdb3a4367bdc7b68878654814, user_id=9cf32d3e1c8d4237be8bd165d992134e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.102109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.151256 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3389/6743] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:50 2022] PUT /identity/v3/projects/4e60d80fdb3a4367bdc7b68878654814/users/9cf32d3e1c8d4237be8bd165d992134e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:51.162082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:51.164170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.259223 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3355/6744] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:51.266715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea01d54-ea23-4073-9763-5eb90c8b4955 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.267002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea01d54-ea23-4073-9763-5eb90c8b4955 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.267277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea01d54-ea23-4073-9763-5eb90c8b4955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.297330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388edb0-cb05-4a0f-aa6a-f39e1e580284 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:51.318455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.319368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.319644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.319914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] PATH_INFO: `/v3/projects/1a5def8be3ff449c8324e11d933dcc49` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.325199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a5def8be3ff449c8324e11d933dcc49)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.328008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.339777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aea01d54-ea23-4073-9763-5eb90c8b4955 None None] MFA Rules not processed for user `9cf32d3e1c8d4237be8bd165d992134e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:51.342098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aea01d54-ea23-4073-9763-5eb90c8b4955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.395073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:51.410978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a5def8be3ff449c8324e11d933dcc49', 'request_id': 'req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:51.425666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a5def8be3ff449c8324e11d933dcc49', 'request_id': 'req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:51.464965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a5def8be3ff449c8324e11d933dcc49', 'request_id': 'req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:51.492557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] The token cache is being invalidate because project 1a5def8be3ff449c8324e11d933dcc49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:51.492557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:51.494138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:51.501232 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3390/6745] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:51 2022] DELETE /identity/v3/projects/1a5def8be3ff449c8324e11d933dcc49 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:51.502258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:51.504615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.521497 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3356/6746] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:51.522702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.522991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.523270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.553693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:51.557643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.630535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f2ed-0def-43f8-bfa5-ab52ddde28b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:51.635057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.635799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.636087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.636361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.638273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.661067 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3357/6747] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:51.662178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:51.679432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd150d28-040a-42a8-b5ab-989aa2932d02 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:51.692815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.695244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.699126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.700212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.703402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.726201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:51.744351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.746207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f3ee4-dec6-4d72-8849-136c645cd0ae service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.770962 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3391/6748] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:51.772621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.772976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.773956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.806785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:51.808912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.828642 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3392/6749] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:51.833109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:51.842043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.844377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece9848-c90e-4c53-b574-ab61df918cf0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:51.847927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.849728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.850576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.851023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.851455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.852569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:51.852869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.854542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.862647 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3358/6750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:51 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:51.869184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3393/6751] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:51.874184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:51.886278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f1690-2b25-4cc7-bb8d-75f786bb4937 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:51.891609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.892638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.893015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.893384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.894174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.896168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.912487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:51.914562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:51.931490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c467a593-6ff2-4102-b4ee-4ad0ddbc6ea6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:51.937046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:51.937702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:51.938005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:51.938427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] PATH_INFO: `/v3/users/9cf32d3e1c8d4237be8bd165d992134e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:51.939794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cf32d3e1c8d4237be8bd165d992134e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:51.941835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:51.944264 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3359/6752] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:51 2022] POST /identity/v3/projects => generated 357 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:51.948804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.022014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cf32d3e1c8d4237be8bd165d992134e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:52.036107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cf32d3e1c8d4237be8bd165d992134e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:52.036884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cf32d3e1c8d4237be8bd165d992134e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:52.040075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:52.057467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cf32d3e1c8d4237be8bd165d992134e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:52.058984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2a1bc0e8-4d76-4ec7-9acc-f0dc95c402eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cf32d3e1c8d4237be8bd165d992134e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:52.072170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c84a99-1ea4-4c00-9b9d-81ba908bc318 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.079966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:52.081366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.081839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.082188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.082931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:52.085671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:52.097870 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3394/6753] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:51 2022] DELETE /identity/v3/users/9cf32d3e1c8d4237be8bd165d992134e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:52.099938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.101757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.103454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.129274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3360/6754] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:51 2022] POST /identity/v3/users => generated 279 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:15:52.130686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.134834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:52.144849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:52.148205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:52.164337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca48aaf1-ee0e-4d7a-9e73-9b491809dc0f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.267526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:52.270356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.270713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.271857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.272649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:52.277833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:52.302521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3361/6755] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:15:52.305114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.312570 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3395/6756] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:15:52.326113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.327965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:52.339293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd11ca-c71a-4e23-8beb-e2729de52492 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.350471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:52.350983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.351259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.351529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.352165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:52.360026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:52.379969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:52.410318 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3362/6757] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:52.412276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.432224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab41ca2-577d-4ccf-8b00-2b3b332ceb6f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.437405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff36f2-f7a6-4583-a91b-202ead42b6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:52.438256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff36f2-f7a6-4583-a91b-202ead42b6bb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.438540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff36f2-f7a6-4583-a91b-202ead42b6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.439004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff36f2-f7a6-4583-a91b-202ead42b6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.450744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff36f2-f7a6-4583-a91b-202ead42b6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:52.452960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff36f2-f7a6-4583-a91b-202ead42b6bb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:52.466009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818beec7-a773-422a-8c27-892f0ab22bbe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.469894 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3396/6758] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:15:52.479403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:52.480091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.480371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.480635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] PATH_INFO: `/v3/projects/919acba060cc48f69db5bbc6d778d58a/users/ca97f199e1664354901483b06e30cf64/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.511317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919acba060cc48f69db5bbc6d778d58a, user_id=ca97f199e1664354901483b06e30cf64, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:52.514203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:52.537857 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3363/6759] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:52 2022] PUT /identity/v3/projects/919acba060cc48f69db5bbc6d778d58a/users/ca97f199e1664354901483b06e30cf64/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:52.545141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.545479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.545846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.614337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] MFA Rules not processed for user `ca97f199e1664354901483b06e30cf64`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:52.615570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:52.781457 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3397/6760] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:52.782499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.909697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410897f9-a15b-4c02-bb04-d74216854c81 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.919806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:52.921012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:52.921502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:52.922360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:52.923400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:52.926979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:52.980763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:52.981578 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3364/6761] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:52 2022] POST /identity/v3/projects => generated 357 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:52.994918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c2d10-932a-4ef0-b3b5-42a784135505 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:52.999963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:53.120485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:53.121693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.122073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.122464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.123942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:53.127285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:53.181704 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3398/6762] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:52 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:53.183233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:53.204294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fcc7a-ac5b-469b-ac59-92f04b7e6600 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:53.216654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:53.217399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.217840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.218223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.219402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:53.221149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:53.240818 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3365/6763] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:53.243037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:53.257793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7faf19-1262-4b8c-a47b-b0808ea7da45 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:53.263435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:53.264110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.264392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.264705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] PATH_INFO: `/v3/projects/f66f2b7853f747b28de9d0cd954b138f/users/f3f2e0450a354f039b965974cef6d2d9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.294556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66f2b7853f747b28de9d0cd954b138f, user_id=f3f2e0450a354f039b965974cef6d2d9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:53.298702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:53.324105 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3399/6764] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:53 2022] PUT /identity/v3/projects/f66f2b7853f747b28de9d0cd954b138f/users/f3f2e0450a354f039b965974cef6d2d9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:15:53.329344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:53.362568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7a6a5-f0b8-43c5-9c2f-9f7cecc21152 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:53.523632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:53.524514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.525022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.525369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.526366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:53.535192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:53.539420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:53.541397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:53.570110 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3366/6765] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:15:53.571449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:53.573237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a39b5f-d751-40ed-a166-1c3adf35f50c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:53.588241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:53.588604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.588888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.589169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] PATH_INFO: `/v3/projects/4e60d80fdb3a4367bdc7b68878654814` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.593556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e60d80fdb3a4367bdc7b68878654814)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:53.594792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1924eab-0c05-482b-bfba-fc5690236e15 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:53.596868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:53.614580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de35b96-2e80-4d2f-918e-325844b889f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:53.615329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de35b96-2e80-4d2f-918e-325844b889f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.616258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de35b96-2e80-4d2f-918e-325844b889f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.616544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de35b96-2e80-4d2f-918e-325844b889f6 admin admin] PATH_INFO: `/v3/projects/f66f2b7853f747b28de9d0cd954b138f/users/f3f2e0450a354f039b965974cef6d2d9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.630470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de35b96-2e80-4d2f-918e-325844b889f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f66f2b7853f747b28de9d0cd954b138f, user_id=f3f2e0450a354f039b965974cef6d2d9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:53.634009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de35b96-2e80-4d2f-918e-325844b889f6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:53.671712 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3367/6766] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:53 2022] PUT /identity/v3/projects/f66f2b7853f747b28de9d0cd954b138f/users/f3f2e0450a354f039b965974cef6d2d9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:53.673614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.673940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.674217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.710067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e60d80fdb3a4367bdc7b68878654814', 'request_id': 'req-531db745-9774-4774-af19-d2fd81d14f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:53.742993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e60d80fdb3a4367bdc7b68878654814', 'request_id': 'req-531db745-9774-4774-af19-d2fd81d14f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:53.762767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e60d80fdb3a4367bdc7b68878654814', 'request_id': 'req-531db745-9774-4774-af19-d2fd81d14f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:53.776739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] MFA Rules not processed for user `f3f2e0450a354f039b965974cef6d2d9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:53.781617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:53.792717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] The token cache is being invalidate because project 4e60d80fdb3a4367bdc7b68878654814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:15:53.793042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:53.793875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-531db745-9774-4774-af19-d2fd81d14f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:15:53.796839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3400/6767] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:15:53 2022] DELETE /identity/v3/projects/4e60d80fdb3a4367bdc7b68878654814 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:53.802421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f205d-4ffd-4cf3-8c29-bdc7b7ee6b6b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:53.802753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f205d-4ffd-4cf3-8c29-bdc7b7ee6b6b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:53.802980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f205d-4ffd-4cf3-8c29-bdc7b7ee6b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:53.829221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:53.859319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-652f205d-4ffd-4cf3-8c29-bdc7b7ee6b6b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:53.862837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-652f205d-4ffd-4cf3-8c29-bdc7b7ee6b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:53.947268 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3368/6768] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:53.959433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:53.961172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:54.052374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:54.118603 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3401/6769] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:54.128573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.128873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.129152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.176987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6f60f-9c3f-467b-8edf-dcaf01ecb4e0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.179140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:54.180440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:54.197130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.197949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.198280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.198565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.215157 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3402/6770] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:54.216066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.229092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.233977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.250716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497212fe-ad38-4ad4-8cde-43a3846bf7c5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.264680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.265479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.265779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.266128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.266960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:15:54.267271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.271660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.275556 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3369/6771] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:54.297600 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3403/6772] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:15:54.300947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.322776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf7b6-a8ff-48a3-9ddb-d80349c0b939 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.336852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.338584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.339635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.340468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.345110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.347508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.412793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.431875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3370/6773] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:15:54 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:54.432933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.433184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0541ed-6ad2-4d66-a7ae-fbe359bbaee5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.571349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f3aff-0e3f-4192-b855-833cabac7e9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.576811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.577652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.579087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.579480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.580968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.581491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.581593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.581897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.582177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.583726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.587228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:54.680849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3371/6774] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:15:54 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:15:54.683159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.711427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f40b1-552c-4cfd-9aa3-02c7071041e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.728018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.728691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.728974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.729249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.733662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.735414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.763512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3372/6775] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:54.765921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.770964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.772429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.789745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d8dda-d2ac-4d6c-9374-6fe32a16cd98 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.793288 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3404/6776] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:54.796782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25336b0c-14e5-44b7-ad56-e19c453703d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.797708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25336b0c-14e5-44b7-ad56-e19c453703d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.798397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25336b0c-14e5-44b7-ad56-e19c453703d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.798807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25336b0c-14e5-44b7-ad56-e19c453703d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.799463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25336b0c-14e5-44b7-ad56-e19c453703d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.801081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25336b0c-14e5-44b7-ad56-e19c453703d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.813844 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3373/6777] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:15:54.818074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:54.833527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf657e-dcc4-4084-8cd2-c3923b667e55 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:54.839589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:54.840788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.841259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.841712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] PATH_INFO: `/v3/projects/4a8a7964b90c4884ac774aa966babd25/users/73c9fb64b0024a42b597d3209038922b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.870692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8a7964b90c4884ac774aa966babd25, user_id=73c9fb64b0024a42b597d3209038922b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:54.877547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:54.904959 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3405/6778] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:15:54 2022] PUT /identity/v3/projects/4a8a7964b90c4884ac774aa966babd25/users/73c9fb64b0024a42b597d3209038922b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:15:54.915613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:54.916360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:54.916821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:54.950302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:54.990801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] MFA Rules not processed for user `73c9fb64b0024a42b597d3209038922b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:15:54.992494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:55.225166 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3374/6779] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:15:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:15:55.266533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:55.268702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:55.414379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb1991-84fc-4be2-b393-46d9638a4b56 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:55.424074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:55.425515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:55.425515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:55.425515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:55.439608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:55.442215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:55.469722 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3406/6780] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:56.368072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:56.389986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c4248c-30e4-4942-a7bf-a48efc1da170 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:56.400249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:56.402714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:56.403038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:56.403354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:56.418489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:56.609941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:56.611841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1eae70-6164-4c3c-80de-89f4511acf0c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:15:56.637468 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3375/6781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:15:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:15:59.536364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:15:59.538482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:15:59.562095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:15:59.774717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e03856-e7e6-4fe7-a329-0f112560a904 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:15:59.795528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:15:59.796678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:15:59.797080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:15:59.797416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] PATH_INFO: `/v3/users/6d289eb930f946c2a6dda938c4dad813` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:15:59.798776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d289eb930f946c2a6dda938c4dad813)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:15:59.801334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:00.038405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d289eb930f946c2a6dda938c4dad813'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:00.072942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d289eb930f946c2a6dda938c4dad813'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:00.074115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d289eb930f946c2a6dda938c4dad813'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:00.110659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d289eb930f946c2a6dda938c4dad813'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:00.112840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d289eb930f946c2a6dda938c4dad813'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:00.221215 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3407/6782] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:15:59 2022] DELETE /identity/v3/users/6d289eb930f946c2a6dda938c4dad813 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:00.226087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:00.226670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:00.226954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:00.287753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:00.289016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:00.509661 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3376/6783] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:00.587817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:00.590743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:00.789507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b94a6-745a-4a5d-9739-fdb9f5d244d5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:00.807994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:00.815213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:00.815504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:00.815786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:00.841006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:00.847143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:00.890227 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3408/6784] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:02.637392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:02.640208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:02.666986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6767ea-ca87-4843-83d5-33a2df48d75a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:02.693368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:02.694383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:02.695067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:02.695703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] PATH_INFO: `/v3/projects/25d8cb72f63a465a9afa2605efae8242` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:02.699920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25d8cb72f63a465a9afa2605efae8242)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:02.704294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:02.806026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:02.858854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25d8cb72f63a465a9afa2605efae8242', 'request_id': 'req-105be183-4be1-40be-857e-7b77bab89434'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:02.881514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25d8cb72f63a465a9afa2605efae8242', 'request_id': 'req-105be183-4be1-40be-857e-7b77bab89434'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:02.898881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25d8cb72f63a465a9afa2605efae8242', 'request_id': 'req-105be183-4be1-40be-857e-7b77bab89434'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:02.940038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] The token cache is being invalidate because project 25d8cb72f63a465a9afa2605efae8242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:02.940391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:02.941077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:02.943086 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3377/6785] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:02 2022] DELETE /identity/v3/projects/25d8cb72f63a465a9afa2605efae8242 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:02.948162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:02.960715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a23518-f053-4dc0-bccf-8fe52d07b95e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:03.049474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:03.134104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:03.134980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:03.135443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:03.135872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] PATH_INFO: `/v3/users/57ac706cae1c40e3a44669da982d415f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:03.137385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=57ac706cae1c40e3a44669da982d415f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:03.139658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:03.248371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ac706cae1c40e3a44669da982d415f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:03.266283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ac706cae1c40e3a44669da982d415f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:03.267038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ac706cae1c40e3a44669da982d415f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:03.287366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ac706cae1c40e3a44669da982d415f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:03.289786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599afdb8-2dfe-493d-a2db-ae25347ace9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ac706cae1c40e3a44669da982d415f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:03.352382 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3409/6786] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:02 2022] DELETE /identity/v3/users/57ac706cae1c40e3a44669da982d415f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:05.177048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:05.179510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:05.201630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105be183-4be1-40be-857e-7b77bab89434 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:05.338351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:05.339332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:05.339830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:05.340300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] PATH_INFO: `/v3/projects/d7197f9576a74655b68b67dbfea39cae` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:05.341725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7197f9576a74655b68b67dbfea39cae)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:05.348853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:05.484342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7197f9576a74655b68b67dbfea39cae', 'request_id': 'req-c1722a93-6644-42cd-8e45-7424fe6d8fec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:05.501417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7197f9576a74655b68b67dbfea39cae', 'request_id': 'req-c1722a93-6644-42cd-8e45-7424fe6d8fec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:05.526752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7197f9576a74655b68b67dbfea39cae', 'request_id': 'req-c1722a93-6644-42cd-8e45-7424fe6d8fec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:05.575160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] The token cache is being invalidate because project d7197f9576a74655b68b67dbfea39cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:05.575369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:05.576013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c1722a93-6644-42cd-8e45-7424fe6d8fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:05.584782 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3378/6787] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:05 2022] DELETE /identity/v3/projects/d7197f9576a74655b68b67dbfea39cae => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:05.589915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:05.590457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:05.590457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:05.653769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:05.665273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:05.818546 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3410/6788] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:05.830957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:05.830957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:05.832144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:05.894453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:05.895693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:05.928417 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3379/6789] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:05.930402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:05.947230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a0e6e-494a-4480-8179-6a60e2384fc8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:05.963936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:05.964939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:05.964939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:05.966439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:05.967586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:16:05.967884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:05.971370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:06.011483 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3411/6790] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:16:06.016197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:06.034820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34039eee-08f3-4f14-a9d1-b2190c5a94e2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:06.121638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:06.127848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:06.130379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:06.131514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:06.132350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:06.138674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:06.221289 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3380/6791] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:06 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:06.222741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:06.233381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f167ac-6e03-461f-9532-1cb32438c480 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:06.328312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:06.386974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:06.387614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:06.387890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:06.388160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:06.388814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:06.393210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:06.435384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3412/6792] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:06 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:06.440047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:06.454907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fec40-3d2c-457c-a10a-ba3d57f3f2c8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:06.468959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:06.469851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:06.470472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:06.470595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:06.471332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:06.473123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:06.504581 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3381/6793] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:06.505025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:06.516399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b307761-874d-48c7-9fcc-7d7bef212b29 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:06.569304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762e5d-e0dd-4c89-bb3e-42ff29a3d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:06.569691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762e5d-e0dd-4c89-bb3e-42ff29a3d029 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:06.571324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762e5d-e0dd-4c89-bb3e-42ff29a3d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:06.571623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762e5d-e0dd-4c89-bb3e-42ff29a3d029 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:06.574547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762e5d-e0dd-4c89-bb3e-42ff29a3d029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:06.578667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762e5d-e0dd-4c89-bb3e-42ff29a3d029 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:06.623586 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3413/6794] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:16:06.627553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:06.635905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:06.651974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a551-80ef-44ba-af60-753f43908b1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:06.681348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:06.682501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:06.683097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:06.683522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] PATH_INFO: `/v3/projects/aa363054392b46868d08fc8cdbb9865f/users/2c01d3ad3efe49ba8b47db1cf1e651d6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:06.744701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa363054392b46868d08fc8cdbb9865f, user_id=2c01d3ad3efe49ba8b47db1cf1e651d6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:06.748131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:06.778034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3382/6795] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:06 2022] PUT /identity/v3/projects/aa363054392b46868d08fc8cdbb9865f/users/2c01d3ad3efe49ba8b47db1cf1e651d6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:06.791998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:06.792297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:06.792570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:06.914121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] MFA Rules not processed for user `2c01d3ad3efe49ba8b47db1cf1e651d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:06.921059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:07.170978 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3414/6796] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:07.174123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:07.380640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f1a25-2f20-4455-b530-1b64242f158d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:07.397108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:07.398786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:07.400369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:07.401558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:07.424319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:07.432566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:07.530368 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3383/6797] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:07 2022] POST /identity/v3/projects => generated 385 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:07.534228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:07.550961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd677a1e-be73-486d-b221-6c383e1dd4fb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:07.711088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:07.711974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:07.713069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:07.713069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:07.714858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:07.717173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:07.780091 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3415/6798] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:07 2022] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:07.784160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:07.806547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c6385-421d-4b21-a0e8-5cad08886062 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:07.828317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:07.831339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:07.832955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:07.834249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:07.836333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:07.857198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:07.922757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3384/6799] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:07.927117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:07.939823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b774c099-bd13-4353-b28a-15b9393512ae admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:07.946332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:07.947388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:07.947884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:07.948363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] PATH_INFO: `/v3/projects/95b9824e270c44ce854131d1d5790a8a/users/f54b8d85e0554b46acca96c86f7ba433/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:08.000416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b9824e270c44ce854131d1d5790a8a, user_id=f54b8d85e0554b46acca96c86f7ba433, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:08.005923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:08.058537 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3416/6800] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:07 2022] PUT /identity/v3/projects/95b9824e270c44ce854131d1d5790a8a/users/f54b8d85e0554b46acca96c86f7ba433/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:08.066336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:08.087606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc6c97-3420-4460-a26a-25ea82460c47 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:08.245175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742b77c-8713-464f-8b58-122ec8c89a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:08.247596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b77c-8713-464f-8b58-122ec8c89a84 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:08.248098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b77c-8713-464f-8b58-122ec8c89a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:08.248532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742b77c-8713-464f-8b58-122ec8c89a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:08.253788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742b77c-8713-464f-8b58-122ec8c89a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:08.255556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742b77c-8713-464f-8b58-122ec8c89a84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:08.284425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:08.286524 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3385/6801] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:08.299493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5c4e15-2043-4342-ba1c-df38a26182cb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:08.313383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355cc5-576a-4a34-801d-bc6b70e36ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:08.313962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355cc5-576a-4a34-801d-bc6b70e36ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:08.314351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355cc5-576a-4a34-801d-bc6b70e36ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:08.314696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355cc5-576a-4a34-801d-bc6b70e36ef6 admin admin] PATH_INFO: `/v3/projects/95b9824e270c44ce854131d1d5790a8a/users/f54b8d85e0554b46acca96c86f7ba433/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:08.317715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95355cc5-576a-4a34-801d-bc6b70e36ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b9824e270c44ce854131d1d5790a8a, user_id=f54b8d85e0554b46acca96c86f7ba433, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:08.355593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95355cc5-576a-4a34-801d-bc6b70e36ef6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:08.371619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:08.393289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3417/6802] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:08 2022] PUT /identity/v3/projects/95b9824e270c44ce854131d1d5790a8a/users/f54b8d85e0554b46acca96c86f7ba433/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:08.395490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:08.396549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:08.397344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:08.471654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] MFA Rules not processed for user `f54b8d85e0554b46acca96c86f7ba433`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:08.473383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:08.583015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:08.686693 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3386/6803] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:08 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:08.761870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:08.762798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:08.765833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:08.834232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] MFA Rules not processed for user `29f3383c209340adb16a7074c291b191`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:08.842257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:08.847201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:08.857100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:09.072652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d1c5b-1531-4b98-8cb2-b44d2b8255bc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:09.086455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:09.087453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:09.088197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:09.089595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:09.110183 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3418/6804] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:09.295543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:09.301501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:09.325118 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3387/6805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:08 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:11.182188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:11.184315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:11.344700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4c57-4ccd-498e-beeb-4f15bf69b48b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:11.353768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:11.356948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:11.357239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:11.357521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:11.366175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:11.398536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:11.403590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:11.432053 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3419/6806] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:18.538589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:18.540668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:18.573266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103518f2-2fc2-4f70-890a-a88440ea08dc service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:18.578124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99f3b5-470d-4b8f-8083-d644e3c80725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:18.578895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f3b5-470d-4b8f-8083-d644e3c80725 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:18.579259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f3b5-470d-4b8f-8083-d644e3c80725 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:18.579589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99f3b5-470d-4b8f-8083-d644e3c80725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:18.605154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f3b5-470d-4b8f-8083-d644e3c80725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:18.606658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99f3b5-470d-4b8f-8083-d644e3c80725 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:18.619398 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3388/6807] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:21.414963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=52 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:28.613546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=65 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:29.969758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:29.970591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:30.166362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89fba6-3f76-45e4-bf2f-3bbf3169443c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:30.177166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:30.177850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:30.178139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:30.178432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] PATH_INFO: `/v3/users/ca97f199e1664354901483b06e30cf64` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:30.179631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca97f199e1664354901483b06e30cf64)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:30.181587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:30.272610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca97f199e1664354901483b06e30cf64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:30.284914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca97f199e1664354901483b06e30cf64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:30.285608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca97f199e1664354901483b06e30cf64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:30.300650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca97f199e1664354901483b06e30cf64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:30.301455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca97f199e1664354901483b06e30cf64'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:30.339541 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3420/6808] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:29 2022] DELETE /identity/v3/users/ca97f199e1664354901483b06e30cf64 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:30.344047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:30.344609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:30.344609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:30.378443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:30.379858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:30.502400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3389/6809] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:30.512920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:30.514975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:30.700672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f690c9c-9e6c-4641-9c60-c20d0690f469 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:30.711463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:30.712604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:30.714449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:30.714952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:30.728866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:30.730816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:30.742957 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3421/6810] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:32.472105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:32.474618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:32.497340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77517312-ed64-47be-b17d-d8b71b5d3bd6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:32.505796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:32.508612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:32.514493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:32.515361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] PATH_INFO: `/v3/projects/919acba060cc48f69db5bbc6d778d58a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:32.516980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919acba060cc48f69db5bbc6d778d58a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:32.519256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:32.598749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919acba060cc48f69db5bbc6d778d58a', 'request_id': 'req-9354a0e9-d485-47e4-9c0d-f07c439185a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.613421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919acba060cc48f69db5bbc6d778d58a', 'request_id': 'req-9354a0e9-d485-47e4-9c0d-f07c439185a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.633961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919acba060cc48f69db5bbc6d778d58a', 'request_id': 'req-9354a0e9-d485-47e4-9c0d-f07c439185a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.666784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] The token cache is being invalidate because project 919acba060cc48f69db5bbc6d778d58a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:32.667424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.669329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.673610 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3390/6811] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:32 2022] DELETE /identity/v3/projects/919acba060cc48f69db5bbc6d778d58a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:32.677783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:32.694756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b60a9-e644-4b77-9f2d-205999c5dc63 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:32.753896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:32.853173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:32.854183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:32.854681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:32.855164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] PATH_INFO: `/v3/users/f3f2e0450a354f039b965974cef6d2d9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:32.856554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3f2e0450a354f039b965974cef6d2d9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:32.859421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:32.933554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3f2e0450a354f039b965974cef6d2d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.944800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3f2e0450a354f039b965974cef6d2d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.947809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3f2e0450a354f039b965974cef6d2d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.974889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3f2e0450a354f039b965974cef6d2d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:32.977778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae218d5-b23e-493b-988d-75f5dc43e60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3f2e0450a354f039b965974cef6d2d9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.021119 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3422/6812] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:32 2022] DELETE /identity/v3/users/f3f2e0450a354f039b965974cef6d2d9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:33.153665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:33.155594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:33.188920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354a0e9-d485-47e4-9c0d-f07c439185a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:33.350760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:33.351434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:33.351718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:33.351996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] PATH_INFO: `/v3/users/2c01d3ad3efe49ba8b47db1cf1e651d6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:33.354620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c01d3ad3efe49ba8b47db1cf1e651d6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:33.359962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:33.406082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:33.447347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c01d3ad3efe49ba8b47db1cf1e651d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.461621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c01d3ad3efe49ba8b47db1cf1e651d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.462404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c01d3ad3efe49ba8b47db1cf1e651d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.472013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c01d3ad3efe49ba8b47db1cf1e651d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.472760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c01d3ad3efe49ba8b47db1cf1e651d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.495510 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3391/6813] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:33 2022] DELETE /identity/v3/users/2c01d3ad3efe49ba8b47db1cf1e651d6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:33.496618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:33.496909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:33.497194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:33.531282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:33.532969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:33.593036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:33.594798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:33.698888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3423/6814] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:33.714467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:33.716071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:33.757230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c9041-f158-46d4-a9b5-30edf1236903 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:33.765366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:33.766318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:33.766805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:33.767174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] PATH_INFO: `/v3/projects/f66f2b7853f747b28de9d0cd954b138f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:33.769057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f66f2b7853f747b28de9d0cd954b138f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:33.775449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:33.831295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:33.857215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38820a31-0488-4278-a5ee-14c56470be07 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:33.886982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f66f2b7853f747b28de9d0cd954b138f', 'request_id': 'req-31e24313-7438-456c-8e5b-c2dbc801debe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.903095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f66f2b7853f747b28de9d0cd954b138f', 'request_id': 'req-31e24313-7438-456c-8e5b-c2dbc801debe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.910980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f66f2b7853f747b28de9d0cd954b138f', 'request_id': 'req-31e24313-7438-456c-8e5b-c2dbc801debe'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.947719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] The token cache is being invalidate because project f66f2b7853f747b28de9d0cd954b138f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:33.948401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.949255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-31e24313-7438-456c-8e5b-c2dbc801debe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:33.955175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3392/6815] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:33 2022] DELETE /identity/v3/projects/f66f2b7853f747b28de9d0cd954b138f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:33.956961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c33d-9476-4fb8-b110-212833ca245e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:33.957394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c33d-9476-4fb8-b110-212833ca245e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:33.958008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5c33d-9476-4fb8-b110-212833ca245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:33.966590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:33.967591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:33.968058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:33.968344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:33.973469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:33.985765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9db5c33d-9476-4fb8-b110-212833ca245e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:33.987429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9db5c33d-9476-4fb8-b110-212833ca245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:34.028108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:34.091935 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3393/6816] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:34.101178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.102210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.102710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.102849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.104270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.124808 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3424/6817] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:34.141473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:34.144857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:34.175529 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3394/6818] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:34.178342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.191677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654da84-f33c-449b-86f6-a25935d9759e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.213429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.214967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.222322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.222836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.223825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:16:34.224326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.226273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.257941 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3425/6819] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:16:34.262241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.288999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3539108-36d6-42ee-af90-4d75cf1aede7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.299785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.300943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.302094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.302756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.304077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.322403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.403311 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3395/6820] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:34 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:34.407531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.423532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee47e2-f2cd-4811-b8c2-2f45dae50e6c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.492748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.493686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.494239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.494809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.495665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.498373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.531757 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3426/6821] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:34 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:34.533345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.557817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104badf-606c-4483-bcd9-8412686b9072 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.567889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.568784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.569069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.569344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.570119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.571746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.589233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.598591 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3396/6822] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:34.601246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4afeb0-b789-42dd-82da-d581961a9ba8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.607349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.609245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:34.619141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.619806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.620087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.620360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.621016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.622666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.634442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eaa61-d4f2-4254-9dff-79a4945612c7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.640412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.641195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.641573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.641985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] PATH_INFO: `/v3/projects/aa363054392b46868d08fc8cdbb9865f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.643251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa363054392b46868d08fc8cdbb9865f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.644928 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3427/6823] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:34.649066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.649659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.665169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf99f6-47f5-4821-a36e-6c4e4b6c99b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.672170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96095cc1-f6a4-4db9-9aaa-cf2016bc8b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.673048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095cc1-f6a4-4db9-9aaa-cf2016bc8b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.673430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095cc1-f6a4-4db9-9aaa-cf2016bc8b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.673841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96095cc1-f6a4-4db9-9aaa-cf2016bc8b7a admin admin] PATH_INFO: `/v3/projects/1c657db47c894f88a2fe11da48ca3d83/users/7dce3e3d966441b8b951843f2ff55fb6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.692539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:34.699659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96095cc1-f6a4-4db9-9aaa-cf2016bc8b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c657db47c894f88a2fe11da48ca3d83, user_id=7dce3e3d966441b8b951843f2ff55fb6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.704169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96095cc1-f6a4-4db9-9aaa-cf2016bc8b7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.710139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa363054392b46868d08fc8cdbb9865f', 'request_id': 'req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:34.719862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa363054392b46868d08fc8cdbb9865f', 'request_id': 'req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:34.727102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa363054392b46868d08fc8cdbb9865f', 'request_id': 'req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:34.729217 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3428/6824] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:34 2022] PUT /identity/v3/projects/1c657db47c894f88a2fe11da48ca3d83/users/7dce3e3d966441b8b951843f2ff55fb6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:34.741570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.742716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.743136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.750889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] The token cache is being invalidate because project aa363054392b46868d08fc8cdbb9865f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:34.751442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:34.752284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:34.754099 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3397/6825] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:34 2022] DELETE /identity/v3/projects/aa363054392b46868d08fc8cdbb9865f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:34.758132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.759811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:34.787412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] MFA Rules not processed for user `7dce3e3d966441b8b951843f2ff55fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:34.789143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:34.834582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02960b-cd55-49a6-ac31-0c5f86ddd1b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:34.857461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:34.926030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:34.926708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:34.926997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:34.927272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] PATH_INFO: `/v3/users/f54b8d85e0554b46acca96c86f7ba433` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:34.928540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54b8d85e0554b46acca96c86f7ba433)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:34.930741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:34.953574 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3429/6826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:34.954856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:34.957899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.015169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54b8d85e0554b46acca96c86f7ba433'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.036057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54b8d85e0554b46acca96c86f7ba433'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.037319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54b8d85e0554b46acca96c86f7ba433'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.048833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54b8d85e0554b46acca96c86f7ba433'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.049969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54b8d85e0554b46acca96c86f7ba433'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.054767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22667f6-4231-423b-92c4-db0b7de0e769 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.059402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.060143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.060669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.061182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.064365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.079819 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3398/6827] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:34 2022] DELETE /identity/v3/users/f54b8d85e0554b46acca96c86f7ba433 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:35.080605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.082342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.154342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.157344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.177293 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3430/6828] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:35.208591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5ded0-76ce-49ff-be43-cd3889de4f58 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.233685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.234762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.236800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.237182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.240075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.242828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.318338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3399/6829] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:35 2022] POST /identity/v3/projects => generated 369 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:35.322351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.334853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9afb629-9bed-4b15-b819-75bd2cd84dae service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.370208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:35.414292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.414989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.415266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.415534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.421898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.423842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.452832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3431/6830] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:35 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:35.454279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.473849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aee3a0-f3b3-4074-96da-1102cb4643fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.479647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.480378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.480860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.481209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.482223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.484489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.500548 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3400/6831] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:35.504169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.520695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2d4e-922d-4084-84e7-6878d5576bab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.534784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.535747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.536068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.536441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] PATH_INFO: `/v3/projects/fa50b67c53654b0185baf093f8338e72/users/423f266a8cef4fc4adfa49fa8a430dc3/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.587707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa50b67c53654b0185baf093f8338e72, user_id=423f266a8cef4fc4adfa49fa8a430dc3, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.590511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.598584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.601101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.616239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb105-42e2-4742-b17f-ce0d3cfb4e11 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.619932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3432/6832] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:35 2022] PUT /identity/v3/projects/fa50b67c53654b0185baf093f8338e72/users/423f266a8cef4fc4adfa49fa8a430dc3/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:35.640006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:35.648421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.718985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.719630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.719918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.720775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] PATH_INFO: `/v3/projects/95b9824e270c44ce854131d1d5790a8a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.722157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b9824e270c44ce854131d1d5790a8a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.724073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.740807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf46b6-8aa2-4db9-ab4d-e10dcc8ad409 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.749932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.750563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.750842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.751113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.751764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.753409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.769861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3433/6833] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:16:35.774114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.784191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b9824e270c44ce854131d1d5790a8a', 'request_id': 'req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.788194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087da76e-8939-4bc6-8ab1-6fac38b45957 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.792853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b9824e270c44ce854131d1d5790a8a', 'request_id': 'req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.801354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b9824e270c44ce854131d1d5790a8a', 'request_id': 'req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.817046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] The token cache is being invalidate because project 95b9824e270c44ce854131d1d5790a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:35.817330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.818023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9c2336f3-bda6-43aa-b606-bcf7cc0fd23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:35.819566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3401/6834] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:35 2022] DELETE /identity/v3/projects/95b9824e270c44ce854131d1d5790a8a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:35.826097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2f9c-9bad-45ca-9cfd-d664d3f466b8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.826594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2f9c-9bad-45ca-9cfd-d664d3f466b8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.827022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af2f9c-9bad-45ca-9cfd-d664d3f466b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.849903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39af2f9c-9bad-45ca-9cfd-d664d3f466b8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:35.851141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39af2f9c-9bad-45ca-9cfd-d664d3f466b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.857669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c3be-a529-41e5-b6a9-779433f48b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.858542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c3be-a529-41e5-b6a9-779433f48b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.858832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c3be-a529-41e5-b6a9-779433f48b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.859109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c3be-a529-41e5-b6a9-779433f48b22 admin admin] PATH_INFO: `/v3/projects/fa50b67c53654b0185baf093f8338e72/users/423f266a8cef4fc4adfa49fa8a430dc3/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.867771 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3402/6835] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:35.867932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c3be-a529-41e5-b6a9-779433f48b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa50b67c53654b0185baf093f8338e72, user_id=423f266a8cef4fc4adfa49fa8a430dc3, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.867932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c3be-a529-41e5-b6a9-779433f48b22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:35.870029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.870378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.870792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.877145 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3434/6836] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:35 2022] PUT /identity/v3/projects/fa50b67c53654b0185baf093f8338e72/users/423f266a8cef4fc4adfa49fa8a430dc3/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:35.887168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.887453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.887729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.896297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:35.897963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.920787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] MFA Rules not processed for user `423f266a8cef4fc4adfa49fa8a430dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:35.922218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:35.935854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:35.975916 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3403/6837] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:35.977072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:35.986807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ccbd5b-a54d-4b54-89f6-2076f8cd7354 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:35.991663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:35.992840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:35.993293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:35.993641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:35.994435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:16:35.994739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:35.996548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.008713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3435/6838] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:36.011502 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3404/6839] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:16:36.015888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.020996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.023748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:36.027215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe31a48-ccf9-454f-a381-e70c04e0592a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.032356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.033111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.033410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.033669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.034338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.036281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.071833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3436/6840] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:36 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:36.072913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.074404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:36.113914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41333d-f4af-45a3-9fb4-2b5c23b0251d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.142723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5a8d2-76df-46de-85ea-fb82133b2c66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.147849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.148464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.148753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.149028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.149844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.151804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.167155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3df5c-daca-4a89-b887-9587780fb8a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.168040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3df5c-daca-4a89-b887-9587780fb8a9 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.168375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3df5c-daca-4a89-b887-9587780fb8a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.168674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3df5c-daca-4a89-b887-9587780fb8a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.181589 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3437/6841] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:36 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:36.182712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.193231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b121b6b1-7456-4086-bf12-5e3ace0aa65a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.199897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.200520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.200795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.201090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.201927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.203767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.220032 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3438/6842] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:36.221226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.232857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773dcbf-b64c-4ea8-98d1-16be25bab944 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.240283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.241151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.241591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.242407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.243013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.244775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.246572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3df5c-daca-4a89-b887-9587780fb8a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.249558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3df5c-daca-4a89-b887-9587780fb8a9 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.257553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3439/6843] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:36.262521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.264664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3405/6844] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:36.275487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c7c16-2e1c-4e4b-8305-2fd01fba6d5f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.280627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.281369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.281697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.282430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] PATH_INFO: `/v3/projects/a674705aa32441ac99d61711ce933c50/users/09e3c1c11ea34739a0f5e0a5549fd8fb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.300633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a674705aa32441ac99d61711ce933c50, user_id=09e3c1c11ea34739a0f5e0a5549fd8fb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.303597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.318089 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3440/6845] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:36 2022] PUT /identity/v3/projects/a674705aa32441ac99d61711ce933c50/users/09e3c1c11ea34739a0f5e0a5549fd8fb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:36.332335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.333245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.334337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.369724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] MFA Rules not processed for user `09e3c1c11ea34739a0f5e0a5549fd8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:36.371890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:36.457534 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3406/6846] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:36.462148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.499963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:36.536998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ced3578-254a-4b83-a24c-46916a598185 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.542214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.552506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.552808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.558114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.559054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.561047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.623846 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3441/6847] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:36 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:36.624927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.642783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962076d7-d88e-4e72-89ef-42d9b668da47 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.700906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:36.791098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.791966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.792259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.792532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.793175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.795540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.825872 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3407/6848] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:36 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:36.832351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.851349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ed039-5611-456f-9dc5-482f31ad361d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.859938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.860617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.861003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.861318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.862120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.864181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.881858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3442/6849] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:36.884318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.896977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7d55-9cde-4f45-bfb9-7c124a60dcaa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.902974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70d832-ecd2-4af6-84a2-3ab8bbddb98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.903686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70d832-ecd2-4af6-84a2-3ab8bbddb98e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.904815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70d832-ecd2-4af6-84a2-3ab8bbddb98e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.905353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70d832-ecd2-4af6-84a2-3ab8bbddb98e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.906266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70d832-ecd2-4af6-84a2-3ab8bbddb98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.909864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70d832-ecd2-4af6-84a2-3ab8bbddb98e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.921839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3408/6850] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:36.925433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:36.939527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49001554-eecc-4ebb-8877-d3de4cadb7b5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:36.946325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:36.947158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:36.947433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:36.947744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] PATH_INFO: `/v3/projects/e45a7311ce8f42008a0488cb7fa8272b/users/c7652db4328247cb90ecf0eebe866064/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:36.969410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45a7311ce8f42008a0488cb7fa8272b, user_id=c7652db4328247cb90ecf0eebe866064, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:36.979603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:36.998833 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3443/6851] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:36 2022] PUT /identity/v3/projects/e45a7311ce8f42008a0488cb7fa8272b/users/c7652db4328247cb90ecf0eebe866064/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:37.009881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.010177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.010460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.057004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] MFA Rules not processed for user `c7652db4328247cb90ecf0eebe866064`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:37.058471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:37.161537 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3409/6852] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:37.166687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:37.260245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09c45-9270-4213-b5a5-f54633ef811b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:37.272909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:37.274309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.274750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.275365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.276220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:37.279031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:37.331490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3444/6853] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:37 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:37.336218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:37.357344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02199748-619d-4082-a4fb-a085b27f3153 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:37.451072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:37.452080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.452568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.453047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.455187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:37.457452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:37.487526 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3410/6854] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:37 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:37.491673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:37.505548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df104cb-9983-42e3-8468-75e74a4bb9eb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:37.511105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:37.511966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.513542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.514146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.515386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:37.517406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:37.530093 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3445/6855] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:37.534780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:37.569351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c878-a899-40a9-b9f2-7b3ef6341d81 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:37.574836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:37.576427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.576796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.577208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] PATH_INFO: `/v3/projects/864826bcf57b4f1ea902fff167db5684/users/303e6d84730e436793e9aaade751abaa/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.602055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864826bcf57b4f1ea902fff167db5684, user_id=303e6d84730e436793e9aaade751abaa, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:37.604805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:37.615091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:37.625440 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3411/6856] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:37 2022] PUT /identity/v3/projects/864826bcf57b4f1ea902fff167db5684/users/303e6d84730e436793e9aaade751abaa/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:16:37.626972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:37.642990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91abbdbc-2c2d-46f2-a1a4-9f47e634f2a1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:37.714560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:37.735390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ac95-37e7-4476-90ff-1ee17dc19cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:37.736253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac95-37e7-4476-90ff-1ee17dc19cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.736928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac95-37e7-4476-90ff-1ee17dc19cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.737897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac95-37e7-4476-90ff-1ee17dc19cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.739151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ac95-37e7-4476-90ff-1ee17dc19cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:37.742567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ac95-37e7-4476-90ff-1ee17dc19cf8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:37.760176 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3446/6857] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:37.761451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:37.772763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd87d21-4f7b-4569-8541-927cb4649869 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:37.787044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:37.787791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.788130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.788462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] PATH_INFO: `/v3/projects/864826bcf57b4f1ea902fff167db5684/users/303e6d84730e436793e9aaade751abaa/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.791468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=864826bcf57b4f1ea902fff167db5684, user_id=303e6d84730e436793e9aaade751abaa, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:37.794206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:37.810574 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3412/6858] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:37 2022] PUT /identity/v3/projects/864826bcf57b4f1ea902fff167db5684/users/303e6d84730e436793e9aaade751abaa/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:37.821023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:37.821610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:37.821947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:37.863556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] MFA Rules not processed for user `303e6d84730e436793e9aaade751abaa`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:37.865906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:38.038879 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3447/6859] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:38.137686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:38.139302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:38.218794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cff9d-8059-485f-9892-c0bd3f5d6716 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:38.224412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343e43f-7ef3-4402-903d-723333605f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:38.224412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e43f-7ef3-4402-903d-723333605f75 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:38.224412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e43f-7ef3-4402-903d-723333605f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:38.224412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343e43f-7ef3-4402-903d-723333605f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:38.285706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e43f-7ef3-4402-903d-723333605f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:38.287215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343e43f-7ef3-4402-903d-723333605f75 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:38.297109 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3413/6860] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:38.781714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:38.783401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:38.853111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ce48d-a647-482a-873c-a26469c5b2f9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:38.858483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:38.859373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:38.859980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:38.860401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] PATH_INFO: `/v3/users/7dce3e3d966441b8b951843f2ff55fb6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:38.861701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dce3e3d966441b8b951843f2ff55fb6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:38.863819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:38.924359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dce3e3d966441b8b951843f2ff55fb6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:38.935960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dce3e3d966441b8b951843f2ff55fb6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:38.936622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dce3e3d966441b8b951843f2ff55fb6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:38.944367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dce3e3d966441b8b951843f2ff55fb6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:38.945624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dce3e3d966441b8b951843f2ff55fb6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:38.958310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:38.971162 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3448/6861] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:38 2022] DELETE /identity/v3/users/7dce3e3d966441b8b951843f2ff55fb6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:38.975410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:38.975939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:38.976053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:38.997059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:38.998634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:39.067297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3414/6862] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:39.076866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:39.078416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:39.148501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593e0cb1-29e4-43b3-80d5-020afce9aa0c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:39.152723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:39.153638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:39.154003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:39.154432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:39.167687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:39.169344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:39.186208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3449/6863] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:39.740846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:39.743881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:39.761956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb19328-41fa-4033-9ec0-130eaebe188c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:39.781040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:39.781735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:39.782664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:39.782946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] PATH_INFO: `/v3/projects/1c657db47c894f88a2fe11da48ca3d83` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:39.784137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c657db47c894f88a2fe11da48ca3d83)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:39.786776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:39.834709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:39.846885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c657db47c894f88a2fe11da48ca3d83', 'request_id': 'req-8d1fd15b-2d35-4f05-9862-6f162ac790c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:39.854271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c657db47c894f88a2fe11da48ca3d83', 'request_id': 'req-8d1fd15b-2d35-4f05-9862-6f162ac790c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:39.860880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c657db47c894f88a2fe11da48ca3d83', 'request_id': 'req-8d1fd15b-2d35-4f05-9862-6f162ac790c6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:39.884844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] The token cache is being invalidate because project 1c657db47c894f88a2fe11da48ca3d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:39.885083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:39.886363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:39.888190 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3415/6864] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:39 2022] DELETE /identity/v3/projects/1c657db47c894f88a2fe11da48ca3d83 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:39.892185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:39.907359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740a6c6-d02f-4453-9eab-1cc00c12b695 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:39.939640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:39.941046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:39.983047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:39.983703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:39.983983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:39.984291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] PATH_INFO: `/v3/users/423f266a8cef4fc4adfa49fa8a430dc3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:39.985874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423f266a8cef4fc4adfa49fa8a430dc3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:39.987951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:40.022412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fd15b-2d35-4f05-9862-6f162ac790c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:40.028881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:40.029979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:40.030697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:40.031102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:40.033333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:40.067924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423f266a8cef4fc4adfa49fa8a430dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.078067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423f266a8cef4fc4adfa49fa8a430dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.079403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423f266a8cef4fc4adfa49fa8a430dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.089412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423f266a8cef4fc4adfa49fa8a430dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.090141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423f266a8cef4fc4adfa49fa8a430dc3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.111941 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3450/6865] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:39 2022] DELETE /identity/v3/users/423f266a8cef4fc4adfa49fa8a430dc3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:40.113731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:40.116670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bdb51c-42f4-4250-b7f1-2280ee7b0d3d service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:40.126957 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3416/6866] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:40.499148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:40.501092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:40.577755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:40.672441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d9a36-ccb8-4b1d-a205-335a3a93df22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:40.682674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:40.683744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:40.684146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:40.685727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] PATH_INFO: `/v3/projects/fa50b67c53654b0185baf093f8338e72` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:40.687367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa50b67c53654b0185baf093f8338e72)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:40.691599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:40.783913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa50b67c53654b0185baf093f8338e72', 'request_id': 'req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.791940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa50b67c53654b0185baf093f8338e72', 'request_id': 'req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.799607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa50b67c53654b0185baf093f8338e72', 'request_id': 'req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.816855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] The token cache is being invalidate because project fa50b67c53654b0185baf093f8338e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:40.817470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.818367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:40.825543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f08d-96a4-42ad-8c15-83ac81a328ad None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:40.825981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3451/6867] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:40 2022] DELETE /identity/v3/projects/fa50b67c53654b0185baf093f8338e72 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:40.826690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f08d-96a4-42ad-8c15-83ac81a328ad None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:40.827145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54f08d-96a4-42ad-8c15-83ac81a328ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:40.860829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a54f08d-96a4-42ad-8c15-83ac81a328ad None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:40.862424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a54f08d-96a4-42ad-8c15-83ac81a328ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:40.905056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:40.906682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:40.969866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71b681-f354-4161-b0cc-5ceec5d1ac0e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:40.974677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:40.975435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:40.975965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:40.976444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:40.978706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3417/6868] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:40.979125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:40.988200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:40.988863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:40.989372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.012699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:41.014807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:41.025099 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3418/6869] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:41.029708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.052582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07708f2e-0652-4310-85a3-42bc9f15e908 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.059094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.060033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.060686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.061184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.062093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:16:41.062745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.064722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.090267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:41.110194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3419/6870] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:16:41.113348 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.137180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d8cd-4cc7-4405-829a-68ca150fdbe3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.139457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.142168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.147738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:41.155010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.155575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.155858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.156132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.156846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.159022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.162720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3452/6871] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:41.195886 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3420/6872] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:41 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:41.196669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.209099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87dcb4-4904-4d49-b74d-f428ec4b70dd service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.359045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.359746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.360026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.360298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.368693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.371208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.408921 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3453/6873] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:41 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:41.413865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.426553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10660df0-0be1-4e84-9281-e36517772010 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.437251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.438277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.438816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.439308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.440075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.441898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.464899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.467999 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3421/6874] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:41.488832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2c318-dbff-470a-8697-497c7999f899 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.503040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b7049-67d2-449d-b625-877184eb61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.506679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b7049-67d2-449d-b625-877184eb61ad admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.507233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b7049-67d2-449d-b625-877184eb61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.507725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b7049-67d2-449d-b625-877184eb61ad admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.508655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b7049-67d2-449d-b625-877184eb61ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.512600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b7049-67d2-449d-b625-877184eb61ad admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.539036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3454/6875] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:16:41.543433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.575780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374d5b5-7406-42c1-a7a4-7a38245a733c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.588719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.589431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.589716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.590017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] PATH_INFO: `/v3/projects/97f407d736e646e196b87449b871317a/users/83141c22e2174ece9dc95cd1e5da9c5b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.623381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97f407d736e646e196b87449b871317a, user_id=83141c22e2174ece9dc95cd1e5da9c5b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.626278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.644291 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3422/6876] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:41 2022] PUT /identity/v3/projects/97f407d736e646e196b87449b871317a/users/83141c22e2174ece9dc95cd1e5da9c5b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:41.655351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.655638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.655920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.689940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] MFA Rules not processed for user `83141c22e2174ece9dc95cd1e5da9c5b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:41.691114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:41.785553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3455/6877] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:16:41.786189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.904554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cbc80-ddb9-4d79-b20f-052df2634018 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:41.910161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:41.911045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:41.911424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:41.911801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:41.912779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:41.914891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:41.963121 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3423/6878] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:16:41 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:16:41.967445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:41.983104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46b465-573b-46c8-b95b-d3333d379673 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:42.138277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:42.139737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.140191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.140625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:42.141453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:42.143976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:42.160926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:42.178956 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3456/6879] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:16:41 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:16:42.182585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:42.196034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe0cfa-848b-42bc-9720-52dde136c073 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:42.217882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:42.218452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.218731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.219012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:42.219670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:42.221329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:42.241142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3424/6880] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:42.245581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:42.263846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd7ae6-75e0-4c76-a593-6f442fc79549 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:42.278690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:42.279446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.279734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.280048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] PATH_INFO: `/v3/projects/3ee86b513c0c4df299ba8c05c0c4d8a2/users/46c8ae2b8944403db044c13b516ef4c0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:42.333460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee86b513c0c4df299ba8c05c0c4d8a2, user_id=46c8ae2b8944403db044c13b516ef4c0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:42.339537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:42.370820 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3457/6881] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:42 2022] PUT /identity/v3/projects/3ee86b513c0c4df299ba8c05c0c4d8a2/users/46c8ae2b8944403db044c13b516ef4c0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:42.375233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:42.392523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26d38-97a2-44e9-b649-5e67352289c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:42.489095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4da9f-2134-4b39-839f-5c231f76a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:42.489640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4da9f-2134-4b39-839f-5c231f76a9fb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.489950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4da9f-2134-4b39-839f-5c231f76a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.490222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4da9f-2134-4b39-839f-5c231f76a9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:42.490863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4da9f-2134-4b39-839f-5c231f76a9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:42.492834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4da9f-2134-4b39-839f-5c231f76a9fb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:42.508948 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3425/6882] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:16:42.511360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:42.533277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7ed61-6b30-4154-9523-c8c47255c355 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:42.539054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:42.539780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.540057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.540332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] PATH_INFO: `/v3/projects/3ee86b513c0c4df299ba8c05c0c4d8a2/users/46c8ae2b8944403db044c13b516ef4c0/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:42.551756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee86b513c0c4df299ba8c05c0c4d8a2, user_id=46c8ae2b8944403db044c13b516ef4c0, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:42.554775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:42.627657 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3458/6883] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:16:42 2022] PUT /identity/v3/projects/3ee86b513c0c4df299ba8c05c0c4d8a2/users/46c8ae2b8944403db044c13b516ef4c0/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:42.628184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.628470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.628747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:42.679331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:42.710936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] MFA Rules not processed for user `46c8ae2b8944403db044c13b516ef4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:42.712267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:42.835513 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3426/6884] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:42.847592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:42.937617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2af593-a404-45f1-8b15-a58a342ffa5f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:42.943686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:42.944539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:42.944994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:42.945427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:43.026722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:43.028895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:43.039927 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3459/6885] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:45.516186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:45.517861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:45.652082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:45.654529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:45.676583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e530-8ded-4009-9bbf-1eb4beb15c1c service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:45.681367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:45.681675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14915382-4ec7-4f95-82ae-44077459eb96 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:45.682740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:45.683771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:45.684369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:45.687759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:45.688402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:45.688660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:45.688934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:45.697513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:45.700728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:45.703003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:45.716950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:45.718713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616714d-47f0-4b24-b592-99bf23827fc0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:45.722351 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3460/6886] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:45.742328 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3427/6887] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:46.733133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:46.749012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238b3f-2d3f-4c90-8c7b-132948d9ce5f service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:46.753584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:46.754257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:46.754538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:46.754814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:46.756606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:46.779233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:46.781292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:46.797221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3461/6888] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:49.540127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246d65-7aed-4d59-ad06-4ed4d5fdcc18 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:49.541774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246d65-7aed-4d59-ad06-4ed4d5fdcc18 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:49.542246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee246d65-7aed-4d59-ad06-4ed4d5fdcc18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:49.608354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee246d65-7aed-4d59-ad06-4ed4d5fdcc18 None None] MFA Rules not processed for user `89a693133ded46eba2b9b70e899f38f9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:49.610156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee246d65-7aed-4d59-ad06-4ed4d5fdcc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:49.706594 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3428/6889] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:54.076640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:54.078337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:54.268082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:54.339912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7e94c-fde1-4dbd-9cdc-d995701f98e1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:54.359448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:54.359953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:54.360703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:54.360996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] PATH_INFO: `/v3/users/09e3c1c11ea34739a0f5e0a5549fd8fb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:54.366408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e3c1c11ea34739a0f5e0a5549fd8fb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:54.369435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:54.470294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e3c1c11ea34739a0f5e0a5549fd8fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:54.486373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e3c1c11ea34739a0f5e0a5549fd8fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:54.486939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e3c1c11ea34739a0f5e0a5549fd8fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:54.499934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e3c1c11ea34739a0f5e0a5549fd8fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:54.513860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e3c1c11ea34739a0f5e0a5549fd8fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:54.593869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3462/6890] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:54 2022] DELETE /identity/v3/users/09e3c1c11ea34739a0f5e0a5549fd8fb => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:54.596721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:54.598140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:54.598578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:54.666918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:54.672485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:54.802733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:54.864692 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3429/6891] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:54.875206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:54.877432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:55.027229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff0af8-4c57-4dac-b47b-fc0762f1dfb4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:55.044075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:55.044888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:55.045449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:55.045735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:55.075930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:55.077682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:55.092868 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3463/6892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:16:55.891624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:55.894364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:55.914702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e8243-de9e-4272-935e-38b93e4f68a9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:55.922187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:55.923457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:55.923926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:55.924388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] PATH_INFO: `/v3/projects/a674705aa32441ac99d61711ce933c50` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:55.926159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a674705aa32441ac99d61711ce933c50)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:55.929036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:56.054401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a674705aa32441ac99d61711ce933c50', 'request_id': 'req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.062672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a674705aa32441ac99d61711ce933c50', 'request_id': 'req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.097242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a674705aa32441ac99d61711ce933c50', 'request_id': 'req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.115103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] The token cache is being invalidate because project a674705aa32441ac99d61711ce933c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:56.115395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.118173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.119756 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3430/6893] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:55 2022] DELETE /identity/v3/projects/a674705aa32441ac99d61711ce933c50 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:56.126562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:56.149782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782fd2-f36b-4546-8e15-4193d122292a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:56.292146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:56.293744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:56.294278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:56.294959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] PATH_INFO: `/v3/users/c7652db4328247cb90ecf0eebe866064` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:56.297280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7652db4328247cb90ecf0eebe866064)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:56.305629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:56.319308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:56.399018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7652db4328247cb90ecf0eebe866064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.421969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7652db4328247cb90ecf0eebe866064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.422757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7652db4328247cb90ecf0eebe866064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.432819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7652db4328247cb90ecf0eebe866064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.438152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7652db4328247cb90ecf0eebe866064'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:56.480628 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3464/6894] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:56 2022] DELETE /identity/v3/users/c7652db4328247cb90ecf0eebe866064 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:57.136578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:57.139738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:57.165180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fa76e2-a4af-470b-ae9d-1d4e5ad21ba8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:57.324770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:57.325461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:57.325836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:57.326114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] PATH_INFO: `/v3/users/83141c22e2174ece9dc95cd1e5da9c5b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:57.332642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83141c22e2174ece9dc95cd1e5da9c5b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:57.335164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:57.505295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83141c22e2174ece9dc95cd1e5da9c5b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.552405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83141c22e2174ece9dc95cd1e5da9c5b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.553535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83141c22e2174ece9dc95cd1e5da9c5b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.567196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:57.568658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83141c22e2174ece9dc95cd1e5da9c5b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.570177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-acfed2ef-8e71-4779-8606-b90539a7acf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83141c22e2174ece9dc95cd1e5da9c5b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.608259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:57.609737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:57.643939 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3431/6895] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:57 2022] DELETE /identity/v3/users/83141c22e2174ece9dc95cd1e5da9c5b => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:57.649303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:57.649610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:57.651045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:57.659336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ddc2df-0770-49e3-bc26-2ae78d505088 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:57.730867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:57.735345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:57.825346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:57.826379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:57.826861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:57.827232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] PATH_INFO: `/v3/projects/e45a7311ce8f42008a0488cb7fa8272b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:57.828532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45a7311ce8f42008a0488cb7fa8272b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:57.833914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:57.953705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45a7311ce8f42008a0488cb7fa8272b', 'request_id': 'req-36586a50-641e-4133-99ff-a0b897a4b4ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.961045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3432/6896] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:16:57.971673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:57.973588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:57.976809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45a7311ce8f42008a0488cb7fa8272b', 'request_id': 'req-36586a50-641e-4133-99ff-a0b897a4b4ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:57.992526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45a7311ce8f42008a0488cb7fa8272b', 'request_id': 'req-36586a50-641e-4133-99ff-a0b897a4b4ca'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.042068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] The token cache is being invalidate because project e45a7311ce8f42008a0488cb7fa8272b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:58.042844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.045247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.052046 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3465/6897] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:57 2022] DELETE /identity/v3/projects/e45a7311ce8f42008a0488cb7fa8272b => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:58.053471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:58.056984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:58.101851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34125047-e364-487c-ba46-8e1ce7904cba None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:58.118025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:58.201768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36586a50-641e-4133-99ff-a0b897a4b4ca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:58.207520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:58.208282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:58.208898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:58.209267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] PATH_INFO: `/v3/users/303e6d84730e436793e9aaade751abaa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:58.210790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303e6d84730e436793e9aaade751abaa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:58.213007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:58.265761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:58.267122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:58.267646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:58.268072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:58.270403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:58.306342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303e6d84730e436793e9aaade751abaa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.322401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:58.328328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303e6d84730e436793e9aaade751abaa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.328692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:58.329294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303e6d84730e436793e9aaade751abaa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.343305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303e6d84730e436793e9aaade751abaa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.345781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303e6d84730e436793e9aaade751abaa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:58.371834 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3433/6898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:58.423431 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3466/6899] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:58 2022] DELETE /identity/v3/users/303e6d84730e436793e9aaade751abaa => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:59.135915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:59.137554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:59.157246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104a71-0bcf-4c20-ac1b-8036833e87c1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:59.188115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:59.190431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:59.287936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:59.320727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:59.321593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:59.321951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:59.322312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] PATH_INFO: `/v3/projects/97f407d736e646e196b87449b871317a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:59.323587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=97f407d736e646e196b87449b871317a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:59.326473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:59.401129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed1a67-108c-4330-9ab3-1d594f054795 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:59.416024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:59.416668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:59.416944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:59.417213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:59.424202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:59.439351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97f407d736e646e196b87449b871317a', 'request_id': 'req-7e525e69-ddcd-4c07-a55a-b7691559b6ca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.454458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:59.456415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97f407d736e646e196b87449b871317a', 'request_id': 'req-7e525e69-ddcd-4c07-a55a-b7691559b6ca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.456567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:59.475954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97f407d736e646e196b87449b871317a', 'request_id': 'req-7e525e69-ddcd-4c07-a55a-b7691559b6ca'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.489028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3467/6900] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:16:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:16:59.497715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] The token cache is being invalidate because project 97f407d736e646e196b87449b871317a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:59.500781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.500781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.504792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:59.507745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:59.507882 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3434/6901] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:59 2022] DELETE /identity/v3/projects/97f407d736e646e196b87449b871317a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:59.509087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:16:59.525727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:16:59.570747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f745c-bd5b-4c82-bf47-8fbcd2b73b30 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:59.606579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:59.688554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:59.689372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:59.689654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:59.691825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] PATH_INFO: `/v3/projects/864826bcf57b4f1ea902fff167db5684` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:59.693575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=864826bcf57b4f1ea902fff167db5684)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:59.699369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e525e69-ddcd-4c07-a55a-b7691559b6ca admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:16:59.700215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:59.715569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:16:59.716319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:59.716601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:59.716870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] PATH_INFO: `/v3/users/46c8ae2b8944403db044c13b516ef4c0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:59.719088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c8ae2b8944403db044c13b516ef4c0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:16:59.723257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:16:59.809250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864826bcf57b4f1ea902fff167db5684', 'request_id': 'req-24bb6dad-001d-4e91-9eb9-2718daafd61f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.841461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c8ae2b8944403db044c13b516ef4c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.843164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864826bcf57b4f1ea902fff167db5684', 'request_id': 'req-24bb6dad-001d-4e91-9eb9-2718daafd61f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.874140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864826bcf57b4f1ea902fff167db5684', 'request_id': 'req-24bb6dad-001d-4e91-9eb9-2718daafd61f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.880602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c8ae2b8944403db044c13b516ef4c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.882208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c8ae2b8944403db044c13b516ef4c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.901034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] The token cache is being invalidate because project 864826bcf57b4f1ea902fff167db5684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:16:59.901537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.902363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-24bb6dad-001d-4e91-9eb9-2718daafd61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.904525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c8ae2b8944403db044c13b516ef4c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.905725 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3468/6902] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:16:59 2022] DELETE /identity/v3/projects/864826bcf57b4f1ea902fff167db5684 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:59.907131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-03797c14-99c8-4fde-9c18-4f9e5b493f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c8ae2b8944403db044c13b516ef4c0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:16:59.910925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:16:59.911219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:16:59.911495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:16:59.918968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:16:59.943214 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3435/6903] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:16:59 2022] DELETE /identity/v3/users/46c8ae2b8944403db044c13b516ef4c0 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:16:59.970035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:16:59.975572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:00.130136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3469/6904] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:16:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:00.137928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.138979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.139492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:00.235467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:00.236743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:00.259402 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3436/6905] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:00.264007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:00.279478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178ef2-db59-44bc-867c-f7715ca8e885 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:00.296745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:00.297897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.298347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.299246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:00.300299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:00.300780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:00.338788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:00.384673 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3470/6906] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:00.389460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:00.400330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374ece0-c065-4b6c-acfd-81ff15e05c75 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:00.405675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:00.406364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.406644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.406923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:00.407566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:00.410051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:00.456416 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3437/6907] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:00 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:00.457595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:00.473898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4abc0c-4072-4a6f-81ac-f28c8e2e159c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:00.617744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:00.689916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:00.690761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.708224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.708676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:00.710594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:00.718686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:00.773865 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3471/6908] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:00 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:17:00.777919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:00.795151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606ffc-0e74-4dc2-bd15-1d0ef1500fdd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:00.811061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:00.814294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.816242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.816736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:00.818031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:00.823300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:00.848506 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3438/6909] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:00.850106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:00.866822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c3c23-6796-4dc5-bdfc-6018cd1db83a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:00.880683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e82170-6fb0-4232-8902-7569080fe599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:00.881325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e82170-6fb0-4232-8902-7569080fe599 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.881606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e82170-6fb0-4232-8902-7569080fe599 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.881909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e82170-6fb0-4232-8902-7569080fe599 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:00.882562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e82170-6fb0-4232-8902-7569080fe599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:00.887245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e82170-6fb0-4232-8902-7569080fe599 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:00.921939 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3472/6910] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:00.926435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:00.950230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f50a9-9f70-4d8a-80fa-07616ab996e0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:00.962639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:00.963484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:00.963863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:00.964324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] PATH_INFO: `/v3/projects/738337cc190644dcb6ac88db4d0994aa/users/42be58e511bc4f27aba89c886e479d5f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:01.007868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] RBAC: Authorizing `identity:create_grant(project_id=738337cc190644dcb6ac88db4d0994aa, user_id=42be58e511bc4f27aba89c886e479d5f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:01.011849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:01.036152 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3439/6911] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:00 2022] PUT /identity/v3/projects/738337cc190644dcb6ac88db4d0994aa/users/42be58e511bc4f27aba89c886e479d5f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:01.048309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:01.048594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:01.048874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:01.156611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] MFA Rules not processed for user `42be58e511bc4f27aba89c886e479d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:01.157933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:01.353826 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3473/6912] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:01.359981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:01.362289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:01.482337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc58d2-806b-4f9a-bd24-2a3a25f8778a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:01.486653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4ec5a-e5db-473c-8787-e6e24e0a3de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:01.487365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4ec5a-e5db-473c-8787-e6e24e0a3de2 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:01.487742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4ec5a-e5db-473c-8787-e6e24e0a3de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:01.488086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4ec5a-e5db-473c-8787-e6e24e0a3de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:01.500197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4ec5a-e5db-473c-8787-e6e24e0a3de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:01.501699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4ec5a-e5db-473c-8787-e6e24e0a3de2 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:01.513232 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3440/6913] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:01.672752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:01.674355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:01.851590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ec686-bc33-4441-9785-7fb2f01867d5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:01.863121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:01.865187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:01.865528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:01.865714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] PATH_INFO: `/v3/projects/3ee86b513c0c4df299ba8c05c0c4d8a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:01.868845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee86b513c0c4df299ba8c05c0c4d8a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:01.874243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:01.970371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee86b513c0c4df299ba8c05c0c4d8a2', 'request_id': 'req-a4762118-d545-4e68-99c9-8632be313806'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:01.971651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:01.985597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee86b513c0c4df299ba8c05c0c4d8a2', 'request_id': 'req-a4762118-d545-4e68-99c9-8632be313806'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:01.999597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee86b513c0c4df299ba8c05c0c4d8a2', 'request_id': 'req-a4762118-d545-4e68-99c9-8632be313806'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:02.035576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] The token cache is being invalidate because project 3ee86b513c0c4df299ba8c05c0c4d8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:02.035896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:02.037279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4762118-d545-4e68-99c9-8632be313806 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:02.047367 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3474/6914] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:01 2022] DELETE /identity/v3/projects/3ee86b513c0c4df299ba8c05c0c4d8a2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:02.048676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.049112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.049458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.089044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:02.090779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:02.259394 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3441/6915] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:02.268045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.268331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.268604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.309573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:02.311398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:02.324638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:02.335481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa11af6-af21-4f90-bdbc-9cfedf232ae4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:02.336327 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3475/6916] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:02.341157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:02.341986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.342180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.342453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.343109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:02.343409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:02.345049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:02.363313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:02.372104 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3442/6917] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:02.378698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ea204-b463-4be8-9cd3-a6a16face08c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:02.391113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:02.392349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.392832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.393326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.397777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:02.405098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:02.473901 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3476/6918] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:02 2022] POST /identity/v3/projects => generated 379 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:17:02.478086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:02.489326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec1161-3701-400e-9bdb-dcea396c00d9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:02.512250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:02.575320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:02.576445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.576796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.577142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.578253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:02.580523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:02.638606 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3443/6919] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:02 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:02.643312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:02.689434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15c3362-c0f0-4ed5-8aad-17176128275a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:02.706208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:02.707973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.708480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.708988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.709933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:02.712044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:02.727368 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3477/6920] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:02.731855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:02.743903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982c0a-c8c5-47f6-b2a7-e4d8f2e00137 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:02.749498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2944286-1894-4080-9784-1cb5810fd675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:02.750165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2944286-1894-4080-9784-1cb5810fd675 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.751012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2944286-1894-4080-9784-1cb5810fd675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.751012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2944286-1894-4080-9784-1cb5810fd675 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.751398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2944286-1894-4080-9784-1cb5810fd675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:02.753016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2944286-1894-4080-9784-1cb5810fd675 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:02.769695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:02.777140 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3444/6921] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:02.794876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b877f8-1336-44e7-8bbf-9030c3affd7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:02.804158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:02.805003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.805370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.805853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] PATH_INFO: `/v3/projects/d5bf007916bb448cbddcf703300e692f/users/916a40f971fa4869b4b12a45e3e04551/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.839262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5bf007916bb448cbddcf703300e692f, user_id=916a40f971fa4869b4b12a45e3e04551, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:02.842198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:02.863446 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3478/6922] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:02 2022] PUT /identity/v3/projects/d5bf007916bb448cbddcf703300e692f/users/916a40f971fa4869b4b12a45e3e04551/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:02.872652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936244b6-c250-4538-b164-7954aa32a887 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:02.872972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936244b6-c250-4538-b164-7954aa32a887 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:02.873253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936244b6-c250-4538-b164-7954aa32a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:02.926195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-936244b6-c250-4538-b164-7954aa32a887 None None] MFA Rules not processed for user `916a40f971fa4869b4b12a45e3e04551`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:02.927719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-936244b6-c250-4538-b164-7954aa32a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:03.046888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3445/6923] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:03.054948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.207417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4288e-fe4a-404c-9487-a111d6a1d092 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:03.216605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:03.217262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.217546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.217840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.245727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:03.248585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:03.293854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3479/6924] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:03 2022] POST /identity/v3/projects => generated 381 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:03.298113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936244b6-c250-4538-b164-7954aa32a887 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.320433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936244b6-c250-4538-b164-7954aa32a887 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:03.448187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:03.448966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.449371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.449651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.450355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:03.452779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:03.501448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3446/6925] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:03 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:17:03.505900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.520440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9ec97-0c37-4dac-aa76-1e4e4b3674b0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:03.533125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:03.533855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.534304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.534584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.535935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:03.537638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:03.550582 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3480/6926] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:03.562067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.573292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecfb0a-8bc1-4c8e-a8cb-42947e9745d3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:03.578408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:03.579188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.580111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.580111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] PATH_INFO: `/v3/projects/53aee7f86de447169377bbcfc73e6080/users/85e2877fc29e4ab58ba6aacafac54442/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.597369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aee7f86de447169377bbcfc73e6080, user_id=85e2877fc29e4ab58ba6aacafac54442, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:03.600218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:03.604094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:03.618465 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3447/6927] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:03 2022] PUT /identity/v3/projects/53aee7f86de447169377bbcfc73e6080/users/85e2877fc29e4ab58ba6aacafac54442/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:03.622008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.633524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706ea83-56a7-49f4-a105-91b7693d6902 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:03.698611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:03.729249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919bf1ad-69dd-48b7-b9c5-d99ca59aabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:03.730514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf1ad-69dd-48b7-b9c5-d99ca59aabf7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.731589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf1ad-69dd-48b7-b9c5-d99ca59aabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.732539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919bf1ad-69dd-48b7-b9c5-d99ca59aabf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.733715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf1ad-69dd-48b7-b9c5-d99ca59aabf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:03.735611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919bf1ad-69dd-48b7-b9c5-d99ca59aabf7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:03.750354 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3481/6928] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:03.754672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.770105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608efed9-e3fd-4272-a019-2717ff953bc3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:03.777825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:03.778583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.778932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.782256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] PATH_INFO: `/v3/projects/53aee7f86de447169377bbcfc73e6080/users/85e2877fc29e4ab58ba6aacafac54442/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.784920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aee7f86de447169377bbcfc73e6080, user_id=85e2877fc29e4ab58ba6aacafac54442, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:03.788102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:03.803011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3448/6929] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:03 2022] PUT /identity/v3/projects/53aee7f86de447169377bbcfc73e6080/users/85e2877fc29e4ab58ba6aacafac54442/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:03.815847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b568d2-cc15-4e93-9dbc-7aed93b6f0c5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:03.816239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b568d2-cc15-4e93-9dbc-7aed93b6f0c5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:03.816444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b568d2-cc15-4e93-9dbc-7aed93b6f0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:03.847885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-18b568d2-cc15-4e93-9dbc-7aed93b6f0c5 None None] MFA Rules not processed for user `85e2877fc29e4ab58ba6aacafac54442`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:03.849244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18b568d2-cc15-4e93-9dbc-7aed93b6f0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:03.939121 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3482/6930] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:03 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:03.952136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:03.954400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:04.025682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbbb63-333d-42d9-8db2-cf55a35691d2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:04.037465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:04.039335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:04.039335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:04.039335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:04.049608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:04.051173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:04.062621 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3449/6931] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:04.281135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:04.281714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:04.282242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:04.304613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] MFA Rules not processed for user `42be58e511bc4f27aba89c886e479d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:04.305919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:04.382553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3483/6932] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:04.539071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:04.556788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ba570-fa24-42c2-b95c-a08b86a41c94 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:04.563663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e2877fc29e4ab58ba6aacafac54442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53aee7f86de447169377bbcfc73e6080', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:04.564366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:04.564906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:04.565182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:04.565858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:04.566169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:04.567908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:04.582172 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3450/6933] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:04.586593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:04.601347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a889e1-ed22-4907-8978-712656f06cb6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:04.607406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e2877fc29e4ab58ba6aacafac54442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53aee7f86de447169377bbcfc73e6080', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:04.608535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:04.609061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:04.609566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:04.610484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:04.613022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:04.654303 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3484/6934] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:04 2022] POST /identity/v3/projects => generated 355 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:17:04.659085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:04.669451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3a486-75c4-4315-9072-86a10af31a92 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:04.750239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e2877fc29e4ab58ba6aacafac54442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53aee7f86de447169377bbcfc73e6080', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:04.750842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:04.751132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:04.751444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:04.752116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:04.752427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:04.754387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:04.771539 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3451/6935] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:17:04.819141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:04.837430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db05db13-8586-4e21-9ee6-a4607db22c7b tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:04.844683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85e2877fc29e4ab58ba6aacafac54442', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53aee7f86de447169377bbcfc73e6080', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:04.846040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:04.846740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:04.850171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] PATH_INFO: `/v3/projects/d45d6a8f55024d0f8dbaa9415f7a19a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:04.860289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d45d6a8f55024d0f8dbaa9415f7a19a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:04.863521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:05.018973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:05.022998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45d6a8f55024d0f8dbaa9415f7a19a2', 'request_id': 'req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.040069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45d6a8f55024d0f8dbaa9415f7a19a2', 'request_id': 'req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.058714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45d6a8f55024d0f8dbaa9415f7a19a2', 'request_id': 'req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.097754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] The token cache is being invalidate because project d45d6a8f55024d0f8dbaa9415f7a19a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:05.098096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.100062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.113502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3485/6936] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:04 2022] DELETE /identity/v3/projects/d45d6a8f55024d0f8dbaa9415f7a19a2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:05.147046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:05.149483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:05.327601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:05.386912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70428ce6-8dcc-416d-bdcf-17ae8d70a8f7 tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:05.541662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:05.545770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:05.581707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:05.582376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:05.583425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:05.583903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:05.596149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:05.632466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:05.634436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928d800e-d597-46a6-9eba-f9967dac7490 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:05.685096 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3452/6937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:05.694468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46b25b-2dc3-4d8d-ab6f-a44a195d408c tempest-VolumeQuotaClassesTest-1574041963 tempest-VolumeQuotaClassesTest-1574041963-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:05.704652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:05.706911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:05.707265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:05.707612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] PATH_INFO: `/v3/users/916a40f971fa4869b4b12a45e3e04551` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:05.711100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=916a40f971fa4869b4b12a45e3e04551)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:05.713115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:05.817163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '916a40f971fa4869b4b12a45e3e04551'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.831602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '916a40f971fa4869b4b12a45e3e04551'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.833151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '916a40f971fa4869b4b12a45e3e04551'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.852975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '916a40f971fa4869b4b12a45e3e04551'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.853959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '916a40f971fa4869b4b12a45e3e04551'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:05.889468 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3486/6938] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:05 2022] DELETE /identity/v3/users/916a40f971fa4869b4b12a45e3e04551 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:05.894224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:05.894389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:05.895105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:05.922370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:05.926028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:06.007997 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3453/6939] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:06.024350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:06.026785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:06.151582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c00f9-edfd-401d-b792-1a0f5cf06eb2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:06.158416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:06.159809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:06.160242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:06.160519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:06.175348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:06.179711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:06.188414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:06.240670 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3487/6940] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:07.601201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:07.603936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:07.629057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0e3f1-c84e-4be9-ae08-1fae8efe3768 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:07.643741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:07.647539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:07.647539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:07.647539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] PATH_INFO: `/v3/projects/d5bf007916bb448cbddcf703300e692f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:07.650076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5bf007916bb448cbddcf703300e692f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:07.657029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:07.775628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5bf007916bb448cbddcf703300e692f', 'request_id': 'req-0416b40b-5a1b-456d-8e89-2f809de4c370'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:07.784353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5bf007916bb448cbddcf703300e692f', 'request_id': 'req-0416b40b-5a1b-456d-8e89-2f809de4c370'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:07.800360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5bf007916bb448cbddcf703300e692f', 'request_id': 'req-0416b40b-5a1b-456d-8e89-2f809de4c370'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:07.821087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] The token cache is being invalidate because project d5bf007916bb448cbddcf703300e692f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:07.821908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:07.823220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0416b40b-5a1b-456d-8e89-2f809de4c370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:07.825653 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3454/6941] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:07 2022] DELETE /identity/v3/projects/d5bf007916bb448cbddcf703300e692f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:07.829822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:07.848432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fcab7-9ecb-43ad-98d9-a63afa66b12b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:07.996109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:07.997086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:07.998404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:07.998840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] PATH_INFO: `/v3/users/85e2877fc29e4ab58ba6aacafac54442` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:08.002335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85e2877fc29e4ab58ba6aacafac54442)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:08.004528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:08.124936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85e2877fc29e4ab58ba6aacafac54442'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:08.148245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85e2877fc29e4ab58ba6aacafac54442'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:08.154384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85e2877fc29e4ab58ba6aacafac54442'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:08.172115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85e2877fc29e4ab58ba6aacafac54442'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:08.172963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85e2877fc29e4ab58ba6aacafac54442'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:08.249322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3488/6942] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:07 2022] DELETE /identity/v3/users/85e2877fc29e4ab58ba6aacafac54442 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:09.177856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cc32e-5a12-4670-9d1c-92d5ae4b63e6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:09.178781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cc32e-5a12-4670-9d1c-92d5ae4b63e6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:09.180375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cc32e-5a12-4670-9d1c-92d5ae4b63e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:09.281049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3e9cc32e-5a12-4670-9d1c-92d5ae4b63e6 None None] MFA Rules not processed for user `29f3383c209340adb16a7074c291b191`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:09.290712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3e9cc32e-5a12-4670-9d1c-92d5ae4b63e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:09.312938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:09.465301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:09.467243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:09.513346 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3455/6943] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:09.675639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a529e2-f06f-4c74-92a1-0813474bfe15 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:09.698319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:09.700364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:09.701449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:09.701923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] PATH_INFO: `/v3/projects/53aee7f86de447169377bbcfc73e6080` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:09.705026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53aee7f86de447169377bbcfc73e6080)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:09.707004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:09.765755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:09.837992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53aee7f86de447169377bbcfc73e6080', 'request_id': 'req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:09.853590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53aee7f86de447169377bbcfc73e6080', 'request_id': 'req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:09.869248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53aee7f86de447169377bbcfc73e6080', 'request_id': 'req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:09.891899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] The token cache is being invalidate because project 53aee7f86de447169377bbcfc73e6080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:09.892707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:09.893061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc122f95-aa2b-4678-b9a7-58d6e00f45b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:09.896223 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3489/6944] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:09 2022] DELETE /identity/v3/projects/53aee7f86de447169377bbcfc73e6080 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:09.902588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:09.902588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:09.902912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:09.943951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:09.944972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:10.108770 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3456/6945] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:10.116990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.117724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.118203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.161843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:10.166283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:10.193118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3490/6946] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:10.203443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:10.222026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f9976-5acc-4db4-a257-f4a53d9cc54b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:10.243110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:10.243110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.243110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.243560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.244267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:10.244976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:10.251508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:10.275578 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3457/6947] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:10.279922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:10.297104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740e6d9-f8a7-40e4-b728-c812e8b74029 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:10.319785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:10.320427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.320706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.320977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.321656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:10.323621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:10.394536 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3491/6948] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:10 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:10.399928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:10.414941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea106a9-ebc8-46b9-a05c-a125a000d4fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:10.551557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:10.552268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.555506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.555900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.556617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:10.558817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:10.603276 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3458/6949] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:10 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:10.607330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:10.623244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeaf493-26dc-45cb-8417-307457277a54 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:10.637733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:10.638624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.639330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.639776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.640650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:10.643366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:10.672909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:10.679917 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3492/6950] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:10.686242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46d276-abd0-4b0e-b609-0f88aa2516ed admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:10.698920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02a420-6156-4e1c-bdd8-bbc02a44d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:10.699554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02a420-6156-4e1c-bdd8-bbc02a44d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.699839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02a420-6156-4e1c-bdd8-bbc02a44d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.700314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02a420-6156-4e1c-bdd8-bbc02a44d3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.701166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02a420-6156-4e1c-bdd8-bbc02a44d3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:10.703031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02a420-6156-4e1c-bdd8-bbc02a44d3c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:10.733697 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3459/6951] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:10.738591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:10.757997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91300cfb-1909-4e91-ab81-03b7fc30ef41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:10.767174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc981c96-5677-4327-9780-5389f9b4474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:10.767878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981c96-5677-4327-9780-5389f9b4474f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.768160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981c96-5677-4327-9780-5389f9b4474f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.768436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc981c96-5677-4327-9780-5389f9b4474f admin admin] PATH_INFO: `/v3/projects/1d113d0d1ec74f018053db6da7ae28a9/users/5938188385e44e4faaa6555529714099/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.802153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc981c96-5677-4327-9780-5389f9b4474f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d113d0d1ec74f018053db6da7ae28a9, user_id=5938188385e44e4faaa6555529714099, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:10.804904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc981c96-5677-4327-9780-5389f9b4474f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:10.832363 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3493/6952] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:10 2022] PUT /identity/v3/projects/1d113d0d1ec74f018053db6da7ae28a9/users/5938188385e44e4faaa6555529714099/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:10.863978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:10.864475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:10.864905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:10.936374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] MFA Rules not processed for user `5938188385e44e4faaa6555529714099`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:10.937202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:10.962793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:11.073241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.073780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.074231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.095455 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3460/6953] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:11.099874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:11.111048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] MFA Rules not processed for user `d2867c5be8974c028f933d1c8fe2c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:11.112374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:11.250749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45972-1d4f-4895-bb95-f92d10c63181 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:11.265576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3494/6954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:11.267544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:11.268189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.268491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.268749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.269397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:11.271833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:11.326073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3461/6955] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:11 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:11.330519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:11.349619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ecd2a-0f59-4478-a852-e717f2b1ac81 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:11.476408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:11.506942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:11.507589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.507873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.509380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.511919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:11.519003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:11.614812 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3495/6956] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:11 2022] POST /identity/v3/users => generated 294 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:11.618261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:11.641144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78157583-b4ef-4f38-a682-eeb8304a0e10 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:11.647679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:11.650525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.651617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.652000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.653238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:11.656288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:11.674403 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3462/6957] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:11.675709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:11.688433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622db5f-ac79-46bc-8630-aeba0a87e576 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:11.694609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6994fa2-d903-453d-9de7-fa73d6d9fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:11.695644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6994fa2-d903-453d-9de7-fa73d6d9fc5c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.696074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6994fa2-d903-453d-9de7-fa73d6d9fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.696536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6994fa2-d903-453d-9de7-fa73d6d9fc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.697424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6994fa2-d903-453d-9de7-fa73d6d9fc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:11.699482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6994fa2-d903-453d-9de7-fa73d6d9fc5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:11.719187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:11.728483 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3496/6958] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:11.733362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d27d9-1e4f-4fa2-b1e7-cc339eb79024 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:11.740915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:11.741769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.742547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.742920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] PATH_INFO: `/v3/projects/348d962560a142eeb1f4bfdfcc74c874/users/c1f5848a1a2048bda58722ff2843165d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.764862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] RBAC: Authorizing `identity:create_grant(project_id=348d962560a142eeb1f4bfdfcc74c874, user_id=c1f5848a1a2048bda58722ff2843165d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:11.768797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:11.801929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:11.802192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:11.802491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:11.806417 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3463/6959] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:11 2022] PUT /identity/v3/projects/348d962560a142eeb1f4bfdfcc74c874/users/c1f5848a1a2048bda58722ff2843165d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:11.838613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] MFA Rules not processed for user `c1f5848a1a2048bda58722ff2843165d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:11.840036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:11.969959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:11.970184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3497/6960] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:12.141224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a689d-8af9-42f7-afd7-ddcf8f00839e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.159762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.161122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.162052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.162604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.163351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.169429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.185760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:12.219935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:12.252991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3464/6961] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:11 2022] POST /identity/v3/projects => generated 387 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:12.262010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2553f-7738-4959-8b6e-e7c9086bf7b9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.406355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.407366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.407366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.407705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.408251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.412602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.418863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:12.420998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:12.447714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3498/6962] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:12 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:12.450882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:12.496408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f64428-e387-467f-a929-d0d0a2353019 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.504377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.505910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.506040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.506483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.507249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.509256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.531371 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3499/6963] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:12.534470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:12.567130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977b36-099b-4efb-a024-31a3e829d5cc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.573003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.574030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.574324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.574635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] PATH_INFO: `/v3/projects/c22eaace4b0f4d0c8950f3d449f5e8cb/users/94be042f7465464db5a11d7349628e89/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.587202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08359d68-7aa3-417d-9a49-9ea400bf119f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.602766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.603651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.604194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.604538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.607683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:12.616320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22eaace4b0f4d0c8950f3d449f5e8cb, user_id=94be042f7465464db5a11d7349628e89, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.619464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.638828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.643805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.648195 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3500/6964] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:12 2022] PUT /identity/v3/projects/c22eaace4b0f4d0c8950f3d449f5e8cb/users/94be042f7465464db5a11d7349628e89/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:12.652394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:12.676598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3465/6965] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:17:12.678800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:12.745708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce8448-64ec-4dcd-887a-118f6d2b0cd0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.752194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041034b1-198d-4256-9f66-933d719f5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.752875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041034b1-198d-4256-9f66-933d719f5d5c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.753099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041034b1-198d-4256-9f66-933d719f5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.753424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041034b1-198d-4256-9f66-933d719f5d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.754254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041034b1-198d-4256-9f66-933d719f5d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.755975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041034b1-198d-4256-9f66-933d719f5d5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.770235 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3501/6966] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:12.774362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:12.793083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c2724-483f-420a-8050-936ff6d20ab0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:12.802191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:12.803288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.803662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.804615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] PATH_INFO: `/v3/projects/c22eaace4b0f4d0c8950f3d449f5e8cb/users/94be042f7465464db5a11d7349628e89/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.807185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22eaace4b0f4d0c8950f3d449f5e8cb, user_id=94be042f7465464db5a11d7349628e89, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:12.812572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:12.826022 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3466/6967] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:12 2022] PUT /identity/v3/projects/c22eaace4b0f4d0c8950f3d449f5e8cb/users/94be042f7465464db5a11d7349628e89/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:17:12.836169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:12.837006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:12.837006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:12.876151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] MFA Rules not processed for user `94be042f7465464db5a11d7349628e89`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:12.878614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:13.068893 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3502/6968] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:13.081243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:13.086607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:13.224422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5367a-f2dc-447c-81a8-f4102360a667 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:13.232473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:13.233133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:13.233411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:13.233927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:13.251873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:13.254783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:13.285596 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3467/6969] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:14.242749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:14.246123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:14.267866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23775c-6425-4a0e-ac69-f93992ebca9b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:14.281656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:14.282839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:14.283565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:14.283846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:14.377130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:14.392304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:14.415086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3503/6970] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:17:15.530177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:15.531675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:15.709125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9254db7-0341-49da-951b-7b3bb6ce32d2 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:15.725064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:15.725916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:15.726555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:15.727141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:15.739053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:15.782669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:15.946124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:15.948285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:15.972687 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3468/6971] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:17:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:19.999653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:20.001187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:20.111168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:20.226621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8e7e2-a7fc-4b0d-b5f0-be3b4487081e service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:20.254431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:20.255978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:20.257838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:20.258352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:20.261826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:20.283129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:20.285840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:20.311023 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3504/6972] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:24.590229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:24.604468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782f9ed-b417-4870-9827-86bb46fac045 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:24.609009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a93d3b-7891-4aa0-b020-44e9df3811a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:24.610082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93d3b-7891-4aa0-b020-44e9df3811a4 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:24.610375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93d3b-7891-4aa0-b020-44e9df3811a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:24.610822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a93d3b-7891-4aa0-b020-44e9df3811a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:24.635903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:24.637347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:24.690527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a93d3b-7891-4aa0-b020-44e9df3811a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:24.692040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a93d3b-7891-4aa0-b020-44e9df3811a4 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:24.702831 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3469/6973] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:24.736020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b0e71-5f47-4192-bed8-7d9d1a0c63c7 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:24.741786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:24.742911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:24.743511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:24.744185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] PATH_INFO: `/v3/users/73c9fb64b0024a42b597d3209038922b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:24.745994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c9fb64b0024a42b597d3209038922b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:24.748528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:24.825752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c9fb64b0024a42b597d3209038922b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:24.844160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c9fb64b0024a42b597d3209038922b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:24.844847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c9fb64b0024a42b597d3209038922b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:24.853594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c9fb64b0024a42b597d3209038922b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:24.862524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c9fb64b0024a42b597d3209038922b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:24.897430 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3505/6974] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:24 2022] DELETE /identity/v3/users/73c9fb64b0024a42b597d3209038922b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:17:24.901993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:24.902306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:24.902582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:24.930865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:24.932918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:25.026891 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3470/6975] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:25.042202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:25.044872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:25.142953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:25.208050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb9634-97ed-405e-8c56-b251453ed66b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:25.219816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb0f9d-ec5a-41c9-93d3-526e50f2b5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:25.220540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0f9d-ec5a-41c9-93d3-526e50f2b5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:25.220825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0f9d-ec5a-41c9-93d3-526e50f2b5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:25.221099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb0f9d-ec5a-41c9-93d3-526e50f2b5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:25.244804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb0f9d-ec5a-41c9-93d3-526e50f2b5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:25.248500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb0f9d-ec5a-41c9-93d3-526e50f2b5c3 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:25.277021 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3506/6976] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:25.618338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:25.627153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:25.651848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b238f-e5db-4566-995a-1bd03208bf8f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:25.660109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:25.661198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:25.662031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:25.662596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] PATH_INFO: `/v3/projects/4a8a7964b90c4884ac774aa966babd25` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:25.664315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8a7964b90c4884ac774aa966babd25)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:25.670372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:25.766832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:25.782243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8a7964b90c4884ac774aa966babd25', 'request_id': 'req-8f0a737c-d547-4f40-9d90-6c6e352e35e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:25.797720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8a7964b90c4884ac774aa966babd25', 'request_id': 'req-8f0a737c-d547-4f40-9d90-6c6e352e35e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:25.814983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8a7964b90c4884ac774aa966babd25', 'request_id': 'req-8f0a737c-d547-4f40-9d90-6c6e352e35e4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:25.844416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] The token cache is being invalidate because project 4a8a7964b90c4884ac774aa966babd25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:25.845363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:25.847993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f0a737c-d547-4f40-9d90-6c6e352e35e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:25.854249 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3471/6977] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:25 2022] DELETE /identity/v3/projects/4a8a7964b90c4884ac774aa966babd25 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:25.861162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:25.862877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:25.863534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:25.907568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:25.962161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:26.161918 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3507/6978] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:26.172220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.172629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.173503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.218748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:26.220057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:26.232458 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3472/6979] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:26.236925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.257554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891460c-f6b9-4da0-b9f8-f00142341920 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:26.266621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:26.267945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.267945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.267945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.268814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:26.269189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:26.270977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:26.299823 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3508/6980] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:26.300706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.312139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cbc026-aa81-4472-a324-ee6ec3ad9718 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:26.318742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:26.319526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.319909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.321536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.322493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:26.325523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:26.389871 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3473/6981] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:26 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:17:26.391199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.405775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fc1d4-df87-4fcb-abf3-6d813aafb3c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:26.484690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:26.486026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.486604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.487173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.487976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:26.490132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:26.518379 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3509/6982] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:26 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:26.522783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.539181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38d416-cf06-4c2a-9916-093f275273e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:26.551888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:26.559806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.559806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.559806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.559806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:26.559806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:26.569179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3474/6983] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:26.573279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.586380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0a6ea-a46b-483f-9d53-2e6c79a71ff8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:26.591646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20135b-c5ff-4627-805f-01970a76b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:26.592259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20135b-c5ff-4627-805f-01970a76b15e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.592535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20135b-c5ff-4627-805f-01970a76b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.592800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20135b-c5ff-4627-805f-01970a76b15e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.593464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20135b-c5ff-4627-805f-01970a76b15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:26.595234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20135b-c5ff-4627-805f-01970a76b15e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:26.607916 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3510/6984] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:26.612142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.625061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c3ef2-d1e4-4801-a8af-79a66e07c19a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:26.631434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:26.632230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.632611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.633016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] PATH_INFO: `/v3/projects/b36ad1507e80475d814c690aa50f84ec/users/88cd627efd89442a8a92d9b80b51276b/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.655809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b36ad1507e80475d814c690aa50f84ec, user_id=88cd627efd89442a8a92d9b80b51276b, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:26.660425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:26.680031 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3475/6985] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:26 2022] PUT /identity/v3/projects/b36ad1507e80475d814c690aa50f84ec/users/88cd627efd89442a8a92d9b80b51276b/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:17:26.690450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06b5e-afcf-40b2-8af2-ad2cf15df16c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:26.690736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06b5e-afcf-40b2-8af2-ad2cf15df16c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:26.691014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06b5e-afcf-40b2-8af2-ad2cf15df16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:26.728140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86d06b5e-afcf-40b2-8af2-ad2cf15df16c None None] MFA Rules not processed for user `88cd627efd89442a8a92d9b80b51276b`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:26.730004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86d06b5e-afcf-40b2-8af2-ad2cf15df16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:26.795947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:26.843735 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3511/6986] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:26.863021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:26.866582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:27.008957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad5948-6157-40a7-9987-862636cd284c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:27.013474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:27.014367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:27.022828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:27.023288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:27.042398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:27.044385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:27.066137 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3476/6987] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:17:27.508731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff05f7-639a-4317-97b8-4f0624503266 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:27.509295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff05f7-639a-4317-97b8-4f0624503266 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:27.509295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff05f7-639a-4317-97b8-4f0624503266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:27.626716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-26ff05f7-639a-4317-97b8-4f0624503266 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:27.629323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-26ff05f7-639a-4317-97b8-4f0624503266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:27.769635 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3512/6988] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:17:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:27.831037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:27.833356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:27.926353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc9629-c179-4b2e-a89e-3a4a206391f9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:27.933785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:27.935035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:27.935663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:27.936181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:27.946544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:27.948646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:27.953035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:27.971203 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3477/6989] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:17:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:17:28.929985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70962ab-9b8e-4c23-8861-8d7e2246667a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:28.930837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70962ab-9b8e-4c23-8861-8d7e2246667a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:28.931162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70962ab-9b8e-4c23-8861-8d7e2246667a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:29.003657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b70962ab-9b8e-4c23-8861-8d7e2246667a None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:29.005269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b70962ab-9b8e-4c23-8861-8d7e2246667a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:29.024909 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3513/6990] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:17:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:29.041355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:29.066770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7cb3-7c8b-403b-8dd1-3007c7d5e0fb service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:29.076131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:29.079153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:29.079711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:29.080221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:29.101380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:29.103296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:29.119568 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3478/6991] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:17:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:29.713415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59a6f8-5494-454b-b18b-8078b451703d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:29.714058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59a6f8-5494-454b-b18b-8078b451703d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:29.714738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59a6f8-5494-454b-b18b-8078b451703d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:29.789482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2e59a6f8-5494-454b-b18b-8078b451703d None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:29.796306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2e59a6f8-5494-454b-b18b-8078b451703d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:29.843365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:29.861128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3514/6992] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:17:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:29.877914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41ce82-fa40-4876-a5b7-2bf88a345b9c service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:29.893778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:29.895165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:29.895780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:29.896326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:29.911710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:29.915799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:29.964300 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3479/6993] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:17:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:30.673903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:30.674473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:30.674473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:30.710042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:30.711586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:30.715585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:30.720345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:30.749553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3515/6994] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:17:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:30.764505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:30.799704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ef6e-d270-4b3e-a0c8-b6e057f2b655 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:30.820312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171ceb6-593e-4e94-aded-0566fe22ef33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:30.824226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171ceb6-593e-4e94-aded-0566fe22ef33 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:30.831721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171ceb6-593e-4e94-aded-0566fe22ef33 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:30.832078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171ceb6-593e-4e94-aded-0566fe22ef33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:30.863621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171ceb6-593e-4e94-aded-0566fe22ef33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:30.873760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2171ceb6-593e-4e94-aded-0566fe22ef33 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:30.897184 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3516/6995] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:17:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:17:30.939546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a542a-edf0-4dc6-884a-242726f38f41 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:30.973948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:30.991475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:30.991832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:30.992759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] PATH_INFO: `/v3/users/5938188385e44e4faaa6555529714099` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:30.996556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5938188385e44e4faaa6555529714099)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:30.999212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:31.169856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5938188385e44e4faaa6555529714099'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:31.187318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5938188385e44e4faaa6555529714099'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:31.188102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5938188385e44e4faaa6555529714099'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:31.197246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5938188385e44e4faaa6555529714099'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:31.198308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5938188385e44e4faaa6555529714099'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:31.244425 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3480/6996] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:30 2022] DELETE /identity/v3/users/5938188385e44e4faaa6555529714099 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:17:31.246140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:31.246761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:31.247375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:31.300484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:31.303826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:31.445270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:31.447352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:31.562653 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3517/6997] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:31.572539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:31.574037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:31.615913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:31.641082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:31.682647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc991c1f-e2d3-4b6a-8ca7-8725c8089f58 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:31.690677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:31.692017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:31.692714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:31.693209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:31.695760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:31.713258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:31.716132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:31.726006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfc6a7-de5a-4ae3-8541-f0036046ab78 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:31.732604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:31.733477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:31.733974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:31.734675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:31.741026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3481/6998] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:31.753896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:31.757099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:31.777187 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3518/6999] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:33.023751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:33.025221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:33.061042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339aaef0-d32b-4cb0-a5c2-3b34fbea7a4d service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:33.072974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:33.074386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:33.074960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:33.075323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] PATH_INFO: `/v3/projects/1d113d0d1ec74f018053db6da7ae28a9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:33.076745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d113d0d1ec74f018053db6da7ae28a9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:33.079516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:33.180598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d113d0d1ec74f018053db6da7ae28a9', 'request_id': 'req-853264c4-9eda-425f-ad2d-4f4db9b37f38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.194837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d113d0d1ec74f018053db6da7ae28a9', 'request_id': 'req-853264c4-9eda-425f-ad2d-4f4db9b37f38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.218178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d113d0d1ec74f018053db6da7ae28a9', 'request_id': 'req-853264c4-9eda-425f-ad2d-4f4db9b37f38'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.238949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] The token cache is being invalidate because project 1d113d0d1ec74f018053db6da7ae28a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:33.239771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.241279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.245364 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3482/7000] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:33 2022] DELETE /identity/v3/projects/1d113d0d1ec74f018053db6da7ae28a9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:33.249726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:33.267720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd07c0-930b-4055-a429-16ab7257dfec service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:33.428480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:33.432063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:33.432373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:33.432653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] PATH_INFO: `/v3/users/c1f5848a1a2048bda58722ff2843165d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:33.436977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f5848a1a2048bda58722ff2843165d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:33.442486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:33.562400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f5848a1a2048bda58722ff2843165d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.585247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f5848a1a2048bda58722ff2843165d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.585639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f5848a1a2048bda58722ff2843165d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.609096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f5848a1a2048bda58722ff2843165d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.612980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f5848a1a2048bda58722ff2843165d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:33.656592 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3519/7001] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:33 2022] DELETE /identity/v3/users/c1f5848a1a2048bda58722ff2843165d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:34.373360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:34.374990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:34.396489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853264c4-9eda-425f-ad2d-4f4db9b37f38 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:34.515892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:34.516543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:34.516821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:34.517099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] PATH_INFO: `/v3/projects/348d962560a142eeb1f4bfdfcc74c874` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:34.519619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348d962560a142eeb1f4bfdfcc74c874)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:34.521938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:34.623571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348d962560a142eeb1f4bfdfcc74c874', 'request_id': 'req-b7e4e8a0-701d-4f44-a64a-8205431e3612'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.640883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348d962560a142eeb1f4bfdfcc74c874', 'request_id': 'req-b7e4e8a0-701d-4f44-a64a-8205431e3612'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.656525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348d962560a142eeb1f4bfdfcc74c874', 'request_id': 'req-b7e4e8a0-701d-4f44-a64a-8205431e3612'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.661561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:34.699930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] The token cache is being invalidate because project 348d962560a142eeb1f4bfdfcc74c874 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:34.700210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.704752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.712809 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3483/7002] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:34 2022] DELETE /identity/v3/projects/348d962560a142eeb1f4bfdfcc74c874 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:34.717146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:34.718830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:34.744076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8873ea53-92e8-4bd4-85c2-24de2c0bd007 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:34.804645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:34.882582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:34.883257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:34.883539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:34.883815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] PATH_INFO: `/v3/users/94be042f7465464db5a11d7349628e89` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:34.892470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94be042f7465464db5a11d7349628e89)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:34.894512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:34.972474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94be042f7465464db5a11d7349628e89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.985713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94be042f7465464db5a11d7349628e89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:34.986537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94be042f7465464db5a11d7349628e89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:35.000436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94be042f7465464db5a11d7349628e89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:35.001329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2067b638-e264-4e49-a584-f4492fa2efc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94be042f7465464db5a11d7349628e89'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:35.028384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3520/7003] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:34 2022] DELETE /identity/v3/users/94be042f7465464db5a11d7349628e89 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:35.817638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:35.819307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:35.857013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4e8a0-701d-4f44-a64a-8205431e3612 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:35.962293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:35.965995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:35.966567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:35.967850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] PATH_INFO: `/v3/projects/c22eaace4b0f4d0c8950f3d449f5e8cb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:35.972596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22eaace4b0f4d0c8950f3d449f5e8cb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:35.977971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:36.081573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22eaace4b0f4d0c8950f3d449f5e8cb', 'request_id': 'req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:36.088771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22eaace4b0f4d0c8950f3d449f5e8cb', 'request_id': 'req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:36.126292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22eaace4b0f4d0c8950f3d449f5e8cb', 'request_id': 'req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:36.153403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] The token cache is being invalidate because project c22eaace4b0f4d0c8950f3d449f5e8cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:36.154808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:36.156390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-aee86aca-3efe-4e52-abf8-119bd4cbbd8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:36.161841 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3484/7004] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:35 2022] DELETE /identity/v3/projects/c22eaace4b0f4d0c8950f3d449f5e8cb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:36.169149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:36.169888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:36.169888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:36.199355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:36.201618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:36.280928 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3521/7005] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:36.290693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:36.291235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:36.291696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:36.337237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:36.338513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:36.356657 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3485/7006] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:36.365312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:36.394732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7ba8-a447-4053-9e7a-066939f97443 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:36.402047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:36.403422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:36.403422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:36.403690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:36.404633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:36.405000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:36.408520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:36.445233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3522/7007] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:17:36.450593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:36.469049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebaed6-657c-4ff0-9e4b-77cdb03f0a4b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:36.480558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:36.485014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:36.485389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:36.485924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:36.486691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:36.492764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:36.597372 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3486/7008] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:36 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:36.600008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:36.627089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c61ff-be19-4641-a6d0-4d8b1468c1df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:36.701791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:36.706614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:36.798157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:36.878562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:36.879216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:36.879496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:36.879772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:36.881085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:36.887788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:36.936113 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3523/7009] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:36 2022] POST /identity/v3/users => generated 286 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:36.940672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:36.964713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e372411-9133-4525-85f8-30b4a788adbc admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:36.971640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:36.972274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:36.972554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:36.972822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:36.973474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:36.975152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:37.002734 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3524/7010] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:37.006946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:37.028275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ce549-7ed8-47bb-8b52-fe7772a3c525 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:37.046367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:37.047392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.047912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.048583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.049463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:37.053757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:37.082404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3525/7011] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:37.086994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:37.109724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b58b37-ea28-4462-9a1d-bbdbc7e009da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:37.120558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c25fa-deeb-47b9-8969-d49a9758bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:37.121260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c25fa-deeb-47b9-8969-d49a9758bae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.121660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c25fa-deeb-47b9-8969-d49a9758bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.122144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c25fa-deeb-47b9-8969-d49a9758bae3 admin admin] PATH_INFO: `/v3/projects/a3d76d510f90412b8f2f2b8f8bec7b83/users/c80163670b554c0398b7d752a9fc05fb/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.130539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:37.145622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c25fa-deeb-47b9-8969-d49a9758bae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d76d510f90412b8f2f2b8f8bec7b83, user_id=c80163670b554c0398b7d752a9fc05fb, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:37.148465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c25fa-deeb-47b9-8969-d49a9758bae3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:37.159801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173226-ab05-42a0-95bc-acc6fe055795 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:37.180080 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3526/7012] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:37 2022] PUT /identity/v3/projects/a3d76d510f90412b8f2f2b8f8bec7b83/users/c80163670b554c0398b7d752a9fc05fb/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:37.181763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.182139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.182479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.230043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] MFA Rules not processed for user `c80163670b554c0398b7d752a9fc05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:37.233105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:37.285496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:37.286193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.286950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.287224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] PATH_INFO: `/v3/users/42be58e511bc4f27aba89c886e479d5f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.291674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42be58e511bc4f27aba89c886e479d5f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:37.297055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:37.398471 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3527/7013] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:37.406844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42be58e511bc4f27aba89c886e479d5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:37.413585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:37.415284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:37.430661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42be58e511bc4f27aba89c886e479d5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:37.431885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42be58e511bc4f27aba89c886e479d5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:37.444123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42be58e511bc4f27aba89c886e479d5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:37.445336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8ea6ba81-5386-4d35-8b08-4ef978db6ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42be58e511bc4f27aba89c886e479d5f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:37.467482 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3487/7014] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:36 2022] DELETE /identity/v3/users/42be58e511bc4f27aba89c886e479d5f => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:17:37.472446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.472726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.472996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.490542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be59ce0-2076-4c66-9488-feba9df514c7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:37.500407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:37.501815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:37.514777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:37.582163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:37.582794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.583071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.583339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.586023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:37.617875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3488/7015] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:17:37.640104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:37.643475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:37.686704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:37.712775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:37.715856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:37.728963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3528/7016] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:17:37.763343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936edbf-80a3-4ef7-8142-2e7dd49a875c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:37.770913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154022d7-cf64-44a6-978d-faff243d8e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:37.774229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154022d7-cf64-44a6-978d-faff243d8e39 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:37.774518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154022d7-cf64-44a6-978d-faff243d8e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:37.774799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154022d7-cf64-44a6-978d-faff243d8e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:37.800429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154022d7-cf64-44a6-978d-faff243d8e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:37.802091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154022d7-cf64-44a6-978d-faff243d8e39 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:37.824875 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3489/7017] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:38.290466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:38.292030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:38.338811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983e7e4-fae4-4cc0-bb74-a495ae6ef043 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:38.357003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:38.357933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:38.358211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:38.358552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] PATH_INFO: `/v3/projects/738337cc190644dcb6ac88db4d0994aa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:38.360241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] RBAC: Authorizing `identity:delete_project(project_id=738337cc190644dcb6ac88db4d0994aa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:38.362421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:38.509477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '738337cc190644dcb6ac88db4d0994aa', 'request_id': 'req-0909217a-b712-4292-adca-004dd7f1f76a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:38.522650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '738337cc190644dcb6ac88db4d0994aa', 'request_id': 'req-0909217a-b712-4292-adca-004dd7f1f76a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:38.538939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '738337cc190644dcb6ac88db4d0994aa', 'request_id': 'req-0909217a-b712-4292-adca-004dd7f1f76a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:38.566696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] The token cache is being invalidate because project 738337cc190644dcb6ac88db4d0994aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:38.567191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:38.570630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0909217a-b712-4292-adca-004dd7f1f76a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:38.577775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3529/7018] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:38 2022] DELETE /identity/v3/projects/738337cc190644dcb6ac88db4d0994aa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:38.579617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:38.580134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:38.580134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:38.616030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:38.617516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:38.803348 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3490/7019] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:38.805075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:38.805364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:38.805639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:38.828114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:38.829654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:38.840343 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3530/7020] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:38.844542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:38.871000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d68c1cb-a9a0-4dd2-b990-6c97ca28a97c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:38.886829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:38.890892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:38.896611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:38.897112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:38.898032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:38.900688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:38.902580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:38.935803 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3491/7021] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:38.939929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:38.952566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd0b02-a29f-402b-b2a3-2d8c8f0fd4a3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:38.963944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:38.964901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:38.965612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:38.966192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:38.967115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:38.969658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:39.032402 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3531/7022] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:38 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:39.038073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:39.052077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a136127-da54-4bad-b2fd-e000348d7dfd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:39.201078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:39.202263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:39.202263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:39.202263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:39.202888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:39.204824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:39.251135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3492/7023] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:39 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:39.255792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:39.271054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d53e9-4018-4da1-ac73-2dc7ca02af83 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:39.299134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:39.301286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:39.301817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:39.302330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:39.304773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:39.309864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:39.334905 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3532/7024] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:39.337692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:39.355189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27ef0b-c402-4f5a-b87e-0c5da9dbf49d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:39.363782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344e0f5-9fee-4726-98a6-130faa74d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:39.364417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344e0f5-9fee-4726-98a6-130faa74d150 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:39.364699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344e0f5-9fee-4726-98a6-130faa74d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:39.364976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344e0f5-9fee-4726-98a6-130faa74d150 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:39.365624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344e0f5-9fee-4726-98a6-130faa74d150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:39.367577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344e0f5-9fee-4726-98a6-130faa74d150 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:39.392389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3493/7025] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:39.396302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:39.411723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af43aa2-74ae-45f6-b6ec-7d05f8774d97 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:39.425424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:39.426343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:39.426720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:39.427091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] PATH_INFO: `/v3/projects/bb9f47e71ffc4d269c6eaba443066c15/users/9fdf4e95ca094d82b5a727b157f0500f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:39.464616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9f47e71ffc4d269c6eaba443066c15, user_id=9fdf4e95ca094d82b5a727b157f0500f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:39.467657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:39.477768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:39.514933 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3533/7026] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:39 2022] PUT /identity/v3/projects/bb9f47e71ffc4d269c6eaba443066c15/users/9fdf4e95ca094d82b5a727b157f0500f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:39.520280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2925d-58d2-4060-a017-a74b552a5709 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:39.520280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2925d-58d2-4060-a017-a74b552a5709 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:39.520621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2925d-58d2-4060-a017-a74b552a5709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:39.550995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9fb2925d-58d2-4060-a017-a74b552a5709 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:39.569428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9fb2925d-58d2-4060-a017-a74b552a5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:39.626566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:39.731322 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3494/7027] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:39.747626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:39.749511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:39.848224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a235-4076-47bd-af75-1417f8f79a31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:39.852264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758737af-1e73-449d-9586-e7ff49dd8269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:39.852902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758737af-1e73-449d-9586-e7ff49dd8269 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:39.853182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758737af-1e73-449d-9586-e7ff49dd8269 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:39.853455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758737af-1e73-449d-9586-e7ff49dd8269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:39.869303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758737af-1e73-449d-9586-e7ff49dd8269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:39.870989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758737af-1e73-449d-9586-e7ff49dd8269 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:39.896838 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3534/7028] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:40.574305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:40.574657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:40.574937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:40.613101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] MFA Rules not processed for user `c80163670b554c0398b7d752a9fc05fb`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:40.614554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:40.694342 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3495/7029] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:48.709118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:48.709710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:48.709710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:48.815439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] MFA Rules not processed for user `9fdf4e95ca094d82b5a727b157f0500f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:48.816694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:49.033861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3535/7030] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:17:49.035229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:49.070286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb145f7-e497-43b4-8b78-72f7ced1445c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:49.120848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:49.122483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:49.125728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:49.126165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:49.126995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:49.129115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:49.210864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:49.211771 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3496/7031] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:49 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:49.225091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0404090-3c08-4bfa-8e89-1cc82e6aa84b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:49.242870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892cb62-7b61-4dde-b8ae-c94a28f68974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:49.243887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892cb62-7b61-4dde-b8ae-c94a28f68974 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:49.244382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892cb62-7b61-4dde-b8ae-c94a28f68974 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:49.244904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892cb62-7b61-4dde-b8ae-c94a28f68974 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:49.245848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892cb62-7b61-4dde-b8ae-c94a28f68974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:49.248408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892cb62-7b61-4dde-b8ae-c94a28f68974 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:49.280175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:49.296670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5bdde3-4995-446a-89f1-aa3beddbff60 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:49.297840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3536/7032] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:49.311467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:49.312512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:49.313036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:49.313509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] PATH_INFO: `/v3/system/users/0704f053a44d432aafb4c9c3bfffabe8/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:49.348772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0704f053a44d432aafb4c9c3bfffabe8, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:49.351091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:49.368175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3497/7033] 10.222.0.16 () {60 vars in 1378 bytes} [Sat Oct 29 03:17:49 2022] PUT /identity/v3/system/users/0704f053a44d432aafb4c9c3bfffabe8/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:17:49.380469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:49.381566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:49.382065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:49.436350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] MFA Rules not processed for user `0704f053a44d432aafb4c9c3bfffabe8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:49.437654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:49.588759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:49.618311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3537/7034] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:49 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 29 03:17:49.623563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:49.745446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:49.783501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3aab6-0d74-4624-9a50-11d675ecb178 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:49.862390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0704f053a44d432aafb4c9c3bfffabe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:49.863933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:49.864754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:49.865293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] PATH_INFO: `/v3/services` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:49.866418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:49.868770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:49.886207 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3498/7035] 10.222.0.16 () {58 vars in 1110 bytes} [Sat Oct 29 03:17:49 2022] GET /identity/v3/services => generated 2191 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:49.887824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:50.204293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb8a4a-5e03-4135-a2ea-af8069ea2956 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:50.334098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0704f053a44d432aafb4c9c3bfffabe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:50.334966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:50.335257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:50.335535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] PATH_INFO: `/v3/limits` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:50.336275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:50.337612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 29 03:17:50.389145 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 29 03:17:50.390389 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:17:50.391290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3538/7036] 10.222.0.16 () {60 vars in 1126 bytes} [Sat Oct 29 03:17:49 2022] POST /identity/v3/limits => generated 124 bytes in 504 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:17:50.396442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:50.687213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dcf39-8e26-482b-afe9-7d1181eb0f2e None tempest-ImageQuotaTest-276860978-system-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:50.800169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0704f053a44d432aafb4c9c3bfffabe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:50.801016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:50.801391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:50.801996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:50.802823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:50.817481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:50.845338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:50.850231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3499/7037] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:17:50 2022] GET /identity/v3/registered_limits => generated 129 bytes in 454 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:50.940704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:51.021672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:51.028659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:51.054230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca069e-258b-465c-9673-7df80a95d1ae None tempest-ImageQuotaTest-276860978-system-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:51.064946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2b3d4-bbf2-47bc-b0f4-b96bc08c3b30 None tempest-ImageQuotaTest-276860978-system-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:51.074918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:51.078980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:51.080299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:51.081528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] PATH_INFO: `/v3/users/88cd627efd89442a8a92d9b80b51276b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:51.086789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cd627efd89442a8a92d9b80b51276b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:51.091221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:51.114165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:51.162842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ba658-7574-4798-aa04-ab01cf8cab3f None tempest-ImageQuotaTest-276860978-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0704f053a44d432aafb4c9c3bfffabe8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:51.163919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ba658-7574-4798-aa04-ab01cf8cab3f None tempest-ImageQuotaTest-276860978-system-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:51.164113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ba658-7574-4798-aa04-ab01cf8cab3f None tempest-ImageQuotaTest-276860978-system-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:51.164459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ba658-7574-4798-aa04-ab01cf8cab3f None tempest-ImageQuotaTest-276860978-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:51.165389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ba658-7574-4798-aa04-ab01cf8cab3f None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:51.166646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ba658-7574-4798-aa04-ab01cf8cab3f None tempest-ImageQuotaTest-276860978-system-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:51.193018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3539/7038] 10.222.0.16 () {58 vars in 1137 bytes} [Sat Oct 29 03:17:50 2022] GET /identity/v3/registered_limits => generated 129 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:51.193837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cd627efd89442a8a92d9b80b51276b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:51.211261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cd627efd89442a8a92d9b80b51276b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:51.212182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cd627efd89442a8a92d9b80b51276b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:51.222409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cd627efd89442a8a92d9b80b51276b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:51.223554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cd627efd89442a8a92d9b80b51276b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:51.251721 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3500/7039] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:51 2022] DELETE /identity/v3/users/88cd627efd89442a8a92d9b80b51276b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:51.256452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:51.256790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:51.257069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:51.283314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:51.284696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:51.418645 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3540/7040] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:17:51.453682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:51.455373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:51.595600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311ef79-1c5e-40dc-b407-fa7b50379ddc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:51.600888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059195a-91a5-453b-91bb-23694bd5bb32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:51.601795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059195a-91a5-453b-91bb-23694bd5bb32 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:51.602302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059195a-91a5-453b-91bb-23694bd5bb32 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:51.602867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059195a-91a5-453b-91bb-23694bd5bb32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:51.615105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059195a-91a5-453b-91bb-23694bd5bb32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:51.617405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059195a-91a5-453b-91bb-23694bd5bb32 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:51.639053 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3501/7041] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:52.909321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:52.910706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:52.929223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8013da-6ba1-48ea-932d-409a14b1187e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:52.944597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:52.945275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:52.945558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:52.945853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] PATH_INFO: `/v3/projects/b36ad1507e80475d814c690aa50f84ec` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:52.947056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b36ad1507e80475d814c690aa50f84ec)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:52.948998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:53.081382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b36ad1507e80475d814c690aa50f84ec', 'request_id': 'req-32767e11-99bb-481c-8af5-ae727a6e18e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:53.096257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b36ad1507e80475d814c690aa50f84ec', 'request_id': 'req-32767e11-99bb-481c-8af5-ae727a6e18e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:53.102396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:53.115501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b36ad1507e80475d814c690aa50f84ec', 'request_id': 'req-32767e11-99bb-481c-8af5-ae727a6e18e1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:53.173183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] The token cache is being invalidate because project b36ad1507e80475d814c690aa50f84ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:17:53.173478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:53.174234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-32767e11-99bb-481c-8af5-ae727a6e18e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:53.176330 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3541/7042] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:52 2022] DELETE /identity/v3/projects/b36ad1507e80475d814c690aa50f84ec => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:53.183402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.183985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.184191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.214277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:53.222370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:53.393147 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3502/7043] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:53.394638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.395136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.395655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.447675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:53.449637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:53.486759 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3542/7044] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:17:53.489010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:53.522503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6a9a3-2c1a-4dba-8973-d204b1ffdb2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:53.542163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:53.543429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.543702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.544145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.544803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:17:53.545106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:53.547103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:53.584519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3503/7045] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:17:53.585950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:53.599072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b26b1-2b5b-4439-b63b-e65a7552c62c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:53.605180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:53.606347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.607029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.607526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.608391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:53.611323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:53.656652 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3543/7046] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:17:53 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:53.656868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:53.671995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff41b1b-030b-40b0-b7d4-07e9abb36099 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:53.699686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:53.791400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:53.795038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.795382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.795727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.796526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:53.801447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:53.852286 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3504/7047] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:17:53 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:17:53.856729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:53.871506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91f7ca-6062-4a99-bc3a-c4e941a856de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:53.923831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:53.925488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.926006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.926468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.927366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:53.929227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:53.942271 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3544/7048] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:17:53.946113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:53.957293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a04c6-10b9-4d7e-8ce0-4ec06c4ad1e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:53.962353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfe3be-4b74-4043-95a0-df8e207c26a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:53.964324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe3be-4b74-4043-95a0-df8e207c26a8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:53.964324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe3be-4b74-4043-95a0-df8e207c26a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:53.964324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfe3be-4b74-4043-95a0-df8e207c26a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:53.965394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfe3be-4b74-4043-95a0-df8e207c26a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:53.967151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfe3be-4b74-4043-95a0-df8e207c26a8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:53.992628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3505/7049] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:17:53.996291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:54.008221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab3735-a093-45f6-841e-b7388e171c67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:54.013414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:54.014157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:54.014435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:54.014707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] PATH_INFO: `/v3/projects/f183b34fdc4449f7b1f085a2256adbf9/users/531499226df542f398434aba80199140/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:54.046122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f183b34fdc4449f7b1f085a2256adbf9, user_id=531499226df542f398434aba80199140, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:54.049150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:54.082106 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3545/7050] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:17:53 2022] PUT /identity/v3/projects/f183b34fdc4449f7b1f085a2256adbf9/users/531499226df542f398434aba80199140/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:54.083986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:54.084274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:54.084542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:54.146189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] MFA Rules not processed for user `531499226df542f398434aba80199140`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:17:54.149628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:54.258782 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3506/7051] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:17:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:17:54.266814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:54.268630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:54.370383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43311da4-de45-4327-9a27-7d4621ffd569 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:54.375448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:54.376090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:54.376370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:54.376641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:54.387675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:54.389299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:54.418441 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3546/7052] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:58.860404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:58.862245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:59.084823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946dfc-329c-40fd-b99d-a170baadbf22 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:59.102172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:59.103368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:59.103662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:59.104321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:59.119906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:59.120385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:59.123874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:17:59.144206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:59.146023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:59.186088 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3507/7053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:17:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:17:59.259288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaabbaf-a328-4c98-89e8-06511cc4c944 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:59.271892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:17:59.273005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:17:59.276580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:17:59.277107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] PATH_INFO: `/v3/users/9fdf4e95ca094d82b5a727b157f0500f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:17:59.292317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdf4e95ca094d82b5a727b157f0500f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:17:59.297392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:17:59.383433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:17:59.424568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdf4e95ca094d82b5a727b157f0500f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:59.440003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdf4e95ca094d82b5a727b157f0500f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:59.440834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdf4e95ca094d82b5a727b157f0500f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:59.453022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdf4e95ca094d82b5a727b157f0500f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:59.457832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdf4e95ca094d82b5a727b157f0500f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:17:59.489534 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3547/7054] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:17:59 2022] DELETE /identity/v3/users/9fdf4e95ca094d82b5a727b157f0500f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:17:59.894297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:17:59.913295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e2931-1d3d-4379-9f35-0d754404fb2e service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:17:59.943405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:00.138075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:00.139213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:00.139674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:00.140308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] PATH_INFO: `/v3/projects/bb9f47e71ffc4d269c6eaba443066c15` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:00.142658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9f47e71ffc4d269c6eaba443066c15)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:00.144625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:00.290212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9f47e71ffc4d269c6eaba443066c15', 'request_id': 'req-2b65246d-cba5-465d-a4d2-474f6163a573'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.302867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9f47e71ffc4d269c6eaba443066c15', 'request_id': 'req-2b65246d-cba5-465d-a4d2-474f6163a573'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.313047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9f47e71ffc4d269c6eaba443066c15', 'request_id': 'req-2b65246d-cba5-465d-a4d2-474f6163a573'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.332300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] The token cache is being invalidate because project bb9f47e71ffc4d269c6eaba443066c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:00.332703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.333377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.339649 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3508/7055] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:17:59 2022] DELETE /identity/v3/projects/bb9f47e71ffc4d269c6eaba443066c15 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:00.340706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:00.342728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:00.385760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2d760-f23b-4f35-b472-6a9229ccf511 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:00.512775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:00.514037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:00.514501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:00.514961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] PATH_INFO: `/v3/users/0704f053a44d432aafb4c9c3bfffabe8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:00.519034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0704f053a44d432aafb4c9c3bfffabe8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:00.521309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:00.655748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0704f053a44d432aafb4c9c3bfffabe8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.667554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0704f053a44d432aafb4c9c3bfffabe8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.668510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0704f053a44d432aafb4c9c3bfffabe8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.681819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0704f053a44d432aafb4c9c3bfffabe8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.682992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0704f053a44d432aafb4c9c3bfffabe8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:00.723155 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3548/7056] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:00 2022] DELETE /identity/v3/users/0704f053a44d432aafb4c9c3bfffabe8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:18:10.327015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:10.716926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=17,keystone:SELECT=76,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:16.999711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:17.002189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:17.160939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b65246d-cba5-465d-a4d2-474f6163a573 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:17.274743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:17.275648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:17.276274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:17.276765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:17.279202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:17.372416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:17.374107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:17.388768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3509/7057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:18:27.276453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:27.278811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:27.297572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bc35a-636f-4869-a089-759812dfa961 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:27.305457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:27.306834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:27.307253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:27.307833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] PATH_INFO: `/v3/users/89a693133ded46eba2b9b70e899f38f9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:27.310079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a693133ded46eba2b9b70e899f38f9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:27.312865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:27.382752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=70 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:27.419579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a693133ded46eba2b9b70e899f38f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.431893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a693133ded46eba2b9b70e899f38f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.433330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a693133ded46eba2b9b70e899f38f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.453285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a693133ded46eba2b9b70e899f38f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.455541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7b83d871-b3aa-4b25-99e3-0c935ea26faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a693133ded46eba2b9b70e899f38f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.477205 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3549/7058] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:27 2022] DELETE /identity/v3/users/89a693133ded46eba2b9b70e899f38f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:27.745133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:27.755611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dee7d9-7f78-4d37-b679-96307619e332 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:27.846980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:27.847937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:27.848379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:27.848863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] PATH_INFO: `/v3/projects/552af5aaae3f49fdb5cc8ea8ec4ccdec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:27.850155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=552af5aaae3f49fdb5cc8ea8ec4ccdec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:27.852521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:27.952259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'request_id': 'req-894673fe-8eec-4110-afca-8561befb21b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.966483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'request_id': 'req-894673fe-8eec-4110-afca-8561befb21b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:27.982958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '552af5aaae3f49fdb5cc8ea8ec4ccdec', 'request_id': 'req-894673fe-8eec-4110-afca-8561befb21b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:28.012795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] The token cache is being invalidate because project 552af5aaae3f49fdb5cc8ea8ec4ccdec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:28.013222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:28.015456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-894673fe-8eec-4110-afca-8561befb21b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:28.019184 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3510/7059] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:27 2022] DELETE /identity/v3/projects/552af5aaae3f49fdb5cc8ea8ec4ccdec => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:28.025762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.026085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.026360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.062759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:28.065146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:28.269064 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3550/7060] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:28.277072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.278386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.278741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.323117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:28.324501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:28.340565 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3511/7061] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:28.341876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:28.356466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bebef3-9027-40de-a745-1890bfa44cc8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:28.369998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:28.371150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.371488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.372021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.372923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:18:28.373444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:28.376434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:28.407169 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3551/7062] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:28.411442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:28.428833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a53e6-95ab-4e4f-a545-a6984cb1f6f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:28.469732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:28.470404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.470682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.470949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.471584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:28.473556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:28.509730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3512/7063] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:18:28 2022] POST /identity/v3/projects => generated 391 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:28.510485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:28.525870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d911b-4544-4fbe-a8f9-ab2e888ff49e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:28.689871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:28.690607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.690956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.691300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.692027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:28.696111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:28.720973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:28.745334 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3552/7064] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:18:28 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:18:28.751969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:28.772998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89970a3c-5f48-4a8b-b888-657296bbe5c0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:28.785496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:28.786249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.786527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.786799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.787452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:28.789218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:28.818852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3513/7065] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:28.823893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:28.837972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a40e249-ec6f-4956-a7f2-54c513f6e579 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:28.845747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2bcf1-a8b4-4d90-b4db-09921ed8ef2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:28.846763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2bcf1-a8b4-4d90-b4db-09921ed8ef2e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.847224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2bcf1-a8b4-4d90-b4db-09921ed8ef2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.847674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2bcf1-a8b4-4d90-b4db-09921ed8ef2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.848497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2bcf1-a8b4-4d90-b4db-09921ed8ef2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:28.850400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2bcf1-a8b4-4d90-b4db-09921ed8ef2e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:28.880225 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3553/7066] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:28.884119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:28.900551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663038e-213b-4e9e-8fa0-8b80ce771ebb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:28.905919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:28.906949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:28.907372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:28.907803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] PATH_INFO: `/v3/projects/d16bb688e6824d7db8fb52894184880c/users/83854b2a621d4c9782f53e22d8e44c83/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:28.958653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16bb688e6824d7db8fb52894184880c, user_id=83854b2a621d4c9782f53e22d8e44c83, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:28.961665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:28.984685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3514/7067] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:28 2022] PUT /identity/v3/projects/d16bb688e6824d7db8fb52894184880c/users/83854b2a621d4c9782f53e22d8e44c83/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:29.003905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:29.004226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:29.004494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:29.085522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] MFA Rules not processed for user `83854b2a621d4c9782f53e22d8e44c83`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:29.087398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:29.310002 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3554/7068] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:29.311431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:29.384014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:29.471578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27728d61-2b06-4984-9548-118120f92e1e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:29.480900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:29.481325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:29.481611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:29.481958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:29.482606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:29.496001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:29.551367 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3515/7069] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:18:29 2022] POST /identity/v3/projects => generated 389 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:29.552792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:29.576721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4de202-6e6a-454b-86ac-82a2990ce0ca None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:29.752813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:29.753635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:29.754082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:29.754674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:29.755536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:29.757733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:29.853772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3555/7070] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:18:29 2022] POST /identity/v3/users => generated 301 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:18:29.855003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:29.880570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6d3c2-cf81-47a1-ab0b-8c341a4dc1b1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:29.904486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:29.906599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:29.907569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:29.909267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:29.917472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:29.921501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:29.984513 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3516/7071] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:18:29.985728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:30.005373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af09c1-e4b8-48fc-b674-25f7d41070be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:30.034186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:30.034886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:30.035196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:30.035439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] PATH_INFO: `/v3/projects/4a47de1f858c48bf9fa540c0b9b0de8f/users/de3bf2f26a2a47c09532fbcf7f5f166c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:30.114326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a47de1f858c48bf9fa540c0b9b0de8f, user_id=de3bf2f26a2a47c09532fbcf7f5f166c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:30.121734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:30.153970 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3556/7072] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:29 2022] PUT /identity/v3/projects/4a47de1f858c48bf9fa540c0b9b0de8f/users/de3bf2f26a2a47c09532fbcf7f5f166c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:18:30.158534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:30.176426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f7528-222c-490c-81b9-2052ec5526e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:30.347940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede200b-fc0b-4eb6-9cc8-7e0a151df13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:30.349589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede200b-fc0b-4eb6-9cc8-7e0a151df13b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:30.349918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede200b-fc0b-4eb6-9cc8-7e0a151df13b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:30.350204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede200b-fc0b-4eb6-9cc8-7e0a151df13b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:30.352060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede200b-fc0b-4eb6-9cc8-7e0a151df13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:30.356858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede200b-fc0b-4eb6-9cc8-7e0a151df13b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:30.389948 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3517/7073] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:30.396459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:30.433245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c609e-6c47-433c-8025-b062aaf85095 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:30.453979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:30.455986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:30.456743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:30.459537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] PATH_INFO: `/v3/projects/4a47de1f858c48bf9fa540c0b9b0de8f/users/de3bf2f26a2a47c09532fbcf7f5f166c/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:30.475421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a47de1f858c48bf9fa540c0b9b0de8f, user_id=de3bf2f26a2a47c09532fbcf7f5f166c, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:30.486312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:30.533152 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3557/7074] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:30 2022] PUT /identity/v3/projects/4a47de1f858c48bf9fa540c0b9b0de8f/users/de3bf2f26a2a47c09532fbcf7f5f166c/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:30.544761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:30.545369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:30.545369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:30.603592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] MFA Rules not processed for user `de3bf2f26a2a47c09532fbcf7f5f166c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:30.604986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:30.821256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:30.822325 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3518/7075] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:30.847767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b916d8-9d70-4688-848c-8779eb7006c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:30.869441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:30.873248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:30.873530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:30.874847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:30.875557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:30.882900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:30.936740 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3558/7076] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:18:30 2022] POST /identity/v3/domains => generated 276 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:30.940880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:30.956781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5916d-51b2-467b-b90e-647759a94d32 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.023814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:31.141395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.144974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.145599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.146083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.147327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.149320 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:31.149320 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:18:31.149320 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:18:31.150769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.383663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.387489 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3519/7077] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:18:30 2022] PUT /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config => generated 138 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:31.406294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5029e-5251-4cbf-ad7f-b88f78b5fbeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.432388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.433263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.433544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.433840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.442785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613, group=identity)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.444058 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:31.444058 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:18:31.444058 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:18:31.444959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.446755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:31.469644 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3559/7078] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:18:31 2022] GET /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/identity => generated 45 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:31.477184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.513509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07cfc6-8752-454c-8ce9-b5c9de040dd3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.540463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.541170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.541449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.541723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/identity/driver` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.563325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613, group=identity, option=driver)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.564297 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:31.564297 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:18:31.564297 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:18:31.565208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.591493 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3520/7079] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Oct 29 03:18:31 2022] GET /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/identity/driver => generated 31 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:31.593413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.610413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316a83b-9b97-4a4a-b9b9-b93ea60956e2 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.621582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.624300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.624837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.625366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/ldap` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.629025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613, group=ldap)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.635246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.650242 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3560/7080] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:18:31 2022] GET /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/ldap => generated 106 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:31.651145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.676736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dce16a-8d7a-4dd2-8d91-1eef89597a41 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.693596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.694710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.695622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.696112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/ldap/url` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.699403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613, group=ldap, option=url)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.701625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.716178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3521/7081] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:18:31 2022] GET /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/ldap/url => generated 46 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:31.722133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.790810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0a16e-76cf-4ad7-a299-e6a2c9534c7f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.810633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.812997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.813230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.813607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/ldap/user_tree_dn` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.819290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613, group=ldap, option=user_tree_dn)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.825083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.851572 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3561/7082] 10.222.0.16 () {58 vars in 1302 bytes} [Sat Oct 29 03:18:31 2022] GET /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config/ldap/user_tree_dn => generated 63 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:31.856181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.869845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091eb06-6a59-4061-9999-290a45534b48 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.882861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.884067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.884590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.885494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.886308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=7d4288dcdf6c4ab58c60852cb4f86613)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.887553 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:31.887553 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:18:31.887553 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:18:31.889011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:31.907396 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3522/7083] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:31 2022] DELETE /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613/config => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:31.912392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:31.925186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63cac7-58ad-4876-bfff-8551e810f404 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:31.953564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:31.958783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:31.961376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:31.962111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:31.973056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7d4288dcdf6c4ab58c60852cb4f86613)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:31.977199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:32.038427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.039196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.121934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.122946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.126036 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3562/7084] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:31 2022] PATCH /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613 => generated 277 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:32.130115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:32.132120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:32.156210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3e3bf-21c2-421b-823c-3be2ace06578 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:32.345194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:32.346429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:32.350254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:32.350934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:32.414869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7d4288dcdf6c4ab58c60852cb4f86613)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:32.431319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:32.510530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.560722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.682827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:32.700271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613', 'request_id': 'req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.715356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613', 'request_id': 'req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.730193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613', 'request_id': 'req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.770747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] The token cache is being invalidate because project 7d4288dcdf6c4ab58c60852cb4f86613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:32.771724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.773367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.791821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613', 'request_id': 'req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.792932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613', 'request_id': 'req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.794331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7d4288dcdf6c4ab58c60852cb4f86613', 'request_id': 'req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:32.813129 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3523/7085] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:32 2022] DELETE /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:32.818355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:32.834064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7b5c-d5d7-46fb-88c1-38f8b04e7b5c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:32.983205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:32.984533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:32.985116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:32.985754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:32.986625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:32.988413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.022408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3563/7086] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:18:32 2022] POST /identity/v3/domains => generated 274 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:33.027934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.029829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:33.062673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2530bd-6032-46a9-a5d3-e9acc3a4f979 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.212000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.212658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.212937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.213210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.213959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.216008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.280800 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3524/7087] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:18:33 2022] PUT /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053/config => generated 138 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:33.285695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.300380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f654a31-1328-471f-a6d8-ac46e427e24a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.310937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.314221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.316635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.318235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.321274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.326744 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:33.326744 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:18:33.326744 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:18:33.331011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.387068 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3564/7088] 10.222.0.16 () {60 vars in 1271 bytes} [Sat Oct 29 03:18:33 2022] PATCH /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053/config => generated 142 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:33.387534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.434766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a45cd2-6e53-4183-83cd-db21c66dede9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.461590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.463070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.463737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.467037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.469341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.477843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.504832 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3525/7089] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:33 2022] GET /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053/config => generated 142 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:33.506729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.522677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3015c-5462-4b12-b58e-b88849f396a1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.559500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.560996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.561451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.561922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.563021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.564496 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:33.564496 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:18:33.564496 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:18:33.567504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.592715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.593399 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3565/7090] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:33 2022] DELETE /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053/config => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:33.615007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e00cc7-3169-4f1f-a905-a0e58022a6fd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.644870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.645471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.645764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.646074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.653707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.667661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Could not find any options in domain configuration for domain c2c10772d2064ef895b5af359fbfa053.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain c2c10772d2064ef895b5af359fbfa053. Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 29 03:18:33.678144 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain c2c10772d2064ef895b5af359fbfa053. Oct 29 03:18:33.679261 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:33.684171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.692678 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3526/7091] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:33 2022] GET /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053/config => generated 151 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 03:18:33.713403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dbea-5fd2-4535-852f-b0c8f3c0565a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.737461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.741296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.741578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.743772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053/config` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.744409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.746175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.756630 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3566/7092] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:33 2022] DELETE /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053/config => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:33.761503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.780548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b96be1-73b8-4b40-acbc-3a21d167b2f8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:33.790734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:33.791407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:33.791856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:33.791993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:33.795978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:33.797684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:33.845262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:33.846253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:33.913776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:33.915261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:33.938810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:33.942251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3527/7093] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:33 2022] PATCH /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:33.944359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:34.022556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a532fe-90dc-492b-80aa-9041728f906e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:34.196418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:34.229784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:34.231040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:34.235064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:34.235561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:34.257522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c2c10772d2064ef895b5af359fbfa053)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:34.259301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:34.345675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.381269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.635275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053', 'request_id': 'req-dcfe8134-d38f-4015-890d-28c7e24b5feb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.701387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053', 'request_id': 'req-dcfe8134-d38f-4015-890d-28c7e24b5feb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.746933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053', 'request_id': 'req-dcfe8134-d38f-4015-890d-28c7e24b5feb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.788542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] The token cache is being invalidate because project c2c10772d2064ef895b5af359fbfa053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:34.789015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.789868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.813896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053', 'request_id': 'req-dcfe8134-d38f-4015-890d-28c7e24b5feb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.815165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053', 'request_id': 'req-dcfe8134-d38f-4015-890d-28c7e24b5feb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.821191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c2c10772d2064ef895b5af359fbfa053', 'request_id': 'req-dcfe8134-d38f-4015-890d-28c7e24b5feb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:34.838770 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3567/7094] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:33 2022] DELETE /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:18:34.847444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:34.872220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b35f5-3a76-461c-85d3-ff17eb693ca4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:34.936136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:35.055915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:35.062375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:35.120960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:35.121943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:35.122399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:35.122840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:35.124361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:35.126363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:35.202833 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3528/7095] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:18:34 2022] POST /identity/v3/domains => generated 276 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:35.208516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:35.223301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:35.471500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe8134-d38f-4015-890d-28c7e24b5feb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:35.531171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:35.606971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4d21b-e213-46e4-9e4d-723d3dd2eb49 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:35.640292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:35.640978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:35.641270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:35.641532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:35.643062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:35.649108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:35.652271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:35.652798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:35.667898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:35.668380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:35.675724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:35.713420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:35.718462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:35.728471 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3529/7096] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:18:35 2022] PUT /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config => generated 138 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:35.729369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:35.757467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae5210c-042c-4cfb-b450-58f80cb86c3d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:35.770381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:35.772475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:35.772953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:35.773242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:35.773522 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3568/7097] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:18:35.775200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e, group=identity)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:35.778231 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:35.778231 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:18:35.778231 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:18:35.779213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:35.837990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:35.844836 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3530/7098] 10.222.0.16 () {60 vars in 1297 bytes} [Sat Oct 29 03:18:35 2022] PATCH /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity => generated 176 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:35.866877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d82997-5185-43b4-9c06-8cbc32c2a1bd service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:35.886097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:35.890101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:35.890489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:35.890931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity/driver` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:35.891922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e, group=identity, option=driver)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:35.893971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:35.964693 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3569/7099] 10.222.0.16 () {60 vars in 1318 bytes} [Sat Oct 29 03:18:35 2022] PATCH /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity/driver => generated 177 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:35.984010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.020399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65aab7-d91b-4393-b8a5-60bf7253cc8a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.031467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.033535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.033535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.033535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity/driver` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.033535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e, group=identity, option=driver)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.035575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:36.096407 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3531/7100] 10.222.0.16 () {58 vars in 1299 bytes} [Sat Oct 29 03:18:35 2022] DELETE /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity/driver => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:36.101788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.155212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df2d43-37f9-43a8-b16c-363a3aab74cd tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.165851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.166506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.166796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.167062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity/driver` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.168892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e, group=identity, option=driver)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.172156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Could not find option driver in group identity in domain configuration for domain d75be398149844a7b5b6979d545f2b6e.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:36.204440 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:36.205637 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:36.212803 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3570/7101] 10.222.0.16 () {58 vars in 1296 bytes} [Sat Oct 29 03:18:36 2022] GET /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity/driver => generated 171 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:36.215039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.235425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d24b1-0b80-4df9-b749-03348e770aeb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.255646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.259235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.260788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.269281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.279857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e, group=identity)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.287554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:36.339231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3532/7102] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 03:18:36 2022] DELETE /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:36.344196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.361299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68509bb-a084-4e1a-a63e-78425dc6c394 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.375216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.376184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.376639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.377097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.379057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e, group=identity)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.381053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Could not find group identity in domain configuration for domain d75be398149844a7b5b6979d545f2b6e.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:36.402433 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:36.403702 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:36.406914 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3571/7103] 10.222.0.16 () {58 vars in 1275 bytes} [Sat Oct 29 03:18:36 2022] GET /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config/identity => generated 154 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:36.411603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.445066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17142435-8ca4-4bce-b9f0-e03b56259fa5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.509424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.510119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.510404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.510681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e/config` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.517626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d75be398149844a7b5b6979d545f2b6e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.525487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:36.541133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:36.560626 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3533/7104] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:36 2022] DELETE /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e/config => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:36.564916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.580804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187146e5-d082-4725-b2f7-fccef18097ca tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.598859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.599721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.600162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.600595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.602565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d75be398149844a7b5b6979d545f2b6e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.604644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:36.699713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:36.702951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:36.781624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:36.786228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:36.792329 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3572/7105] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:36 2022] PATCH /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e => generated 277 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:36.793629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:36.796313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:36.819557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9bf37-15e4-470b-8bb8-dd8693298ce4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:36.947014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:36.947862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:36.948865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:36.949359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:36.968251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d75be398149844a7b5b6979d545f2b6e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:36.971358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.024035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.066640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.182397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e', 'request_id': 'req-f2f03965-1df4-42de-a78e-92ba10530fd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.198806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e', 'request_id': 'req-f2f03965-1df4-42de-a78e-92ba10530fd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.216279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e', 'request_id': 'req-f2f03965-1df4-42de-a78e-92ba10530fd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.239238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] The token cache is being invalidate because project d75be398149844a7b5b6979d545f2b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:37.239537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.240194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.257500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e', 'request_id': 'req-f2f03965-1df4-42de-a78e-92ba10530fd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.262067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e', 'request_id': 'req-f2f03965-1df4-42de-a78e-92ba10530fd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.263342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd75be398149844a7b5b6979d545f2b6e', 'request_id': 'req-f2f03965-1df4-42de-a78e-92ba10530fd9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:37.283363 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3534/7106] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:36 2022] DELETE /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:37.288825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.302415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862e966-3efa-48db-957a-310599a819fb tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.387087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.388372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.388946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.389475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.390380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.391970 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:37.391970 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:18:37.391970 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:18:37.393448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.404810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.406688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:37.416815 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3573/7107] 10.222.0.16 () {58 vars in 1173 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:37.423713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f03965-1df4-42de-a78e-92ba10530fd9 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.430658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.431988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.432402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.433022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.434153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.435268 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:18:37.435268 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:18:37.435268 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:18:37.436449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.438356 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3535/7108] 10.222.0.16 () {58 vars in 1200 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.442462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.454997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525585e-1937-4b11-85c5-5f8d5b83d1ae tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.464165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.465260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.465656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.466085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.466821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.468567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.474310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.482732 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3574/7109] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.486657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08aac6-9518-4e9b-b256-004e160dad04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.491753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.493479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.493913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.494401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.495118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.497248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.502708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.503519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3536/7110] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.515459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a917a8-9751-41e1-82eb-911a6c761c98 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.521402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.522640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.523067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.523669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.524567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.526818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.532987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.541139 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3575/7111] 10.222.0.16 () {58 vars in 1188 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:18:37.546273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4eb50f-1f3a-43a8-a492-72db6c05bcd1 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.554507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.555324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.555717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.556205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.557135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.559105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.565018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.572283 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3537/7112] 10.222.0.16 () {58 vars in 1200 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.578440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41264ce5-5271-4e6f-b0b6-978e9022d714 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.592118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.592992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.593383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.593839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.595392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.597616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.604682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.612749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3576/7113] 10.222.0.16 () {58 vars in 1203 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.616907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22be021-afa1-4465-b7ab-d3cb7d7979f3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.623732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.624604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.624995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.625624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.626589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.628362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.634458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.642706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3538/7114] 10.222.0.16 () {58 vars in 1209 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.647710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e326585-53dc-4cc7-b3eb-0b17d400cf94 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.655213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.656224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.656712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.657097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.657972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.659900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.665405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.673871 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3577/7115] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.679646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82462af4-0681-41ba-a5c4-f36062f17159 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.686546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.687621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.688175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.688722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.689694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.691806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.695635 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3539/7116] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.700519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.713272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7639a8e-c7e6-4a28-92ed-5aef61286f99 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.721696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.722692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.723226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.723782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.724834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.727801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.734762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.743823 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3578/7117] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.749449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77521fe1-9d37-4a38-9d09-b4d66791372d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.756045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.757067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.757664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.758357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.759775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.761706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.767849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.775412 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3540/7118] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.775693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:37.781066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff676-8840-4a01-9d5c-f53f9ad7956e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.790631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.791870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.792619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.793195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.794134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.796112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.802794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.814023 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3579/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.818907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d5c0b-7c72-4f49-a89f-6cd5364370b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.825033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.826125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.826661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.827225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.828311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.830707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.836633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.843468 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3541/7120] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.850891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14383350-dd4e-44e8-bfe8-bd59f09fd7df tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.857213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.858335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.859008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.859527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.872597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.876336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.884360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3580/7121] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:37.885613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.892964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:37.897545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7687ce-0d3c-4d08-9942-661345cbeb71 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.906720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.918865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.919169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.919465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.920082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.925176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.931495 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3542/7122] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.933012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:37.954547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4bcec-62e5-4e48-a7de-9623b9c80f53 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:37.969347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:37.970506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:37.971028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:37.971546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:37.972388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:37.974324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:37.983027 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3581/7123] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:37.984685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.001933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa1d5d-3f0a-4071-be9b-d226fc9e5ba5 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.026888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.027848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.028131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.028629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.029402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.036616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.039329 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3543/7124] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:37 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.043153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.058333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4175db-aec1-401a-ae45-005f1e3a9e85 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.073631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.074503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.074889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.075275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.076073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.078008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.084539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.085014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3582/7125] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.105752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64502d92-cf00-4a4e-aa33-a885bbdb7a3a tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.121625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.122654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.123120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.129366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.130333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.132439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.134574 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3544/7126] 10.222.0.16 () {58 vars in 1269 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:38.140217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.153360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96cb533-f936-484e-a212-20ab049bac60 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.169823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.174966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.175138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.175514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.185961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.190818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.195348 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3583/7127] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.199558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.213145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5f303-f448-43da-9ce6-b404bc16039d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.219920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.221584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.222742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.224875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.225865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.230569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.238558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.247483 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3545/7128] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.254961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ebfe2-0f4e-4f91-8331-263ff3165888 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.271036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.273188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.274222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.275614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.276465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.281243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.288934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.297552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3584/7129] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:38.302748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b686a0-ff5a-4a7f-a5e9-4af064ff7123 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.315172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.316623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.320783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.321365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.322429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.324976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.336372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.343627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3546/7130] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.348747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daad4b-eaf3-42ed-8555-95f12c1eed13 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.362494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.363608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.364132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.364637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.365642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.368279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.376736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.378301 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3585/7131] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.392342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de45727-f41e-4762-ad88-daa6467d6ab3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.404700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.407223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.408298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.411926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.412792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.415283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.417894 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3547/7132] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.422763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.437362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e57dc-e703-4662-8840-b6e3bac9403c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.448674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.455994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.456570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.457312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.458641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.461083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.467743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.476027 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3586/7133] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.480641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275011a1-acf8-4617-acaf-801e6067dc3f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.486945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.489346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.489907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.490434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.491378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.493683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.498465 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3548/7134] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.500438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.518530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a090-aeac-4cf8-b9b3-3e0c9981f57f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.525063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.527625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.528188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.528711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.529534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.532184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.538111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.548638 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3587/7135] 10.222.0.16 () {58 vars in 1266 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.554761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9dfb7-257f-424c-a8a4-63ad91af0b12 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.564973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.566024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.570288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.570828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.572106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.574354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.585295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.599686 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3549/7136] 10.222.0.16 () {58 vars in 1308 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.602814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67a64b2-0cb3-445a-b344-579a8a2cab2e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.609463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.610952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.611497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.612034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.613096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.617450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.624733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.634249 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3588/7137] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.642470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fba7-cf9a-425c-af16-06020025ac9f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.649883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.651136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.651915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.652531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.653423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.655764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.663875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.674489 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3550/7138] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.680222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4b608-3a70-4528-aea0-d9905f1ca73c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.686649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.688265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.688563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.688845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.691081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.697243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.700655 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3589/7139] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.705284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.722257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e75ef-16dc-452b-8943-376db492060b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.754606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.755373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.755659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.755940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.758358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.767469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.769512 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3551/7140] 10.222.0.16 () {58 vars in 1242 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.774686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.786054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656ea97-3e30-4abe-be62-b3aa4064188b tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.827076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.828654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.829254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.829392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.830020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.831649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.833858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3590/7141] 10.222.0.16 () {58 vars in 1245 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.838058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.860929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000c688-c051-4b18-8c91-0b96e37adaf8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.874038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.874924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.875799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.876100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.878000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.880172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.886579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.887152 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3552/7142] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.902428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98140d3-6b5d-4995-8081-f36b1cda549f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.915344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.916338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.916939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.917407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.918344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.920200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.922289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3591/7143] 10.222.0.16 () {58 vars in 1254 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:38.926746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.950025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55565a-fec5-4952-9ff6-28fb3630319e tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.957375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.958252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.958539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.958814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.960230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:38.962448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:38.963838 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3553/7144] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:38.968113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:38.980463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bef9b-8946-4adc-97a7-0ebe050b3376 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:38.986345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:38.987218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:38.987688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:38.988136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:38.989006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.000242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.006472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.008898 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3592/7145] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Oct 29 03:18:38 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.023604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85c0c-8236-4b94-b3d5-a941b39245d8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.037024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.038703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.039482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.040266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.042565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.046771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.055441 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3554/7146] 10.222.0.16 () {58 vars in 1257 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.060535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.076221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940c3a-dca4-42c8-9054-141e0590cd7c tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.090825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.091797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.092087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.092367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.093219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.094667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.100560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.102339 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3593/7147] 10.222.0.16 () {58 vars in 1293 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.119536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf222-76e8-401c-b911-b8097819be65 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.133038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.134110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.134510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.134855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.136851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.146513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.148562 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3555/7148] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.152492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.169119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f30a14-b9f2-4846-aab6-8530cb87388f tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.182276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.183098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.183418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.183721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.185335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.191919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.198600 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3594/7149] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.203429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.237497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35328a2d-6864-43b2-a624-b091be3c4628 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.252775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.254206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.254504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.254784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.256544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.260600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.266100 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3556/7150] 10.222.0.16 () {58 vars in 1212 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.270343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.292305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd32da-9725-406b-82cb-6d8a1c42efbe tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.298914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.300858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.301338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.301848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.302677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.305078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.307038 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3595/7151] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.310843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.322564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbb01f-16ed-4497-89dc-1b1e10cf3b24 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.332862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.334027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.334690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.335203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.335978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.338208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.339989 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3557/7152] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:39.344132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.358507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e291d-8347-450b-81bc-a5d5b821f8b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.364461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.365924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.366565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.366904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.368233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.371412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.375136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3596/7153] 10.222.0.16 () {58 vars in 1218 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.376772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.391166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db097c4-1938-4cb3-9974-ab46f1ab43b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.398159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.399212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.399802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.400242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.401018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.403284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.408983 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3558/7154] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.410669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.437176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddfbb6-66b4-4308-b707-b103d6f5e341 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.443609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6df2ac-3723-46cd-90a4-b0fc2094fda3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.444301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6df2ac-3723-46cd-90a4-b0fc2094fda3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.444762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6df2ac-3723-46cd-90a4-b0fc2094fda3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.445113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6df2ac-3723-46cd-90a4-b0fc2094fda3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.445712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6df2ac-3723-46cd-90a4-b0fc2094fda3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.447731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6df2ac-3723-46cd-90a4-b0fc2094fda3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.452483 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3597/7155] 10.222.0.16 () {58 vars in 1239 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.454593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.470859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d18285-1e4c-45d9-b3e4-02ff7c32bf04 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.480346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.481237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.481573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.481889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.482538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.484265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.495300 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3559/7156] 10.222.0.16 () {58 vars in 1260 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.499874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.499874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.500878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.508322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.554000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b1ffe-344b-46bb-8deb-78c0fec63e2d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.554568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] MFA Rules not processed for user `d2867c5be8974c028f933d1c8fe2c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:39.555787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:39.576951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.579304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.593701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.598256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.626594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.641628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.659583 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3560/7157] 10.222.0.16 () {58 vars in 1263 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.664707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.728635 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3598/7158] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:39.730514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a008c5-1809-488e-9802-cfc0ad8532ec tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.750867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.752375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.752536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.753230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.756120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.759277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.764735 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3561/7159] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 29 03:18:39.766838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.788127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb02a5b-41ab-4da9-8033-1dfa33b9359a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.803641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.804330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.804614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.804892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.805521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.811797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.818227 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3599/7160] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.820913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.855524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff427c7-8943-485e-8473-1f888d107588 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.873766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.874955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.875586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.876080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.877015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:39.880009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:39.882613 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3562/7161] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 03:18:39 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 29 03:18:39.889003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.901901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca38bfb-83e0-44ba-85b8-e1fabbad80b0 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.907837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.908493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.908777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.909053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/d75be398149844a7b5b6979d545f2b6e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.918598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Could not find domain: d75be398149844a7b5b6979d545f2b6e.: keystone.exception.DomainNotFound: Could not find domain: d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:39.925850 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:39.927256 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:39.928449 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d75be398149844a7b5b6979d545f2b6e. Oct 29 03:18:39.929587 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:39.931462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.938842 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3600/7162] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:39 2022] PATCH /identity/v3/domains/d75be398149844a7b5b6979d545f2b6e => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:39.943843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30a964-dba1-4d08-81c6-cbd311804cb4 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:39.949181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:39.950050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:39.950608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:39.950998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/c2c10772d2064ef895b5af359fbfa053` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:39.959022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Could not find domain: c2c10772d2064ef895b5af359fbfa053.: keystone.exception.DomainNotFound: Could not find domain: c2c10772d2064ef895b5af359fbfa053. Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c2c10772d2064ef895b5af359fbfa053. Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:39.965149 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:39.966490 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:39.967766 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c2c10772d2064ef895b5af359fbfa053. Oct 29 03:18:39.969093 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:39.974144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:39.980481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3563/7163] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:39 2022] PATCH /identity/v3/domains/c2c10772d2064ef895b5af359fbfa053 => generated 112 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 03:18:39.986398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8c73c-070d-4655-bd97-d1a7a29ac4a8 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:40.001228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed09214-ea5c-485f-af4b-2e2b229f5b0d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de3bf2f26a2a47c09532fbcf7f5f166c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a47de1f858c48bf9fa540c0b9b0de8f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:40.002048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09214-ea5c-485f-af4b-2e2b229f5b0d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:40.002432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09214-ea5c-485f-af4b-2e2b229f5b0d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:40.002815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed09214-ea5c-485f-af4b-2e2b229f5b0d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] PATH_INFO: `/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:40.011076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed09214-ea5c-485f-af4b-2e2b229f5b0d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-6ed09214-ea5c-485f-af4b-2e2b229f5b0d tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Could not find domain: 7d4288dcdf6c4ab58c60852cb4f86613.: keystone.exception.DomainNotFound: Could not find domain: 7d4288dcdf6c4ab58c60852cb4f86613. Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7d4288dcdf6c4ab58c60852cb4f86613. Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:40.016660 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:40.017979 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:40.019233 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 7d4288dcdf6c4ab58c60852cb4f86613. Oct 29 03:18:40.020574 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:40.026769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:40.035081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:40.045675 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3601/7164] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:39 2022] PATCH /identity/v3/domains/7d4288dcdf6c4ab58c60852cb4f86613 => generated 112 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:40.178072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244ea88-d894-4620-9bc5-d4d9e5dcc9b3 tempest-DomainConfigurationTestJSON-445971276 tempest-DomainConfigurationTestJSON-445971276-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:40.184702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:40.188030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:40.188447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:40.189526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] PATH_INFO: `/v3/users/83854b2a621d4c9782f53e22d8e44c83` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:40.190396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83854b2a621d4c9782f53e22d8e44c83)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:40.199510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:40.311547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83854b2a621d4c9782f53e22d8e44c83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:40.346202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83854b2a621d4c9782f53e22d8e44c83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:40.347323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83854b2a621d4c9782f53e22d8e44c83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:40.352907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:40.367835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83854b2a621d4c9782f53e22d8e44c83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:40.370221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83854b2a621d4c9782f53e22d8e44c83'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:40.395212 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3564/7165] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:40 2022] DELETE /identity/v3/users/83854b2a621d4c9782f53e22d8e44c83 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:40.399491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:40.400376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:40.400819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:40.441125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:40.442683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:40.598340 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3602/7166] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:40.612781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:40.615220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:40.735059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6796f-0193-4c99-b208-40f01aec8241 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:40.744183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:40.746355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:40.747432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:40.749940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:40.772653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:40.774470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:40.806433 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3565/7167] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:18:42.371284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:42.373355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:42.428665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:42.445570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbd7f6-c88a-43ca-a869-97bf82c75c5a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:42.506788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:42.507529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:42.509165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:42.509658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] PATH_INFO: `/v3/projects/d16bb688e6824d7db8fb52894184880c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:42.523032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16bb688e6824d7db8fb52894184880c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:42.525434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:42.714052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16bb688e6824d7db8fb52894184880c', 'request_id': 'req-cd9a5308-b772-48ad-8b2f-a18de03d648f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:42.726808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16bb688e6824d7db8fb52894184880c', 'request_id': 'req-cd9a5308-b772-48ad-8b2f-a18de03d648f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:42.750850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16bb688e6824d7db8fb52894184880c', 'request_id': 'req-cd9a5308-b772-48ad-8b2f-a18de03d648f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:42.774534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] The token cache is being invalidate because project d16bb688e6824d7db8fb52894184880c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:42.774981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:42.777291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:42.780966 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3603/7168] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:42 2022] DELETE /identity/v3/projects/d16bb688e6824d7db8fb52894184880c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:42.785825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:42.837236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce69b2-700f-4f29-87b5-f812175abfe1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:43.243226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:43.243903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:43.244181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:43.246313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] PATH_INFO: `/v3/users/de3bf2f26a2a47c09532fbcf7f5f166c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:43.252126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3bf2f26a2a47c09532fbcf7f5f166c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:43.254171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:43.398571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3bf2f26a2a47c09532fbcf7f5f166c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:43.441037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3bf2f26a2a47c09532fbcf7f5f166c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:43.442179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3bf2f26a2a47c09532fbcf7f5f166c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:43.452654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3bf2f26a2a47c09532fbcf7f5f166c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:43.453552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-253ea2ac-2346-4d2f-bb4e-3a420307a42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3bf2f26a2a47c09532fbcf7f5f166c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:43.497586 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3566/7169] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:42 2022] DELETE /identity/v3/users/de3bf2f26a2a47c09532fbcf7f5f166c => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:45.080126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:45.082198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:45.119671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a5308-b772-48ad-8b2f-a18de03d648f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:45.349539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:45.350262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:45.350542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:45.350818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] PATH_INFO: `/v3/projects/4a47de1f858c48bf9fa540c0b9b0de8f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:45.360794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a47de1f858c48bf9fa540c0b9b0de8f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:45.364176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:45.494344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a47de1f858c48bf9fa540c0b9b0de8f', 'request_id': 'req-31abfed9-114c-4430-8db2-3d823a5808fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:45.510477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a47de1f858c48bf9fa540c0b9b0de8f', 'request_id': 'req-31abfed9-114c-4430-8db2-3d823a5808fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:45.532120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a47de1f858c48bf9fa540c0b9b0de8f', 'request_id': 'req-31abfed9-114c-4430-8db2-3d823a5808fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:45.559323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] The token cache is being invalidate because project 4a47de1f858c48bf9fa540c0b9b0de8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:45.559882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:45.568142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-31abfed9-114c-4430-8db2-3d823a5808fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:45.574404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3604/7170] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:45 2022] DELETE /identity/v3/projects/4a47de1f858c48bf9fa540c0b9b0de8f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:45.575716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:45.576246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:45.576246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:45.603186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:45.637219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:45.640230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:45.866630 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3567/7171] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:45.876233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:45.877095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:45.877219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:45.924898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:45.926096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:45.960050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3605/7172] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:45.964217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:45.982112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba9d061-7ae7-4994-b005-7f39792ef304 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:46.008870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:46.010868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.011934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.012362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.013231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:18:46.014275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:46.016431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:46.047927 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3568/7173] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:46.052695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:46.068040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea95da-bf42-4d26-a1d4-4ad77ff63fa8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:46.084081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:46.085509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.088574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.089262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.090494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:46.110621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:46.151136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:46.228447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3606/7174] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:18:46 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:46.229736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:46.252795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c0766-cefd-4a8f-9354-8712b3741c3f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:46.450036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:46.450859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.451174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.451799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.452611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:46.466114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:46.569943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:46.570481 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3569/7175] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:18:46 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:46.601496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f7c40-b90c-49e9-92a8-897c2397d604 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:46.644551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:46.645204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.645487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.645756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.648308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:46.652440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:46.676998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3607/7176] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:46.681311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:46.702123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d47ea-8782-4b24-a9b5-85a149cf4632 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:46.708783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265e43e-8d04-48af-9e8a-986dec9a6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:46.709345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e43e-8d04-48af-9e8a-986dec9a6ceb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.710044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e43e-8d04-48af-9e8a-986dec9a6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.710546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265e43e-8d04-48af-9e8a-986dec9a6ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.711576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e43e-8d04-48af-9e8a-986dec9a6ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:46.713771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1265e43e-8d04-48af-9e8a-986dec9a6ceb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:46.736793 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3570/7177] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:46.740862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:46.760748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4281c40f-afbc-4031-a3e1-655aa076eaf1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:46.780824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:46.781739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.782419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.783746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] PATH_INFO: `/v3/projects/011b8a3161714d06987de8c58a58c347/users/45adee3b7d4b499e8bfbf8db12d0646e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.832699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011b8a3161714d06987de8c58a58c347, user_id=45adee3b7d4b499e8bfbf8db12d0646e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:46.835720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:46.859266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3608/7178] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:46 2022] PUT /identity/v3/projects/011b8a3161714d06987de8c58a58c347/users/45adee3b7d4b499e8bfbf8db12d0646e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:46.870398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:46.870742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:46.871087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:46.926055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] MFA Rules not processed for user `45adee3b7d4b499e8bfbf8db12d0646e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:46.927561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:47.030226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:47.040917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:47.042382 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3571/7179] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:47.209536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:47.211368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:47.279727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb7c08-7e74-4af6-897e-43a97f981c89 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:47.286801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:47.288244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:47.288693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:47.289151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:47.290399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:47.294302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:47.343866 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3609/7180] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:18:47 2022] POST /identity/v3/projects => generated 367 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:47.347937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:47.439909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b315481-a0d3-454a-82cf-09b523335e45 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:47.502589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7708f86-d632-4511-be83-0127888c387f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:47.508348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:47.509148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:47.509435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:47.509711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:47.511763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:47.514660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:47.557855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:47.559349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:47.559915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:47.560446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] PATH_INFO: `/v3/users/531499226df542f398434aba80199140` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:47.565554 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3610/7181] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:18:47 2022] POST /identity/v3/users => generated 290 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:18:47.576514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:47.579284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531499226df542f398434aba80199140)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:47.583949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:47.592602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd78542-8542-42cb-a277-efe1d4831e41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:47.600388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:47.601404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:47.601943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:47.602411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:47.603256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:47.607141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:47.642768 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3611/7182] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:47.644763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:47.659683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb4fcc-7b0c-418d-882b-8a83e2b9410b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:47.669450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:47.670456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:47.670836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:47.671207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] PATH_INFO: `/v3/projects/8003b7513ff54958b4184f26b906cd89/users/db810aabd420472b8babf632261c13de/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:47.719750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531499226df542f398434aba80199140'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:47.725127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8003b7513ff54958b4184f26b906cd89, user_id=db810aabd420472b8babf632261c13de, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:47.729068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:47.732344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:47.745544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531499226df542f398434aba80199140'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:47.751128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531499226df542f398434aba80199140'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:47.761620 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3612/7183] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:47 2022] PUT /identity/v3/projects/8003b7513ff54958b4184f26b906cd89/users/db810aabd420472b8babf632261c13de/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:47.765775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:47.768772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:47.769460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531499226df542f398434aba80199140'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:47.771679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-efbef056-3a90-448f-a2f8-b5cceedd6fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531499226df542f398434aba80199140'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:47.797719 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3572/7184] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:47 2022] DELETE /identity/v3/users/531499226df542f398434aba80199140 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:47.802407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:47.804017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:47.804659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:47.851455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:47.856665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:47.904172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692fa951-325a-48e0-8f0e-3519bd414a32 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:47.925286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:48.025611 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3573/7185] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:48.037881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.039316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:48.081762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:48.084101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.086059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.086478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.092292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:48.097258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:48.138728 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3613/7186] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:48.145541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.166252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a9f08-7e6e-470c-8bbd-2e549d790f6e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:48.176786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cdf263-8737-4901-b674-2111a732812d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:48.177836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf263-8737-4901-b674-2111a732812d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.178330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf263-8737-4901-b674-2111a732812d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.179653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdf263-8737-4901-b674-2111a732812d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.190528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0db7f-6671-474f-94a8-4e7f2900c716 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:48.203003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdf263-8737-4901-b674-2111a732812d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:48.207423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cdf263-8737-4901-b674-2111a732812d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:48.214463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:48.219170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.219876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.222513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] PATH_INFO: `/v3/projects/8003b7513ff54958b4184f26b906cd89/users/db810aabd420472b8babf632261c13de/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.229179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3574/7187] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:18:48.230425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8003b7513ff54958b4184f26b906cd89, user_id=db810aabd420472b8babf632261c13de, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:48.233365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:48.247596 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3614/7188] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:48 2022] PUT /identity/v3/projects/8003b7513ff54958b4184f26b906cd89/users/db810aabd420472b8babf632261c13de/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:48.258233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.258744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.259202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.293483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] MFA Rules not processed for user `db810aabd420472b8babf632261c13de`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:48.295851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:48.412984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.413581 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3575/7189] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:48.435923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a344f4-8bae-497a-b4c1-a3e2ec802337 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:48.451704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:48.452351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.452632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.453092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.453781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:48.455427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:48.489254 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3615/7190] 10.222.0.16 () {60 vars in 1150 bytes} [Sat Oct 29 03:18:48 2022] POST /identity/v3/domains => generated 276 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:18:48.495461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.511499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519b0ca-ea31-4574-a4dd-99bfc3dabb21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:48.597830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:48.619038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:48.619038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.619038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.619643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.620406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:48.627041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:48.654129 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3576/7191] 10.222.0.16 () {60 vars in 1150 bytes} [Sat Oct 29 03:18:48 2022] POST /identity/v3/domains => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:48.654331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.671711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3c04-6114-4c35-92f5-58c6ae98308a tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:48.828807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:48.829460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:48.829745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:48.830697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:48.830697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:48.832348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:48.878990 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3616/7192] 10.222.0.16 () {60 vars in 1150 bytes} [Sat Oct 29 03:18:48 2022] POST /identity/v3/domains => generated 278 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:48.884965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.885171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:48.889713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:48.903304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:48.909036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7d3db-dc22-4f68-95b4-d227bf92dbbc tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.054915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858aa6d-7e3b-418a-83c6-6447f6c2de66 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.060578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.060906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.061226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.061520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.061676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.061819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] PATH_INFO: `/v3/projects/f183b34fdc4449f7b1f085a2256adbf9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.061915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.062117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.063266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.063393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f183b34fdc4449f7b1f085a2256adbf9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.064381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.065074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.095764 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3577/7193] 10.222.0.16 () {60 vars in 1150 bytes} [Sat Oct 29 03:18:48 2022] POST /identity/v3/domains => generated 279 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:49.101014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.161951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f183b34fdc4449f7b1f085a2256adbf9', 'request_id': 'req-75b4590e-4560-49a6-ad13-6c57064290a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.171187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f183b34fdc4449f7b1f085a2256adbf9', 'request_id': 'req-75b4590e-4560-49a6-ad13-6c57064290a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.179307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f183b34fdc4449f7b1f085a2256adbf9', 'request_id': 'req-75b4590e-4560-49a6-ad13-6c57064290a8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.211014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] The token cache is being invalidate because project f183b34fdc4449f7b1f085a2256adbf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:49.213068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.214266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-75b4590e-4560-49a6-ad13-6c57064290a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.222637 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3617/7194] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:48 2022] DELETE /identity/v3/projects/f183b34fdc4449f7b1f085a2256adbf9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:18:49.225692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae479081-593f-4e45-8b60-d89d8bae9511 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.229547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae479081-593f-4e45-8b60-d89d8bae9511 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.230433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae479081-593f-4e45-8b60-d89d8bae9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.252892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe216ca-d898-404c-aa20-d628022c4d60 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.266295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ae479081-593f-4e45-8b60-d89d8bae9511 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:49.268985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ae479081-593f-4e45-8b60-d89d8bae9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:49.365158 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3618/7195] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:49.374285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.374699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.375066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.392274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.393965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.394313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.394655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/c6e62674ac104eeeb03454fbb3f71f92` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.416859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c6e62674ac104eeeb03454fbb3f71f92)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.423155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:49.423832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.442094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:49.456725 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3619/7196] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:49.462701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.478603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0324c87f-14b5-459a-8041-8a24be425f03 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.485378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.487788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.488757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.489061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.489331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.490067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:18:49.490362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.492639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.510470 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3620/7197] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:49.511772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:49.512515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.526946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.527233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d33caae-bd13-4c15-8944-8b5ae366ae02 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.532557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.533263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.533607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.534198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.534922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.537495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.573390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:49.605307 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3621/7198] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:18:49 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:49.610458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.623450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92', 'request_id': 'req-3a0153cd-222b-42f0-b3e3-ce80c563c78f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.639018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92', 'request_id': 'req-3a0153cd-222b-42f0-b3e3-ce80c563c78f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.650711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92', 'request_id': 'req-3a0153cd-222b-42f0-b3e3-ce80c563c78f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.679143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project c6e62674ac104eeeb03454fbb3f71f92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:49.680885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.681722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.697353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1f36e-8907-44b4-8fae-d115a1a9c296 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.706210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.706906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.707198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.707569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.708187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.710809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.716618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92', 'request_id': 'req-3a0153cd-222b-42f0-b3e3-ce80c563c78f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.717671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92', 'request_id': 'req-3a0153cd-222b-42f0-b3e3-ce80c563c78f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.718400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c6e62674ac104eeeb03454fbb3f71f92', 'request_id': 'req-3a0153cd-222b-42f0-b3e3-ce80c563c78f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:49.749013 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3578/7199] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:49 2022] DELETE /identity/v3/domains/c6e62674ac104eeeb03454fbb3f71f92 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:49.749260 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3622/7200] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:18:49 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:49.749390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.749390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:49.751686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.760060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:49.823604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22222905-d4cd-40bf-a216-95ad6473f7e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.852636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.853277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.854165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.854165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.854629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.856436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.895744 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3623/7201] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:49.897640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:49.924086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4ed49-daee-41d8-9826-c6e8983886e1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.938596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:49.940942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:49.942867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:49.943237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:49.944230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:49.950181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:49.963839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0153cd-222b-42f0-b3e3-ce80c563c78f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:49.984514 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3624/7202] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:49.989503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:50.017014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65148b-7ab5-42a5-9b3b-955755532014 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:50.031456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a15a48-1490-4dd7-810b-6d429a95c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:50.034979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15a48-1490-4dd7-810b-6d429a95c5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:50.035273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15a48-1490-4dd7-810b-6d429a95c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:50.035556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15a48-1490-4dd7-810b-6d429a95c5b7 admin admin] PATH_INFO: `/v3/projects/7b59eece75b44cadb77fa353dd60fafb/users/58f9100572be451b98ae878ae77f211c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:50.079650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a15a48-1490-4dd7-810b-6d429a95c5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b59eece75b44cadb77fa353dd60fafb, user_id=58f9100572be451b98ae878ae77f211c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:50.089761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a15a48-1490-4dd7-810b-6d429a95c5b7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:50.124299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:50.125030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:50.125399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:50.125991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:50.126134 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3625/7203] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:18:49 2022] PUT /identity/v3/projects/7b59eece75b44cadb77fa353dd60fafb/users/58f9100572be451b98ae878ae77f211c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:50.131042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:50.136583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:50.136833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:50.137048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:50.139406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:50.189627 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3579/7204] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:18:49 2022] POST /identity/v3/domains => generated 248 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:18:50.191335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:50.207539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:50.238883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] MFA Rules not processed for user `58f9100572be451b98ae878ae77f211c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:50.240158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:50.294647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfc640-acef-4b06-9a9b-1af7ff7b5030 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:50.301632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:50.302546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:50.302945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:50.303317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/5d377076c8f14e8b8e2afb74164996a6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:50.318482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5d377076c8f14e8b8e2afb74164996a6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:50.320375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:50.351809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.353001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.405390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.406185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.417128 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3580/7205] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:50 2022] PATCH /identity/v3/domains/5d377076c8f14e8b8e2afb74164996a6 => generated 249 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:50.417719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:50.420170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:50.457608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3626/7206] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:18:50.552096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:50.554864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:50.580606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200aa4ca-ed09-443b-9ec6-8129d248dbb1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:50.598434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:50.599155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:50.600369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:50.600985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/5d377076c8f14e8b8e2afb74164996a6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:50.615598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:50.639605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5d377076c8f14e8b8e2afb74164996a6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:50.644484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:50.683166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.700186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fada3f05-9d20-470b-bb1d-64c5228007de None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:50.710836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.762151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:50.785135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6', 'request_id': 'req-3789b863-9d26-4502-8917-d0b0cdcded05'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.797105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6', 'request_id': 'req-3789b863-9d26-4502-8917-d0b0cdcded05'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.805007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6', 'request_id': 'req-3789b863-9d26-4502-8917-d0b0cdcded05'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.827543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project 5d377076c8f14e8b8e2afb74164996a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:50.827848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.828506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.862427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6', 'request_id': 'req-3789b863-9d26-4502-8917-d0b0cdcded05'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.864466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6', 'request_id': 'req-3789b863-9d26-4502-8917-d0b0cdcded05'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.865170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5d377076c8f14e8b8e2afb74164996a6', 'request_id': 'req-3789b863-9d26-4502-8917-d0b0cdcded05'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:50.876873 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3581/7207] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:50 2022] DELETE /identity/v3/domains/5d377076c8f14e8b8e2afb74164996a6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:18:50.882354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:50.883202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:50.883862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:50.885178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:50.886768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:50.887267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:50.890202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:51.027001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b863-9d26-4502-8917-d0b0cdcded05 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:51.036381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:51.037440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:51.038064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:51.038789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:51.040104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:51.044364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:51.044714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:51.051263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:51.066516 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3627/7208] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:18:51.094348 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3582/7209] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:18:50 2022] POST /identity/v3/domains => generated 279 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:51.098266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:51.114546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8a2de-d10b-43c6-b278-baf9d3a1c72c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:51.259284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:51.260163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:51.260452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:51.262059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/fa352755ee1442c2b18aa10a48f8980f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:51.281454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fa352755ee1442c2b18aa10a48f8980f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:51.283375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:51.311859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.312785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.341248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:51.369179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.372373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.379540 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3628/7210] 10.222.0.16 () {60 vars in 1250 bytes} [Sat Oct 29 03:18:51 2022] PATCH /identity/v3/domains/fa352755ee1442c2b18aa10a48f8980f => generated 278 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:51.384470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:51.387120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:51.432797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d09b52-26c4-4a4f-86ab-aacaded30baf tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:51.604711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:51.605504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:51.605931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:51.606307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/fa352755ee1442c2b18aa10a48f8980f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:51.622444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=fa352755ee1442c2b18aa10a48f8980f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:51.624721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:51.626971 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3583/7211] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:18:51 2022] GET /identity/v3/domains/fa352755ee1442c2b18aa10a48f8980f => generated 278 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:51.632217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:51.661203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908dc79b-85c1-489f-836c-155d241b0c9f tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:51.669503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:51.670212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:51.670489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:51.670773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/fa352755ee1442c2b18aa10a48f8980f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:51.672113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fa352755ee1442c2b18aa10a48f8980f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:51.675230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:51.744105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.765626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.859151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:51.863197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:51.903810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f', 'request_id': 'req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.926561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:51.930665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f', 'request_id': 'req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:51.965851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f', 'request_id': 'req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.009826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8afa3-6e85-4ff6-be88-9d9095e763eb tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.010793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project fa352755ee1442c2b18aa10a48f8980f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:52.011401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.012311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.023492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f', 'request_id': 'req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.024535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f', 'request_id': 'req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.029436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fa352755ee1442c2b18aa10a48f8980f', 'request_id': 'req-0d85f47b-c52a-400f-a8f8-4c5ea53f5597'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.038024 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3629/7212] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:51 2022] DELETE /identity/v3/domains/fa352755ee1442c2b18aa10a48f8980f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:18:52.040093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.040685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.041121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.069971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] MFA Rules not processed for user `29f3383c209340adb16a7074c291b191`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:52.071314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:52.163033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.163577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.163861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.164135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.171606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:52.183052 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3630/7213] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:52.184251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:52.189587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:52.197117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:52.199890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:52.215672 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3584/7214] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:18:52.269180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:52.336098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f862cd-f9f2-44fe-b28c-7d02707a2e4f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.346708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.347517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.347907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.348287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.349020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:52.350877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:52.384132 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3631/7215] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 03:18:52 2022] GET /identity/v3/domains => generated 1347 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:52.388458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:52.405877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ffc23-0ed9-44f9-ba9a-accc4dd84b50 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.419439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.420111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.420399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.420690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/fa352755ee1442c2b18aa10a48f8980f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.439868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find domain: fa352755ee1442c2b18aa10a48f8980f.: keystone.exception.DomainNotFound: Could not find domain: fa352755ee1442c2b18aa10a48f8980f. Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fa352755ee1442c2b18aa10a48f8980f. Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:52.457650 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:52.459135 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fa352755ee1442c2b18aa10a48f8980f. Oct 29 03:18:52.460412 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:52.462181 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3585/7216] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:52 2022] PATCH /identity/v3/domains/fa352755ee1442c2b18aa10a48f8980f => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:52.468019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:52.502209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba266e-b09a-4e29-9137-6de61aeeea50 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.510106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.510951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.511727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.512078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.513646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:52.515822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:52.542859 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3632/7217] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:18:52 2022] POST /identity/v3/domains => generated 277 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:52.546681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:52.574242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b861-f3e4-430f-9ce0-9403fe8dc8a2 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.709890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.710731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.711117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.711518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.712983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:52.715771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:52.776526 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3586/7218] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:18:52 2022] POST /identity/v3/users => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:52.777625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:52.789625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971cb3-129b-4bc8-ac4f-4a3ed09a8ed8 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.805107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.805748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.806103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.806385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/groups` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.807041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:52.813459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:52.847142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3633/7219] 10.222.0.16 () {60 vars in 1147 bytes} [Sat Oct 29 03:18:52 2022] POST /identity/v3/groups => generated 325 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:18:52.851801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:52.868230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c3f88-6326-498e-92a5-a2be51c95538 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:52.883666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:52.886494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:52.886893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:52.887648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:52.891138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=da5cd0a152e64ef8a14c201a834c9d0c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:52.895116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:52.952154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.953080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.977302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:52.992938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.993776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:52.998534 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3587/7220] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:52 2022] PATCH /identity/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c => generated 278 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:53.002451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:53.004917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:53.022563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09f202-3a05-46ec-b2af-666899abad7b tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:53.097390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:53.098482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:53.098867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:53.099278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:53.114487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=da5cd0a152e64ef8a14c201a834c9d0c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:53.116536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:53.162021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.319969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:53.367821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190babdd1f6c4474a6f567ead6875644'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.386994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190babdd1f6c4474a6f567ead6875644'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.387786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190babdd1f6c4474a6f567ead6875644'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.403980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190babdd1f6c4474a6f567ead6875644'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.404786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190babdd1f6c4474a6f567ead6875644'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.446667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.533534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c', 'request_id': 'req-210c255c-c929-4f4f-915b-ac758bd56e08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.547976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c', 'request_id': 'req-210c255c-c929-4f4f-915b-ac758bd56e08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.576958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c', 'request_id': 'req-210c255c-c929-4f4f-915b-ac758bd56e08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.597915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project da5cd0a152e64ef8a14c201a834c9d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:53.598435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.601055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.622979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c', 'request_id': 'req-210c255c-c929-4f4f-915b-ac758bd56e08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.632913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c', 'request_id': 'req-210c255c-c929-4f4f-915b-ac758bd56e08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.643658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'da5cd0a152e64ef8a14c201a834c9d0c', 'request_id': 'req-210c255c-c929-4f4f-915b-ac758bd56e08'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:53.671673 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3634/7221] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:53 2022] DELETE /identity/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:53.675635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:53.707588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fcd3b-9baa-4a4b-a3ca-7ce69033f983 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:53.912488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:53.913171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:53.913457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:53.913736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:53.934253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=da5cd0a152e64ef8a14c201a834c9d0c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:53.937660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c.: keystone.exception.DomainNotFound: Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:53.965760 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:53.967260 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:53.968795 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:53.971649 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3588/7222] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:18:53 2022] GET /identity/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c => generated 112 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:53.976443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:53.982329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:54.001178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c255c-c929-4f4f-915b-ac758bd56e08 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.006838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.007445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.007730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.008012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/users/190babdd1f6c4474a6f567ead6875644` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.019048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:get_user(user_id=190babdd1f6c4474a6f567ead6875644)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.022471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find user: 190babdd1f6c4474a6f567ead6875644.: keystone.exception.UserNotFound: Could not find user: 190babdd1f6c4474a6f567ead6875644. Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 29 03:18:54.038674 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:54.039821 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 190babdd1f6c4474a6f567ead6875644. Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:54.044576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3635/7223] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:18:53 2022] GET /identity/v3/users/190babdd1f6c4474a6f567ead6875644 => generated 110 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:54.046913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.063081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940ff3a0-5312-422f-bcfb-74e403d40e41 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.086610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.087485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.087916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.089164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/groups/bc7e7674899c49eea9f4681e80e0b75c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.095911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:get_group(group_id=bc7e7674899c49eea9f4681e80e0b75c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.099296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find group: bc7e7674899c49eea9f4681e80e0b75c.: keystone.exception.GroupNotFound: Could not find group: bc7e7674899c49eea9f4681e80e0b75c. Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 29 03:18:54.120447 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:54.122105 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: bc7e7674899c49eea9f4681e80e0b75c. Oct 29 03:18:54.123497 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:54.127228 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3589/7224] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:54 2022] GET /identity/v3/groups/bc7e7674899c49eea9f4681e80e0b75c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:54.132105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.145742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ced3bb-16e8-4b6b-a797-6356aa9da606 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.152601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.153274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.153621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.153621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/groups/bc7e7674899c49eea9f4681e80e0b75c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.166814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:54.178316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find group: bc7e7674899c49eea9f4681e80e0b75c.: keystone.exception.GroupNotFound: Could not find group: bc7e7674899c49eea9f4681e80e0b75c. Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 29 03:18:54.179132 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:54.180357 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: bc7e7674899c49eea9f4681e80e0b75c. Oct 29 03:18:54.181843 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:54.188791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:54.189497 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3636/7225] 10.222.0.16 () {58 vars in 1227 bytes} [Sat Oct 29 03:18:54 2022] DELETE /identity/v3/groups/bc7e7674899c49eea9f4681e80e0b75c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:54.190766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.205398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d4f82-1b9d-47fc-9bca-114849925941 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.234796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.235485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.235770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.236050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/users/190babdd1f6c4474a6f567ead6875644` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.245727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_user(user_id=190babdd1f6c4474a6f567ead6875644)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.249497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find user: 190babdd1f6c4474a6f567ead6875644.: keystone.exception.UserNotFound: Could not find user: 190babdd1f6c4474a6f567ead6875644. Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 29 03:18:54.283664 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:54.284812 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 190babdd1f6c4474a6f567ead6875644. Oct 29 03:18:54.286221 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:54.289355 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3637/7226] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:54 2022] DELETE /identity/v3/users/190babdd1f6c4474a6f567ead6875644 => generated 110 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:54.295256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.312466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb72296-74db-459e-9f12-77030c424b9d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.331126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.332116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.332566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.333007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.345370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99c009-c384-4310-b846-e2512803b58e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.351271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c.: keystone.exception.DomainNotFound: Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:54.363785 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.366021 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:54.367411 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:18:54.368526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.368526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.368526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.368526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.371852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:54.373366 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3638/7227] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:54 2022] PATCH /identity/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c => generated 112 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:18:54.379053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.399697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d668f-04ca-4bf8-a462-1c7e23368821 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.412582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.413519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.414028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.414482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.415288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.417291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.449126 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3639/7228] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 03:18:54 2022] GET /identity/v3/domains => generated 1347 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:18:54.450127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.458546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:54.467703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e1703-82c8-4f30-a5c5-1ee3ca5c2076 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.478898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.480255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.483970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.485252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.487475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:18:54.488018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.493843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.542874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3640/7229] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:18:54 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:18:54.548516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.563586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5de8e-ae8f-43aa-a2e5-853908d5fff1 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.579111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.581845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.587155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.589091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.589375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.590812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.592705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-151697294) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:18:54.594384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.597387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.622097 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3590/7230] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:18:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:18:54.631545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.632868 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3641/7231] 10.222.0.16 () {58 vars in 1197 bytes} [Sat Oct 29 03:18:54 2022] GET /identity/v3/domains?name=tempest-test_domain-151697294 => generated 407 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:54.647074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dd8f1-252f-4401-8154-1edb72e457b9 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.656249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.657842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.658325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.659268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.678711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c.: keystone.exception.DomainNotFound: Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:18:54.692443 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:18:54.693726 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: da5cd0a152e64ef8a14c201a834c9d0c. Oct 29 03:18:54.695498 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:18:54.696686 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3591/7232] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:54 2022] PATCH /identity/v3/domains/da5cd0a152e64ef8a14c201a834c9d0c => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 03:18:54.700131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.733090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0030-848b-4b5d-bc30-d839b8e1f5fa tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.750388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.751061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.751544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.751822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/4d0f0d0810734edfb4023866290a36dd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.783480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4d0f0d0810734edfb4023866290a36dd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:54.787221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:54.925920 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3642/7233] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:54 2022] PATCH /identity/v3/domains/4d0f0d0810734edfb4023866290a36dd => generated 278 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:18:54.926911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:54.940558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0689e-3f27-41dd-bdbd-d96e57540795 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:54.969489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:54.970189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:54.970470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:54.970956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/4d0f0d0810734edfb4023866290a36dd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:54.980126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:54.998496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4d0f0d0810734edfb4023866290a36dd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:55.000608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:55.033445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4d0f0d0810734edfb4023866290a36dd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.046213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4d0f0d0810734edfb4023866290a36dd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.190429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d0f0d0810734edfb4023866290a36dd', 'request_id': 'req-a91e13c7-e4a8-4a67-9171-569de04cb59e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.201427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d0f0d0810734edfb4023866290a36dd', 'request_id': 'req-a91e13c7-e4a8-4a67-9171-569de04cb59e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.218863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d0f0d0810734edfb4023866290a36dd', 'request_id': 'req-a91e13c7-e4a8-4a67-9171-569de04cb59e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.241043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project 4d0f0d0810734edfb4023866290a36dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:55.241604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.242846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.262854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4d0f0d0810734edfb4023866290a36dd', 'request_id': 'req-a91e13c7-e4a8-4a67-9171-569de04cb59e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.264896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4d0f0d0810734edfb4023866290a36dd', 'request_id': 'req-a91e13c7-e4a8-4a67-9171-569de04cb59e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.265697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4d0f0d0810734edfb4023866290a36dd', 'request_id': 'req-a91e13c7-e4a8-4a67-9171-569de04cb59e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.276836 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3592/7234] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:54 2022] DELETE /identity/v3/domains/4d0f0d0810734edfb4023866290a36dd => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:55.281067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:55.284398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:55.299553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f389ccc-a9bc-4cd0-9b3b-88e383aa9bab tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:55.395158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:55.395989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:55.396424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:55.396763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/6aa87c5c822f46579eaf563dd02565da` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:55.438649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6aa87c5c822f46579eaf563dd02565da)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:55.440305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:55.476825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6aa87c5c822f46579eaf563dd02565da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.477568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6aa87c5c822f46579eaf563dd02565da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.550030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6aa87c5c822f46579eaf563dd02565da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.550994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6aa87c5c822f46579eaf563dd02565da'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.560817 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3643/7235] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:55 2022] PATCH /identity/v3/domains/6aa87c5c822f46579eaf563dd02565da => generated 276 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:18:55.564854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:55.588073 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e13c7-e4a8-4a67-9171-569de04cb59e tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:55.680254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:55.681516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:55.682375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:55.694562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/6aa87c5c822f46579eaf563dd02565da` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:55.719194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6aa87c5c822f46579eaf563dd02565da)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:55.722849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:55.810525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6aa87c5c822f46579eaf563dd02565da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.839623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6aa87c5c822f46579eaf563dd02565da'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.841102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:55.931619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa87c5c822f46579eaf563dd02565da', 'request_id': 'req-eb6004ca-69e2-446b-8686-8c6170340f8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.941482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa87c5c822f46579eaf563dd02565da', 'request_id': 'req-eb6004ca-69e2-446b-8686-8c6170340f8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.954877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa87c5c822f46579eaf563dd02565da', 'request_id': 'req-eb6004ca-69e2-446b-8686-8c6170340f8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.977904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project 6aa87c5c822f46579eaf563dd02565da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:55.978246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.979968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.996980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6aa87c5c822f46579eaf563dd02565da', 'request_id': 'req-eb6004ca-69e2-446b-8686-8c6170340f8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:55.998215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6aa87c5c822f46579eaf563dd02565da', 'request_id': 'req-eb6004ca-69e2-446b-8686-8c6170340f8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.000047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6aa87c5c822f46579eaf563dd02565da', 'request_id': 'req-eb6004ca-69e2-446b-8686-8c6170340f8d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.017836 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3593/7236] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:55 2022] DELETE /identity/v3/domains/6aa87c5c822f46579eaf563dd02565da => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:56.022861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:56.030135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:56.065783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86e019-548b-4a3f-ac4c-0da4d96dc085 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:56.180318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:56.203202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:56.204046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:56.204355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:56.204736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/7efa304cac1140d9b1f3370831675e5a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:56.228613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=7efa304cac1140d9b1f3370831675e5a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:56.230925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:56.267301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '7efa304cac1140d9b1f3370831675e5a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.268505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '7efa304cac1140d9b1f3370831675e5a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.327984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '7efa304cac1140d9b1f3370831675e5a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.329414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '7efa304cac1140d9b1f3370831675e5a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.332178 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3644/7237] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:18:56 2022] PATCH /identity/v3/domains/7efa304cac1140d9b1f3370831675e5a => generated 277 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:18:56.340387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:56.344080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:56.366571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6004ca-69e2-446b-8686-8c6170340f8d tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:56.468087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db810aabd420472b8babf632261c13de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8003b7513ff54958b4184f26b906cd89', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:56.468991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:56.469472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:56.469941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] PATH_INFO: `/v3/domains/7efa304cac1140d9b1f3370831675e5a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:56.498134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=7efa304cac1140d9b1f3370831675e5a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:56.500618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:56.532118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '7efa304cac1140d9b1f3370831675e5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.558971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '7efa304cac1140d9b1f3370831675e5a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.643719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:56.657220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efa304cac1140d9b1f3370831675e5a', 'request_id': 'req-743cd64f-ae74-403a-99c6-53a8668b6706'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.681120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efa304cac1140d9b1f3370831675e5a', 'request_id': 'req-743cd64f-ae74-403a-99c6-53a8668b6706'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.694310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efa304cac1140d9b1f3370831675e5a', 'request_id': 'req-743cd64f-ae74-403a-99c6-53a8668b6706'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.723809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] The token cache is being invalidate because project 7efa304cac1140d9b1f3370831675e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:56.724175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.724822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.739738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '7efa304cac1140d9b1f3370831675e5a', 'request_id': 'req-743cd64f-ae74-403a-99c6-53a8668b6706'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.740602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '7efa304cac1140d9b1f3370831675e5a', 'request_id': 'req-743cd64f-ae74-403a-99c6-53a8668b6706'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.741315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-743cd64f-ae74-403a-99c6-53a8668b6706 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '7efa304cac1140d9b1f3370831675e5a', 'request_id': 'req-743cd64f-ae74-403a-99c6-53a8668b6706'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:56.753575 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3594/7238] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:18:56 2022] DELETE /identity/v3/domains/7efa304cac1140d9b1f3370831675e5a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:56.757695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:56.759657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:56.859131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81480e-6295-4493-83b0-adf632b27008 tempest-DomainsTestJSON-1521293408 tempest-DomainsTestJSON-1521293408-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:56.975833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:56.976914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:56.977415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:56.977952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] PATH_INFO: `/v3/users/45adee3b7d4b499e8bfbf8db12d0646e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:56.980112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] RBAC: Authorizing `identity:delete_user(user_id=45adee3b7d4b499e8bfbf8db12d0646e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:56.982362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:57.128302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45adee3b7d4b499e8bfbf8db12d0646e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:57.133214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:57.142212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45adee3b7d4b499e8bfbf8db12d0646e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:57.143650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45adee3b7d4b499e8bfbf8db12d0646e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:57.159696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45adee3b7d4b499e8bfbf8db12d0646e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:57.161060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45adee3b7d4b499e8bfbf8db12d0646e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:57.193731 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3645/7239] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:56 2022] DELETE /identity/v3/users/45adee3b7d4b499e8bfbf8db12d0646e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:57.199545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee843879-f221-4413-b811-717f026c82dd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:57.199939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee843879-f221-4413-b811-717f026c82dd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:57.200373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee843879-f221-4413-b811-717f026c82dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:57.257156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee843879-f221-4413-b811-717f026c82dd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:18:57.258442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee843879-f221-4413-b811-717f026c82dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:57.461486 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3595/7240] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:18:57.589984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:57.592116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:57.721775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8ee7e-ef29-4935-aa7a-715d0d06c7db admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:57.731075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:57.731948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:57.732229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:57.732550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:57.747297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:57.749731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:57.761764 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3646/7241] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:18:58.109059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee843879-f221-4413-b811-717f026c82dd None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:58.111450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee843879-f221-4413-b811-717f026c82dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:58.175929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee843879-f221-4413-b811-717f026c82dd None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:58.198790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:58.198790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:58.198790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:58.198790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] PATH_INFO: `/v3/projects/011b8a3161714d06987de8c58a58c347` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:58.206638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011b8a3161714d06987de8c58a58c347)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:58.206638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:58.308243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011b8a3161714d06987de8c58a58c347', 'request_id': 'req-af3c556d-c147-48f1-a3a9-3e068e44c952'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.326080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011b8a3161714d06987de8c58a58c347', 'request_id': 'req-af3c556d-c147-48f1-a3a9-3e068e44c952'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.334698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011b8a3161714d06987de8c58a58c347', 'request_id': 'req-af3c556d-c147-48f1-a3a9-3e068e44c952'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.390047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] The token cache is being invalidate because project 011b8a3161714d06987de8c58a58c347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:18:58.391813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.393712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.401887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3596/7242] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:58 2022] DELETE /identity/v3/projects/011b8a3161714d06987de8c58a58c347 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:58.403122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:58.420176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b8d12-c2b0-4e64-b737-e58833a0998a service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:18:58.658181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:18:58.660392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:18:58.660617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:18:58.662262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] PATH_INFO: `/v3/users/db810aabd420472b8babf632261c13de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:18:58.665073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db810aabd420472b8babf632261c13de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:18:58.669919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:18:58.828615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db810aabd420472b8babf632261c13de'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.852709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db810aabd420472b8babf632261c13de'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.853409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db810aabd420472b8babf632261c13de'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.863062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db810aabd420472b8babf632261c13de'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.865518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88c04ea6-da59-4193-91fd-fcdc3ab22d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db810aabd420472b8babf632261c13de'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:18:58.885657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:18:58.912521 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3647/7243] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:18:58 2022] DELETE /identity/v3/users/db810aabd420472b8babf632261c13de => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:18:59.881571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:18:59.883306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:18:59.905420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c556d-c147-48f1-a3a9-3e068e44c952 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.002566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:00.090057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.090736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.091018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.091699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] PATH_INFO: `/v3/projects/8003b7513ff54958b4184f26b906cd89` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.092908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8003b7513ff54958b4184f26b906cd89)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.103124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:00.165137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8003b7513ff54958b4184f26b906cd89', 'request_id': 'req-8847013d-1793-4c3b-8846-2b6acfacd0d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:00.172757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8003b7513ff54958b4184f26b906cd89', 'request_id': 'req-8847013d-1793-4c3b-8846-2b6acfacd0d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:00.180131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8003b7513ff54958b4184f26b906cd89', 'request_id': 'req-8847013d-1793-4c3b-8846-2b6acfacd0d7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:00.204746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] The token cache is being invalidate because project 8003b7513ff54958b4184f26b906cd89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:00.205043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:00.205904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8847013d-1793-4c3b-8846-2b6acfacd0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:00.210102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3597/7244] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:18:59 2022] DELETE /identity/v3/projects/8003b7513ff54958b4184f26b906cd89 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:00.215287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.215821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.215943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.239992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:00.242485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:00.332539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3648/7245] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:00.341143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.341453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.341728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.370387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:00.375923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:00.407759 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3598/7246] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:00.411919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:00.435323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7683e27-24ed-40b6-8612-02022263a1b3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.444204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.444798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.445140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.445533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.446284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:00.446768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.450828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:00.478081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3649/7247] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:00.482713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:00.496282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c5900-c32d-4dbc-90ff-12c96402db51 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.527277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.528393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.528958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.529975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.533232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.538431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:00.641094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:00.647775 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3599/7248] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:00 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:00.655152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf35970-bc5a-4ef8-a132-8374014b14a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.725510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:00.730942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:00.799831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.815133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.815408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.815517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.816195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.818184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:00.875874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3650/7249] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:00 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:19:00.880687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:00.895120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2090bc0-a2cc-4d73-b6c6-ab6c3ea91931 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.899903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.900629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.901041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.901311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.902114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.906067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:00.907033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e06101-db9b-45e0-b2cc-9bae8b1c42a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.928319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.929224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.929392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.935625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3651/7250] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:00.939318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.940568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:00.941721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:00.961263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f0480-8e99-4545-bfd3-e6e3651bba70 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:00.977535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d92351-eba5-4ee1-b4a8-78ab91c0d0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:00.980573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d92351-eba5-4ee1-b4a8-78ab91c0d0de admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:00.981378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d92351-eba5-4ee1-b4a8-78ab91c0d0de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:00.981905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d92351-eba5-4ee1-b4a8-78ab91c0d0de admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:00.982781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d92351-eba5-4ee1-b4a8-78ab91c0d0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.985172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d92351-eba5-4ee1-b4a8-78ab91c0d0de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:00.987401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:00.989024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:01.020522 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3652/7251] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:01.020747 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3600/7252] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:19:01.022520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:01.057455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e0aa8-b3fe-490b-a44d-e8ade31f6e6f service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:01.081587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:01.083527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:01.084019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:01.084517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] PATH_INFO: `/v3/projects/1fd6bad7d7d64634b33f4fb07ee45ceb/users/10950d31b4a74fbe8b4500fa6d18fff6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:01.110166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd6bad7d7d64634b33f4fb07ee45ceb, user_id=10950d31b4a74fbe8b4500fa6d18fff6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:01.114234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:01.134011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3601/7253] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:01 2022] PUT /identity/v3/projects/1fd6bad7d7d64634b33f4fb07ee45ceb/users/10950d31b4a74fbe8b4500fa6d18fff6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:01.150341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:01.150627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:01.151334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:01.233460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] MFA Rules not processed for user `10950d31b4a74fbe8b4500fa6d18fff6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:01.245571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:01.327757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:01.426566 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3653/7254] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:01.428033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:01.438181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:01.622510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7d6ba-736a-4632-988f-bd0c6c174e91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:01.631383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:01.633077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:01.633467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:01.634488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:01.635490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:01.644059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:01.714764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:01.717438 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3602/7255] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:01 2022] POST /identity/v3/projects => generated 373 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:01.728880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735485a-8c88-4612-8650-8e03d6b38645 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:01.868657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:01.869878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:01.870268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:01.870630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:01.871578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:01.875835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:01.919716 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3654/7256] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:01 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:19:01.922914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:01.951206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cf3ff-27c8-4484-8e1e-66beba7ca617 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:01.956929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:01.957913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:01.958369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:01.958865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:01.959816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:01.966997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:02.032331 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3603/7257] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:02.036503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:02.063467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d320e6-b400-4a71-ba91-f647e472e4e2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:02.083889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:02.086818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:02.087295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:02.088403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] PATH_INFO: `/v3/projects/baca3910685547809ba98c80274524b1/users/169d9d484921447a88d4ebde51942c7a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:02.127275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=baca3910685547809ba98c80274524b1, user_id=169d9d484921447a88d4ebde51942c7a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:02.131624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:02.182052 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3655/7258] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:02 2022] PUT /identity/v3/projects/baca3910685547809ba98c80274524b1/users/169d9d484921447a88d4ebde51942c7a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:02.186190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:02.202310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443a69c-05b9-4b3c-8356-01ae7cac06ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:02.339277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15479c84-658e-4052-bca0-efd4bff5cd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:02.339927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479c84-658e-4052-bca0-efd4bff5cd78 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:02.340203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479c84-658e-4052-bca0-efd4bff5cd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:02.340943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15479c84-658e-4052-bca0-efd4bff5cd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:02.347621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479c84-658e-4052-bca0-efd4bff5cd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:02.349548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15479c84-658e-4052-bca0-efd4bff5cd78 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:02.369746 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3604/7259] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:02.370055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:02.384715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fd7e16-6ab7-443b-b2a2-c72bbfa79f4e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:02.392550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:02.393700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:02.394191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:02.394644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] PATH_INFO: `/v3/projects/baca3910685547809ba98c80274524b1/users/169d9d484921447a88d4ebde51942c7a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:02.397690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baca3910685547809ba98c80274524b1, user_id=169d9d484921447a88d4ebde51942c7a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:02.404042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:02.427682 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3656/7260] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:02 2022] PUT /identity/v3/projects/baca3910685547809ba98c80274524b1/users/169d9d484921447a88d4ebde51942c7a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:02.441371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:02.442006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:02.442530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:02.533882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] MFA Rules not processed for user `169d9d484921447a88d4ebde51942c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:02.535536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:02.720459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:02.747856 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3605/7261] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:02.750844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:02.770211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4b28-ae38-4380-a77c-b308335bd345 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:02.779528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:02.780071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:02.780356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:02.780647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:02.781267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:02.783287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:02.840309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3657/7262] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:02 2022] POST /identity/v3/projects => generated 334 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:02.846285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:02.870225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ce7ac-01c7-47c4-afe1-aed70c89a894 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:02.905177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:02.907223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:03.045418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:03.046719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.049632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.050155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.050984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:03.055598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:03.056900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a413abe-7583-4ed0-8f3e-f15ca5a763f8 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:03.070276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:03.071129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.071588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.072937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] PATH_INFO: `/v3/users/4802a76fa4d1475aa201d46cbcf8b7ae` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.077133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4802a76fa4d1475aa201d46cbcf8b7ae)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:03.081363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:03.095234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:03.139965 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3606/7263] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:19:02 2022] POST /identity/v3/projects => generated 333 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:03.141536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:03.182710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4802a76fa4d1475aa201d46cbcf8b7ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:03.199521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4802a76fa4d1475aa201d46cbcf8b7ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:03.200720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4802a76fa4d1475aa201d46cbcf8b7ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:03.213990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4802a76fa4d1475aa201d46cbcf8b7ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:03.216652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e85a455f-43f7-408a-b78b-0f56b4f0d19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4802a76fa4d1475aa201d46cbcf8b7ae'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:03.263801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3658/7264] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:02 2022] DELETE /identity/v3/users/4802a76fa4d1475aa201d46cbcf8b7ae => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:03.265980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.266262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.266532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.301469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a97dd6-5b82-4965-9888-48e353f60a14 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:03.306795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:03.315220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:03.438859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:03.439495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.439774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.440045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.440689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:03.445743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:03.457313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3659/7265] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:03.475103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:03.479915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:03.577706 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3607/7266] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:03 2022] POST /identity/v3/projects => generated 356 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:03.579133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:03.583596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:03.616469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:03.661380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813cfa6-3372-414d-ace2-6cdf826da9c0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:03.816047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:03.822209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b91f2-dffb-4805-9513-90bb3cddd43c tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:03.832903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:03.833641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.833975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.834710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.834906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:03.836977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:03.845394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:03.846071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.846349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.846623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.905058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3608/7267] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 03:19:03 2022] GET /identity/v3/projects => generated 6807 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:03.910808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:03.940100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda6addd-3e78-45f4-b2a9-608304eb96d6 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:03.970956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:03.971895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:03.972486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:03.972981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:03.973910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:03.974452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:03.976555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:04.011621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:04.013070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:04.016364 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3609/7268] 10.222.0.16 () {58 vars in 1158 bytes} [Sat Oct 29 03:19:03 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:04.021294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:04.028983 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3660/7269] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:19:04.035069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76573-312b-48c0-bb4f-1aae361b0da7 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:04.049429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:04.051309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:04.051309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:04.051309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:04.051641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Adding query filter params (parent_id=4168b74615424c60aa57dcc80c26632a) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:04.051985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:04.054591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:04.101509 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3610/7270] 10.222.0.16 () {58 vars in 1216 bytes} [Sat Oct 29 03:19:04 2022] GET /identity/v3/projects?parent_id=4168b74615424c60aa57dcc80c26632a => generated 496 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:04.103012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:04.121192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd6588e-228c-409b-9410-d0dc0abb476b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:04.133185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:04.134084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:04.135456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:04.136631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects/b08f3b30091f42668446d525a29a970f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:04.140258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b08f3b30091f42668446d525a29a970f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:04.145818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:04.291806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b08f3b30091f42668446d525a29a970f', 'request_id': 'req-5abc1721-113c-45fd-8bd5-93495f00eabb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.313318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b08f3b30091f42668446d525a29a970f', 'request_id': 'req-5abc1721-113c-45fd-8bd5-93495f00eabb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.332543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b08f3b30091f42668446d525a29a970f', 'request_id': 'req-5abc1721-113c-45fd-8bd5-93495f00eabb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.362567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] The token cache is being invalidate because project b08f3b30091f42668446d525a29a970f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:04.362858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.365681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.368438 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3661/7271] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:04 2022] DELETE /identity/v3/projects/b08f3b30091f42668446d525a29a970f => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:04.372742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:04.374541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:04.406016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1e8c0-f9c3-44bf-91bb-fff58ea155c4 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:04.549551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:04.550190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:04.550472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:04.550744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects/4168b74615424c60aa57dcc80c26632a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:04.552115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4168b74615424c60aa57dcc80c26632a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:04.554173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:04.612691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:04.614242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:04.675030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4168b74615424c60aa57dcc80c26632a', 'request_id': 'req-f79f4518-153d-4cc3-8468-c5aacf2b1857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.689528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4168b74615424c60aa57dcc80c26632a', 'request_id': 'req-f79f4518-153d-4cc3-8468-c5aacf2b1857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.707902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4168b74615424c60aa57dcc80c26632a', 'request_id': 'req-f79f4518-153d-4cc3-8468-c5aacf2b1857'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.731106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] The token cache is being invalidate because project 4168b74615424c60aa57dcc80c26632a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:04.731502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.732291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:04.737103 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3611/7272] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:04 2022] DELETE /identity/v3/projects/4168b74615424c60aa57dcc80c26632a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:04.738105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:04.747043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:04.762777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:04.818758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1721-113c-45fd-8bd5-93495f00eabb tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:04.867438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f4518-153d-4cc3-8468-c5aacf2b1857 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:04.873282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '169d9d484921447a88d4ebde51942c7a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'baca3910685547809ba98c80274524b1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:04.874300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:04.874744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:04.875165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] PATH_INFO: `/v3/projects/ee65816d6bec48408ac910e14122bff3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:04.876678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ee65816d6bec48408ac910e14122bff3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:04.879182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:04.914513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:05.002061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee65816d6bec48408ac910e14122bff3', 'request_id': 'req-e7baeece-9dd1-419b-85ab-17cf6ad50d17'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.017640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee65816d6bec48408ac910e14122bff3', 'request_id': 'req-e7baeece-9dd1-419b-85ab-17cf6ad50d17'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.033728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee65816d6bec48408ac910e14122bff3', 'request_id': 'req-e7baeece-9dd1-419b-85ab-17cf6ad50d17'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.048749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:05.049612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:05.049961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:05.050235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] PATH_INFO: `/v3/projects/9bbda688bf8f4763b5f6cd46530c0e44` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:05.059437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] The token cache is being invalidate because project ee65816d6bec48408ac910e14122bff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:05.059930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.060490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.061547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbda688bf8f4763b5f6cd46530c0e44)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:05.063168 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3612/7273] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:04 2022] DELETE /identity/v3/projects/ee65816d6bec48408ac910e14122bff3 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:05.067677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:05.070539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:05.071959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:05.172857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbda688bf8f4763b5f6cd46530c0e44', 'request_id': 'req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.189512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbda688bf8f4763b5f6cd46530c0e44', 'request_id': 'req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.194511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baeece-9dd1-419b-85ab-17cf6ad50d17 tempest-ListProjectsTestJSON-76333861 tempest-ListProjectsTestJSON-76333861-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:05.200195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbda688bf8f4763b5f6cd46530c0e44', 'request_id': 'req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.226521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] The token cache is being invalidate because project 9bbda688bf8f4763b5f6cd46530c0e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:05.227033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.229026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.232439 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3662/7274] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:04 2022] DELETE /identity/v3/projects/9bbda688bf8f4763b5f6cd46530c0e44 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:05.237248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:05.239408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:05.296298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:05.325993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:05.327152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:05.327358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:05.327625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] PATH_INFO: `/v3/users/10950d31b4a74fbe8b4500fa6d18fff6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:05.329129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=10950d31b4a74fbe8b4500fa6d18fff6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:05.332485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:05.402604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e9e96-f39c-4c9f-a62f-8d9b4251034e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:05.408025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:05.408733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:05.409016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:05.409290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] PATH_INFO: `/v3/users/07b3453302a142d394e53a6069e7f6b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:05.411014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07b3453302a142d394e53a6069e7f6b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:05.413043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:05.441507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10950d31b4a74fbe8b4500fa6d18fff6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.479141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10950d31b4a74fbe8b4500fa6d18fff6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.479980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10950d31b4a74fbe8b4500fa6d18fff6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.505375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10950d31b4a74fbe8b4500fa6d18fff6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.506627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a227e0c1-073d-4eb1-9a12-1a2900a81e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10950d31b4a74fbe8b4500fa6d18fff6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.521005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07b3453302a142d394e53a6069e7f6b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.534476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07b3453302a142d394e53a6069e7f6b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.535323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07b3453302a142d394e53a6069e7f6b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.537255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:05.546683 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3613/7275] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:05 2022] DELETE /identity/v3/users/10950d31b4a74fbe8b4500fa6d18fff6 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:05.551215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:05.551497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:05.551774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:05.557935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07b3453302a142d394e53a6069e7f6b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.559303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07b3453302a142d394e53a6069e7f6b3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:05.590833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:05.592066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:05.603331 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3663/7276] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:05 2022] DELETE /identity/v3/users/07b3453302a142d394e53a6069e7f6b3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:05.733910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3614/7277] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:05.757909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:05.761112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:05.868414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c7273-6b74-4bc8-8c8e-10e84f90e297 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:05.882247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:05.883996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:05.884353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:05.884631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:06.060480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:06.062004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:06.073353 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3664/7278] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:06.500937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:06.509235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:06.529590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a334d-de6d-48ea-a5dd-ff0d950960f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:06.534827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:06.535558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:06.535761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:06.536025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] PATH_INFO: `/v3/projects/1fd6bad7d7d64634b33f4fb07ee45ceb` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:06.537173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd6bad7d7d64634b33f4fb07ee45ceb)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:06.539202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:06.607177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:06.609425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:06.635740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd6bad7d7d64634b33f4fb07ee45ceb', 'request_id': 'req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.640512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4b2aa-9b41-4958-8518-8a7d2a0cdfcb service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:06.643746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd6bad7d7d64634b33f4fb07ee45ceb', 'request_id': 'req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.651313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:06.656608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd6bad7d7d64634b33f4fb07ee45ceb', 'request_id': 'req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.687504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] The token cache is being invalidate because project 1fd6bad7d7d64634b33f4fb07ee45ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:06.688268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.689664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.692103 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3615/7279] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:06 2022] DELETE /identity/v3/projects/1fd6bad7d7d64634b33f4fb07ee45ceb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:06.696066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:06.700549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:06.750698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:06.751438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:06.751877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:06.752163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] PATH_INFO: `/v3/projects/b16c75ae69534efdbd8da0046509ef7e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:06.754407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b16c75ae69534efdbd8da0046509ef7e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:06.756532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:06.790173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:06.820471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6b4e4-31fd-48ea-bf19-7bb58830f250 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:06.823104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b16c75ae69534efdbd8da0046509ef7e', 'request_id': 'req-6db3f37b-9433-4441-9f57-d7d7ffeee044'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.833670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b16c75ae69534efdbd8da0046509ef7e', 'request_id': 'req-6db3f37b-9433-4441-9f57-d7d7ffeee044'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.843566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b16c75ae69534efdbd8da0046509ef7e', 'request_id': 'req-6db3f37b-9433-4441-9f57-d7d7ffeee044'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.870505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] The token cache is being invalidate because project b16c75ae69534efdbd8da0046509ef7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:06.871041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.872397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6db3f37b-9433-4441-9f57-d7d7ffeee044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.874456 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3665/7280] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:06 2022] DELETE /identity/v3/projects/b16c75ae69534efdbd8da0046509ef7e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:06.880032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053cec-4ca7-403f-b0d3-6fe94352656b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:06.880615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053cec-4ca7-403f-b0d3-6fe94352656b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:06.881381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6053cec-4ca7-403f-b0d3-6fe94352656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:06.903717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:06.904379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:06.904660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:06.904937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] PATH_INFO: `/v3/users/169d9d484921447a88d4ebde51942c7a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:06.907031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169d9d484921447a88d4ebde51942c7a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:06.909058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:06.922333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e6053cec-4ca7-403f-b0d3-6fe94352656b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:06.924480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e6053cec-4ca7-403f-b0d3-6fe94352656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:06.938537 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3666/7281] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:06.947967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:06.948365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:06.948662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:06.976809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:06.977835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169d9d484921447a88d4ebde51942c7a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:06.978569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:07.002383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169d9d484921447a88d4ebde51942c7a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:07.003098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169d9d484921447a88d4ebde51942c7a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:07.007192 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3667/7282] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:19:07.011729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.016202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169d9d484921447a88d4ebde51942c7a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:07.016933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169d9d484921447a88d4ebde51942c7a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:07.028840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64bedfc-10e3-4bd1-a313-1b74b2f9722b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.037971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.038329 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3616/7283] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:06 2022] DELETE /identity/v3/users/169d9d484921447a88d4ebde51942c7a => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:07.039374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.040041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.040414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.041256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:07.041749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.043848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.058335 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3668/7284] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:19:07.062600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.064454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:07.084082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:07.162222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c7e47-6e09-4039-86dc-51fc9c1d34b6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.187456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.188454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.188835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.189479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.190766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.195946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.249752 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3617/7285] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:07 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:07.251286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.262401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f566288-7331-4431-b962-cac051c77ca1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.331039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.331673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.332216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.332497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.333192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.335290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.364441 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3669/7286] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:07 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:07.368296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.385674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5a59-1d01-44d2-90d4-579d4bde8404 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.392860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.393988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.395385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.395766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.396733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.398668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.415231 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3618/7287] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:19:07.418128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.437993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97d051-7436-400f-8f26-614605b29660 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.452118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334dff4e-a5e1-4123-b801-aa267979d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.455352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dff4e-a5e1-4123-b801-aa267979d01d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.456190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dff4e-a5e1-4123-b801-aa267979d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.456190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334dff4e-a5e1-4123-b801-aa267979d01d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.457418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dff4e-a5e1-4123-b801-aa267979d01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.459304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334dff4e-a5e1-4123-b801-aa267979d01d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.472447 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3670/7288] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:07 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:07.478239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.496869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fb599-a43f-4f94-9592-9aab44bcbbd1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.502144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.504107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.504555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.505014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] PATH_INFO: `/v3/projects/8defd456714c423287de1e24b274c80a/users/883ffb8165f94b5fb9a232f715f22c85/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.563026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8defd456714c423287de1e24b274c80a, user_id=883ffb8165f94b5fb9a232f715f22c85, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.566370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.590363 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3619/7289] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:07 2022] PUT /identity/v3/projects/8defd456714c423287de1e24b274c80a/users/883ffb8165f94b5fb9a232f715f22c85/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:07.600510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.600831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.601062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.648784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] MFA Rules not processed for user `883ffb8165f94b5fb9a232f715f22c85`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:07.650899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:07.737352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:07.764563 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3671/7290] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:19:07.776484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.778535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:07.912700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fe2de-8e5d-49e9-bd35-e3aaed7ca48c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:07.920959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c54f92-23e5-4e26-bc57-1d5499af88eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:07.921929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c54f92-23e5-4e26-bc57-1d5499af88eb service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:07.922060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c54f92-23e5-4e26-bc57-1d5499af88eb service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:07.923180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c54f92-23e5-4e26-bc57-1d5499af88eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:07.936970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c54f92-23e5-4e26-bc57-1d5499af88eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:07.939687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c54f92-23e5-4e26-bc57-1d5499af88eb service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:07.953536 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3620/7291] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:07.983186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:07.984791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:08.108353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce6d1b-8c3a-4ceb-99b6-5026dc3b4080 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:08.114193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:08.114845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.115679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.115958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] PATH_INFO: `/v3/projects/baca3910685547809ba98c80274524b1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.118034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baca3910685547809ba98c80274524b1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:08.120783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:08.199355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baca3910685547809ba98c80274524b1', 'request_id': 'req-6cb85270-dad4-4a81-aa98-bb75851ccb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:08.214639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baca3910685547809ba98c80274524b1', 'request_id': 'req-6cb85270-dad4-4a81-aa98-bb75851ccb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:08.229660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baca3910685547809ba98c80274524b1', 'request_id': 'req-6cb85270-dad4-4a81-aa98-bb75851ccb84'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:08.251995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] The token cache is being invalidate because project baca3910685547809ba98c80274524b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:08.252741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:08.254074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6cb85270-dad4-4a81-aa98-bb75851ccb84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:08.256399 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3672/7292] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:07 2022] DELETE /identity/v3/projects/baca3910685547809ba98c80274524b1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:08.262295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.262575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.262914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.297925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:08.299277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:08.443262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:08.472379 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3621/7293] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:08.481392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.481735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.482710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.506560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:08.507927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:08.521081 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3673/7294] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:08.522214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:08.540088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2de20-29e7-4cd6-a739-b321a9dd05e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:08.557197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:08.559202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.560687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.561091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.561964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:08.563695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:08.570139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:08.588057 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3622/7295] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:08.592547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:08.609019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60cb7be-668b-410c-b9cb-c55a6e585412 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:08.619440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:08.620445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.620794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.623316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.624095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:08.626268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:08.694560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3674/7296] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:08 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:08.696171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:08.708693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4646d-c2e7-49d4-bf43-235a6892b982 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:08.832170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:08.832813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.833081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.833351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.834031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:08.835963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:08.891968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:08.892889 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3623/7297] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:08 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:08.927341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9431128-a4f4-433a-bddf-7a606077310f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:08.962480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:08.962987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:08.963398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:08.963665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:08.964320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:08.972243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:09.003280 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3675/7298] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:09.007605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:09.023053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3ac4b-fb67-44ac-a022-c6fa50ae4382 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:09.036660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a86014d-b5b2-4b2b-bbfb-d9262d67e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:09.040542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86014d-b5b2-4b2b-bbfb-d9262d67e86b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:09.040844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86014d-b5b2-4b2b-bbfb-d9262d67e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:09.041173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a86014d-b5b2-4b2b-bbfb-d9262d67e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:09.042186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86014d-b5b2-4b2b-bbfb-d9262d67e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:09.052930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a86014d-b5b2-4b2b-bbfb-d9262d67e86b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:09.083905 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3624/7299] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:09.087920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:09.099752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cf7ef-784d-4390-9d1c-89b2ac30df89 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:09.106320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:09.107145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:09.107515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:09.107897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] PATH_INFO: `/v3/projects/23bf8348ef8948cf9673e7728bad63a1/users/d89e2db8b2f7418da67adee0da62d42e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:09.187701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bf8348ef8948cf9673e7728bad63a1, user_id=d89e2db8b2f7418da67adee0da62d42e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:09.190634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:09.224375 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3676/7300] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:09 2022] PUT /identity/v3/projects/23bf8348ef8948cf9673e7728bad63a1/users/d89e2db8b2f7418da67adee0da62d42e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:09.235191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:09.235478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:09.235739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:09.278117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] MFA Rules not processed for user `d89e2db8b2f7418da67adee0da62d42e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:09.279823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:09.383625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3625/7301] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:09.388545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:09.407302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3582388-a7a2-4e51-bf68-b951ffeb6a8b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:09.419903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34d164-dc3f-4be2-8f40-addd6eadac2a tempest-DefaultDomainTestJSON-612141273 tempest-DefaultDomainTestJSON-612141273-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89e2db8b2f7418da67adee0da62d42e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bf8348ef8948cf9673e7728bad63a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:09.420713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d164-dc3f-4be2-8f40-addd6eadac2a tempest-DefaultDomainTestJSON-612141273 tempest-DefaultDomainTestJSON-612141273-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:09.421097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d164-dc3f-4be2-8f40-addd6eadac2a tempest-DefaultDomainTestJSON-612141273 tempest-DefaultDomainTestJSON-612141273-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:09.421491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d164-dc3f-4be2-8f40-addd6eadac2a tempest-DefaultDomainTestJSON-612141273 tempest-DefaultDomainTestJSON-612141273-project] PATH_INFO: `/v3/domains/default` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:09.423832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34d164-dc3f-4be2-8f40-addd6eadac2a tempest-DefaultDomainTestJSON-612141273 tempest-DefaultDomainTestJSON-612141273-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:09.426010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34d164-dc3f-4be2-8f40-addd6eadac2a tempest-DefaultDomainTestJSON-612141273 tempest-DefaultDomainTestJSON-612141273-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:09.432717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3677/7302] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Oct 29 03:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:09.433623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:09.546706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:09.567928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f282ac5-c0b9-4d1c-b8df-d5b2c210cb42 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:09.574054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:09.574953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:09.575417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:09.575856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] PATH_INFO: `/v3/users/d89e2db8b2f7418da67adee0da62d42e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:09.578769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89e2db8b2f7418da67adee0da62d42e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:09.580925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:09.671561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89e2db8b2f7418da67adee0da62d42e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:09.689891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89e2db8b2f7418da67adee0da62d42e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:09.691307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89e2db8b2f7418da67adee0da62d42e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:09.699774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89e2db8b2f7418da67adee0da62d42e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:09.701051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89e2db8b2f7418da67adee0da62d42e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:09.724365 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3626/7303] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:09 2022] DELETE /identity/v3/users/d89e2db8b2f7418da67adee0da62d42e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:09.729778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d456-710d-44f2-a293-839714db627d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:09.730098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d456-710d-44f2-a293-839714db627d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:09.730376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5d456-710d-44f2-a293-839714db627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:09.776594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-73d5d456-710d-44f2-a293-839714db627d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:09.777773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73d5d456-710d-44f2-a293-839714db627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:09.800326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:09.929608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3678/7304] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:09.942037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:09.943851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:10.056814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f10f3-249a-4262-8fd8-7f17936accce admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:10.063989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb358a-ae31-493a-a738-9941cd991e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:10.064933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb358a-ae31-493a-a738-9941cd991e08 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:10.065437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb358a-ae31-493a-a738-9941cd991e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:10.065919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb358a-ae31-493a-a738-9941cd991e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:10.083496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb358a-ae31-493a-a738-9941cd991e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:10.085759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb358a-ae31-493a-a738-9941cd991e08 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:10.098440 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3627/7305] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:10.723374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d456-710d-44f2-a293-839714db627d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:10.724794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73d5d456-710d-44f2-a293-839714db627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:10.751781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5d456-710d-44f2-a293-839714db627d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:10.762163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:10.764595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:10.765109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:10.766020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] PATH_INFO: `/v3/projects/23bf8348ef8948cf9673e7728bad63a1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:10.768019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bf8348ef8948cf9673e7728bad63a1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:10.774564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:10.923267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bf8348ef8948cf9673e7728bad63a1', 'request_id': 'req-a78dc21e-98fb-4fc2-a979-c693b53971cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:10.930980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bf8348ef8948cf9673e7728bad63a1', 'request_id': 'req-a78dc21e-98fb-4fc2-a979-c693b53971cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:10.940233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bf8348ef8948cf9673e7728bad63a1', 'request_id': 'req-a78dc21e-98fb-4fc2-a979-c693b53971cb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:10.962342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] The token cache is being invalidate because project 23bf8348ef8948cf9673e7728bad63a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:10.962676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:10.963467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a78dc21e-98fb-4fc2-a979-c693b53971cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:10.965846 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3679/7306] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:10 2022] DELETE /identity/v3/projects/23bf8348ef8948cf9673e7728bad63a1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:10.970639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:10.971644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:10.972132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.022489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:11.023718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:11.171517 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3628/7307] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:11.184335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.184627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.185930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.218293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:11.220416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:11.231136 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3680/7308] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:11.234570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.244713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0e7104-ead5-4bba-9ff3-49f0460f14be None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.249579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.250255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.250538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.250833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.251460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:11.251949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.253763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.263233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:11.271186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.277364 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3629/7309] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:11.281267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b916c-fd55-432c-b9d8-31de640399c8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.286294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.287202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.287572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.288080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.288945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.291799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.343685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.350570 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3681/7310] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:11 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:11.354684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187c977-6875-4747-9bbb-c4d8e2d0ea55 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.430063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.430686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.431090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.431402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.432803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.434917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.477095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.487297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3630/7311] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:11 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:11.493128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea62e8-1a79-4d93-9442-cdcb91fc70ea admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.509266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.510366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.510745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.511132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.511946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.513880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.534026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.535123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3682/7312] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:11.549913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee987560-bd38-41bf-9d8e-4c64e0d2027e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.563592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4709e-f73e-483a-8033-2bef99ec1bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.564336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4709e-f73e-483a-8033-2bef99ec1bdb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.564716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4709e-f73e-483a-8033-2bef99ec1bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.565084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4709e-f73e-483a-8033-2bef99ec1bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.565902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4709e-f73e-483a-8033-2bef99ec1bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.568009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4709e-f73e-483a-8033-2bef99ec1bdb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.585409 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3631/7313] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:19:11.586295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.597094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb46ab-5cd8-425d-a2a3-d9b071304c86 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.603200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.604116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.605315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.605718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] PATH_INFO: `/v3/projects/efca564a031441f3b0db8d4ec5436ffb/users/43d1ccb6c4974c9dab25ee34a58ab016/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.624562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efca564a031441f3b0db8d4ec5436ffb, user_id=43d1ccb6c4974c9dab25ee34a58ab016, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.627448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.641819 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3683/7314] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:11 2022] PUT /identity/v3/projects/efca564a031441f3b0db8d4ec5436ffb/users/43d1ccb6c4974c9dab25ee34a58ab016/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:11.653083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.653490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.653894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.699749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] MFA Rules not processed for user `43d1ccb6c4974c9dab25ee34a58ab016`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:11.701171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:11.844078 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3632/7315] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:11.847392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.867576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3afd01-ed5b-4c43-8369-0a98b50be6a1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.885316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.886132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.886409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.886813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.888975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.890602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:11.935677 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3684/7316] 10.222.0.16 () {60 vars in 1299 bytes} [Sat Oct 29 03:19:11 2022] POST /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2 => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:11.937129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:11.951724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea574550-5f3c-4cf1-8ef6-b6c13576fb2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:11.972805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:11.978864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:11.978864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:11.978864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/5ae7b911e71348d0b801bac749e140c2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:11.982462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016, credential_id=5ae7b911e71348d0b801bac749e140c2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:11.983935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.030247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3633/7317] 10.222.0.16 () {58 vars in 1380 bytes} [Sat Oct 29 03:19:11 2022] DELETE /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/5ae7b911e71348d0b801bac749e140c2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:12.035143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.049540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bb259-a35a-4790-b548-74a6af0ad7de tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.062730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.063405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.063688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.063965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.064592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.066447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.097787 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3685/7318] 10.222.0.16 () {60 vars in 1299 bytes} [Sat Oct 29 03:19:12 2022] POST /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2 => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:12.098712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.109332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eae47d-d48a-403b-8cee-ea029752269f tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.116553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.117558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.122078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.122445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/2835959b975f4b399c8554bacb9c73a8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.125530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016, credential_id=2835959b975f4b399c8554bacb9c73a8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.128975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.164264 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3634/7319] 10.222.0.16 () {58 vars in 1380 bytes} [Sat Oct 29 03:19:12 2022] DELETE /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/2835959b975f4b399c8554bacb9c73a8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:12.169071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.181772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac579a-16a7-496b-a069-2dc03bd3a4a6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.200159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.202166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.202687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.203204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/2835959b975f4b399c8554bacb9c73a8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.207837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Could not find credential: beacbe955473f3227865da87971f3a23be084b079ecee7572794433bcdb7c39d.: keystone.exception.CredentialNotFound: Could not find credential: beacbe955473f3227865da87971f3a23be084b079ecee7572794433bcdb7c39d. Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 29 03:19:12.236136 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:19:12.237455 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: beacbe955473f3227865da87971f3a23be084b079ecee7572794433bcdb7c39d. Oct 29 03:19:12.238917 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:19:12.240774 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3686/7320] 10.222.0.16 () {58 vars in 1377 bytes} [Sat Oct 29 03:19:12 2022] GET /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/2835959b975f4b399c8554bacb9c73a8 => generated 148 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:19:12.246530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.261011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab21c2-b7d0-4839-a714-ce265381549c tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.273658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.274750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.275259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.275815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.276659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.281427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.313432 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3635/7321] 10.222.0.16 () {60 vars in 1299 bytes} [Sat Oct 29 03:19:12 2022] POST /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2 => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:12.318024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.358202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b60ab0-0acd-4d8a-9d27-7640b6cbdd73 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.363340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.364388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.364763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.366239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.366923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.368792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.405854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3687/7322] 10.222.0.16 () {60 vars in 1299 bytes} [Sat Oct 29 03:19:12 2022] POST /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2 => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:12.408961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.430818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9008b9-9e5b-4b8c-a93d-0b91f3fedc79 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.444694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.445599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.446069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.446504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.447255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.449151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.486405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.486640 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3636/7323] 10.222.0.16 () {58 vars in 1278 bytes} [Sat Oct 29 03:19:12 2022] GET /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2 => generated 865 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:12.512502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1bc18-2f1d-44e6-bc3c-72be4a864020 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.523852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.523852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.523852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.524389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/3b0118327ca748d58241fc4633e05712` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.541051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016, credential_id=3b0118327ca748d58241fc4633e05712)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.551675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.597892 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3688/7324] 10.222.0.16 () {58 vars in 1380 bytes} [Sat Oct 29 03:19:12 2022] DELETE /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/3b0118327ca748d58241fc4633e05712 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:12.602036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.620717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce465d-ec51-40d0-a3ee-7e270a2118b6 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.639728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.640441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.640708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.640992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/1cdba8a77ba54bbc9184148e3933da49` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.643468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016, credential_id=1cdba8a77ba54bbc9184148e3933da49)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.645200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.669142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:12.673719 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3637/7325] 10.222.0.16 () {58 vars in 1380 bytes} [Sat Oct 29 03:19:12 2022] DELETE /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/1cdba8a77ba54bbc9184148e3933da49 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:12.683468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.727074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280be6f-3fe3-427f-b379-d37993d0d235 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.732103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.732798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.733083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.733533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.734530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.744593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.810408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3689/7326] 10.222.0.16 () {60 vars in 1299 bytes} [Sat Oct 29 03:19:12 2022] POST /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2 => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:19:12.814678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.843713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f69dd-57e8-4375-8945-033deff38e2e tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.863832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.864588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.864877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.865155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/faccb78672904dbb918fc448210a7af0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.867686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016, credential_id=faccb78672904dbb918fc448210a7af0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.869320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.878717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:12.885932 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3638/7327] 10.222.0.16 () {58 vars in 1377 bytes} [Sat Oct 29 03:19:12 2022] GET /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/faccb78672904dbb918fc448210a7af0 => generated 367 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:12.893486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1588f7-c9cf-4016-b2f2-9049a45f4de5 tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:12.899450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8a8e3-9b5d-405a-9630-68cf30937e7a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '43d1ccb6c4974c9dab25ee34a58ab016', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'efca564a031441f3b0db8d4ec5436ffb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:12.900754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8a8e3-9b5d-405a-9630-68cf30937e7a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:12.901047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8a8e3-9b5d-405a-9630-68cf30937e7a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:12.901357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8a8e3-9b5d-405a-9630-68cf30937e7a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/faccb78672904dbb918fc448210a7af0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:12.903755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8a8e3-9b5d-405a-9630-68cf30937e7a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=43d1ccb6c4974c9dab25ee34a58ab016, credential_id=faccb78672904dbb918fc448210a7af0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:12.907076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8a8e3-9b5d-405a-9630-68cf30937e7a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:12.926299 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3690/7328] 10.222.0.16 () {58 vars in 1380 bytes} [Sat Oct 29 03:19:12 2022] DELETE /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016/credentials/OS-EC2/faccb78672904dbb918fc448210a7af0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:12.931612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:13.010449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085bfd-4e3e-4cd8-82ad-892b588d427a tempest-EC2CredentialsTest-1247673266 tempest-EC2CredentialsTest-1247673266-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:13.018031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:13.019680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:13.021019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:13.029742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] PATH_INFO: `/v3/users/43d1ccb6c4974c9dab25ee34a58ab016` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:13.029742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43d1ccb6c4974c9dab25ee34a58ab016)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:13.030203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:13.126041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43d1ccb6c4974c9dab25ee34a58ab016'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:13.144164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43d1ccb6c4974c9dab25ee34a58ab016'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:13.145499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43d1ccb6c4974c9dab25ee34a58ab016'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:13.154606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43d1ccb6c4974c9dab25ee34a58ab016'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:13.155866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43d1ccb6c4974c9dab25ee34a58ab016'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:13.174015 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3639/7329] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:12 2022] DELETE /identity/v3/users/43d1ccb6c4974c9dab25ee34a58ab016 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:13.178724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:13.179274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:13.179860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:13.205171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:13.207331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:13.313098 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3691/7330] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:19:13.323845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:13.326561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:13.427647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75fc22-779b-45c5-b491-29a1a98a1890 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:13.432981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa1e3c-0985-4855-aba1-67aa820227ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:13.433665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa1e3c-0985-4855-aba1-67aa820227ca service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:13.433981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa1e3c-0985-4855-aba1-67aa820227ca service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:13.434255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa1e3c-0985-4855-aba1-67aa820227ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:13.445767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa1e3c-0985-4855-aba1-67aa820227ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:13.448080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa1e3c-0985-4855-aba1-67aa820227ca service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:13.462680 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3640/7331] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:14.094618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:14.097214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:14.132577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939640fb-b7f8-44b7-b790-1de87c7962e0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:14.143188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:14.143742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.144018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.144291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] PATH_INFO: `/v3/projects/efca564a031441f3b0db8d4ec5436ffb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.145453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efca564a031441f3b0db8d4ec5436ffb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:14.148686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:14.223351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efca564a031441f3b0db8d4ec5436ffb', 'request_id': 'req-e49353b2-14a2-428b-af77-499bbdf23b01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:14.235235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efca564a031441f3b0db8d4ec5436ffb', 'request_id': 'req-e49353b2-14a2-428b-af77-499bbdf23b01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:14.245521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efca564a031441f3b0db8d4ec5436ffb', 'request_id': 'req-e49353b2-14a2-428b-af77-499bbdf23b01'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:14.264395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] The token cache is being invalidate because project efca564a031441f3b0db8d4ec5436ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:14.265839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:14.266805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e49353b2-14a2-428b-af77-499bbdf23b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:14.268623 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3692/7332] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:14 2022] DELETE /identity/v3/projects/efca564a031441f3b0db8d4ec5436ffb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:14.273985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.274515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.274662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.294710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:14.296814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:14.358168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:14.483297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3641/7333] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:19:14.491045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.491336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.491612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.518161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:14.519396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:14.532632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:14.533029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3693/7334] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:14.543861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5c6ce-0b9a-4999-a7bd-ab62f778ac12 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:14.548747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:14.549381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.549666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.550029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.550693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:14.551004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:14.552724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:14.580693 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3642/7335] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:14.585084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:14.597303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b727445-b195-4661-9d48-fd0f3ac316e1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:14.603620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:14.606108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.607403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.607860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.609075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:14.612007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:14.651661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:14.666251 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3694/7336] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:14 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:14.667934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:14.682240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5778b7-689a-4acf-8084-46f145125d99 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:14.785111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:14.785743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.786118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.786393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.787036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:14.789388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:14.817702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3643/7337] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:14 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:14.822704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:14.842174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61850b6-bb35-44bf-903d-25d4997e3d53 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:14.852670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:14.853305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.853580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.853980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.857870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:14.863372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:14.895760 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3695/7338] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:14.900554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:14.918599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eef70da-bfc2-4ea0-9f17-03477470616e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:14.934539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94365bf2-d948-4bdd-9092-5d9c13c5c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:14.941581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94365bf2-d948-4bdd-9092-5d9c13c5c90e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:14.941949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94365bf2-d948-4bdd-9092-5d9c13c5c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:14.942391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94365bf2-d948-4bdd-9092-5d9c13c5c90e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:14.945062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94365bf2-d948-4bdd-9092-5d9c13c5c90e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:14.949373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94365bf2-d948-4bdd-9092-5d9c13c5c90e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:14.988775 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3644/7339] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:14.990618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:15.030986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09978-a5fc-41e9-850f-b41c674a982d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:15.040410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:15.041377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.041867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.042345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] PATH_INFO: `/v3/projects/e11d63df7c7d4e199f77a8c7f5d5c88b/users/38fde93d198243f0b9dfe442246e7668/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.086085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11d63df7c7d4e199f77a8c7f5d5c88b, user_id=38fde93d198243f0b9dfe442246e7668, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:15.089772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:15.123498 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3696/7340] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:14 2022] PUT /identity/v3/projects/e11d63df7c7d4e199f77a8c7f5d5c88b/users/38fde93d198243f0b9dfe442246e7668/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:15.137461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.137822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.138107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.198583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] MFA Rules not processed for user `38fde93d198243f0b9dfe442246e7668`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:15.200162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:15.359910 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3645/7341] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:15.362081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:15.491358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a6216-e28d-4ca4-9f53-674d9d801dba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:15.502290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:15.502935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.503212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.503623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.504327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:15.506390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:15.538926 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3697/7342] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:15 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:15.549759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:15.561647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebdfa0-65db-4e73-82be-858ea781dbc7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:15.578314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:15.658804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:15.659448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.660652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.660930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.661579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:15.665202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:15.711475 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3646/7343] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:15 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:15.713792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:15.727202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a69f9-aa43-44cb-9749-af870d623754 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:15.732512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:15.733285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.733581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.733858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.734566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:15.737238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:15.757566 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3698/7344] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:15.758984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:15.771679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dbf5d-dfd7-441a-853b-d6fc01873adc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:15.778552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c2b3dc-efd0-43ce-b365-bc07bb35f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:15.779434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b3dc-efd0-43ce-b365-bc07bb35f189 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.779795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b3dc-efd0-43ce-b365-bc07bb35f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.780137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c2b3dc-efd0-43ce-b365-bc07bb35f189 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.780859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2b3dc-efd0-43ce-b365-bc07bb35f189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:15.782602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c2b3dc-efd0-43ce-b365-bc07bb35f189 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:15.798996 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3647/7345] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:19:15.800288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:15.812020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cac1db-f194-4bb9-b55b-824eeb831550 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:15.817243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:15.818687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.819048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.819327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] PATH_INFO: `/v3/projects/6375f05970214c39bd76fa1430e01655/users/0f46d306136743d58bca44aaafbaedfa/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.836722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6375f05970214c39bd76fa1430e01655, user_id=0f46d306136743d58bca44aaafbaedfa, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:15.842582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:15.882937 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3699/7346] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:15 2022] PUT /identity/v3/projects/6375f05970214c39bd76fa1430e01655/users/0f46d306136743d58bca44aaafbaedfa/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:15.884849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112512e9-d546-4c06-9fe7-ce090243e470 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:15.885289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112512e9-d546-4c06-9fe7-ce090243e470 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:15.885622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112512e9-d546-4c06-9fe7-ce090243e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:15.952926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-112512e9-d546-4c06-9fe7-ce090243e470 None None] MFA Rules not processed for user `0f46d306136743d58bca44aaafbaedfa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:15.954217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-112512e9-d546-4c06-9fe7-ce090243e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:16.142603 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3648/7347] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:16.143188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:16.296089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d06f2-0ac1-4fd9-85fe-865b2eb0af53 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:16.301195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656dfcf-258b-4781-9412-1e35605dbe08 tempest-IdentityV3ProjectsTest-1652854334 tempest-IdentityV3ProjectsTest-1652854334-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38fde93d198243f0b9dfe442246e7668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e11d63df7c7d4e199f77a8c7f5d5c88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:16.302703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656dfcf-258b-4781-9412-1e35605dbe08 tempest-IdentityV3ProjectsTest-1652854334 tempest-IdentityV3ProjectsTest-1652854334-project] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:16.302972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656dfcf-258b-4781-9412-1e35605dbe08 tempest-IdentityV3ProjectsTest-1652854334 tempest-IdentityV3ProjectsTest-1652854334-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:16.304852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656dfcf-258b-4781-9412-1e35605dbe08 tempest-IdentityV3ProjectsTest-1652854334 tempest-IdentityV3ProjectsTest-1652854334-project] PATH_INFO: `/v3/users/38fde93d198243f0b9dfe442246e7668/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:16.310138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656dfcf-258b-4781-9412-1e35605dbe08 tempest-IdentityV3ProjectsTest-1652854334 tempest-IdentityV3ProjectsTest-1652854334-project] RBAC: Authorizing `identity:list_user_projects(user_id=38fde93d198243f0b9dfe442246e7668)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:16.311975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656dfcf-258b-4781-9412-1e35605dbe08 tempest-IdentityV3ProjectsTest-1652854334 tempest-IdentityV3ProjectsTest-1652854334-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:16.428931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:16.486351 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3700/7348] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:19:16 2022] GET /identity/v3/users/38fde93d198243f0b9dfe442246e7668/projects => generated 517 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:19:16.488395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:16.490261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:16.493189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:16.534292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] MFA Rules not processed for user `38fde93d198243f0b9dfe442246e7668`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:16.536097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:16.569456 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3649/7349] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:16.574472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:16.574766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:16.575040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:16.610397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] MFA Rules not processed for user `38fde93d198243f0b9dfe442246e7668`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:16.611850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:16.706088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.models.token_model [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] User 38fde93d198243f0b9dfe442246e7668 has no access to project 6375f05970214c39bd76fa1430e01655 {{(pid=82080) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 29 03:19:16.726553 n-d-862964-4 devstack@keystone.service[82080]: WARNING keystone.server.flask.application [None req-73b622df-ce8f-4ca1-8761-3a34941df112 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 29 03:19:16.730215 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3701/7350] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:16 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 157 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 29 03:19:16.735405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:16.820914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fa186-5f94-4699-8666-efefdd269cf4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:16.833901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:16.834783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:16.835660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:16.836165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] PATH_INFO: `/v3/users/38fde93d198243f0b9dfe442246e7668` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:16.837737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fde93d198243f0b9dfe442246e7668)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:16.840337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:16.854997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:16.914914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fde93d198243f0b9dfe442246e7668'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:16.940917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fde93d198243f0b9dfe442246e7668'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:16.942114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fde93d198243f0b9dfe442246e7668'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:16.951125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fde93d198243f0b9dfe442246e7668'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:16.952080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fde93d198243f0b9dfe442246e7668'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:16.974674 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3650/7351] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:16 2022] DELETE /identity/v3/users/38fde93d198243f0b9dfe442246e7668 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:16.979069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:16.979350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:16.979807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:17.008081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:17.008081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:17.085699 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3702/7352] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:17.093637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:17.095875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:17.210048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f63b12-689b-4872-841d-7891b3605786 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:17.214737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:17.215650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:17.215985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:17.216323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:17.227297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:17.228963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:17.242391 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3651/7353] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:17.656912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:17.659110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:17.681406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5b2d1-b635-4fea-af39-92fb119858a5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:17.690282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:17.691577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:17.692345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:17.693079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] PATH_INFO: `/v3/projects/e11d63df7c7d4e199f77a8c7f5d5c88b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:17.694734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11d63df7c7d4e199f77a8c7f5d5c88b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:17.699064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:17.821385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11d63df7c7d4e199f77a8c7f5d5c88b', 'request_id': 'req-a529b018-6fdb-44d8-bdef-deca08ee7fa1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:17.839472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11d63df7c7d4e199f77a8c7f5d5c88b', 'request_id': 'req-a529b018-6fdb-44d8-bdef-deca08ee7fa1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:17.846670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11d63df7c7d4e199f77a8c7f5d5c88b', 'request_id': 'req-a529b018-6fdb-44d8-bdef-deca08ee7fa1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:17.874541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] The token cache is being invalidate because project e11d63df7c7d4e199f77a8c7f5d5c88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:17.874837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:17.875580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:17.877624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3703/7354] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:17 2022] DELETE /identity/v3/projects/e11d63df7c7d4e199f77a8c7f5d5c88b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:17.884091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:17.908897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679197-3893-499d-b233-879d07e05dc8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:18.054598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:18.055273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:18.055552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:18.055823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] PATH_INFO: `/v3/users/0f46d306136743d58bca44aaafbaedfa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:18.057616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f46d306136743d58bca44aaafbaedfa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:18.059645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:18.153606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:18.186681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f46d306136743d58bca44aaafbaedfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:18.239138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f46d306136743d58bca44aaafbaedfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:18.239138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f46d306136743d58bca44aaafbaedfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:18.255947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f46d306136743d58bca44aaafbaedfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:18.284387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0a951409-8e4c-4023-836a-3a298155df79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f46d306136743d58bca44aaafbaedfa'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:18.314757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3652/7355] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:17 2022] DELETE /identity/v3/users/0f46d306136743d58bca44aaafbaedfa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:18.878374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:18.880191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:18.914003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529b018-6fdb-44d8-bdef-deca08ee7fa1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:18.950918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:19.035426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.036095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.036457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.036812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] PATH_INFO: `/v3/projects/6375f05970214c39bd76fa1430e01655` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.038051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6375f05970214c39bd76fa1430e01655)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.042408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:19.115004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6375f05970214c39bd76fa1430e01655', 'request_id': 'req-1660c634-a788-42d1-a629-5f80bd1b4b42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:19.131951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6375f05970214c39bd76fa1430e01655', 'request_id': 'req-1660c634-a788-42d1-a629-5f80bd1b4b42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:19.147966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6375f05970214c39bd76fa1430e01655', 'request_id': 'req-1660c634-a788-42d1-a629-5f80bd1b4b42'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:19.171118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] The token cache is being invalidate because project 6375f05970214c39bd76fa1430e01655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:19.172112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:19.172902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-1660c634-a788-42d1-a629-5f80bd1b4b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:19.175371 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3704/7356] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:18 2022] DELETE /identity/v3/projects/6375f05970214c39bd76fa1430e01655 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:19.180466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.180995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.180995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.201546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:19.203069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:19.311104 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3653/7357] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:19.318705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b604-78de-4de3-944f-252916e6a024 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.319326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b604-78de-4de3-944f-252916e6a024 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.319703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577b604-78de-4de3-944f-252916e6a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.344394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3577b604-78de-4de3-944f-252916e6a024 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:19.346061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3577b604-78de-4de3-944f-252916e6a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:19.358864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3705/7358] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:19.360774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:19.377276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d6374-3c1a-483b-80c6-cc677d886626 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:19.382932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.383607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.383922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.384223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.385235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:19.385676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.387334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:19.419389 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3654/7359] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:19.423741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577b604-78de-4de3-944f-252916e6a024 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:19.518751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577b604-78de-4de3-944f-252916e6a024 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:19.529024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.529959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.530767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.532865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.535568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.538138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:19.590858 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3706/7360] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:19 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:19.595692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:19.613018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460885f7-f0cd-4eb1-af1c-0820ecf66027 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:19.695740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.696297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.696744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.697022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.698052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.700188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:19.760422 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3655/7361] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:19 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:19.761895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:19.777519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f9f16-4375-4256-a31d-22d284b7c6b0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:19.790536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.793279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.793833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.794846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.796185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.798931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:19.824774 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3707/7362] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:19.826079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:19.842047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ce1a-c6f6-4fc5-8bdf-a1c6faa9a463 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:19.851283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98da8c8-ac34-4d08-863f-80a3e29d2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.851934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da8c8-ac34-4d08-863f-80a3e29d2efc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.852346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da8c8-ac34-4d08-863f-80a3e29d2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.852616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da8c8-ac34-4d08-863f-80a3e29d2efc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.853258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da8c8-ac34-4d08-863f-80a3e29d2efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.855710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98da8c8-ac34-4d08-863f-80a3e29d2efc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:19.880289 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3656/7363] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:19.881318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:19.892616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a5354-e249-4540-85c4-9c15e5907a58 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:19.905293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35596561-d116-448b-be41-705977f47d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:19.906018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35596561-d116-448b-be41-705977f47d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:19.906613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35596561-d116-448b-be41-705977f47d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:19.906613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35596561-d116-448b-be41-705977f47d30 admin admin] PATH_INFO: `/v3/projects/ae13b7bd3340461ba556cabf99993d0e/users/e37e17f45e5547789e2fc5b4f35177ae/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:19.951587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35596561-d116-448b-be41-705977f47d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae13b7bd3340461ba556cabf99993d0e, user_id=e37e17f45e5547789e2fc5b4f35177ae, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:19.958967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35596561-d116-448b-be41-705977f47d30 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:20.017727 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3708/7364] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:19 2022] PUT /identity/v3/projects/ae13b7bd3340461ba556cabf99993d0e/users/e37e17f45e5547789e2fc5b4f35177ae/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:20.026691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:20.027107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:20.027750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:20.146970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] MFA Rules not processed for user `e37e17f45e5547789e2fc5b4f35177ae`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:20.150230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:20.163592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:20.254703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3657/7365] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:20.268382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35596561-d116-448b-be41-705977f47d30 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:20.270272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35596561-d116-448b-be41-705977f47d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:20.395741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:20.414957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35596561-d116-448b-be41-705977f47d30 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:20.422603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683a536-7999-4da6-8452-4a9733cd41f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:20.424463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a536-7999-4da6-8452-4a9733cd41f5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:20.427280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a536-7999-4da6-8452-4a9733cd41f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:20.427678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683a536-7999-4da6-8452-4a9733cd41f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:20.449231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683a536-7999-4da6-8452-4a9733cd41f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:20.450962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683a536-7999-4da6-8452-4a9733cd41f5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:20.471560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3709/7366] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:30.251079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:30.466571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:54.069463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:54.245571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fa28e-c879-4f06-9c8b-b41bc95cb10c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:54.256234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:54.256857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:54.257156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:54.257399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] PATH_INFO: `/v3/users/e37e17f45e5547789e2fc5b4f35177ae` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:54.263225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37e17f45e5547789e2fc5b4f35177ae)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:54.265370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:54.343311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37e17f45e5547789e2fc5b4f35177ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:54.382900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37e17f45e5547789e2fc5b4f35177ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:54.385108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37e17f45e5547789e2fc5b4f35177ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:54.405342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37e17f45e5547789e2fc5b4f35177ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:54.407203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37e17f45e5547789e2fc5b4f35177ae'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:54.443606 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3658/7367] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:54 2022] DELETE /identity/v3/users/e37e17f45e5547789e2fc5b4f35177ae => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:54.445974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:54.446464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:54.446594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:54.533072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:54.536280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:54.879289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3710/7368] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:54.907478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:54.909007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:55.138986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57fca8-59d0-4ddb-bd8b-797b8bbf2fe5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:55.147801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:55.148456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:55.148741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:55.149016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:55.176680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:55.179376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:55.208588 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3659/7369] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:19:57.293790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:57.295844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:57.311933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:57.313380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:57.343973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b95ec-7478-4edf-af7b-46f47b8fa09f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:57.351770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481bdb3-a174-4de6-9c16-9686194b9e24 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:57.363554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:57.364465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:57.364761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:57.365038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] PATH_INFO: `/v3/users/883ffb8165f94b5fb9a232f715f22c85` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:57.366567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883ffb8165f94b5fb9a232f715f22c85)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:57.370569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:57.378132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:57.379617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:57.381047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:57.381459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] PATH_INFO: `/v3/projects/ae13b7bd3340461ba556cabf99993d0e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:57.383275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae13b7bd3340461ba556cabf99993d0e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:57.385580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:57.457018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:57.514460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae13b7bd3340461ba556cabf99993d0e', 'request_id': 'req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.527857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae13b7bd3340461ba556cabf99993d0e', 'request_id': 'req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.550572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae13b7bd3340461ba556cabf99993d0e', 'request_id': 'req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.577328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] The token cache is being invalidate because project ae13b7bd3340461ba556cabf99993d0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:57.577733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.580848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ee0cb79c-43ec-4616-8ad0-0ef938bf1259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.584338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3660/7370] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:57 2022] DELETE /identity/v3/projects/ae13b7bd3340461ba556cabf99993d0e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:57.589292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed7f4-ad54-4e89-aea7-04db77427764 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:57.589861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed7f4-ad54-4e89-aea7-04db77427764 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:57.590336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abed7f4-ad54-4e89-aea7-04db77427764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:57.642670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7abed7f4-ad54-4e89-aea7-04db77427764 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:57.646252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7abed7f4-ad54-4e89-aea7-04db77427764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:57.660985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883ffb8165f94b5fb9a232f715f22c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.707553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883ffb8165f94b5fb9a232f715f22c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.708343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883ffb8165f94b5fb9a232f715f22c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.755701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883ffb8165f94b5fb9a232f715f22c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.758024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4f99fddd-7fcd-44bb-b176-7ddfe15e7547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883ffb8165f94b5fb9a232f715f22c85'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:57.844191 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3661/7371] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:19:57.853521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:57.853819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:57.854234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:57.864659 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3711/7372] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:19:57 2022] DELETE /identity/v3/users/883ffb8165f94b5fb9a232f715f22c85 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:57.870427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:57.870710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:57.871050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:57.938646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:57.939891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:57.943253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:57.944597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:58.096622 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3712/7373] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:19:58.198595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.200536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:58.231949 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3662/7374] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:58.236268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:58.236453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.276909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704dd16-34a2-406c-a8ea-70bf3d589cbc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.306496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.307328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.307612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.307882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.308548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:19:58.308853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.310507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.353337 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3663/7375] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:19:58.358205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.374648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f847f-868b-44fc-a1c5-d5bbbc9ba49e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.384436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea22fc-33e1-434b-8a91-279eaf20ed93 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.391225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.392276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.392823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.393241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.394714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.406598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.411607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.420286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.420668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.421135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.452105 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3664/7376] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:19:58 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:58.453599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.458239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.459716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.472208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:58.507926 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3713/7377] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:19:58.576716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0f585-f22f-4cc4-a4d0-2c7a0be0f10f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.587703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.589087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.589515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.589965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.590784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.593471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.632594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.635095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3665/7378] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:19:58 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:19:58.648223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5853a-8ccf-40b3-919e-c87783d90d06 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.665553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.666551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.666974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.667476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.668558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.671677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.700775 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3714/7379] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:58.704560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.722297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1de273-d4db-4a4c-b9a2-63755ebf6b04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.736766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1abf6a-d422-4c1f-969c-5bd7cda4bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.737416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1abf6a-d422-4c1f-969c-5bd7cda4bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.737701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1abf6a-d422-4c1f-969c-5bd7cda4bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.738097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1abf6a-d422-4c1f-969c-5bd7cda4bbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.738932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1abf6a-d422-4c1f-969c-5bd7cda4bbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.744028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1abf6a-d422-4c1f-969c-5bd7cda4bbc7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.769046 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3666/7380] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:19:58.774925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:58.792412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554f5a4-0d38-46ff-aa38-f7cf23fecfac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:58.803244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:58.812615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.812615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.812879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] PATH_INFO: `/v3/projects/b312c9d222bd43f4aab680b2b7488cbe/users/aebe6bb8511843e5a2b69b39dff319e9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.851363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b312c9d222bd43f4aab680b2b7488cbe, user_id=aebe6bb8511843e5a2b69b39dff319e9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:58.854938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:58.898374 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3715/7381] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:19:58 2022] PUT /identity/v3/projects/b312c9d222bd43f4aab680b2b7488cbe/users/aebe6bb8511843e5a2b69b39dff319e9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:19:58.908883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9787326-1249-4173-9199-906b32defdf6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:58.909175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9787326-1249-4173-9199-906b32defdf6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:58.909459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9787326-1249-4173-9199-906b32defdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:58.983733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a9787326-1249-4173-9199-906b32defdf6 None None] MFA Rules not processed for user `aebe6bb8511843e5a2b69b39dff319e9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:58.986176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a9787326-1249-4173-9199-906b32defdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:59.299686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:59.305831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:59.325841 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3667/7382] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:19:59.376715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9787326-1249-4173-9199-906b32defdf6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:19:59.485156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e317e-802d-4360-8463-fde524fdaa45 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:59.506096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:59.506760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:59.507036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:59.507307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] PATH_INFO: `/v3/projects/8defd456714c423287de1e24b274c80a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:59.509493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8defd456714c423287de1e24b274c80a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:19:59.511775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:19:59.661575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9787326-1249-4173-9199-906b32defdf6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:19:59.662749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8defd456714c423287de1e24b274c80a', 'request_id': 'req-81c4381d-4751-4416-93ad-18c37e263422'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:59.671612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8defd456714c423287de1e24b274c80a', 'request_id': 'req-81c4381d-4751-4416-93ad-18c37e263422'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:59.680450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8defd456714c423287de1e24b274c80a', 'request_id': 'req-81c4381d-4751-4416-93ad-18c37e263422'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:59.698473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] The token cache is being invalidate because project 8defd456714c423287de1e24b274c80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:19:59.700553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:59.702138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-81c4381d-4751-4416-93ad-18c37e263422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:19:59.704069 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3716/7383] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:19:59 2022] DELETE /identity/v3/projects/8defd456714c423287de1e24b274c80a => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:19:59.709574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbd094-123a-4886-b6bf-7d5a531ea8d8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:59.709954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbd094-123a-4886-b6bf-7d5a531ea8d8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:59.710286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbd094-123a-4886-b6bf-7d5a531ea8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:59.755742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:59.804659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a7cbd094-123a-4886-b6bf-7d5a531ea8d8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:19:59.807278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a7cbd094-123a-4886-b6bf-7d5a531ea8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:19:59.823106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:19:59.823820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:19:59.824494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:19:59.824953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:19:59.826850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:19:59.829784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:00.015296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.016826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.024961 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3717/7384] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:00.026958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.027250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.027530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.045065 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3668/7385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:19:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:00.075375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:00.076867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:00.088029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3718/7386] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:00.092340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.111957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e34b-efb4-4ee7-aa4b-979dc8141321 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.127504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.128403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.128860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.129299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.130155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:20:00.130607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.132491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.170302 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3669/7387] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:20:00.172697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.188974 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3b028-eb08-43ac-bae2-0ee6a0f554cb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.205267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.208873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.209115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.209386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.210077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.213894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.276118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3719/7388] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:00 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:00.280165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.296713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208b06e-b352-43cf-ba22-94fecfd48c08 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.369924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.370560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.370847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.371112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.371758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.374013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.411055 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3670/7389] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:00 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:00.412283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.424452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf005ea5-1120-42e1-babe-d60772f355b4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.431963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.432869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.433522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.433522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.434053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.437948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.452747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3720/7390] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:20:00.454160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.467691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f3ae2-68e5-4020-8531-537298778f7e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.473761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc24982a-129f-4116-babf-ff4964ab62c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.474444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24982a-129f-4116-babf-ff4964ab62c1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.474716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24982a-129f-4116-babf-ff4964ab62c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.474994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc24982a-129f-4116-babf-ff4964ab62c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.475653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24982a-129f-4116-babf-ff4964ab62c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.477351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc24982a-129f-4116-babf-ff4964ab62c1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.501629 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3671/7391] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:20:00.502921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.520947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c19c50-ee42-467a-acaf-e635f5a572f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.529650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.530830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.531984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.534108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] PATH_INFO: `/v3/projects/04fa6739286e436681638423104388f1/users/f32d08fb92764caea451fbbf2b92abfd/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.561837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04fa6739286e436681638423104388f1, user_id=f32d08fb92764caea451fbbf2b92abfd, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.565439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.597470 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3721/7392] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:00 2022] PUT /identity/v3/projects/04fa6739286e436681638423104388f1/users/f32d08fb92764caea451fbbf2b92abfd/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:00.598066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.598360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.598639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.637764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] MFA Rules not processed for user `f32d08fb92764caea451fbbf2b92abfd`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:00.641034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:00.699618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:00.729094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3672/7393] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:00.733835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.816905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4acc8-57c5-4601-a031-7e427eea0546 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.822904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.823620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.824003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.824591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.825306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.827771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:00.890554 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3722/7394] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:00 2022] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:00.892958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:00.911632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd161282-92ec-4463-8cb6-107b9ba59cf2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:00.983851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:00.984555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:00.984878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:00.985203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:00.985873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:00.987830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.018896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3673/7395] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:00 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:01.019935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.032128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bdda6b-1af6-40ea-bc7e-52aacd0f59b0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.037964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.038587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.039478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.039478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.039898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.041691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.059620 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3723/7396] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:01.061146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.072436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed6b0d-773c-47d6-a77a-401ec692376d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.078323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf2cbf-bc47-4905-b5ea-82f1b3a69c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.079208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf2cbf-bc47-4905-b5ea-82f1b3a69c61 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.079576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf2cbf-bc47-4905-b5ea-82f1b3a69c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.079942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf2cbf-bc47-4905-b5ea-82f1b3a69c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.080700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf2cbf-bc47-4905-b5ea-82f1b3a69c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.082611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf2cbf-bc47-4905-b5ea-82f1b3a69c61 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.097732 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3674/7397] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:01.099966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.112347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b40ac2-c774-4ff7-a07f-ee75336be8aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.118384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.119060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.119404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.120229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] PATH_INFO: `/v3/projects/07c0f5454e9a43839160e4fc03c0e777/users/37b6bad91d7c4a99a8a8125d0f260677/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.140259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c0f5454e9a43839160e4fc03c0e777, user_id=37b6bad91d7c4a99a8a8125d0f260677, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.143585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.154988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:01.172402 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3724/7398] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:01 2022] PUT /identity/v3/projects/07c0f5454e9a43839160e4fc03c0e777/users/37b6bad91d7c4a99a8a8125d0f260677/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:01.174389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.174784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.175157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.206069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] MFA Rules not processed for user `37b6bad91d7c4a99a8a8125d0f260677`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:01.207489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:01.283814 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3675/7399] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:01.285821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.409100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f80ab-7135-4c79-a62f-6dc8f25f9af4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.414915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.415960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.416369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.417403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.418223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.420247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.468913 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3725/7400] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:01 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:01.469373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.490071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55ebe0-ed83-4e5d-b1d6-290a6e78d681 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.585543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:01.601208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.602217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.603043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.604683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.605613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.608904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.639672 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3676/7401] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:01 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:01.643563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.683539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66071f-7a02-4776-a377-3023a8c4e23b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.709952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.710718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.711009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.711291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.711962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.722952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.762367 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3726/7402] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:01.763623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.783653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f135-c67b-48f1-a433-bdb19a9042a5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.799390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.801849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.803625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.803897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] PATH_INFO: `/v3/projects/0cff74c593cd4637b5064f83c796eb79/users/c728aa87abc0412fa608f81368f118d2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.832493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff74c593cd4637b5064f83c796eb79, user_id=c728aa87abc0412fa608f81368f118d2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.836102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.858187 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3677/7403] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:01 2022] PUT /identity/v3/projects/0cff74c593cd4637b5064f83c796eb79/users/c728aa87abc0412fa608f81368f118d2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:01.859851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.876666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a510ed-8a55-4d45-96cb-70d892eb6b7c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:01.963534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f697a0-75d4-4702-b788-2e1f43082798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:01.964675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f697a0-75d4-4702-b788-2e1f43082798 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:01.965160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f697a0-75d4-4702-b788-2e1f43082798 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:01.965621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f697a0-75d4-4702-b788-2e1f43082798 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:01.966485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f697a0-75d4-4702-b788-2e1f43082798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:01.971366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f697a0-75d4-4702-b788-2e1f43082798 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:01.994571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:01.995083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3727/7404] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:02.022284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9df51-9aae-4b48-8205-79506390f2f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:02.050143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:02.051128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:02.051558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:02.051993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] PATH_INFO: `/v3/projects/0cff74c593cd4637b5064f83c796eb79/users/c728aa87abc0412fa608f81368f118d2/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:02.055416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff74c593cd4637b5064f83c796eb79, user_id=c728aa87abc0412fa608f81368f118d2, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:02.061425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:02.082948 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3678/7405] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:01 2022] PUT /identity/v3/projects/0cff74c593cd4637b5064f83c796eb79/users/c728aa87abc0412fa608f81368f118d2/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:02.097033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:02.098770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:02.100470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:02.176638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] MFA Rules not processed for user `c728aa87abc0412fa608f81368f118d2`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:02.177912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:02.254180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:02.272944 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3728/7406] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:04.248509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:04.254534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:04.457378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc485673-2e36-4772-a951-ad65a17af139 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:04.464336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691dd8f-6fbb-4b24-b1bf-854848db254e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:04.465082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691dd8f-6fbb-4b24-b1bf-854848db254e service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:04.465371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691dd8f-6fbb-4b24-b1bf-854848db254e service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:04.465649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691dd8f-6fbb-4b24-b1bf-854848db254e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:04.629132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691dd8f-6fbb-4b24-b1bf-854848db254e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:04.630587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691dd8f-6fbb-4b24-b1bf-854848db254e service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:04.683025 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3679/7407] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:07.491351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:07.497696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:07.601840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3bdd-2127-4938-b6e9-ba415bd980ed None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:07.606913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:07.607711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:07.607995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:07.608338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] PATH_INFO: `/v3/users/29f3383c209340adb16a7074c291b191` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:07.609442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29f3383c209340adb16a7074c291b191)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:07.611422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:07.671995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29f3383c209340adb16a7074c291b191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:07.693063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29f3383c209340adb16a7074c291b191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:07.693700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29f3383c209340adb16a7074c291b191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:07.715091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29f3383c209340adb16a7074c291b191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:07.721662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29f3383c209340adb16a7074c291b191'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:07.759782 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3729/7408] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:07 2022] DELETE /identity/v3/users/29f3383c209340adb16a7074c291b191 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:07.761410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:07.762212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:07.762638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:07.803501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:07.807364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:07.921343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:07.943639 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3680/7409] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:08.054704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:08.056516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:08.223348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf8752-f871-4637-9a58-bb5f22da32e1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:08.233939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:08.234680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:08.235026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:08.235418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:08.267538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:08.267538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:08.286915 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3730/7410] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:08.326102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:08.327597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:08.484537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef0499-1685-4dac-b2c7-419226f02bc2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:08.499132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:08.499915 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:08.500303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:08.500697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:08.504101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:08.608430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:08.610668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:08.628834 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3681/7411] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:09.132541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:09.134976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:09.173651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce416fc-9d46-49b8-8417-73864fd90250 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:09.203954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:09.204861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:09.205548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:09.206508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] PATH_INFO: `/v3/projects/b67b758e83034d5f903c6ca9dfa5c883` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:09.208698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67b758e83034d5f903c6ca9dfa5c883)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:09.211852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:09.242591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:09.307684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67b758e83034d5f903c6ca9dfa5c883', 'request_id': 'req-a10724e2-0c43-4f4e-ac03-bd3806739a66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.318773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67b758e83034d5f903c6ca9dfa5c883', 'request_id': 'req-a10724e2-0c43-4f4e-ac03-bd3806739a66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.326140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67b758e83034d5f903c6ca9dfa5c883', 'request_id': 'req-a10724e2-0c43-4f4e-ac03-bd3806739a66'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.346876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] The token cache is being invalidate because project b67b758e83034d5f903c6ca9dfa5c883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:09.347408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.348303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.350384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3731/7412] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:09 2022] DELETE /identity/v3/projects/b67b758e83034d5f903c6ca9dfa5c883 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:09.355689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:09.373347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627270-7fbb-4409-9717-c3c79b8a525c service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:09.639748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:09.640740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:09.641252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:09.641739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] PATH_INFO: `/v3/users/3efdad253d1840ceb4e902c63cb1c05a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:09.646440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efdad253d1840ceb4e902c63cb1c05a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:09.656198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:09.770148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efdad253d1840ceb4e902c63cb1c05a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.780539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:09.788699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efdad253d1840ceb4e902c63cb1c05a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.790156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efdad253d1840ceb4e902c63cb1c05a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.823393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efdad253d1840ceb4e902c63cb1c05a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.836594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efdad253d1840ceb4e902c63cb1c05a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:09.872362 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3682/7413] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:09 2022] DELETE /identity/v3/users/3efdad253d1840ceb4e902c63cb1c05a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:09.900036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:09.902316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:10.047279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10724e2-0c43-4f4e-ac03-bd3806739a66 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:10.139702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:10.141758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:10.142304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:10.142716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:10.150624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:10.304588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:10.306857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:10.349439 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3732/7414] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:10.961004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:10.963021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:11.149244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a327a-ed70-4f57-924f-9fa374db65e5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:11.178950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:11.179636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.179929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.180198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] PATH_INFO: `/v3/projects/3a7bba4b1f53412d8a190228d922c443` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.186969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7bba4b1f53412d8a190228d922c443)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:11.197726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:11.209386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:11.210892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:11.232090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:11.252912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54ccea-447d-4bea-8c94-e878eceb03a2 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:11.274724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:11.275405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.275794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.275933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] PATH_INFO: `/v3/users/aebe6bb8511843e5a2b69b39dff319e9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.282273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=aebe6bb8511843e5a2b69b39dff319e9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:11.285931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:11.389233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7bba4b1f53412d8a190228d922c443', 'request_id': 'req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.409172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7bba4b1f53412d8a190228d922c443', 'request_id': 'req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.424685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7bba4b1f53412d8a190228d922c443', 'request_id': 'req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.437797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aebe6bb8511843e5a2b69b39dff319e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.450300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aebe6bb8511843e5a2b69b39dff319e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.452623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aebe6bb8511843e5a2b69b39dff319e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.453116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] The token cache is being invalidate because project 3a7bba4b1f53412d8a190228d922c443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:11.453413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.454315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-865b88c2-bc2c-41b0-babc-8b4bc06a61cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.458849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3683/7415] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:10 2022] DELETE /identity/v3/projects/3a7bba4b1f53412d8a190228d922c443 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:11.464076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629549-0fff-429d-8238-93db740ac1db None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.464384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629549-0fff-429d-8238-93db740ac1db None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.464630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629549-0fff-429d-8238-93db740ac1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.469861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aebe6bb8511843e5a2b69b39dff319e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.471907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bee873e0-2a98-4075-a819-0f2ab074e1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aebe6bb8511843e5a2b69b39dff319e9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:11.517228 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3733/7416] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:11 2022] DELETE /identity/v3/users/aebe6bb8511843e5a2b69b39dff319e9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:11.521453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.521752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.522050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.524091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ce629549-0fff-429d-8238-93db740ac1db None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:11.529905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce629549-0fff-429d-8238-93db740ac1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:11.588122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:11.589907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:11.716539 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3684/7417] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:11.727566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.727910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.728368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.748162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:11.798919 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3734/7418] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:11.803895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:11.810128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:11.823765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:11.825894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:11.850703 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3685/7419] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:11.850703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:11.871491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521663a-1bf8-49fc-a969-81f9c3fb6ee4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:11.881202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:11.881892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.882148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.882419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.883079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:20:11.883384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:11.888873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:11.920337 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3686/7420] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:20:11.924124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:11.950966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2a520-b13d-49ae-92e8-c9965b726320 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:11.960494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:11.961139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:11.961671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:11.961671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:11.962598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:11.970349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.034180 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3687/7421] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:11 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:12.037874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:12.041570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1134c-5a64-4f2f-a4ac-15cd766203da None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.193436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:12.199006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360dd48-2243-4c7e-a5c7-e0f7f140a394 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.210262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.211914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.212930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.214892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.217355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.219916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.268893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.270362 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.270876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.272620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.285990 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3688/7422] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:12 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:12.293301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:12.296529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.300365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.319491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399a4f7-bf84-4fd7-b944-b0744a1d6c0b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.334359 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3735/7423] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:20:12.334987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.335979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.336545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.337061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.338340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.349510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.364083 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3689/7424] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:12.368251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:12.381384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e916d5f-8101-4d5e-a4da-dfd4effe7f7c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.388373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38653cd9-bf1a-4c06-94cc-39a867872670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.392421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38653cd9-bf1a-4c06-94cc-39a867872670 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.392711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38653cd9-bf1a-4c06-94cc-39a867872670 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.392992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38653cd9-bf1a-4c06-94cc-39a867872670 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.393663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38653cd9-bf1a-4c06-94cc-39a867872670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.395345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38653cd9-bf1a-4c06-94cc-39a867872670 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.432707 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3736/7425] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:12.438215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:12.452948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac0c90-48fd-4ee1-8c13-750dea1aaac6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.469469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.476565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.478264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.478264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] PATH_INFO: `/v3/projects/277ad94ea2a64ebf892a59f204307814/users/b612ecc5516f4f6ead6ca28d74911292/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.511292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277ad94ea2a64ebf892a59f204307814, user_id=b612ecc5516f4f6ead6ca28d74911292, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.514369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.563849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3690/7426] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:12 2022] PUT /identity/v3/projects/277ad94ea2a64ebf892a59f204307814/users/b612ecc5516f4f6ead6ca28d74911292/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:12.565277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.565759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.566237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.620365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] MFA Rules not processed for user `b612ecc5516f4f6ead6ca28d74911292`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:12.622025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:12.701086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:12.703825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:12.738311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3737/7427] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:12.744344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:12.896730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8944ad2-fc03-409f-9699-2c6dfecfd478 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.900787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345cc2d-3150-4c26-b762-dd034a54f042 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:12.910565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.912583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:12.913185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.913389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:12.913471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.913572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:12.913736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.914736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.915162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] PATH_INFO: `/v3/projects/b312c9d222bd43f4aab680b2b7488cbe` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:12.916393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.917656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b312c9d222bd43f4aab680b2b7488cbe)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:12.924645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:12.962109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:12.975808 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3738/7428] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:12 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:12.981016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.034389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b312c9d222bd43f4aab680b2b7488cbe', 'request_id': 'req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:13.050024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b312c9d222bd43f4aab680b2b7488cbe', 'request_id': 'req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:13.066981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b312c9d222bd43f4aab680b2b7488cbe', 'request_id': 'req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:13.093218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:13.095251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] The token cache is being invalidate because project b312c9d222bd43f4aab680b2b7488cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:13.095647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:13.097509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f81ce9fb-d8d3-4c87-bf73-cad4ac1ea568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:13.100664 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3691/7429] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:12 2022] DELETE /identity/v3/projects/b312c9d222bd43f4aab680b2b7488cbe => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:13.105562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.105937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.106337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.149847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff825b41-13c5-4956-9ca1-5628bc192772 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.156704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:13.158884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:13.272865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.273505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.273788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.274091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.274790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.276889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.294174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3692/7430] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:13.316290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3739/7431] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:12 2022] POST /identity/v3/users => generated 294 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:13.320611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.327139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:13.346391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939d72b-0bc2-441e-92ff-7c712fd20754 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.357668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f76b7-573d-4f52-a4b4-b1e3f3a190a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.361246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f76b7-573d-4f52-a4b4-b1e3f3a190a7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.361832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f76b7-573d-4f52-a4b4-b1e3f3a190a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.362204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f76b7-573d-4f52-a4b4-b1e3f3a190a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.363041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f76b7-573d-4f52-a4b4-b1e3f3a190a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.364860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f76b7-573d-4f52-a4b4-b1e3f3a190a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.385736 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3693/7432] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:13.389564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.414351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56f8ad-40f8-4ec3-b227-ea6e4677237c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.418714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.419019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.419274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.425569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.426346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.426630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.426903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.427648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.430214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.448177 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3740/7433] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:13.449291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.463868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629842a8-b1b8-4bf2-b62b-3cda86dfa789 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.468699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:13.469427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293ec0d-a911-41b2-8cb8-3d070c46d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.470039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:13.470148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293ec0d-a911-41b2-8cb8-3d070c46d6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.470434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293ec0d-a911-41b2-8cb8-3d070c46d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.471355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293ec0d-a911-41b2-8cb8-3d070c46d6ee admin admin] PATH_INFO: `/v3/projects/5615f75cf2bf4030b44a167c659c6241/users/6baab7fbebff4a53ad81e7a932212ee0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.491596 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3694/7434] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:13.498412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.502734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293ec0d-a911-41b2-8cb8-3d070c46d6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5615f75cf2bf4030b44a167c659c6241, user_id=6baab7fbebff4a53ad81e7a932212ee0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.512230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d293ec0d-a911-41b2-8cb8-3d070c46d6ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.526882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83efd3-5738-4498-a3df-7805e9fb08a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.538392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3741/7435] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:13 2022] PUT /identity/v3/projects/5615f75cf2bf4030b44a167c659c6241/users/6baab7fbebff4a53ad81e7a932212ee0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:13.553633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.554019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.554360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.589387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] MFA Rules not processed for user `6baab7fbebff4a53ad81e7a932212ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:13.591642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:13.691493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.692126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.692401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.692681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.693326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:20:13.693636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.695284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.702341 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3742/7436] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:13.703639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.717633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5276-67fb-4417-87c8-d695df6ade1b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.719730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3695/7437] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:20:13.724393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.730881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.732521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.734313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.734800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.735720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.739564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.748862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039f485-fcde-4aea-9f90-ce5ba6ed1a29 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.763139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.764270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.764270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.764642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.765378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.767599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.800289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3743/7438] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:13.803913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.809585 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3696/7439] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:13.812168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:13.817298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:13.859822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:13.957660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdabe8c-8d3a-4fe7-805b-3b5a9e8b4099 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.969040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.969737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.970152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.970305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.970943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.972955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:13.980827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3d2d3-8fcc-49eb-82e5-a7c7a9e8dda0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:13.986677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:13.987793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:13.988083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:13.988367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:13.989417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:13.994451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.021518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3697/7440] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:14.022843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.030488 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3744/7441] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:13 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:14.032332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.042662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd98eddd-5233-4357-b18b-30e98ec8cd4b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.044480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f2d29-bf4f-466d-8f18-a0fcc41b87da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.050283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.051123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.051259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.051503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.051762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.051904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.052063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.052311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.052622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.052962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.054619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.055468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.073049 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3745/7442] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:14.074261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.079170 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3698/7443] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:20:14.080636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.086525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79600166-4efc-48f7-adca-fc8fa4902026 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.093503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.094587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.094971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.096158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] PATH_INFO: `/v3/projects/7aa693b53e2a4272a039510c8b840fd1/users/7091f82316104bc2b5d35f28c1e9a83b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.105660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e4f4-23b5-45cd-9467-c9686ebdaf7c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.111910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.112553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.112841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.113114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.114603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.116580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa693b53e2a4272a039510c8b840fd1, user_id=7091f82316104bc2b5d35f28c1e9a83b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.116716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.121299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.146085 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3746/7445] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:14 2022] PUT /identity/v3/projects/7aa693b53e2a4272a039510c8b840fd1/users/7091f82316104bc2b5d35f28c1e9a83b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:14.146278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3699/7445] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:14.151945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.152309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.167532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568167e-0231-44e5-bed2-8ad212ab3845 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.273540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0444ed8-4bda-44d0-b971-e18673a971d9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.282919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b9023-4fbc-406d-85cf-2cac682eafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.283626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9023-4fbc-406d-85cf-2cac682eafd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.284370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9023-4fbc-406d-85cf-2cac682eafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.284663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b9023-4fbc-406d-85cf-2cac682eafd3 admin admin] PATH_INFO: `/v3/projects/3870a141a2b6444793c3641c2b8a6a58/users/085d8dd3dc344e0ebda868c44fc92b9e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.300979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.301768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.302174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.302722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.303512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.305317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.311900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b9023-4fbc-406d-85cf-2cac682eafd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3870a141a2b6444793c3641c2b8a6a58, user_id=085d8dd3dc344e0ebda868c44fc92b9e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.316196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b9023-4fbc-406d-85cf-2cac682eafd3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.318278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3700/7446] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:14.322388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.334820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9e87e-5786-4e12-b221-8e6d2a273e0d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.341971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3747/7447] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:14 2022] PUT /identity/v3/projects/3870a141a2b6444793c3641c2b8a6a58/users/085d8dd3dc344e0ebda868c44fc92b9e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:14.352502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.353172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.353899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.437833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc06bd-c4a3-4d21-a2c1-4b4b2795f19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.438712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc06bd-c4a3-4d21-a2c1-4b4b2795f19f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.438998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc06bd-c4a3-4d21-a2c1-4b4b2795f19f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.439269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc06bd-c4a3-4d21-a2c1-4b4b2795f19f admin admin] PATH_INFO: `/v3/projects/7aa693b53e2a4272a039510c8b840fd1/users/7091f82316104bc2b5d35f28c1e9a83b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.441212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] MFA Rules not processed for user `085d8dd3dc344e0ebda868c44fc92b9e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:14.443869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc06bd-c4a3-4d21-a2c1-4b4b2795f19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aa693b53e2a4272a039510c8b840fd1, user_id=7091f82316104bc2b5d35f28c1e9a83b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.443999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:14.448548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc06bd-c4a3-4d21-a2c1-4b4b2795f19f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.456252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:14.467207 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3701/7448] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:14 2022] PUT /identity/v3/projects/7aa693b53e2a4272a039510c8b840fd1/users/7091f82316104bc2b5d35f28c1e9a83b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:14.478037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.479228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.479873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.531672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] MFA Rules not processed for user `7091f82316104bc2b5d35f28c1e9a83b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:14.533872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:14.551717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:14.647532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3748/7449] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:14.651743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.670801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a2a8c-cfbc-4d0b-b84a-3af0ba939e79 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:14.700179 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3702/7450] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:14.714392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.715811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:14.805238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:14.806089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:14.806477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:14.807016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:14.807934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:14.810016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:14.908720 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3749/7451] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:14 2022] POST /identity/v3/projects => generated 377 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:14.913045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:14.926747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28e89d-cd0d-467d-80de-24fe4309734f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.013985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e92074-f69f-44fe-af10-40740124dd9e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.021318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.022379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.022888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.023501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.024390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:15.027329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:15.064390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.065130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.065646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.066246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.068760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:15.072076 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3750/7452] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:14 2022] POST /identity/v3/users => generated 295 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:15.076173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:15.099182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9073b0-ada5-4081-a72d-b0d3607803ff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.110923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.111699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.112032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.112308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.113439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:15.117647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:15.156820 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3751/7453] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:15.158541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:15.164904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:15.175224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfdb5a-eded-4c46-b74c-6b1ede285ad4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.181411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.182155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.182589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.182874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] PATH_INFO: `/v3/projects/0874597a9d8640a1acafbe38c13b86ac/users/2557f1f21a3f46a39ff622dab519f1f4/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.209383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874597a9d8640a1acafbe38c13b86ac, user_id=2557f1f21a3f46a39ff622dab519f1f4, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:15.228649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:15.252369 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3752/7454] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:15 2022] PUT /identity/v3/projects/0874597a9d8640a1acafbe38c13b86ac/users/2557f1f21a3f46a39ff622dab519f1f4/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:15.256901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:15.297757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:15.342432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:15.344958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:15.359187 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3703/7455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:20:15.406944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ebc93-d52c-46d0-b6ec-9a59879d847d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.415020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f62c8-0d5c-4c6e-9449-b37c71d0799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.416022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f62c8-0d5c-4c6e-9449-b37c71d0799c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.416338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f62c8-0d5c-4c6e-9449-b37c71d0799c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.417238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f62c8-0d5c-4c6e-9449-b37c71d0799c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.418163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f62c8-0d5c-4c6e-9449-b37c71d0799c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:15.421315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f62c8-0d5c-4c6e-9449-b37c71d0799c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:15.443755 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3753/7456] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:15.444943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:15.467580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a43c6-3613-4f15-931a-7e8c8581edf3 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.483325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9a056-0549-441f-96d4-bcb207039185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.484103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9a056-0549-441f-96d4-bcb207039185 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.484917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9a056-0549-441f-96d4-bcb207039185 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.485283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9a056-0549-441f-96d4-bcb207039185 admin admin] PATH_INFO: `/v3/projects/0874597a9d8640a1acafbe38c13b86ac/users/2557f1f21a3f46a39ff622dab519f1f4/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.488912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9a056-0549-441f-96d4-bcb207039185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874597a9d8640a1acafbe38c13b86ac, user_id=2557f1f21a3f46a39ff622dab519f1f4, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:15.494130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9a056-0549-441f-96d4-bcb207039185 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:15.530096 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3704/7457] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:15 2022] PUT /identity/v3/projects/0874597a9d8640a1acafbe38c13b86ac/users/2557f1f21a3f46a39ff622dab519f1f4/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:15.540579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.540944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.541230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.616671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] MFA Rules not processed for user `2557f1f21a3f46a39ff622dab519f1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:15.622223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:15.680041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.680411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.680788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:15.706138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] MFA Rules not processed for user `d2867c5be8974c028f933d1c8fe2c2fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:15.707699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:15.817076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3705/7458] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:15.821642 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3754/7459] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:15.836319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:15.838132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:15.984116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8b3ca-f1da-46dd-9b95-6f9c75bc1043 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:15.993393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:15.995525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:15.996532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:15.998120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:16.074569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:16.076357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:16.091558 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3706/7460] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:20.338339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:20.339745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:20.469923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55ebc0-b7d2-411a-892e-cde27eb80146 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:20.473876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:20.474519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:20.474801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:20.475076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:20.625642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:20.670814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:20.672299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:20.726287 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3755/7461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:22.476295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:22.483492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:22.514716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d6cf7-d608-4643-9193-6e7a0e53810d service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:22.527026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6ac34-3abc-44f4-a64c-727efa144512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:22.528161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ac34-3abc-44f4-a64c-727efa144512 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:22.528523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ac34-3abc-44f4-a64c-727efa144512 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:22.528865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6ac34-3abc-44f4-a64c-727efa144512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:22.555158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:22.566394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6ac34-3abc-44f4-a64c-727efa144512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:22.571085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6ac34-3abc-44f4-a64c-727efa144512 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:22.609661 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3707/7462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:20:23.053001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:23.055911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:23.299975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647d11b-5fd5-4860-90a6-5c4bb3076142 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:23.316653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:23.317532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:23.318018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:23.318465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] PATH_INFO: `/v3/users/f32d08fb92764caea451fbbf2b92abfd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:23.319979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32d08fb92764caea451fbbf2b92abfd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:23.322347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:23.462855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32d08fb92764caea451fbbf2b92abfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:23.484205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32d08fb92764caea451fbbf2b92abfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:23.490594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32d08fb92764caea451fbbf2b92abfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:23.512348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32d08fb92764caea451fbbf2b92abfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:23.513150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32d08fb92764caea451fbbf2b92abfd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:23.568571 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3756/7463] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:23 2022] DELETE /identity/v3/users/f32d08fb92764caea451fbbf2b92abfd => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:23.573976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:23.574442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:23.574527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:23.624027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:23.625187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:23.911022 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3708/7464] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:23.924535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:23.926807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:24.095155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144be0e-739c-45a2-83b3-79817e90bd73 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:24.122296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:24.123048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:24.123332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:24.123604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:24.167578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:24.169064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:24.223014 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3757/7465] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:25.620409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:25.621873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:25.642309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16388634-16c9-43b1-8e06-4b2b315757ef None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:25.662598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:25.663469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:25.663904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:25.664179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] PATH_INFO: `/v3/projects/04fa6739286e436681638423104388f1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:25.665611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] RBAC: Authorizing `identity:delete_project(project_id=04fa6739286e436681638423104388f1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:25.667630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:25.785192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04fa6739286e436681638423104388f1', 'request_id': 'req-9e56c177-356f-415a-bf06-c367db0a147c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:25.808715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04fa6739286e436681638423104388f1', 'request_id': 'req-9e56c177-356f-415a-bf06-c367db0a147c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:25.825495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04fa6739286e436681638423104388f1', 'request_id': 'req-9e56c177-356f-415a-bf06-c367db0a147c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:25.849265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] The token cache is being invalidate because project 04fa6739286e436681638423104388f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:25.849669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:25.855976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:25.859876 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3709/7466] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:25 2022] DELETE /identity/v3/projects/04fa6739286e436681638423104388f1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:25.863345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:25.876381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f4bc68-63b5-4de1-9991-200066ef4ac4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:25.887414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:26.015254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:26.018716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:26.019186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:26.019670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] PATH_INFO: `/v3/users/37b6bad91d7c4a99a8a8125d0f260677` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:26.021620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b6bad91d7c4a99a8a8125d0f260677)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:26.025313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:26.145355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b6bad91d7c4a99a8a8125d0f260677'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:26.170083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b6bad91d7c4a99a8a8125d0f260677'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:26.177718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b6bad91d7c4a99a8a8125d0f260677'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:26.201739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b6bad91d7c4a99a8a8125d0f260677'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:26.207068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b6bad91d7c4a99a8a8125d0f260677'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:26.251385 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3758/7467] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:25 2022] DELETE /identity/v3/users/37b6bad91d7c4a99a8a8125d0f260677 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:27.383092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:27.387193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:27.419328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56c177-356f-415a-bf06-c367db0a147c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:27.569786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:27.570707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:27.573317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:27.573831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] PATH_INFO: `/v3/projects/07c0f5454e9a43839160e4fc03c0e777` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:27.575331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c0f5454e9a43839160e4fc03c0e777)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:27.579186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:27.631955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:27.730531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c0f5454e9a43839160e4fc03c0e777', 'request_id': 'req-20c23cbc-9686-4ba8-9f09-e560670a245e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:27.744496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c0f5454e9a43839160e4fc03c0e777', 'request_id': 'req-20c23cbc-9686-4ba8-9f09-e560670a245e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:27.767716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c0f5454e9a43839160e4fc03c0e777', 'request_id': 'req-20c23cbc-9686-4ba8-9f09-e560670a245e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:27.802030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] The token cache is being invalidate because project 07c0f5454e9a43839160e4fc03c0e777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:27.802326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:27.808450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:27.814176 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3710/7468] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:27 2022] DELETE /identity/v3/projects/07c0f5454e9a43839160e4fc03c0e777 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:27.815355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:27.816914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:27.886367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99836-7ad4-4731-bac9-6b93397e8837 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:28.054291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:28.054942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:28.055253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:28.055532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] PATH_INFO: `/v3/users/c728aa87abc0412fa608f81368f118d2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:28.064148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c728aa87abc0412fa608f81368f118d2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:28.074429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:28.173376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:28.194858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c728aa87abc0412fa608f81368f118d2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:28.213751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c728aa87abc0412fa608f81368f118d2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:28.214580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c728aa87abc0412fa608f81368f118d2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:28.231776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c728aa87abc0412fa608f81368f118d2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:28.232553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0a61ccca-4a51-4919-bc2e-b855d321eefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c728aa87abc0412fa608f81368f118d2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:28.260262 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3759/7469] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:27 2022] DELETE /identity/v3/users/c728aa87abc0412fa608f81368f118d2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:29.935920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:29.937773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:29.958260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c23cbc-9686-4ba8-9f09-e560670a245e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:30.077652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:30.079356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:30.080191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:30.080657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] PATH_INFO: `/v3/projects/0cff74c593cd4637b5064f83c796eb79` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:30.082300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cff74c593cd4637b5064f83c796eb79)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:30.084880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:30.220432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cff74c593cd4637b5064f83c796eb79', 'request_id': 'req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:30.232070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cff74c593cd4637b5064f83c796eb79', 'request_id': 'req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:30.241615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cff74c593cd4637b5064f83c796eb79', 'request_id': 'req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:30.263741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] The token cache is being invalidate because project 0cff74c593cd4637b5064f83c796eb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:30.264276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:30.265108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e0251615-8a7d-4be2-8d9a-44d3b3c907b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:30.271983 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3711/7470] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:29 2022] DELETE /identity/v3/projects/0cff74c593cd4637b5064f83c796eb79 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:30.273187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:30.273653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:30.274695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:30.359837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:30.362732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:30.525482 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3760/7471] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:30.533328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:30.533600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:30.533904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:30.586939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:30.589361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:30.614708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:30.629134 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3712/7472] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:30.634480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6a2d-4b0a-45a2-8f79-8fba424a847d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:30.656860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:30.657765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:30.658259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:30.658829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:30.659508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:20:30.659966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:30.662343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:30.692107 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3761/7473] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:20:30.696646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:30.712485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257bee2-656d-4b87-bf8d-eddff7c6249f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:30.722720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:30.723046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:30.723328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:30.723962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:30.724620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:30.728004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:30.768637 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3713/7474] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:30 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:30.769510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:30.806698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3522569-0c4b-41f8-b4bc-b88ab1dc66e9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:30.963997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:30.965144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:30.965705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:30.966010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:30.966668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:30.968654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.040747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3762/7475] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:30 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:31.042333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.059634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6cabd-b828-4980-bb78-ba080b514102 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:31.066229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:31.067185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.067699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.068171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.069018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:31.072067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.078896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:31.113847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.120070 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3714/7476] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:31.126584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e3a008-5901-4f39-9e13-7085763900b3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:31.133827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1db6d-1866-488b-9bea-f4077fa0f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:31.135718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1db6d-1866-488b-9bea-f4077fa0f383 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.136208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1db6d-1866-488b-9bea-f4077fa0f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.136878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1db6d-1866-488b-9bea-f4077fa0f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.138149 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1db6d-1866-488b-9bea-f4077fa0f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:31.140332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1db6d-1866-488b-9bea-f4077fa0f383 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.159009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.164890 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3763/7477] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:31.170948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c17479-350c-40ee-b5a0-5f86b668c1db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:31.177586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:31.178606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.178884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.179331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] PATH_INFO: `/v3/projects/e984af26f6dc4af8868ad34681a73ca8/users/91e6c674438547819977bc71eaeba125/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.213702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e984af26f6dc4af8868ad34681a73ca8, user_id=91e6c674438547819977bc71eaeba125, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:31.219037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.252582 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3715/7478] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:31 2022] PUT /identity/v3/projects/e984af26f6dc4af8868ad34681a73ca8/users/91e6c674438547819977bc71eaeba125/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:31.263344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.263883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.264547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.313354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:31.321297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] MFA Rules not processed for user `91e6c674438547819977bc71eaeba125`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:31.323725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:31.478404 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3764/7479] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:31.483037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.612029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e0139-a8de-43eb-8b40-f26bcbfb2d6c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:31.622789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:31.623424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.624398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.624674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.625313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:31.628810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.695563 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3716/7480] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:31 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:31.699960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.720645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd1e45-2552-4c6d-a22a-a544807c1870 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:31.856133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:31.856963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.858198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.858571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.861227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:31.863442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.929834 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3765/7481] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:31 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:31.931904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.946658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32173221-4526-42ae-8ace-2dcebedd8ce8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:31.952809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:31.953439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:31.953719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:31.954054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:31.954923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:31.958728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:31.975917 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3717/7482] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:31.980543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:31.993584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1759c-0bc8-447a-8b88-d7a668ef3244 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.002474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.005699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.006331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.006574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.007312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.009287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:32.044143 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3766/7483] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:32.048266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:32.077132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e006-8342-48db-948f-41d69f6bef18 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.091395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:32.095342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:32.129442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23374dfa-eb7f-4e37-a9e6-b4f5006b5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.131873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374dfa-eb7f-4e37-a9e6-b4f5006b5783 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.132156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374dfa-eb7f-4e37-a9e6-b4f5006b5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.132430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23374dfa-eb7f-4e37-a9e6-b4f5006b5783 admin admin] PATH_INFO: `/v3/projects/1ef03e28078e4b35b93a1e159ba9caa8/users/933f16b8d7c54352891e031febd00f31/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.160575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e01b-c3ca-4ec1-abb7-254b1b2ffb5c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.173342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.174024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.174303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.174573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] PATH_INFO: `/v3/users/58f9100572be451b98ae878ae77f211c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.176128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f9100572be451b98ae878ae77f211c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.179386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:32.182630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374dfa-eb7f-4e37-a9e6-b4f5006b5783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef03e28078e4b35b93a1e159ba9caa8, user_id=933f16b8d7c54352891e031febd00f31, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.190585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23374dfa-eb7f-4e37-a9e6-b4f5006b5783 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:32.226612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3718/7484] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:32 2022] PUT /identity/v3/projects/1ef03e28078e4b35b93a1e159ba9caa8/users/933f16b8d7c54352891e031febd00f31/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:32.229250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e38a9-1cbe-4023-a962-fa8029367efa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.233255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e38a9-1cbe-4023-a962-fa8029367efa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.233712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e38a9-1cbe-4023-a962-fa8029367efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.281692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b81e38a9-1cbe-4023-a962-fa8029367efa None None] MFA Rules not processed for user `b612ecc5516f4f6ead6ca28d74911292`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:32.293240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b81e38a9-1cbe-4023-a962-fa8029367efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:32.310421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f9100572be451b98ae878ae77f211c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:32.333232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f9100572be451b98ae878ae77f211c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:32.335113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f9100572be451b98ae878ae77f211c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:32.345373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f9100572be451b98ae878ae77f211c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:32.346333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-dff0da5e-5985-4bad-aa39-971b8d050e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f9100572be451b98ae878ae77f211c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:32.375117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:32.395495 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3767/7485] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:32 2022] DELETE /identity/v3/users/58f9100572be451b98ae878ae77f211c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:32.397422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.397645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.398246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.425625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3719/7486] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:32.428016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.428642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.428758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.473669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:32.476090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:32.480480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] MFA Rules not processed for user `933f16b8d7c54352891e031febd00f31`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:32.482145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:32.559330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:32.614883 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3768/7487] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:32.619571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3720/7488] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:32.620105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:32.623669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:32.636297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:32.640284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23004a70-86ca-4cb4-a593-7f9439d6ebf3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.640516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:32.645752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.646416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.646692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.646964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.647656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.651425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:32.704984 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3769/7489] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:32 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:32.706113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:32.798393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5b717-0e9a-40b5-88de-d1c35a1e5ee2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.849374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7f1d2-97d3-4f8a-bb73-9551631f2484 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.863319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.863562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.863892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.864187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.866873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.869206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:32.871195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.871898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.872254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.872817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.884219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.886541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:32.910790 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3721/7490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:20:32.922884 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3770/7491] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:32 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:32.926705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:32.956940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870232a-4d11-43d1-aacd-0ee6ee4175eb service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:32.970790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:32.971608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:32.972037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:32.972315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:32.973206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:32.977016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:33.006644 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3722/7492] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:33.007462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:33.020021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1739be-b32e-4bde-bbde-3dd6d80401cb admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:33.031497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:33.033403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.033701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.034011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] PATH_INFO: `/v3/projects/19cf478b2c3a47348bfbd73df7b4536d/users/319723010cec4217bcc0dfb354d8b775/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.075963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19cf478b2c3a47348bfbd73df7b4536d, user_id=319723010cec4217bcc0dfb354d8b775, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:33.079575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:33.124887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:33.125421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3771/7493] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:33 2022] PUT /identity/v3/projects/19cf478b2c3a47348bfbd73df7b4536d/users/319723010cec4217bcc0dfb354d8b775/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:33.139215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8511cfe2-000e-4263-8597-c6bf1b58dede admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:33.295365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668815e-f74c-4adb-9cce-f4219fd2cf0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:33.296001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668815e-f74c-4adb-9cce-f4219fd2cf0b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.296277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668815e-f74c-4adb-9cce-f4219fd2cf0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.296574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668815e-f74c-4adb-9cce-f4219fd2cf0b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.297216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668815e-f74c-4adb-9cce-f4219fd2cf0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:33.307120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5668815e-f74c-4adb-9cce-f4219fd2cf0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:33.351742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3723/7494] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:20:33.356096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:33.379144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e929fc0-cbf3-4170-9723-033240d96085 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:33.394384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:33.395377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.395799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.396310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] PATH_INFO: `/v3/projects/19cf478b2c3a47348bfbd73df7b4536d/users/319723010cec4217bcc0dfb354d8b775/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.398577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19cf478b2c3a47348bfbd73df7b4536d, user_id=319723010cec4217bcc0dfb354d8b775, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:33.401364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:33.423760 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3772/7495] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:33 2022] PUT /identity/v3/projects/19cf478b2c3a47348bfbd73df7b4536d/users/319723010cec4217bcc0dfb354d8b775/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:33.434450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.434737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.435087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.472152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:33.473930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:33.501473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=1,keystone:SELECT=93,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:33.512979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:33.534571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] MFA Rules not processed for user `319723010cec4217bcc0dfb354d8b775`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:33.540708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:33.601584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790d247-3a09-4b38-b4d7-2ca403145b0d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:33.606994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:33.607816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.608000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.608333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] PATH_INFO: `/v3/projects/7b59eece75b44cadb77fa353dd60fafb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.609789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b59eece75b44cadb77fa353dd60fafb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:33.611949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:33.707621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b59eece75b44cadb77fa353dd60fafb', 'request_id': 'req-c860e266-c0a3-432d-880c-9b0feeb556b4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:33.715972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b59eece75b44cadb77fa353dd60fafb', 'request_id': 'req-c860e266-c0a3-432d-880c-9b0feeb556b4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:33.726586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b59eece75b44cadb77fa353dd60fafb', 'request_id': 'req-c860e266-c0a3-432d-880c-9b0feeb556b4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:33.746804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] The token cache is being invalidate because project 7b59eece75b44cadb77fa353dd60fafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:33.748661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:33.749372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c860e266-c0a3-432d-880c-9b0feeb556b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:33.758622 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3773/7496] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:33 2022] DELETE /identity/v3/projects/7b59eece75b44cadb77fa353dd60fafb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:33.763038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8626e76-8cd3-49fd-b1a9-b4d6876379d4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.763038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8626e76-8cd3-49fd-b1a9-b4d6876379d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.763038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8626e76-8cd3-49fd-b1a9-b4d6876379d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.781155 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3724/7497] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:33.786528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f8626e76-8cd3-49fd-b1a9-b4d6876379d4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:33.788137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8626e76-8cd3-49fd-b1a9-b4d6876379d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:33.793819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:33.809459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:33.882470 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3774/7498] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:33.891316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.891608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.891885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.916703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:33.918219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:33.928494 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3775/7499] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:33.932429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05ccb3-4b02-4d43-a1ae-d49691ff3203 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:33.933609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:33.953699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a163a-0325-4739-984a-ec1be79ac369 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:33.966503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:33.967823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:33.969265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:33.969616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:33.971659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:20:33.973191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:33.979478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.004451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.005099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.005468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.005750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.007814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:34.008286 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3776/7500] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:20:34.014403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:34.040019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4afaa-9dd6-4ce7-8ba6-efe147e2fa67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:34.055333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410594-b298-426c-9938-800cd874a244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.056344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410594-b298-426c-9938-800cd874a244 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.057186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410594-b298-426c-9938-800cd874a244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.057666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50410594-b298-426c-9938-800cd874a244 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.058756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50410594-b298-426c-9938-800cd874a244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.061093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50410594-b298-426c-9938-800cd874a244 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.104176 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3777/7501] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:34 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:34.108068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410594-b298-426c-9938-800cd874a244 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:34.118882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:34.123893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.127002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.156867 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3725/7502] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:20:34.203909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50410594-b298-426c-9938-800cd874a244 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:34.209153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.210126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.210606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.211003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.211893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.214540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.253299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:34.253401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3778/7503] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:34 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:34.271985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107e0c6-aba4-4e2b-9869-a92ae8681ff0 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:34.285990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.286681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.286970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.287249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.287908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.289597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.295168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:34.339730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3726/7504] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:34.341053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:34.356742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a5fd2-7a78-48d7-bd27-7edefaa195f7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:34.372820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12c787-33f9-4b24-8a78-88efb83a4067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.373458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c787-33f9-4b24-8a78-88efb83a4067 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.373736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c787-33f9-4b24-8a78-88efb83a4067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.374053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12c787-33f9-4b24-8a78-88efb83a4067 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.374702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c787-33f9-4b24-8a78-88efb83a4067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.376728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12c787-33f9-4b24-8a78-88efb83a4067 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.403780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3779/7505] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:34.407708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:34.424329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e50c8a-3490-4083-84a5-1482264928a2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:34.435184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.436234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.436523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.436797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] PATH_INFO: `/v3/projects/e5852496af804ff69acb17ee09051c01/users/55ea022ab23b43999311c9448ce5eea6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.475058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5852496af804ff69acb17ee09051c01, user_id=55ea022ab23b43999311c9448ce5eea6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.478146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:34.521781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3727/7506] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:34 2022] PUT /identity/v3/projects/e5852496af804ff69acb17ee09051c01/users/55ea022ab23b43999311c9448ce5eea6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:34.532477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.532675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.532945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.594340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] MFA Rules not processed for user `55ea022ab23b43999311c9448ce5eea6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:34.595560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:34.807508 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3780/7507] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:34.807746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:34.965787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989af51-5f97-485a-b177-5d115ab9427a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:34.977315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:34.978151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:34.978425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:34.978705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:34.979402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:34.982205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:35.026309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:35.033621 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3728/7508] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:20:34 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:20:35.040821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d1f7a-11fd-4d3d-9bcb-613d5bdbcf18 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:35.163792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:35.164903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:35.165423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:35.165998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:35.174085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:35.215421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:35.291536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:35.305267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:35.314973 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3781/7509] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:20:35 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:20:35.321947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35057a8-85f6-4ae7-8b03-fe47fe6095e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:35.342688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:35.343396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:35.343678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:35.343985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:35.344611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:35.346672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:35.363435 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3729/7510] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:35.369065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:35.390615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866c420-fe0f-45cc-bb24-31fa9e602580 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:35.413406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:35.414517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:35.415061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:35.415507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] PATH_INFO: `/v3/projects/ae6cfa90bb214640a5a58a6cae2e3aa4/users/40be306aa7b24380b98d82d71fa851d6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:35.456486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6cfa90bb214640a5a58a6cae2e3aa4, user_id=40be306aa7b24380b98d82d71fa851d6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:35.459747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:35.497636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:35.498367 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3782/7511] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:35 2022] PUT /identity/v3/projects/ae6cfa90bb214640a5a58a6cae2e3aa4/users/40be306aa7b24380b98d82d71fa851d6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:35.522268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6ba9c-be3d-420c-8777-5c5997f6a2c6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:35.671226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedca68c-c854-4fcb-9791-fe8fd3782c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:35.671905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedca68c-c854-4fcb-9791-fe8fd3782c05 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:35.672511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedca68c-c854-4fcb-9791-fe8fd3782c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:35.673166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedca68c-c854-4fcb-9791-fe8fd3782c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:35.674077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedca68c-c854-4fcb-9791-fe8fd3782c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:35.675714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedca68c-c854-4fcb-9791-fe8fd3782c05 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:35.708620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:35.709044 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3730/7512] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:20:35.724294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bc35f-ee3e-486f-95e4-037254aa3932 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:35.729719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:35.730604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:35.731023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:35.731612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] PATH_INFO: `/v3/projects/ae6cfa90bb214640a5a58a6cae2e3aa4/users/40be306aa7b24380b98d82d71fa851d6/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:35.734483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6cfa90bb214640a5a58a6cae2e3aa4, user_id=40be306aa7b24380b98d82d71fa851d6, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:35.739875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:35.754809 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3783/7513] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:20:35 2022] PUT /identity/v3/projects/ae6cfa90bb214640a5a58a6cae2e3aa4/users/40be306aa7b24380b98d82d71fa851d6/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:35.765468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:35.765791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:35.766094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:35.844151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] MFA Rules not processed for user `40be306aa7b24380b98d82d71fa851d6`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:35.845503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:35.944192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:36.027074 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3731/7514] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:20:36.037601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:36.039694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:36.193438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cadbb-25ef-442a-9781-febb6352d675 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:36.212999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:36.213655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:36.213962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:36.214234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:36.249901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:36.251388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:36.284103 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3784/7515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:36.396093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:36.427546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959efbd1-33eb-4f85-9f1b-6679274a4eca None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:36.434468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:36.436117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:36.436856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:36.437604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:36.645226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:36.649196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:36.670432 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3732/7516] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:37.336622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:37.341201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:37.374686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1613707-87da-4609-b628-409506f53c56 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:37.380015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:37.380878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:37.381225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:37.381563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:37.383633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:37.556296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:37.558242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:37.573706 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3785/7517] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:38.536796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:38.551116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbfc48-6d30-400c-84b7-a811ead1beba service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:38.571832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:38.572486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:38.572766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:38.573035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:38.575461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:38.689682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:38.692234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:38.707142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3733/7518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:47.542481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:47.544659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:47.618014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19854949-0f43-47d3-8c7d-c56d0451d1f7 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:47.621690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:47.622361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:47.622712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:47.622997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:47.624882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:47.650408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:47.777675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:47.779400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:47.823150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3786/7519] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:48.700616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=72 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:50.042818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:50.045331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:50.061838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57197417-ce1a-4b98-9715-223ec3c5505e service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:50.066156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:50.067110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:50.067608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:50.068204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:50.082818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:50.143141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:50.147076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d548198-ff13-4383-9f46-5ff7a6520879 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:50.183369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3734/7520] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:50.204980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:50.205532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:50.464157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86957d54-30b1-4bec-8263-d42aa7b2c91c service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:50.469915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:50.470931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:50.471399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:50.471869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] PATH_INFO: `/v3/users/91e6c674438547819977bc71eaeba125` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:50.473702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e6c674438547819977bc71eaeba125)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:50.476315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:50.642992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e6c674438547819977bc71eaeba125'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:50.656759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e6c674438547819977bc71eaeba125'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:50.657504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e6c674438547819977bc71eaeba125'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:50.686718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e6c674438547819977bc71eaeba125'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:50.687622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e6c674438547819977bc71eaeba125'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:50.745974 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3787/7521] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:50 2022] DELETE /identity/v3/users/91e6c674438547819977bc71eaeba125 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:50.762266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:50.762800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:50.763253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:50.826561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:20:50.832978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:51.122223 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3735/7522] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:20:51.141160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:51.152495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:51.195453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:51.294994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff58376-1022-4be2-99fe-1d1f74a596e1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:51.311845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:51.312498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:51.312779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:51.313050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:51.357877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:51.358571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:51.415888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3788/7523] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:20:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:20:52.150789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:52.152999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:52.185502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc553d3-35fd-4b1a-b4c5-aae8e0b7dae4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:52.209035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:52.210012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:52.210296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:52.210570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] PATH_INFO: `/v3/projects/e984af26f6dc4af8868ad34681a73ca8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:52.215479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=e984af26f6dc4af8868ad34681a73ca8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:52.221340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:52.463947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e984af26f6dc4af8868ad34681a73ca8', 'request_id': 'req-c6f3a95a-ad44-43bf-8358-547b16bc37ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:52.506375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e984af26f6dc4af8868ad34681a73ca8', 'request_id': 'req-c6f3a95a-ad44-43bf-8358-547b16bc37ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:52.536135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e984af26f6dc4af8868ad34681a73ca8', 'request_id': 'req-c6f3a95a-ad44-43bf-8358-547b16bc37ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:52.596111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] The token cache is being invalidate because project e984af26f6dc4af8868ad34681a73ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:52.596406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:52.597189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:52.598821 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3736/7524] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:52 2022] DELETE /identity/v3/projects/e984af26f6dc4af8868ad34681a73ca8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:20:52.603388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:52.620738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fb9b2-bc60-492b-b381-a6c087ee998b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:52.847960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:52.847960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:52.847960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:52.847960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] PATH_INFO: `/v3/users/933f16b8d7c54352891e031febd00f31` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:52.848496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933f16b8d7c54352891e031febd00f31)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:52.848496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:53.014775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933f16b8d7c54352891e031febd00f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:53.031247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933f16b8d7c54352891e031febd00f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:53.032154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933f16b8d7c54352891e031febd00f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:53.055392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933f16b8d7c54352891e031febd00f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:53.056231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933f16b8d7c54352891e031febd00f31'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:53.102016 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3789/7525] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:52 2022] DELETE /identity/v3/users/933f16b8d7c54352891e031febd00f31 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:53.611326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:53.615315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:53.633910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f3a95a-ad44-43bf-8358-547b16bc37ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:53.893209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:53.894993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:53.900429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:53.900429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] PATH_INFO: `/v3/projects/1ef03e28078e4b35b93a1e159ba9caa8` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:53.903489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef03e28078e4b35b93a1e159ba9caa8)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:53.905877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:53.950446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:54.055177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef03e28078e4b35b93a1e159ba9caa8', 'request_id': 'req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.069706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef03e28078e4b35b93a1e159ba9caa8', 'request_id': 'req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.083727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef03e28078e4b35b93a1e159ba9caa8', 'request_id': 'req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.128049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] The token cache is being invalidate because project 1ef03e28078e4b35b93a1e159ba9caa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:54.128912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.132832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.145989 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3737/7526] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:53 2022] DELETE /identity/v3/projects/1ef03e28078e4b35b93a1e159ba9caa8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:54.147156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:54.149648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:54.181235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa6d88-a62f-40ab-9203-4dd19310dc37 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:54.433391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:20:54.489195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:54.494580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:54.496039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:54.496848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] PATH_INFO: `/v3/users/319723010cec4217bcc0dfb354d8b775` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:54.499784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=319723010cec4217bcc0dfb354d8b775)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:54.502424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:54.648716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '319723010cec4217bcc0dfb354d8b775'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.674431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '319723010cec4217bcc0dfb354d8b775'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.675365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '319723010cec4217bcc0dfb354d8b775'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.694119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '319723010cec4217bcc0dfb354d8b775'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.695691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '319723010cec4217bcc0dfb354d8b775'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:54.749579 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3790/7527] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:20:54 2022] DELETE /identity/v3/users/319723010cec4217bcc0dfb354d8b775 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:20:55.497750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:20:55.501079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:20:55.562598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19eb27-21b7-499c-a7a5-c2dc91ce1b6e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:20:55.771351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:20:55.772714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:20:55.773124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:20:55.773559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] PATH_INFO: `/v3/projects/19cf478b2c3a47348bfbd73df7b4536d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:20:55.775083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19cf478b2c3a47348bfbd73df7b4536d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:20:55.777193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:20:55.874490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19cf478b2c3a47348bfbd73df7b4536d', 'request_id': 'req-de91932b-0b23-4ca6-acb4-84a39cb9696f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:55.886788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19cf478b2c3a47348bfbd73df7b4536d', 'request_id': 'req-de91932b-0b23-4ca6-acb4-84a39cb9696f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:55.908562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19cf478b2c3a47348bfbd73df7b4536d', 'request_id': 'req-de91932b-0b23-4ca6-acb4-84a39cb9696f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:55.952025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] The token cache is being invalidate because project 19cf478b2c3a47348bfbd73df7b4536d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:20:55.952477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:55.953401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-de91932b-0b23-4ca6-acb4-84a39cb9696f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:20:55.968503 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3738/7528] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:20:55 2022] DELETE /identity/v3/projects/19cf478b2c3a47348bfbd73df7b4536d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:00.163040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:00.165127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:00.181469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83a600-ad18-4bc5-9cf4-02ced7977bd7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:00.255960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:00.257653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:00.258334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:00.258918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] PATH_INFO: `/v3/users/085d8dd3dc344e0ebda868c44fc92b9e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:00.260498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=085d8dd3dc344e0ebda868c44fc92b9e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:00.262647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:00.340544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085d8dd3dc344e0ebda868c44fc92b9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:00.359277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085d8dd3dc344e0ebda868c44fc92b9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:00.361163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085d8dd3dc344e0ebda868c44fc92b9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:00.378466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085d8dd3dc344e0ebda868c44fc92b9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:00.379224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085d8dd3dc344e0ebda868c44fc92b9e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:00.387323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:00.413067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3791/7529] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:00 2022] DELETE /identity/v3/users/085d8dd3dc344e0ebda868c44fc92b9e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:00.417842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:00.418743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:00.419194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:00.443943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:00.445601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:00.481931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:00.552123 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3739/7530] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:00.566680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:00.569970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:00.664907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f1d93-f5ec-444c-8d5a-00076d12ea33 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:00.668196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:00.669064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:00.669345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:00.669615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:00.682551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:00.684068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:00.698673 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3792/7531] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:00.996188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:00.998479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:01.027200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0402259-8958-40c8-9ca1-eec321c3dfd8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:01.033894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:01.034902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:01.035384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:01.035750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] PATH_INFO: `/v3/projects/3870a141a2b6444793c3641c2b8a6a58` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:01.037116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3870a141a2b6444793c3641c2b8a6a58)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:01.040364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:01.092719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3870a141a2b6444793c3641c2b8a6a58', 'request_id': 'req-4d313907-98c6-4109-9a65-4d1e21858c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.099959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3870a141a2b6444793c3641c2b8a6a58', 'request_id': 'req-4d313907-98c6-4109-9a65-4d1e21858c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.106644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3870a141a2b6444793c3641c2b8a6a58', 'request_id': 'req-4d313907-98c6-4109-9a65-4d1e21858c7b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.121097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] The token cache is being invalidate because project 3870a141a2b6444793c3641c2b8a6a58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:01.121383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.122040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.125855 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3740/7532] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:00 2022] DELETE /identity/v3/projects/3870a141a2b6444793c3641c2b8a6a58 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:01.127746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:01.138145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c6c8c-62cc-4c58-a002-8106a6b8ca4e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:01.200056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:01.200919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:01.201294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:01.201665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] PATH_INFO: `/v3/users/2557f1f21a3f46a39ff622dab519f1f4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:01.203186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2557f1f21a3f46a39ff622dab519f1f4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:01.205245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:01.260209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2557f1f21a3f46a39ff622dab519f1f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.268870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2557f1f21a3f46a39ff622dab519f1f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.269796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2557f1f21a3f46a39ff622dab519f1f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.277619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2557f1f21a3f46a39ff622dab519f1f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.279057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a14c0bb8-e0b6-4049-a497-d6d77c3e5b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2557f1f21a3f46a39ff622dab519f1f4'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.299067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3793/7533] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:01 2022] DELETE /identity/v3/users/2557f1f21a3f46a39ff622dab519f1f4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:01.623690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:01.625354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:01.641778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d313907-98c6-4109-9a65-4d1e21858c7b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:01.735121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:01.735821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:01.736105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:01.736381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] PATH_INFO: `/v3/projects/0874597a9d8640a1acafbe38c13b86ac` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:01.737649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0874597a9d8640a1acafbe38c13b86ac)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:01.739720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:01.796894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0874597a9d8640a1acafbe38c13b86ac', 'request_id': 'req-38d9b89b-0f49-4f8f-a46c-be9a74941480'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.810162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0874597a9d8640a1acafbe38c13b86ac', 'request_id': 'req-38d9b89b-0f49-4f8f-a46c-be9a74941480'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.814853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:01.824515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0874597a9d8640a1acafbe38c13b86ac', 'request_id': 'req-38d9b89b-0f49-4f8f-a46c-be9a74941480'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.839667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] The token cache is being invalidate because project 0874597a9d8640a1acafbe38c13b86ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:01.841931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.844768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-38d9b89b-0f49-4f8f-a46c-be9a74941480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:01.846518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3741/7534] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:01 2022] DELETE /identity/v3/projects/0874597a9d8640a1acafbe38c13b86ac => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:01.853404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:01.853717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:01.854043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:01.872978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:01.881958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:01.886079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:01.957988 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3794/7535] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:01.965588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:01.965880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:01.966138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:01.989157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:01.990420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:01.999493 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3742/7536] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:02.004849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.014157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d8ee5-919b-45e6-b4c9-7a124ae6cd5c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.020644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.021266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.021529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.021925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.022475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:21:02.022774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.024423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.036650 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3795/7537] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:21:02.041120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.053691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af71995-be2f-46cc-b3c3-967777c4b9f3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.060381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.061126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.061480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.062093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.062845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.064873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.102380 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3743/7538] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:02 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:02.103925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.115302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3edbf-af1b-4694-9ca9-5dbc1dab186a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.189438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.190214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.190562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.190921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.191588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.194159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.222568 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3796/7539] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:02 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:21:02.227219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.238396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8982648-514f-403f-8133-2910a09c2e00 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.243360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.243970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.244241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.244505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.245147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.246792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.257073 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3744/7540] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:02.261234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.271319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee2c2d-8fee-453a-9244-cfe2ad9a26ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.276856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf987e-e78a-4f7d-8c2b-1873b0591b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.277479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf987e-e78a-4f7d-8c2b-1873b0591b94 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.277760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf987e-e78a-4f7d-8c2b-1873b0591b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.278080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf987e-e78a-4f7d-8c2b-1873b0591b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.278725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf987e-e78a-4f7d-8c2b-1873b0591b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.280493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf987e-e78a-4f7d-8c2b-1873b0591b94 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.292233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3797/7541] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:21:02.296111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.306825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780c5bc-6b48-43eb-a98a-c5d8e4d915a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.311660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.312314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.312589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.312856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] PATH_INFO: `/v3/projects/99d0b508aa1042fe95240e99ad4fdfb3/users/de82e374d9544130af13724a8ecc0715/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.328626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d0b508aa1042fe95240e99ad4fdfb3, user_id=de82e374d9544130af13724a8ecc0715, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.331297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.351896 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3745/7542] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:02 2022] PUT /identity/v3/projects/99d0b508aa1042fe95240e99ad4fdfb3/users/de82e374d9544130af13724a8ecc0715/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:02.362436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.362661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.362937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.394634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] MFA Rules not processed for user `de82e374d9544130af13724a8ecc0715`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:02.395261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:02.467816 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3798/7543] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:21:02.472821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.540730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c57d0-bc8d-42d2-9a23-388e573d1d9f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.548831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.549460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.549733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.550041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.550750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.552626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.585588 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3746/7544] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:02 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:02.586902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.592797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:02.599503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234be89-f0fb-4c8f-9d53-a4c481f0f9d0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.660927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.661548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.661842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.662110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.662774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.664977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.691605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3799/7545] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:02 2022] POST /identity/v3/users => generated 302 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:02.692933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.704634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad1941-6b25-4c27-a109-4bfec3b98e70 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.710281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.710995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.711329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.711685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.712467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.714256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.729852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3747/7546] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:02.735936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.752801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b33161-2a86-40dc-bc9a-d56e4f4884c1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.764603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.765376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.765723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.766086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] PATH_INFO: `/v3/projects/88f0c652185045f0928234b0ab3ef86f/users/9eaa049f476a4f34b3292777d15e255b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.788760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f0c652185045f0928234b0ab3ef86f, user_id=9eaa049f476a4f34b3292777d15e255b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.793368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.808733 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3800/7547] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:02 2022] PUT /identity/v3/projects/88f0c652185045f0928234b0ab3ef86f/users/9eaa049f476a4f34b3292777d15e255b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:02.812486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.824378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769403c6-bb92-4852-9a4c-762d2742ccd1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.903805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:02.914643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac92b62f-bf8a-42b2-981d-4ed4fcde87c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.915775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92b62f-bf8a-42b2-981d-4ed4fcde87c4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.916435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92b62f-bf8a-42b2-981d-4ed4fcde87c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.916827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92b62f-bf8a-42b2-981d-4ed4fcde87c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.918002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92b62f-bf8a-42b2-981d-4ed4fcde87c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.921002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac92b62f-bf8a-42b2-981d-4ed4fcde87c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.939709 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3748/7548] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:02.941040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:02.951890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924a7be-553e-4c07-aa89-c2df6403b1c6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:02.958924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:02.959708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.960051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.960392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] PATH_INFO: `/v3/projects/88f0c652185045f0928234b0ab3ef86f/users/9eaa049f476a4f34b3292777d15e255b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:02.962462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f0c652185045f0928234b0ab3ef86f, user_id=9eaa049f476a4f34b3292777d15e255b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:02.965230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:02.977128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3801/7549] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:02 2022] PUT /identity/v3/projects/88f0c652185045f0928234b0ab3ef86f/users/9eaa049f476a4f34b3292777d15e255b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:02.988244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:02.988563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:02.988825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:03.028078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] MFA Rules not processed for user `9eaa049f476a4f34b3292777d15e255b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:03.029935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:03.112457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3749/7550] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:03.124134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:03.125929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:03.189860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581af14-f08e-4692-b58f-6db936134616 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:03.193500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:03.194174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:03.194451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:03.194717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:03.204823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:03.206307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:03.217128 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3802/7551] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:03.270349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:03.271991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:03.287375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030fc75-2472-48e5-8cb2-6acad520d21b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:03.291742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3d10f-156a-4781-8b5e-9ec392f28e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:03.292595 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d10f-156a-4781-8b5e-9ec392f28e85 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:03.293104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d10f-156a-4781-8b5e-9ec392f28e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:03.293585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3d10f-156a-4781-8b5e-9ec392f28e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:03.358093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3d10f-156a-4781-8b5e-9ec392f28e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:03.359481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf3d10f-156a-4781-8b5e-9ec392f28e85 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:03.370839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3750/7552] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:08.179150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:08.251746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:08.260397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec995eda-a728-442f-8a3a-d795f409bfbc service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:08.265637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:08.266364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:08.266648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:08.266924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] PATH_INFO: `/v3/users/de82e374d9544130af13724a8ecc0715` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:08.268047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de82e374d9544130af13724a8ecc0715)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:08.270605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:08.329430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de82e374d9544130af13724a8ecc0715'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:08.339836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de82e374d9544130af13724a8ecc0715'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:08.340591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de82e374d9544130af13724a8ecc0715'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:08.353016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de82e374d9544130af13724a8ecc0715'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:08.354211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de82e374d9544130af13724a8ecc0715'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:08.376984 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3803/7553] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:08 2022] DELETE /identity/v3/users/de82e374d9544130af13724a8ecc0715 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:21:08.381495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:08.382008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:08.382202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:08.404884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:08.414678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:08.511108 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3751/7554] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:08.536189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:08.537542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:08.658349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6181cb-bd6a-4d38-997d-a0cf6d0b6e82 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:08.684111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:08.684111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:08.684111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:08.684455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:08.698140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:08.700283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:08.726162 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3804/7555] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:09.085139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:09.087172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:09.130524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aee06-10c8-4078-85e0-1ca6f4c146c7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:09.159382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:09.160299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:09.160680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:09.161075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] PATH_INFO: `/v3/projects/99d0b508aa1042fe95240e99ad4fdfb3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:09.164691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d0b508aa1042fe95240e99ad4fdfb3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:09.172464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:09.186699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:09.225454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d0b508aa1042fe95240e99ad4fdfb3', 'request_id': 'req-e1eb1978-75e7-43a5-a418-a4d0223381ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.232102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d0b508aa1042fe95240e99ad4fdfb3', 'request_id': 'req-e1eb1978-75e7-43a5-a418-a4d0223381ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.237854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d0b508aa1042fe95240e99ad4fdfb3', 'request_id': 'req-e1eb1978-75e7-43a5-a418-a4d0223381ab'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.251679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] The token cache is being invalidate because project 99d0b508aa1042fe95240e99ad4fdfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:09.251972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.252828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.257498 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3752/7556] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:09 2022] DELETE /identity/v3/projects/99d0b508aa1042fe95240e99ad4fdfb3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:09.258765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:09.268813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43c87d-ae2e-4cbd-ac04-20528637e1e7 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:09.328210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:09.328858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:09.329234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:09.329547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] PATH_INFO: `/v3/users/9eaa049f476a4f34b3292777d15e255b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:09.330806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eaa049f476a4f34b3292777d15e255b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:09.332744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:09.360636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:09.393687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eaa049f476a4f34b3292777d15e255b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.417016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eaa049f476a4f34b3292777d15e255b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.417732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eaa049f476a4f34b3292777d15e255b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.434955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eaa049f476a4f34b3292777d15e255b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.435803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5176e5f7-e531-4611-aa27-552c78a380b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eaa049f476a4f34b3292777d15e255b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.456360 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3805/7557] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:09 2022] DELETE /identity/v3/users/9eaa049f476a4f34b3292777d15e255b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:21:09.795942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:09.798262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:09.817527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb1978-75e7-43a5-a418-a4d0223381ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:09.891853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:09.892636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:09.893127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:09.893459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] PATH_INFO: `/v3/projects/88f0c652185045f0928234b0ab3ef86f` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:09.894846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f0c652185045f0928234b0ab3ef86f)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:09.897262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:09.948013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f0c652185045f0928234b0ab3ef86f', 'request_id': 'req-bfe88d2f-d019-49c6-8de7-81d500e4327e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.954504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f0c652185045f0928234b0ab3ef86f', 'request_id': 'req-bfe88d2f-d019-49c6-8de7-81d500e4327e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.960056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f0c652185045f0928234b0ab3ef86f', 'request_id': 'req-bfe88d2f-d019-49c6-8de7-81d500e4327e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.973051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] The token cache is being invalidate because project 88f0c652185045f0928234b0ab3ef86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:09.973345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.974014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bfe88d2f-d019-49c6-8de7-81d500e4327e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:09.975545 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3753/7558] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:09 2022] DELETE /identity/v3/projects/88f0c652185045f0928234b0ab3ef86f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:09.980827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:09.981188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:09.981528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.002093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:10.003641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:10.071735 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3806/7559] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:21:10.079352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.079641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.079916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.100145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:10.101621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:10.109888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3754/7560] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:10.114180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.124810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd56ff42-3e73-4500-b80f-a795b5da70c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.129501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.130166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.130443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.130714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.131405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:21:10.131707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.133378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.146810 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3807/7561] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:21:10.151624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.161517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a7fa5-030d-4157-a68f-32b00b35291e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.166550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.167147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.167423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.167693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.168320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.170270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.192506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:10.200872 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3755/7562] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:10.204638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.215001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f26146-e0cf-43cd-be1e-5157cdc61e43 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.274105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.274797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.274977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.275240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.275862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.277776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.299701 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3808/7563] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:10.304044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.315015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c5d67-3734-4b0f-9e1c-e6e43b086244 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.319643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.320534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.320859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.321133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.321772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.323415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.333515 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3756/7564] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:10.337620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.348147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2b93d-fbb4-48ac-b044-43034a98cee6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.353342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7b7b-8a97-4655-afac-f91c719a8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.354000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7b7b-8a97-4655-afac-f91c719a8291 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.354296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7b7b-8a97-4655-afac-f91c719a8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.354565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7b7b-8a97-4655-afac-f91c719a8291 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.355209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a7b7b-8a97-4655-afac-f91c719a8291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.356812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a7b7b-8a97-4655-afac-f91c719a8291 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.368309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3809/7565] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:10.372734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.383875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc95a4-08d7-4934-adff-77339d0faeb1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.389010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.389670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.389983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.390224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] PATH_INFO: `/v3/projects/b28e7aab5ed845efa46a60ba42356e39/users/ca49be3b9d134ae5b144cccd8eb33e08/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.405174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28e7aab5ed845efa46a60ba42356e39, user_id=ca49be3b9d134ae5b144cccd8eb33e08, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.407791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.421866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3757/7566] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:10 2022] PUT /identity/v3/projects/b28e7aab5ed845efa46a60ba42356e39/users/ca49be3b9d134ae5b144cccd8eb33e08/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:10.433654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.433960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.434254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.443087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:10.465603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] MFA Rules not processed for user `ca49be3b9d134ae5b144cccd8eb33e08`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:10.466966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:10.540728 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3810/7567] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:10.545234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.611429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf89480-745a-435a-a8a8-67705de9b722 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.616449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.617632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.617936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.618297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.618901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.620798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.652102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3758/7568] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:10.653292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.664614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe58c11-1c1f-4799-9e0e-b84ab9d4f5e5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.725075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.725782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.726143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.726415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.727339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.729289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.755489 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3811/7569] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:10.760108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.770895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206bb32-8acb-4f4e-84d4-2a7d895eee12 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.776187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.776797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.777069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.777339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.778011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.779617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.790435 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3759/7570] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:10.794774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.805019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba5e49-8865-4342-a182-28fead361436 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.809970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.810667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.810939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.811211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] PATH_INFO: `/v3/projects/c31ce474c8f8477783c1e836bf57bc4a/users/f0e76cc6c78842d8bdba6474bf2e0ba9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.826985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31ce474c8f8477783c1e836bf57bc4a, user_id=f0e76cc6c78842d8bdba6474bf2e0ba9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.829635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.843086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3812/7571] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:10 2022] PUT /identity/v3/projects/c31ce474c8f8477783c1e836bf57bc4a/users/f0e76cc6c78842d8bdba6474bf2e0ba9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:10.847178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.857773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e7bb8-0eee-470f-a1e4-efd4303ef3eb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.922464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca683548-44b9-4933-b476-c2d12733f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.923091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683548-44b9-4933-b476-c2d12733f9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.923345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683548-44b9-4933-b476-c2d12733f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.923619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca683548-44b9-4933-b476-c2d12733f9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.924257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca683548-44b9-4933-b476-c2d12733f9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.925882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca683548-44b9-4933-b476-c2d12733f9a9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.939058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3760/7572] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:10.943314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:10.964909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fb696-a271-4205-87ab-f4254dda0b5e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:10.964909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:10.964909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.964909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.965461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] PATH_INFO: `/v3/projects/c31ce474c8f8477783c1e836bf57bc4a/users/f0e76cc6c78842d8bdba6474bf2e0ba9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:10.966701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31ce474c8f8477783c1e836bf57bc4a, user_id=f0e76cc6c78842d8bdba6474bf2e0ba9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:10.969603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:10.982458 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3813/7573] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:10 2022] PUT /identity/v3/projects/c31ce474c8f8477783c1e836bf57bc4a/users/f0e76cc6c78842d8bdba6474bf2e0ba9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:21:10.993837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:10.994256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:10.994634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:11.025315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] MFA Rules not processed for user `f0e76cc6c78842d8bdba6474bf2e0ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:11.026630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:11.062741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:11.117529 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3761/7574] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:11.129187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:11.131132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:11.184172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:11.193237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea1f3d-798a-4c6c-9bcc-5ea44efc8366 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:11.197180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:11.197832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:11.198130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:11.198531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:11.212649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:11.214212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:11.224323 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3814/7575] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:11.313250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:11.326381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915b0f4-1a2a-4b71-8524-a55c7c4f7690 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:11.330174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:11.330784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:11.331059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:11.331376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:11.388654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:11.390128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:11.399602 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3762/7576] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:12.573212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:12.575021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:12.654166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d57f7d-9684-44b7-87d0-ce6a3a9bc8cd service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:12.660510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:12.661123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:12.661400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:12.661678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:12.663590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:12.722565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:12.724453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b21c55-f811-4f73-8e00-72b5f204acc1 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:12.735043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3815/7577] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:19.225007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:19.329762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a1c3c-6bbe-4a6f-93a4-e1f7976d8a01 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:19.339362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:19.340153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:19.340535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:19.340912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] PATH_INFO: `/v3/users/ca49be3b9d134ae5b144cccd8eb33e08` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:19.342289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca49be3b9d134ae5b144cccd8eb33e08)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:19.350261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:19.438975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca49be3b9d134ae5b144cccd8eb33e08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:19.455694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:19.459264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca49be3b9d134ae5b144cccd8eb33e08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:19.460897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca49be3b9d134ae5b144cccd8eb33e08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:19.472551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca49be3b9d134ae5b144cccd8eb33e08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:19.474004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca49be3b9d134ae5b144cccd8eb33e08'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:19.493942 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3763/7578] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:19 2022] DELETE /identity/v3/users/ca49be3b9d134ae5b144cccd8eb33e08 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:19.498967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:19.499877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:19.500312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:19.541403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:19.542870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:19.692369 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3816/7579] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:19.699673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:19.701481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:19.772058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef0a50-dd81-4fad-8c44-1644f6d5d7cb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:19.776696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:19.777733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:19.778201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:19.778881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:19.790333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:19.792009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:19.816324 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3764/7580] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:20.127221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:20.129228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:20.149894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd341-fc68-4b94-badb-5477687722a9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:20.164559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:20.165458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:20.166479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:20.166835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] PATH_INFO: `/v3/projects/b28e7aab5ed845efa46a60ba42356e39` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:20.169059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28e7aab5ed845efa46a60ba42356e39)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:20.171139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:20.210162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:20.256323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28e7aab5ed845efa46a60ba42356e39', 'request_id': 'req-38f2be24-e864-42a5-b093-5022a10b6549'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.263267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28e7aab5ed845efa46a60ba42356e39', 'request_id': 'req-38f2be24-e864-42a5-b093-5022a10b6549'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.269243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28e7aab5ed845efa46a60ba42356e39', 'request_id': 'req-38f2be24-e864-42a5-b093-5022a10b6549'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.283881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] The token cache is being invalidate because project b28e7aab5ed845efa46a60ba42356e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:20.284226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.284967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.287093 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3817/7581] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:20 2022] DELETE /identity/v3/projects/b28e7aab5ed845efa46a60ba42356e39 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:20.290925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:20.303194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90917dba-7235-4d95-98c1-fc2d723f502e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:20.379388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:20.380496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:20.380782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:20.381300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] PATH_INFO: `/v3/users/f0e76cc6c78842d8bdba6474bf2e0ba9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:20.382755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e76cc6c78842d8bdba6474bf2e0ba9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:20.385032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:20.438927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e76cc6c78842d8bdba6474bf2e0ba9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.452096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e76cc6c78842d8bdba6474bf2e0ba9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.452833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e76cc6c78842d8bdba6474bf2e0ba9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.460561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e76cc6c78842d8bdba6474bf2e0ba9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.461356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4a87e656-d324-48a0-b6d7-0ec8b4ff5247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e76cc6c78842d8bdba6474bf2e0ba9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.471971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:20.476691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3765/7582] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:20 2022] DELETE /identity/v3/users/f0e76cc6c78842d8bdba6474bf2e0ba9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:20.797262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:20.798759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:20.832998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2be24-e864-42a5-b093-5022a10b6549 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:20.892765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:20.893601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:20.894006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:20.894389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] PATH_INFO: `/v3/projects/c31ce474c8f8477783c1e836bf57bc4a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:20.895629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31ce474c8f8477783c1e836bf57bc4a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:20.897625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:20.948851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31ce474c8f8477783c1e836bf57bc4a', 'request_id': 'req-2b7f8c04-550d-4046-a56b-06206fe0b873'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.955841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31ce474c8f8477783c1e836bf57bc4a', 'request_id': 'req-2b7f8c04-550d-4046-a56b-06206fe0b873'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.962103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31ce474c8f8477783c1e836bf57bc4a', 'request_id': 'req-2b7f8c04-550d-4046-a56b-06206fe0b873'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.977207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] The token cache is being invalidate because project c31ce474c8f8477783c1e836bf57bc4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:20.977596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.978371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b7f8c04-550d-4046-a56b-06206fe0b873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:20.979906 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3818/7583] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:20 2022] DELETE /identity/v3/projects/c31ce474c8f8477783c1e836bf57bc4a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:20.985109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:20.986146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:20.988382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.039506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:21.043309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:21.117557 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3766/7584] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:21.127097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.129693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.130392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.157491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:21.159663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:21.169205 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3819/7585] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:21.173549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.184339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be76247d-8c03-4a1b-8569-7bae04b77d42 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.190096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.190736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.191013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.191281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.191949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:21:21.192249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.193936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.209868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3767/7586] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:21:21.214301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.228454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d3bdf9-ef4e-494b-b98a-4d892f1b1c3c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.237868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.238954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.239385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.239954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.241232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.244269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.292480 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3820/7587] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:21 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:21.295302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.309854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9d4a6-2c86-41d3-8cfa-b02e7ca9a1be admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.374581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.375147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.375427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.375756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.376389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.378343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.402973 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3768/7588] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:21 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:21.407293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.418151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe32eee-4071-47af-9038-40ce77d554e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.423180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.423878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.424185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.424430 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.425176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.426892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.434066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:21.442780 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3821/7589] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:21.444754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.455884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b567d-f62e-48ea-b8ba-d2d069f6d836 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.460826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc08c6d-42ae-4abe-90cd-5a7b4b743127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.461439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08c6d-42ae-4abe-90cd-5a7b4b743127 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.461714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08c6d-42ae-4abe-90cd-5a7b4b743127 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.462033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc08c6d-42ae-4abe-90cd-5a7b4b743127 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.462700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08c6d-42ae-4abe-90cd-5a7b4b743127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.464409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc08c6d-42ae-4abe-90cd-5a7b4b743127 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.480463 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3769/7590] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:21.481954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.492880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9648bb2-80d2-415c-8bde-f88d94a32dba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.497703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.498500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.498871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.499238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] PATH_INFO: `/v3/projects/2b1b4358363c4472b054ba19c0bda83a/users/dc93f2087f8546c4808f6d8c79bc048c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.515112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1b4358363c4472b054ba19c0bda83a, user_id=dc93f2087f8546c4808f6d8c79bc048c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.517848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.532093 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3822/7591] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:21 2022] PUT /identity/v3/projects/2b1b4358363c4472b054ba19c0bda83a/users/dc93f2087f8546c4808f6d8c79bc048c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:21.537409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5fda-26d8-4e1c-9ddb-d83fe8ecec07 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.537758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5fda-26d8-4e1c-9ddb-d83fe8ecec07 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.538182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c5fda-26d8-4e1c-9ddb-d83fe8ecec07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.566989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1a9c5fda-26d8-4e1c-9ddb-d83fe8ecec07 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:21.568367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a9c5fda-26d8-4e1c-9ddb-d83fe8ecec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:21.634378 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3770/7592] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:21.641338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:21.643125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:21.705586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975927f-17bd-410a-b2d8-88bf081c2969 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:21.709629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:21.710316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:21.710698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:21.710966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:21.720796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:21.722278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:21.732942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3823/7593] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:22.516862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:22.516862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:22.516862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:22.536754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:22.571642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] MFA Rules not processed for user `dc93f2087f8546c4808f6d8c79bc048c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:22.572995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:22.670358 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3771/7594] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:22.670709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:22.682502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec576001-0009-43af-85f1-58c90131ac6d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:22.688832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:22.694023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:22.694350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:22.694741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:22.695914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:22.697998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:22.741942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3824/7595] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:22 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:21:22.744454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:22.762260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edaddf7-f329-4c3e-8798-f00a832a7c62 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:22.840602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:22.841228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:22.841513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:22.841790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:22.842470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:22.844558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:22.873240 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3772/7596] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:22 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:22.874540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:22.886578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb073-55cd-43d9-8cba-870d9902a7fa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:22.892058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:22.892058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:22.892292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:22.892507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:22.893142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:22.895267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:22.907236 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3825/7597] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:22.911404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:22.922422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebab51b-f850-48a8-bdc7-e9b826fb3175 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:22.927355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:22.928559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:22.928559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:22.928769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] PATH_INFO: `/v3/projects/7099010e6162411aa62c4c483606fc3b/users/7b9b20cffff144c59dd1293a9f938254/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:22.945640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7099010e6162411aa62c4c483606fc3b, user_id=7b9b20cffff144c59dd1293a9f938254, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:22.948465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:22.963620 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3773/7598] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:22 2022] PUT /identity/v3/projects/7099010e6162411aa62c4c483606fc3b/users/7b9b20cffff144c59dd1293a9f938254/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:22.967882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:22.979190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3361774-288e-4c9c-a860-b769d5251f41 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:23.056165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524684e-ab44-4561-8c0e-0dfb07bd5e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:23.056789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524684e-ab44-4561-8c0e-0dfb07bd5e43 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:23.057072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524684e-ab44-4561-8c0e-0dfb07bd5e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:23.057345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524684e-ab44-4561-8c0e-0dfb07bd5e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:23.058168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524684e-ab44-4561-8c0e-0dfb07bd5e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:23.059791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524684e-ab44-4561-8c0e-0dfb07bd5e43 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:23.075279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3826/7599] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:23.076651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:23.091812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cacf17-dc70-4576-a433-eebcd432c2a0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:23.097235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0835e7-575d-40ea-b3f8-5711aea06ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:23.097987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0835e7-575d-40ea-b3f8-5711aea06ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:23.098325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0835e7-575d-40ea-b3f8-5711aea06ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:23.098591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0835e7-575d-40ea-b3f8-5711aea06ed8 admin admin] PATH_INFO: `/v3/projects/7099010e6162411aa62c4c483606fc3b/users/7b9b20cffff144c59dd1293a9f938254/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:23.100596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0835e7-575d-40ea-b3f8-5711aea06ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7099010e6162411aa62c4c483606fc3b, user_id=7b9b20cffff144c59dd1293a9f938254, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:23.103399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0835e7-575d-40ea-b3f8-5711aea06ed8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:23.115274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3774/7600] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:23 2022] PUT /identity/v3/projects/7099010e6162411aa62c4c483606fc3b/users/7b9b20cffff144c59dd1293a9f938254/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:23.787300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:23.788143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:23.788532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:23.821299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] MFA Rules not processed for user `7b9b20cffff144c59dd1293a9f938254`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:23.822685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:23.874317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:23.938953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3827/7601] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:23.950655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:23.951297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:23.951297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:23.975444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] MFA Rules not processed for user `dc93f2087f8546c4808f6d8c79bc048c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:23.977123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:24.029644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:24.043570 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3775/7602] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:24.063749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:24.065469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:24.150097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c415e5-87d2-46c3-a074-16c552b8dcf1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:24.157884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57458d56-5b8f-4b65-b33d-3d493c66a60b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:24.158513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458d56-5b8f-4b65-b33d-3d493c66a60b service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:24.158792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458d56-5b8f-4b65-b33d-3d493c66a60b service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:24.159061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57458d56-5b8f-4b65-b33d-3d493c66a60b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:24.167861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57458d56-5b8f-4b65-b33d-3d493c66a60b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:24.169486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57458d56-5b8f-4b65-b33d-3d493c66a60b service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:24.183018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3828/7603] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:24.460838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:24.462479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:24.549381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e5e71-9ff1-47ad-af64-eaf7af17d5b2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:24.553391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:24.554078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:24.554443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:24.554729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:24.557012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:24.570290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:24.571822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:24.582908 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3776/7604] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:34.175156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=49 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:34.578387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=29 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:39.216254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:39.216782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:39.216782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:39.257215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] MFA Rules not processed for user `b612ecc5516f4f6ead6ca28d74911292`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:39.262029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:39.496342 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3829/7605] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:42.448431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:42.450058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:42.656692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904927b-6c7f-4cb2-931f-9cbfef2307d3 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:42.660726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbc6ab-4f65-4458-8340-f49a6f0f1f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:42.661519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc6ab-4f65-4458-8340-f49a6f0f1f06 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:42.661974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc6ab-4f65-4458-8340-f49a6f0f1f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:42.662422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbc6ab-4f65-4458-8340-f49a6f0f1f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:42.686031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc6ab-4f65-4458-8340-f49a6f0f1f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:42.687708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbc6ab-4f65-4458-8340-f49a6f0f1f06 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:42.717937 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3777/7606] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:46.305593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:46.307169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:46.395583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37812e3e-9d96-4825-a060-f5ab27d0ce4e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:46.402052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:46.404154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:46.404511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:46.404855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] PATH_INFO: `/v3/users/55ea022ab23b43999311c9448ce5eea6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:46.406253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=55ea022ab23b43999311c9448ce5eea6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:46.409423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:46.511111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55ea022ab23b43999311c9448ce5eea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:46.531144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55ea022ab23b43999311c9448ce5eea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:46.531991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55ea022ab23b43999311c9448ce5eea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:46.564248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55ea022ab23b43999311c9448ce5eea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:46.566847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55ea022ab23b43999311c9448ce5eea6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:46.619289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3830/7607] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:46 2022] DELETE /identity/v3/users/55ea022ab23b43999311c9448ce5eea6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:46.623647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:46.624156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:46.625554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:46.670195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:46.671499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:46.826600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3778/7608] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:21:46.836757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:46.838652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:46.873332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:46.875621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:46.894365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:46.946005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65ebec-85a3-4197-8dfe-814fa093b2ca admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:46.957312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:46.958314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:46.958776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:46.959196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:46.985284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996f56e-9282-47e4-90da-ce0baf01ada1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:46.989187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:46.989948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:46.991208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:46.991594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:46.991996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:46.992666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:46.994736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:47.003865 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3831/7609] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:47.010364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:47.012598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:47.025357 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3779/7610] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:47.829035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:47.830891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:47.880735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373b53-6db9-445a-bf35-a1281da65a73 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:47.895084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:47.895885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:47.896407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:47.896674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] PATH_INFO: `/v3/projects/e5852496af804ff69acb17ee09051c01` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:47.898476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5852496af804ff69acb17ee09051c01)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:47.901994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:47.972599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5852496af804ff69acb17ee09051c01', 'request_id': 'req-faa6ae4d-5f24-4b70-a0be-bc358383182e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:47.981925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5852496af804ff69acb17ee09051c01', 'request_id': 'req-faa6ae4d-5f24-4b70-a0be-bc358383182e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:47.989848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5852496af804ff69acb17ee09051c01', 'request_id': 'req-faa6ae4d-5f24-4b70-a0be-bc358383182e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.010282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] The token cache is being invalidate because project e5852496af804ff69acb17ee09051c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:48.010706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.011488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.013399 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3832/7611] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:47 2022] DELETE /identity/v3/projects/e5852496af804ff69acb17ee09051c01 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:48.017296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:48.029944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dd8a7-4ebb-4a03-b084-d4cbbe902994 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:48.084023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:48.100608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:48.102047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:48.102604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:48.103095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] PATH_INFO: `/v3/users/40be306aa7b24380b98d82d71fa851d6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:48.104554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40be306aa7b24380b98d82d71fa851d6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:48.106893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:48.192614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40be306aa7b24380b98d82d71fa851d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.210522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40be306aa7b24380b98d82d71fa851d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.211486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40be306aa7b24380b98d82d71fa851d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.220921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40be306aa7b24380b98d82d71fa851d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.221971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40be306aa7b24380b98d82d71fa851d6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:48.250294 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3780/7612] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:48 2022] DELETE /identity/v3/users/40be306aa7b24380b98d82d71fa851d6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:49.305838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:49.307895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:49.331878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6ae4d-5f24-4b70-a0be-bc358383182e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:49.415120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:49.416177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:49.416607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:49.417172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] PATH_INFO: `/v3/projects/ae6cfa90bb214640a5a58a6cae2e3aa4` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:49.418560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6cfa90bb214640a5a58a6cae2e3aa4)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:49.420687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:49.495702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:49.497370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:49.508382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6cfa90bb214640a5a58a6cae2e3aa4', 'request_id': 'req-6c760c02-10eb-4134-ad9e-6978c709d94b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:49.510824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:49.520469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6cfa90bb214640a5a58a6cae2e3aa4', 'request_id': 'req-6c760c02-10eb-4134-ad9e-6978c709d94b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:49.533083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6cfa90bb214640a5a58a6cae2e3aa4', 'request_id': 'req-6c760c02-10eb-4134-ad9e-6978c709d94b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:49.567727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] The token cache is being invalidate because project ae6cfa90bb214640a5a58a6cae2e3aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:49.568291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:49.569723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6c760c02-10eb-4134-ad9e-6978c709d94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:49.574264 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3833/7613] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:49 2022] DELETE /identity/v3/projects/ae6cfa90bb214640a5a58a6cae2e3aa4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:49.580280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c235a9-9308-44d0-9d05-09d055ccca46 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:49.580706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c235a9-9308-44d0-9d05-09d055ccca46 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:49.581078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c235a9-9308-44d0-9d05-09d055ccca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:49.617506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3504bc-0f50-4d99-b70e-7119a090f786 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:49.623423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d6c235a9-9308-44d0-9d05-09d055ccca46 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:49.624785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d6c235a9-9308-44d0-9d05-09d055ccca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:49.696565 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3834/7614] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:49.698861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:49.699716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:49.702988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:49.703501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:49.704021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:49.704378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:49.704833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:49.706221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:49.727849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:49.729743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:49.731467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:49.733109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:49.748439 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3835/7615] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:21:49.755563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:49.772880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ef86-d8f1-4a1e-b30d-8503d50e7941 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:49.775056 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3781/7616] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:21:49.779181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:49.779821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:49.780498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:49.780792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:49.781481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:21:49.781790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:49.784047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:49.818297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3836/7617] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:21:49.824897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:49.862237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aee65-c318-4707-b970-20f9ac95733a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:49.891494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:49.894363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:49.894995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:49.897522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:49.898392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:49.904627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:49.964826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3782/7618] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:49 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:49.969539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:49.980752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ec9d7-d8af-485f-9cf6-a204c502b3ab admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.142367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.143089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.143467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.143985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.145021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.147399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.182292 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3837/7619] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:49 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:50.182582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.187996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:50.201771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa2084-81ff-4245-a026-663351d243fd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.207462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.208099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.210224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.210628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.211438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.213512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.231384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.243784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3783/7620] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:21:50.244287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d9374-923e-4913-8426-a68f8fb1da0b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.249296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6f27e-9e1b-4e34-a20d-3bcd9810bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.250755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6f27e-9e1b-4e34-a20d-3bcd9810bf93 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.251139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6f27e-9e1b-4e34-a20d-3bcd9810bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.251513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6f27e-9e1b-4e34-a20d-3bcd9810bf93 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.252262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6f27e-9e1b-4e34-a20d-3bcd9810bf93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.254191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c6f27e-9e1b-4e34-a20d-3bcd9810bf93 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.267681 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3838/7621] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:50.272670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.284767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58fb1d7-db31-44f6-abf7-9446a6c5194e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.289780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.290644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.291613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.291613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] PATH_INFO: `/v3/projects/88b166eed7e54f71a0f839adb1bf12b0/users/666b17a62ddd4a33832a3298a720c462/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.311485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b166eed7e54f71a0f839adb1bf12b0, user_id=666b17a62ddd4a33832a3298a720c462, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.315093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.343487 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3784/7622] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:50 2022] PUT /identity/v3/projects/88b166eed7e54f71a0f839adb1bf12b0/users/666b17a62ddd4a33832a3298a720c462/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:50.350523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04942e2a-0556-4f09-823c-229035abb642 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.351041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04942e2a-0556-4f09-823c-229035abb642 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.351299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04942e2a-0556-4f09-823c-229035abb642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.388416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-04942e2a-0556-4f09-823c-229035abb642 None None] MFA Rules not processed for user `666b17a62ddd4a33832a3298a720c462`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:50.390908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-04942e2a-0556-4f09-823c-229035abb642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:50.432995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:50.490389 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3839/7623] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:50.491081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.584150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939f7ee-1b5b-4c75-89bb-b0b9584affe5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.590308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.591566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.592038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.592375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.593277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.595539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.641126 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3785/7624] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:50 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:21:50.642624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04942e2a-0556-4f09-823c-229035abb642 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.656343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04942e2a-0556-4f09-823c-229035abb642 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.738065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.743085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.743683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.744158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.745389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.750465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.808113 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3840/7625] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:50 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:50.809705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.828781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288ef46-317e-40a9-8571-5a8eaf76e8a1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.838626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.839644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.840038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.840664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.841510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.843274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.875848 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3786/7626] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:50.880270 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:50.895861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5554de-7892-4b71-ab86-2c2622aea011 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:50.903454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:50.904322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:50.904735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:50.905151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] PATH_INFO: `/v3/projects/64137c734e9943908471cd8c3b641caf/users/6cfc22fb453b458bba2a7b8fe9cdc03b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:50.942459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64137c734e9943908471cd8c3b641caf, user_id=6cfc22fb453b458bba2a7b8fe9cdc03b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:50.945170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:50.975668 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3841/7627] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:50 2022] PUT /identity/v3/projects/64137c734e9943908471cd8c3b641caf/users/6cfc22fb453b458bba2a7b8fe9cdc03b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:50.976892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:51.003965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c07ec-1688-4e9c-97fa-fb6b9c0bf188 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:51.090625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428e0aa-7f22-44f0-a2bf-534cfa54b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:51.091652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e0aa-7f22-44f0-a2bf-534cfa54b91b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:51.092033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e0aa-7f22-44f0-a2bf-534cfa54b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:51.092424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428e0aa-7f22-44f0-a2bf-534cfa54b91b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:51.093175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428e0aa-7f22-44f0-a2bf-534cfa54b91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:51.095037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428e0aa-7f22-44f0-a2bf-534cfa54b91b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:51.119171 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3787/7628] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:51.119429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:51.139925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dea428-60b3-4588-b5d4-13ca037df1bd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:51.160170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:51.160876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:51.161155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:51.161429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] PATH_INFO: `/v3/projects/64137c734e9943908471cd8c3b641caf/users/6cfc22fb453b458bba2a7b8fe9cdc03b/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:51.163674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64137c734e9943908471cd8c3b641caf, user_id=6cfc22fb453b458bba2a7b8fe9cdc03b, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:51.166407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:51.202897 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3842/7629] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:51 2022] PUT /identity/v3/projects/64137c734e9943908471cd8c3b641caf/users/6cfc22fb453b458bba2a7b8fe9cdc03b/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:21:51.206507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:51.206507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:51.206507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:51.270648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] MFA Rules not processed for user `6cfc22fb453b458bba2a7b8fe9cdc03b`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:51.276581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:51.371404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:51.470117 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3788/7630] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:51.476819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:51.479392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:51.568526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a5e18-a00c-460f-8b8c-a6c6fbaadbb7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:51.573502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c13a5-c38b-4c20-ae99-abe3b10d90af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:51.574494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c13a5-c38b-4c20-ae99-abe3b10d90af service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:51.575061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c13a5-c38b-4c20-ae99-abe3b10d90af service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:51.575642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c13a5-c38b-4c20-ae99-abe3b10d90af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:51.589424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c13a5-c38b-4c20-ae99-abe3b10d90af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:51.591643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c13a5-c38b-4c20-ae99-abe3b10d90af service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:51.604316 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3843/7631] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:21:52.184197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:52.294420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdce1a-320b-4635-95f0-e628b8e0b7c1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:52.315199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:52.315944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:52.316453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:52.316961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] PATH_INFO: `/v3/users/666b17a62ddd4a33832a3298a720c462` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:52.318776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666b17a62ddd4a33832a3298a720c462)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:52.321410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:52.397362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666b17a62ddd4a33832a3298a720c462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:52.415404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666b17a62ddd4a33832a3298a720c462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:52.416675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666b17a62ddd4a33832a3298a720c462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:52.428542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666b17a62ddd4a33832a3298a720c462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:52.429973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666b17a62ddd4a33832a3298a720c462'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:52.455924 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3789/7632] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:52 2022] DELETE /identity/v3/users/666b17a62ddd4a33832a3298a720c462 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:52.460933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:52.461220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:52.461506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:52.500381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:52.505238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:52.579181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:52.658146 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3844/7633] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:52.680359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:52.682440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:52.816987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:52.843581 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742da95-90e4-4b55-909d-ebc946ca3d91 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:52.855061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:52.859068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:52.860405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:52.860980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:52.900352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:52.904338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:52.933283 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3790/7634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:53.476732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:53.478304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:53.515445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db39958-6070-4cb4-a45c-872168f7b9b2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:53.551262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:53.554982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:53.560965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:53.561357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] PATH_INFO: `/v3/projects/88b166eed7e54f71a0f839adb1bf12b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:53.563784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b166eed7e54f71a0f839adb1bf12b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:53.566720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:53.660245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b166eed7e54f71a0f839adb1bf12b0', 'request_id': 'req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.667753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b166eed7e54f71a0f839adb1bf12b0', 'request_id': 'req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.675953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b166eed7e54f71a0f839adb1bf12b0', 'request_id': 'req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.693432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] The token cache is being invalidate because project 88b166eed7e54f71a0f839adb1bf12b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:53.694258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.695147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.697196 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3845/7635] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:53 2022] DELETE /identity/v3/projects/88b166eed7e54f71a0f839adb1bf12b0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:53.701575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:53.712811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100bd5b-e8aa-400e-8a0e-62f93a7237ae service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:53.778642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:53.779593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:53.779987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:53.780363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] PATH_INFO: `/v3/users/6cfc22fb453b458bba2a7b8fe9cdc03b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:53.781669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfc22fb453b458bba2a7b8fe9cdc03b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:53.783882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:53.863601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfc22fb453b458bba2a7b8fe9cdc03b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.881122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfc22fb453b458bba2a7b8fe9cdc03b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.881960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfc22fb453b458bba2a7b8fe9cdc03b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.890395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfc22fb453b458bba2a7b8fe9cdc03b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.891119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bd13fd8e-72b4-4cc4-873d-cc31eb38b7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfc22fb453b458bba2a7b8fe9cdc03b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:53.956789 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3791/7636] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:21:53 2022] DELETE /identity/v3/users/6cfc22fb453b458bba2a7b8fe9cdc03b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:21:54.373980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:54.375633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:54.400053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855aa7b-66a6-40bc-ad57-f0d098ad5cac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:54.541596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:54.543157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:54.543600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:54.544034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] PATH_INFO: `/v3/projects/64137c734e9943908471cd8c3b641caf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:54.546318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64137c734e9943908471cd8c3b641caf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:54.548999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:54.625704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64137c734e9943908471cd8c3b641caf', 'request_id': 'req-3dbf66c8-5d9a-48fe-993f-8312d4c57934'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:54.627861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:54.636665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64137c734e9943908471cd8c3b641caf', 'request_id': 'req-3dbf66c8-5d9a-48fe-993f-8312d4c57934'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:54.647245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64137c734e9943908471cd8c3b641caf', 'request_id': 'req-3dbf66c8-5d9a-48fe-993f-8312d4c57934'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:54.670306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] The token cache is being invalidate because project 64137c734e9943908471cd8c3b641caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:21:54.670843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:54.671780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3dbf66c8-5d9a-48fe-993f-8312d4c57934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:21:54.673682 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3846/7637] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:21:54 2022] DELETE /identity/v3/projects/64137c734e9943908471cd8c3b641caf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:54.678649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:54.678974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:54.679299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:54.718339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:54.719451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:54.848528 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3792/7638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:54.858525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:54.858525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:54.858525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:54.881983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:54.883404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:54.897797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:54.905618 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3847/7639] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:54.905777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:54.910521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb34402-dff0-4945-bddd-f3ef6f21b61b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:54.918957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:54.919722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:54.920519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:54.921022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:54.921796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:21:54.922246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:54.924035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:54.944072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:54.951412 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3793/7640] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:21:54.956744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb378d-68c1-41fe-8a5f-3ef0046ac2cf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:54.962902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:54.963715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:54.964064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:54.964397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:54.965146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:54.967720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.017040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:55.048873 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3848/7641] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:54 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:55.057567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929f0e6-2890-4f14-97a7-611a83cab7fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:55.212993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:55.213917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.214494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.215007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.215802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:55.218119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.263304 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3794/7642] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:55 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:55.267431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:55.295631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00217d-8f40-493c-be51-036c9c4537c4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:55.300701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:55.301866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.302154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.302429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.303080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:55.305272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.318377 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3849/7643] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:55.321642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:55.333786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa2ed-3dc9-43c3-a7bd-e28f59ca2fc3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:55.339516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8819d655-3e2d-4a5d-8cb1-6a4e17b7b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:55.340154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819d655-3e2d-4a5d-8cb1-6a4e17b7b1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.340554 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819d655-3e2d-4a5d-8cb1-6a4e17b7b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.340836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8819d655-3e2d-4a5d-8cb1-6a4e17b7b1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.341482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819d655-3e2d-4a5d-8cb1-6a4e17b7b1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:55.343191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8819d655-3e2d-4a5d-8cb1-6a4e17b7b1f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.393968 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3795/7644] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:55.397851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:55.410770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac99a0-d76b-4861-9cd4-1a3b4e332871 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:55.416781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:55.417428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.417826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.418186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] PATH_INFO: `/v3/projects/a437897ada0f456fb332d7570d7e0edc/users/418e5ca67ff245899e6f1c0049d7d039/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.435365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a437897ada0f456fb332d7570d7e0edc, user_id=418e5ca67ff245899e6f1c0049d7d039, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:55.438656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.455920 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3850/7645] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:55 2022] PUT /identity/v3/projects/a437897ada0f456fb332d7570d7e0edc/users/418e5ca67ff245899e6f1c0049d7d039/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:55.467147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.467643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.468042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.501713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] MFA Rules not processed for user `418e5ca67ff245899e6f1c0049d7d039`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:55.504969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:55.609964 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3796/7646] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:21:55.613935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:55.715289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b92375-2bb7-4578-b51b-6b6489210498 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:55.721267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:55.722042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.722514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.723073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.723806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:55.727975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.770917 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3851/7647] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:55 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:21:55.775780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:55.791716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34341c01-5b35-4f2a-8dd5-eb815f74a24b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:55.963672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:55.964901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:55.965249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:55.966535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:55.967281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:55.969402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:55.978627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:56.005598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3797/7648] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:55 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:56.009539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:56.043385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b21a6d-d447-469e-84de-cb3327562ef3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:56.069641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:56.070495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:56.070776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:56.071046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:56.071699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:56.077912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:56.105636 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3852/7649] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:56.109049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:56.138527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cbd24e-dde5-41a6-9426-34694bc40e9d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:56.166291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba69d7-bfa6-45db-a3de-254679758299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:56.167313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba69d7-bfa6-45db-a3de-254679758299 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:56.167981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba69d7-bfa6-45db-a3de-254679758299 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:56.176980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba69d7-bfa6-45db-a3de-254679758299 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:56.177851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba69d7-bfa6-45db-a3de-254679758299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:56.179722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba69d7-bfa6-45db-a3de-254679758299 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:56.211202 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3798/7650] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:21:56.216772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:56.278911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cebac22-8672-402c-82dd-99ea85a3e06c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:56.312019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:56.312961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:56.313410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:56.313891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] PATH_INFO: `/v3/projects/7228a3eef03244378513886aa6f0655e/users/33bebc4490a84fbf870232cb921ec5fa/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:56.341296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7228a3eef03244378513886aa6f0655e, user_id=33bebc4490a84fbf870232cb921ec5fa, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:56.344260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:56.377888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3853/7651] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:56 2022] PUT /identity/v3/projects/7228a3eef03244378513886aa6f0655e/users/33bebc4490a84fbf870232cb921ec5fa/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:56.387962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:56.388485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:56.388957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:56.448089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] MFA Rules not processed for user `33bebc4490a84fbf870232cb921ec5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:56.449481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:56.648348 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3799/7652] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:21:56.653486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:56.711106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:56.761883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53093d64-c938-466b-9b1e-4c831b7fc46c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:56.768512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:56.769211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:56.769583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:56.770010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:56.770790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:56.773280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:56.814235 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3854/7653] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:21:56 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:56.818552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:56.833672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21257036-7c35-4dd2-87fa-86b125027182 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:56.929431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:56.929696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:56.930120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:56.930460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:56.931170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:56.933596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:56.966124 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3800/7654] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:21:56 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:21:56.970213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:57.004490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871c5e1-0c91-48c0-b962-165538cb88f5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:57.011553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:57.012633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.013226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.013694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.016486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:57.018843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:57.042020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:57.073367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143524a9-60b6-4307-8b38-e28700f25eb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:57.079471 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3855/7655] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:21:57.094645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:57.096386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.096838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.097328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] PATH_INFO: `/v3/projects/1fe0a93dd9b642b8a06755f6ba0cf651/users/9046da82a7e44d8386b53f5cee6e79cd/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.123545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe0a93dd9b642b8a06755f6ba0cf651, user_id=9046da82a7e44d8386b53f5cee6e79cd, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:57.128489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:57.150036 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3801/7656] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:57 2022] PUT /identity/v3/projects/1fe0a93dd9b642b8a06755f6ba0cf651/users/9046da82a7e44d8386b53f5cee6e79cd/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:57.150880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:57.167605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c22b74-bfa4-413e-8956-10e9dc17c2b9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:57.271581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa51d2-979e-4d88-b802-d07b751e6a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:57.272331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa51d2-979e-4d88-b802-d07b751e6a20 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.272855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa51d2-979e-4d88-b802-d07b751e6a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.273227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa51d2-979e-4d88-b802-d07b751e6a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.274012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa51d2-979e-4d88-b802-d07b751e6a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:57.275905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa51d2-979e-4d88-b802-d07b751e6a20 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:57.293431 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3856/7657] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:21:57.294750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:57.319187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fe39f-af4d-4033-96c7-8f6c2be34203 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:57.339956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:57.341258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.341546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.341837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] PATH_INFO: `/v3/projects/1fe0a93dd9b642b8a06755f6ba0cf651/users/9046da82a7e44d8386b53f5cee6e79cd/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.346687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fe0a93dd9b642b8a06755f6ba0cf651, user_id=9046da82a7e44d8386b53f5cee6e79cd, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:57.350107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:57.363489 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3802/7658] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:21:57 2022] PUT /identity/v3/projects/1fe0a93dd9b642b8a06755f6ba0cf651/users/9046da82a7e44d8386b53f5cee6e79cd/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:21:57.375306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.375726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.376207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.410734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] MFA Rules not processed for user `9046da82a7e44d8386b53f5cee6e79cd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:21:57.414017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:57.505053 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3857/7659] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:21:57 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:21:57.517979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:57.521145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:57.548062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:57.598881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de02178-42ea-4683-80ba-22960dd3a083 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:57.604775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:57.605402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.605680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.605986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.617663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:57.620625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:57.645448 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3803/7660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:57.684176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:57.685789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:57.703217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d587e-61a1-424a-a900-557e5c12dbaa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:57.710068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:57.710919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:57.711377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:57.711751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:57.733333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:21:57.785538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:57.787322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:57.798129 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3858/7661] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:21:58.539648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:21:58.541090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:58.656903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0a5a7-037a-4a02-8e04-d8fd4899fce9 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:21:58.663224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:21:58.663871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:21:58.664149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:21:58.664419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:21:58.669784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:21:58.817838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:21:58.820699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:21:58.835906 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3804/7662] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:21:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:05.271678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:05.274046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:05.307130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c434-fe27-4d33-a94a-93bf7d014b25 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:05.313776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:05.314929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:05.315398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:05.316003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] PATH_INFO: `/v3/users/d2867c5be8974c028f933d1c8fe2c2fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:05.317477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2867c5be8974c028f933d1c8fe2c2fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:05.321147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:05.432722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2867c5be8974c028f933d1c8fe2c2fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:05.446838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2867c5be8974c028f933d1c8fe2c2fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:05.447727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2867c5be8974c028f933d1c8fe2c2fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:05.463671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2867c5be8974c028f933d1c8fe2c2fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:05.464451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2867c5be8974c028f933d1c8fe2c2fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:05.503284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3859/7663] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:05 2022] DELETE /identity/v3/users/d2867c5be8974c028f933d1c8fe2c2fa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:05.839937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:05.852102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:05.854178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:05.854678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e6f1-8c8c-478e-a169-d4370c3c4e96 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:05.963844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa827a55-b673-4d26-b0c1-02f379cfbf4b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:05.973494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:05.974677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:05.975314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:05.975916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] PATH_INFO: `/v3/users/418e5ca67ff245899e6f1c0049d7d039` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:05.980457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=418e5ca67ff245899e6f1c0049d7d039)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:05.982625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.038456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:06.039500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.039996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.040481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] PATH_INFO: `/v3/projects/b9abafce931f45438286305af9b7a64a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.050687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9abafce931f45438286305af9b7a64a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:06.053104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.057742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:06.087286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:06.088395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418e5ca67ff245899e6f1c0049d7d039'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.112913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418e5ca67ff245899e6f1c0049d7d039'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.113680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418e5ca67ff245899e6f1c0049d7d039'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.138464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418e5ca67ff245899e6f1c0049d7d039'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.141228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f4b52b61-764d-4f5c-8269-bb491f4ee7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418e5ca67ff245899e6f1c0049d7d039'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.154232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9abafce931f45438286305af9b7a64a', 'request_id': 'req-52feff1c-10ee-4036-a952-7450ec362491'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.170295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9abafce931f45438286305af9b7a64a', 'request_id': 'req-52feff1c-10ee-4036-a952-7450ec362491'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.181621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9abafce931f45438286305af9b7a64a', 'request_id': 'req-52feff1c-10ee-4036-a952-7450ec362491'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.204131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] The token cache is being invalidate because project b9abafce931f45438286305af9b7a64a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:06.204988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.206588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-52feff1c-10ee-4036-a952-7450ec362491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:06.211173 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3805/7664] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:05 2022] DELETE /identity/v3/projects/b9abafce931f45438286305af9b7a64a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:06.219014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ffef9-ecc3-45f5-9b9f-ecd8bed38a6d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.219889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ffef9-ecc3-45f5-9b9f-ecd8bed38a6d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.220375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ffef9-ecc3-45f5-9b9f-ecd8bed38a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.227236 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3860/7665] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:05 2022] DELETE /identity/v3/users/418e5ca67ff245899e6f1c0049d7d039 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:06.244728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.245838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.248020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.266936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b57ffef9-ecc3-45f5-9b9f-ecd8bed38a6d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:06.268385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b57ffef9-ecc3-45f5-9b9f-ecd8bed38a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:06.340596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:06.346374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:06.420058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3806/7666] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:06.432526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.433381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.434388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.513211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:06.514511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:06.555592 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3807/7667] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:06.562664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:06.577391 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3861/7668] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:06.579883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e065e-19d4-42d7-be3e-28fc453e98d4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:06.587399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:06.588177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.588467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.588853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.589456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:06.589759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:06.590124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:06.591629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.591849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:06.609204 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3808/7669] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:06.617442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:06.631424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434aa9d-c1ea-493d-be35-e86cf5bade63 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:06.637638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:06.638315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.638597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.639107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.639752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:06.642261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.691998 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3809/7670] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:06 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:06.694140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:06.723267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64d969-3d93-423b-89fc-b06b054ce589 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:06.800372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:06.801366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.801491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.802034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.831156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:06.835418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674303-7a47-4eb2-882c-b89927c867c9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:06.859191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:06.860461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.860995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.861632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.862596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:06.864931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.883537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:06.919774 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3810/7671] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:06 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:06.920945 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:06.943759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaa0aa-292f-4fa1-a2fd-401c3a996538 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:06.956372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:06.957017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:06.957299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:06.957707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:06.958411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:06.960090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.978689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:06.980293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:06.989941 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3811/7672] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:06.995343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.013769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7dc18-286f-451c-b8d6-da36694cc82d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.018421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3862/7673] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:07.025489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e89f5-f880-4246-9205-5b6822a97fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:07.026163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e89f5-f880-4246-9205-5b6822a97fae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.026447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e89f5-f880-4246-9205-5b6822a97fae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.026723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e89f5-f880-4246-9205-5b6822a97fae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.027370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e89f5-f880-4246-9205-5b6822a97fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:07.029011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e89f5-f880-4246-9205-5b6822a97fae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:07.056195 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3812/7674] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:07.057615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.070557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e148a99-60ce-4cb9-a537-0e992fc88051 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.075797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:07.076622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.076908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.077182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] PATH_INFO: `/v3/projects/f3c2ec228616493ea8aa375275cb9c6e/users/eb5796e247494cbdb0be4b44dd9a4f68/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.094522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3c2ec228616493ea8aa375275cb9c6e, user_id=eb5796e247494cbdb0be4b44dd9a4f68, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:07.097693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:07.134502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3863/7675] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:07 2022] PUT /identity/v3/projects/f3c2ec228616493ea8aa375275cb9c6e/users/eb5796e247494cbdb0be4b44dd9a4f68/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:07.136354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.136912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.137218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.180887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] MFA Rules not processed for user `eb5796e247494cbdb0be4b44dd9a4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:07.182223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:07.269226 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3813/7676] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:07.269710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.416446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdccce1-a2c8-49ae-9548-187b4077bca4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.432009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:07.432823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.433355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.433733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.435452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:07.437744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:07.506544 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3864/7677] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:07 2022] POST /identity/v3/projects => generated 403 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:07.511274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.527514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8198b8-81cd-4873-9f8b-9970e47b15d8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.663126 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:07.664292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.664854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.665239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.666012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:07.668158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:07.730599 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3814/7678] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:07 2022] POST /identity/v3/users => generated 308 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:07.734977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.747101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25b1d9-e73c-48e6-b2d5-70a2e6d95cc5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.753588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:07.754317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.754878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.755003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.755816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:07.757480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:07.775519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.782605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3865/7679] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:07.786407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74527d-f018-49c0-a947-f1d76a264989 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.798470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:07.799430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:07.799642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:07.800331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] PATH_INFO: `/v3/projects/c2671807254f4ec4afd68e8624b04215/users/798f4fd1a40144bfb1fe985bcb461ba1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:07.828898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2671807254f4ec4afd68e8624b04215, user_id=798f4fd1a40144bfb1fe985bcb461ba1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:07.833974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:07.845103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.849079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:07.888663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba2f58-5a44-4c0d-8bd2-81849e363532 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:07.893434 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3815/7680] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:07 2022] PUT /identity/v3/projects/c2671807254f4ec4afd68e8624b04215/users/798f4fd1a40144bfb1fe985bcb461ba1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:07.895421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:07.994675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:08.087642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:08.088423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.088636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.088908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] PATH_INFO: `/v3/projects/a437897ada0f456fb332d7570d7e0edc` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.090605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a437897ada0f456fb332d7570d7e0edc)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:08.093919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:08.098284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b376-82a0-4145-98ad-ab3c3631a182 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:08.103614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:08.114066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:08.114706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.114983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.115256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.115954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:08.117974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:08.143358 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3816/7681] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:08.144311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:08.152964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a437897ada0f456fb332d7570d7e0edc', 'request_id': 'req-53508b09-ee8a-4e02-b2f7-1db257bbce48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.169507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b7a05-e5a5-4804-9067-829384020da7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:08.173469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a437897ada0f456fb332d7570d7e0edc', 'request_id': 'req-53508b09-ee8a-4e02-b2f7-1db257bbce48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.184545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a437897ada0f456fb332d7570d7e0edc', 'request_id': 'req-53508b09-ee8a-4e02-b2f7-1db257bbce48'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.203986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] The token cache is being invalidate because project a437897ada0f456fb332d7570d7e0edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:08.204426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.205269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.210034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3866/7682] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:07 2022] DELETE /identity/v3/projects/a437897ada0f456fb332d7570d7e0edc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:08.211219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:08.216399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:08.276276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e2881-50a9-4ffa-8609-ec957f72ddf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:08.277097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2881-50a9-4ffa-8609-ec957f72ddf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.277383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2881-50a9-4ffa-8609-ec957f72ddf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.277659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e2881-50a9-4ffa-8609-ec957f72ddf0 admin admin] PATH_INFO: `/v3/projects/c2671807254f4ec4afd68e8624b04215/users/798f4fd1a40144bfb1fe985bcb461ba1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.283873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e2881-50a9-4ffa-8609-ec957f72ddf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2671807254f4ec4afd68e8624b04215, user_id=798f4fd1a40144bfb1fe985bcb461ba1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:08.289929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e2881-50a9-4ffa-8609-ec957f72ddf0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:08.321034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3817/7683] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:08 2022] PUT /identity/v3/projects/c2671807254f4ec4afd68e8624b04215/users/798f4fd1a40144bfb1fe985bcb461ba1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:08.331282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.331575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.331856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.359329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53508b09-ee8a-4e02-b2f7-1db257bbce48 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:08.422477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] MFA Rules not processed for user `798f4fd1a40144bfb1fe985bcb461ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:08.423651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:08.458524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:08.460197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.461182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.461182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] PATH_INFO: `/v3/users/33bebc4490a84fbf870232cb921ec5fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.462652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bebc4490a84fbf870232cb921ec5fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:08.464710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:08.549001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:08.551257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bebc4490a84fbf870232cb921ec5fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.573188 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3818/7684] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:08.573631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bebc4490a84fbf870232cb921ec5fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.574637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bebc4490a84fbf870232cb921ec5fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.575194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:08.587547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18011320-d6a6-4e2b-a9de-28805da8562d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:08.590972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bebc4490a84fbf870232cb921ec5fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.593027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bebc4490a84fbf870232cb921ec5fa'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:08.594236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798f4fd1a40144bfb1fe985bcb461ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2671807254f4ec4afd68e8624b04215', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:08.595076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.595747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.596278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.597452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:08.599443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:08.642307 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3819/7685] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:22:08 2022] POST /identity/v3/roles => generated 240 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:08.645061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:08.647468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:08.651129 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3867/7686] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:08 2022] DELETE /identity/v3/users/33bebc4490a84fbf870232cb921ec5fa => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:08.665775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61aead3-52e0-47bb-8ae6-344f53171fd8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:08.695729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:08.744525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798f4fd1a40144bfb1fe985bcb461ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2671807254f4ec4afd68e8624b04215', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:08.745362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:08.745734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:08.746201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] PATH_INFO: `/v3/projects/f3c2ec228616493ea8aa375275cb9c6e/users/eb5796e247494cbdb0be4b44dd9a4f68/roles/70b7db414ead456ba6fe3f25be4e1619` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:08.752543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f3c2ec228616493ea8aa375275cb9c6e, user_id=eb5796e247494cbdb0be4b44dd9a4f68, role_id=70b7db414ead456ba6fe3f25be4e1619)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:08.757170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:08.782084 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3820/7687] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:08 2022] PUT /identity/v3/projects/f3c2ec228616493ea8aa375275cb9c6e/users/eb5796e247494cbdb0be4b44dd9a4f68/roles/70b7db414ead456ba6fe3f25be4e1619 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:08.783536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:08.785340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:08.918276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fac05-fce3-4641-a92a-8ea5cff78417 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:09.060518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:09.065022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1783d4-925b-494c-b91c-398be34e924a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5796e247494cbdb0be4b44dd9a4f68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3c2ec228616493ea8aa375275cb9c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1111645988'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:09.065746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1783d4-925b-494c-b91c-398be34e924a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:09.066746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1783d4-925b-494c-b91c-398be34e924a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:09.066965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1783d4-925b-494c-b91c-398be34e924a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] PATH_INFO: `/v3/users/eb5796e247494cbdb0be4b44dd9a4f68/application_credentials` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:09.067715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1783d4-925b-494c-b91c-398be34e924a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] RBAC: Authorizing `identity:create_application_credential(user_id=eb5796e247494cbdb0be4b44dd9a4f68)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:09.068504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:09.068978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1783d4-925b-494c-b91c-398be34e924a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:09.245925 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3868/7688] 10.222.0.16 () {60 vars in 1315 bytes} [Sat Oct 29 03:22:08 2022] POST /identity/v3/users/eb5796e247494cbdb0be4b44dd9a4f68/application_credentials => generated 659 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:09.250196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:09.250483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:09.250843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:09.262064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:09.289365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] MFA Rules not processed for user `eb5796e247494cbdb0be4b44dd9a4f68`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:09.290941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:09.321467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b3af11-1a88-4a8f-97fb-292d2365c2f8 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:09.331799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:09.332538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:09.332749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:09.333006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] PATH_INFO: `/v3/projects/7228a3eef03244378513886aa6f0655e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:09.337276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7228a3eef03244378513886aa6f0655e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:09.339282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:09.457320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7228a3eef03244378513886aa6f0655e', 'request_id': 'req-461d192f-f12b-4b7e-8119-88c39c2c02a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.465352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7228a3eef03244378513886aa6f0655e', 'request_id': 'req-461d192f-f12b-4b7e-8119-88c39c2c02a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.472741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7228a3eef03244378513886aa6f0655e', 'request_id': 'req-461d192f-f12b-4b7e-8119-88c39c2c02a3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.491378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] The token cache is being invalidate because project 7228a3eef03244378513886aa6f0655e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:09.491724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.492778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.494720 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3821/7689] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:09 2022] DELETE /identity/v3/projects/7228a3eef03244378513886aa6f0655e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:09.501557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:09.507293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:09.543981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3869/7690] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:09 2022] POST /identity/v3/auth/tokens => generated 3394 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 29 03:22:09.551924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:09.637716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:09.645766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c21c-308e-4ee6-9598-e41fd166d34a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:09.657204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d192f-f12b-4b7e-8119-88c39c2c02a3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:09.657845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb5796e247494cbdb0be4b44dd9a4f68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3c2ec228616493ea8aa375275cb9c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-1111645988'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:09.660934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:09.661265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:09.663625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] PATH_INFO: `/v3/users/eb5796e247494cbdb0be4b44dd9a4f68/application_credentials/c9abe404969e4a51802f515f30a9a90b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:09.664496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:09.665371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:09.665609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] RBAC: Authorizing `identity:delete_application_credential(user_id=eb5796e247494cbdb0be4b44dd9a4f68, application_credential_id=c9abe404969e4a51802f515f30a9a90b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:09.666106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:09.666619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] PATH_INFO: `/v3/users/9046da82a7e44d8386b53f5cee6e79cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:09.667990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9046da82a7e44d8386b53f5cee6e79cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:09.669783 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:09.671281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:09.706231 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3870/7691] 10.222.0.16 () {58 vars in 1395 bytes} [Sat Oct 29 03:22:09 2022] DELETE /identity/v3/users/eb5796e247494cbdb0be4b44dd9a4f68/application_credentials/c9abe404969e4a51802f515f30a9a90b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:09.711945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:09.719189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:09.783436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9046da82a7e44d8386b53f5cee6e79cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.802381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:09.821972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9046da82a7e44d8386b53f5cee6e79cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.822721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9046da82a7e44d8386b53f5cee6e79cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.849558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9046da82a7e44d8386b53f5cee6e79cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.850493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9046da82a7e44d8386b53f5cee6e79cd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:09.886685 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3822/7692] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:09 2022] DELETE /identity/v3/users/9046da82a7e44d8386b53f5cee6e79cd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:09.887562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:09.888932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:09.917934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01747671-d514-4192-9052-251452ac267a tempest-ApplicationCredentialsV3AdminTest-622149073 tempest-ApplicationCredentialsV3AdminTest-622149073-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:10.076201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b2ad2-aa1c-46e7-9b05-b3b7e075b72f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:10.086636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:10.087841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:10.088338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:10.088533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:10.091028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:10.099569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '798f4fd1a40144bfb1fe985bcb461ba1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2671807254f4ec4afd68e8624b04215', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:10.100388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:10.100682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:10.100959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] PATH_INFO: `/v3/roles/70b7db414ead456ba6fe3f25be4e1619` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:10.109768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:10.111850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:10.113873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: Authorizing `identity:delete_role(role_id=70b7db414ead456ba6fe3f25be4e1619)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:10.119514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:10.132416 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3823/7693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:10.248068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Invalidating the token cache because role 70b7db414ead456ba6fe3f25be4e1619 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:10.248591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.249599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.252186 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3871/7694] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:09 2022] DELETE /identity/v3/roles/70b7db414ead456ba6fe3f25be4e1619 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:10.258442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:10.261013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:10.448962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:10.468416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269e473-c8a8-4d70-a94c-c10172cb4f11 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:10.641285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:10.646025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:10.655940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:10.658164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:10.659539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:10.660331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] PATH_INFO: `/v3/users/eb5796e247494cbdb0be4b44dd9a4f68` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:10.663892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5796e247494cbdb0be4b44dd9a4f68)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:10.669562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:10.687755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b7c70-ec7c-40ec-98e2-b6eb9c353423 tempest-ApplicationCredentialsV3AdminTest-2125550224 tempest-ApplicationCredentialsV3AdminTest-2125550224-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:10.705921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:10.705921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:10.705921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:10.705921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] PATH_INFO: `/v3/projects/1fe0a93dd9b642b8a06755f6ba0cf651` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:10.707399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fe0a93dd9b642b8a06755f6ba0cf651)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:10.713285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:10.819861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5796e247494cbdb0be4b44dd9a4f68'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.836229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5796e247494cbdb0be4b44dd9a4f68'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.837174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5796e247494cbdb0be4b44dd9a4f68'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.846727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5796e247494cbdb0be4b44dd9a4f68'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.847228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fe0a93dd9b642b8a06755f6ba0cf651', 'request_id': 'req-c877b83a-de21-42a6-8e8c-da4725ca635c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.847843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-014bbece-f937-4bf8-9f75-763564f30686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5796e247494cbdb0be4b44dd9a4f68'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.859498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fe0a93dd9b642b8a06755f6ba0cf651', 'request_id': 'req-c877b83a-de21-42a6-8e8c-da4725ca635c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.872810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fe0a93dd9b642b8a06755f6ba0cf651', 'request_id': 'req-c877b83a-de21-42a6-8e8c-da4725ca635c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.877234 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3824/7695] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:10 2022] DELETE /identity/v3/users/eb5796e247494cbdb0be4b44dd9a4f68 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:10.890009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:10.890478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:10.890935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:10.903013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] The token cache is being invalidate because project 1fe0a93dd9b642b8a06755f6ba0cf651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:10.903354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.905217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c877b83a-de21-42a6-8e8c-da4725ca635c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:10.907017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3872/7696] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:10 2022] DELETE /identity/v3/projects/1fe0a93dd9b642b8a06755f6ba0cf651 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:10.915906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429001a-1ee8-42ed-a2a2-f30883d132f2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:10.916240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429001a-1ee8-42ed-a2a2-f30883d132f2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:10.916520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429001a-1ee8-42ed-a2a2-f30883d132f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:10.925373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:10.926755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:10.941988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6429001a-1ee8-42ed-a2a2-f30883d132f2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:10.944761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6429001a-1ee8-42ed-a2a2-f30883d132f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:10.971143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:11.007027 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3825/7697] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:11.013744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.015323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:11.063987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:11.079230 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3873/7698] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:11.080993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.081431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.082238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.107336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:11.108042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89b146-2708-43a5-8c11-40d5ae696302 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.108563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:11.112600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.113561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.114161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.114635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.121147 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3874/7699] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:11.122439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.129766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.132508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.135966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b5038-7648-47e7-9936-aa7d987e136a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.145349 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3826/7700] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:11.145846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.146900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.147235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.148042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.148812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:11.149129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.151011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.165188 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3875/7701] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:11.170894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.182508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f25e5-f9fc-4415-a352-fefce43426aa service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.187359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.188381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.189288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.189562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.190240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.192868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.250797 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3827/7702] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:11 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:11.252222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.267524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a8c8b7-9fbb-4e14-9684-3bd6699f3a3b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.337157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.337793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.338165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.338497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.339929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.341988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.379787 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3876/7703] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:11 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:11.381078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.392797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dbe16-1719-4c45-b749-3e4fda48f474 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.398229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.398932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.399442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.399559 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.400406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.402106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.418765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.419287 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3828/7704] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:11.433797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee8817-ce30-441d-b2cf-a2b3c7e95ffd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.438791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a88183-e3d6-4ce5-95be-dd14b29f06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.439624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88183-e3d6-4ce5-95be-dd14b29f06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.439966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88183-e3d6-4ce5-95be-dd14b29f06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.440303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a88183-e3d6-4ce5-95be-dd14b29f06a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.441144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88183-e3d6-4ce5-95be-dd14b29f06a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.442737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a88183-e3d6-4ce5-95be-dd14b29f06a0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.454672 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3877/7705] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:11.458845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.475452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4323b-c411-4a1a-82e7-7ce48c00e218 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.481427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.482238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.483120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.483428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] PATH_INFO: `/v3/projects/68ca1c9ce32f45d48a7ad400f9946cfa/users/7a9d2ede84b946958b6efcb9b2bda29d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.517790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ca1c9ce32f45d48a7ad400f9946cfa, user_id=7a9d2ede84b946958b6efcb9b2bda29d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.520672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.557369 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3829/7706] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:11 2022] PUT /identity/v3/projects/68ca1c9ce32f45d48a7ad400f9946cfa/users/7a9d2ede84b946958b6efcb9b2bda29d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:11.568055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.568609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.569198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.635774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] MFA Rules not processed for user `7a9d2ede84b946958b6efcb9b2bda29d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:11.636903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:11.685482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.687493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:11.841791 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3878/7707] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:11.846066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:11.872018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7756c-bdd0-490c-8edb-c4cf80e2f902 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.879485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331de8e-8a5a-4601-87ed-310e6fd891a2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:11.882584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66428735-9254-4882-b926-8fff70970acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.883293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66428735-9254-4882-b926-8fff70970acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.883673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66428735-9254-4882-b926-8fff70970acf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.883863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66428735-9254-4882-b926-8fff70970acf admin admin] PATH_INFO: `/v3/projects/f3c2ec228616493ea8aa375275cb9c6e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.885544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66428735-9254-4882-b926-8fff70970acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3c2ec228616493ea8aa375275cb9c6e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.889356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66428735-9254-4882-b926-8fff70970acf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.894134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:11.895712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:11.896268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:11.896268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:11.898608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:11.904281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:11.972485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:11.977437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3c2ec228616493ea8aa375275cb9c6e', 'request_id': 'req-66428735-9254-4882-b926-8fff70970acf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:11.986816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3c2ec228616493ea8aa375275cb9c6e', 'request_id': 'req-66428735-9254-4882-b926-8fff70970acf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:11.995163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3c2ec228616493ea8aa375275cb9c6e', 'request_id': 'req-66428735-9254-4882-b926-8fff70970acf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.003776 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3879/7708] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:11 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:12.005111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.014625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:12.022958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66428735-9254-4882-b926-8fff70970acf admin admin] The token cache is being invalidate because project f3c2ec228616493ea8aa375275cb9c6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:12.023552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.032622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.035001 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3830/7709] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:11 2022] DELETE /identity/v3/projects/f3c2ec228616493ea8aa375275cb9c6e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:12.039235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.043539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:12.142884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7674e-c413-4418-ab0a-625c5a0958fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:12.149162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:12.150078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.150631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.151010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.152337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:12.154873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:12.195052 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3880/7710] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:12 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:12.201051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.206913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:12.213283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66428735-9254-4882-b926-8fff70970acf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:12.223464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:12.225282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.226560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.227362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] PATH_INFO: `/v3/users/798f4fd1a40144bfb1fe985bcb461ba1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.228958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] RBAC: Authorizing `identity:delete_user(user_id=798f4fd1a40144bfb1fe985bcb461ba1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:12.236118 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee716d91-b229-4d40-b267-c6f6a6671004 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:12.236608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:12.252935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:12.255517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.255872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.256275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.257194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:12.258969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:12.281204 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3881/7711] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:12.285712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.310989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d35b6-7baf-4c1a-a878-9bd50f0b19a5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:12.325792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:12.327369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.327651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.327924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] PATH_INFO: `/v3/projects/f305e6b9316c4718bcdf6d007b682be7/users/ebfa4443e8f44e8489dcd602fe738ac9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.338637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798f4fd1a40144bfb1fe985bcb461ba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.359584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798f4fd1a40144bfb1fe985bcb461ba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.360600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798f4fd1a40144bfb1fe985bcb461ba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.379518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f305e6b9316c4718bcdf6d007b682be7, user_id=ebfa4443e8f44e8489dcd602fe738ac9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:12.381494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798f4fd1a40144bfb1fe985bcb461ba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.382680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798f4fd1a40144bfb1fe985bcb461ba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:12.383299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:12.422182 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3882/7712] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:12 2022] PUT /identity/v3/projects/f305e6b9316c4718bcdf6d007b682be7/users/ebfa4443e8f44e8489dcd602fe738ac9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:12.422182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.422517 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3831/7713] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:12 2022] DELETE /identity/v3/users/798f4fd1a40144bfb1fe985bcb461ba1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:12.434622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:12.524255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ebafe-abef-41e4-8b84-72d03c5eca17 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:12.607412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:12.623784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd580f-d0de-4b9d-af99-0bc0f7e53bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:12.624583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd580f-d0de-4b9d-af99-0bc0f7e53bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.624865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd580f-d0de-4b9d-af99-0bc0f7e53bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.625727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd580f-d0de-4b9d-af99-0bc0f7e53bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.625880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd580f-d0de-4b9d-af99-0bc0f7e53bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:12.630070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbd580f-d0de-4b9d-af99-0bc0f7e53bc5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:12.643634 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3883/7714] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:12.648188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.666562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1521f-1b20-4c67-a1e6-1486142f950f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:12.690951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:12.691664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.691948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.692830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] PATH_INFO: `/v3/projects/f305e6b9316c4718bcdf6d007b682be7/users/ebfa4443e8f44e8489dcd602fe738ac9/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.698932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f305e6b9316c4718bcdf6d007b682be7, user_id=ebfa4443e8f44e8489dcd602fe738ac9, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:12.702319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:12.738694 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3832/7715] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:12 2022] PUT /identity/v3/projects/f305e6b9316c4718bcdf6d007b682be7/users/ebfa4443e8f44e8489dcd602fe738ac9/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:12.750505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:12.750797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:12.751076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:12.824274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:12.827123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:12.836214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] MFA Rules not processed for user `ebfa4443e8f44e8489dcd602fe738ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:12.853762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:12.988034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee3df4-c495-46ac-b930-12a2df86b399 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.011517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.012191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.012463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.012768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] PATH_INFO: `/v3/projects/c2671807254f4ec4afd68e8624b04215` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.014034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2671807254f4ec4afd68e8624b04215)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.015956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.030829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:13.067881 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3884/7716] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:13.082201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.083893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:13.120976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2671807254f4ec4afd68e8624b04215', 'request_id': 'req-9600b21f-47a6-4ffa-a651-54232f92b9fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:13.154691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2671807254f4ec4afd68e8624b04215', 'request_id': 'req-9600b21f-47a6-4ffa-a651-54232f92b9fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:13.167941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246f963-9e7d-44b6-95be-6bd27677aca6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.170010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2671807254f4ec4afd68e8624b04215', 'request_id': 'req-9600b21f-47a6-4ffa-a651-54232f92b9fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:13.199492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] The token cache is being invalidate because project c2671807254f4ec4afd68e8624b04215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:13.199811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:13.200600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9600b21f-47a6-4ffa-a651-54232f92b9fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:13.207400 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3833/7717] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:12 2022] DELETE /identity/v3/projects/c2671807254f4ec4afd68e8624b04215 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:13.209414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531ad1-306f-495f-a46c-42a6a89ecd69 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.210228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531ad1-306f-495f-a46c-42a6a89ecd69 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.210580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1531ad1-306f-495f-a46c-42a6a89ecd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.236505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d1531ad1-306f-495f-a46c-42a6a89ecd69 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:13.238473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d1531ad1-306f-495f-a46c-42a6a89ecd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:13.298732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.300673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.300951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.301243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.309272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:13.352865 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3834/7718] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:13.464326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.464326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.464326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.472461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:13.497486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.497986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:13.499290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.499544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:13.515389 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3885/7719] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:13.517276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.529632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990960cf-5d3d-440b-97e2-84dcbb423510 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.529900 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3835/7720] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:13.535150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.535973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.536321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.536934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.537719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:13.538386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.540090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.563492 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3886/7721] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:13.568402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.585128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885574d-4f99-4986-8b8d-19e4e2c7f228 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.590103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.591537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.591820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.592093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.592739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.594875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.650939 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3836/7722] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:13 2022] POST /identity/v3/projects => generated 369 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:13.655574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.676744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73097c0-eb33-4114-85c1-c0c5d511f33e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.797510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.797987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.798306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.798765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.799421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.803414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.833061 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3887/7723] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:13 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:13.834861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.864537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada92fa-6aa0-46b9-8b03-ca7e7ad96ebd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.877109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.878269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.879302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.879635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.880359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.883314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.908888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3837/7724] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:13.913135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.926442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc970c63-73bb-4473-9815-592cc6b8f9ba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.933460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7c776-ff9e-4e90-9ba1-78fc32fdfd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.934163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7c776-ff9e-4e90-9ba1-78fc32fdfd07 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.934594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7c776-ff9e-4e90-9ba1-78fc32fdfd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.934907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7c776-ff9e-4e90-9ba1-78fc32fdfd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.935463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7c776-ff9e-4e90-9ba1-78fc32fdfd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.938198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7c776-ff9e-4e90-9ba1-78fc32fdfd07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:13.955577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3888/7725] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:13.956822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:13.970055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c47bc-8166-4543-bfe9-e9d587e2a387 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:13.975659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:13.976701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:13.977046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:13.977491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] PATH_INFO: `/v3/projects/380165076cd84243a617f3fc4b4ef5da/users/158668c4dc634fe1b66defd7e59e014e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:13.996256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380165076cd84243a617f3fc4b4ef5da, user_id=158668c4dc634fe1b66defd7e59e014e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:13.999068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.018535 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3838/7726] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:13 2022] PUT /identity/v3/projects/380165076cd84243a617f3fc4b4ef5da/users/158668c4dc634fe1b66defd7e59e014e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:14.031326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.031861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.033649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.071396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] MFA Rules not processed for user `158668c4dc634fe1b66defd7e59e014e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:14.073340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:14.190087 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3889/7727] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:14.194951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.236736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:14.285376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b212e1c-7386-4243-85e2-61eba1d309d8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.293157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.294135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.294627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.295048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.296276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:14.298799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.348825 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3839/7728] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:14 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:14.349044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.361092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e71153-3562-4731-a451-6f8ea90b6b41 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.405523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.407580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:14.430763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:14.489068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.490025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.490337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.490650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.493026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:14.493501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a457c0-c7f4-47bc-9cfe-b945ed978945 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.496052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.499742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.500477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.500832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.501886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] PATH_INFO: `/v3/users/7a9d2ede84b946958b6efcb9b2bda29d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.503145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9d2ede84b946958b6efcb9b2bda29d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:14.506205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.551426 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3890/7729] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:14 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:14.557133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.571729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04498cf3-563a-4c48-ad04-9760b9201d47 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.580415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9d2ede84b946958b6efcb9b2bda29d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:14.582761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.588716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.589761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.590174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.591565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:14.594906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.601216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9d2ede84b946958b6efcb9b2bda29d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:14.602088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9d2ede84b946958b6efcb9b2bda29d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:14.615479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9d2ede84b946958b6efcb9b2bda29d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:14.616493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7366ea61-25dc-42d6-9001-6e84d9c5a88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9d2ede84b946958b6efcb9b2bda29d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:14.621851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3891/7730] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:14.623330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.626626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:14.643015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491202f-ef1c-4b75-b36d-f69aee569817 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.644259 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3840/7731] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:14 2022] DELETE /identity/v3/users/7a9d2ede84b946958b6efcb9b2bda29d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:14.650649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.651295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.651884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.688967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:14.690727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:14.763748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:14.767978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.770173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.770939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.773866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] PATH_INFO: `/v3/projects/7767ac8215d44607836d5e5c101c5831/users/6f05d64f260943f09f79cab4413bd493/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.796801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7767ac8215d44607836d5e5c101c5831, user_id=6f05d64f260943f09f79cab4413bd493, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:14.801550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.819095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3841/7732] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:14.825593 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3892/7733] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:14 2022] PUT /identity/v3/projects/7767ac8215d44607836d5e5c101c5831/users/6f05d64f260943f09f79cab4413bd493/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:14.830723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.831670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:14.834273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:14.842226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a7b52-93ab-478d-a2c5-2d2753867a5f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.935962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad57d7c-292a-416c-8fa3-cf6714f02f63 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:14.940660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.941639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.942274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.942759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.971807 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:14.972715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:14.973059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:14.973319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:14.974587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:14.976333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:14.991141 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3842/7734] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:14.996549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:15.011460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1af3bc-832b-4a90-a1b9-52defbf88b7f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:15.014978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:15.020659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e730-7902-44cb-a6e4-15419f885ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:15.021346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e730-7902-44cb-a6e4-15419f885ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:15.021694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e730-7902-44cb-a6e4-15419f885ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:15.022848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e730-7902-44cb-a6e4-15419f885ff7 admin admin] PATH_INFO: `/v3/projects/7767ac8215d44607836d5e5c101c5831/users/6f05d64f260943f09f79cab4413bd493/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:15.029089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e730-7902-44cb-a6e4-15419f885ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7767ac8215d44607836d5e5c101c5831, user_id=6f05d64f260943f09f79cab4413bd493, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:15.035284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e730-7902-44cb-a6e4-15419f885ff7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:15.040953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:15.042699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:15.052338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3843/7735] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:14 2022] PUT /identity/v3/projects/7767ac8215d44607836d5e5c101c5831/users/6f05d64f260943f09f79cab4413bd493/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:15.054567 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3893/7736] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:15.062491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:15.063069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:15.063904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:15.142242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] MFA Rules not processed for user `6f05d64f260943f09f79cab4413bd493`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:15.143923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:15.237856 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3844/7737] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:15.240062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:15.369015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f755c7-b015-4958-a9bb-07e3bb4720ba service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:15.379011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:15.379802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:15.380299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:15.380864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:15.381767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:15.384136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:15.492771 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3894/7738] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:15 2022] POST /identity/v3/projects => generated 359 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:15.516320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:15.531537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eea71e-259c-4832-8369-9732d657ee2a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:15.641180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:15.674630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:15.675330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:15.676248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:15.676804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:15.677190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:15.683242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:15.746444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3845/7739] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:15 2022] POST /identity/v3/users => generated 413 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:15.750920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:15.770635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1227-229e-4fee-8b75-0b669da4d70f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:15.785924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:15.788151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:15.788682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:15.789268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/users/4d45b14f9e2b42998f173dfd8d5633a5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:15.840821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:15.842866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:15.852129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_user(user_id=4d45b14f9e2b42998f173dfd8d5633a5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:15.854609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:15.856587 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3895/7740] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:22:15 2022] GET /identity/v3/users/4d45b14f9e2b42998f173dfd8d5633a5 => generated 413 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:15.861079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:15.882126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6479f2a-1296-4ebe-8587-8657fa86c1b3 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:15.887813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:15.888551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:15.888989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:15.889297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/users/4d45b14f9e2b42998f173dfd8d5633a5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:15.890827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4d45b14f9e2b42998f173dfd8d5633a5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:15.893329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:15.962962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d45b14f9e2b42998f173dfd8d5633a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:15.983732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d45b14f9e2b42998f173dfd8d5633a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:15.984846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d45b14f9e2b42998f173dfd8d5633a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.014551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d35b-1756-46e4-97d9-0cf9eced97db tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:16.021730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:16.023190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:16.024397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:16.024821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] PATH_INFO: `/v3/projects/68ca1c9ce32f45d48a7ad400f9946cfa` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:16.026943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ca1c9ce32f45d48a7ad400f9946cfa)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:16.029241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:16.029454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d45b14f9e2b42998f173dfd8d5633a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.030506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d45b14f9e2b42998f173dfd8d5633a5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.055955 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3896/7741] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:15 2022] DELETE /identity/v3/users/4d45b14f9e2b42998f173dfd8d5633a5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:16.061986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:16.065937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:16.105121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ca1c9ce32f45d48a7ad400f9946cfa', 'request_id': 'req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.120732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ca1c9ce32f45d48a7ad400f9946cfa', 'request_id': 'req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.130769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ca1c9ce32f45d48a7ad400f9946cfa', 'request_id': 'req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.149958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:16.155257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] The token cache is being invalidate because project 68ca1c9ce32f45d48a7ad400f9946cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:16.155642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.157249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.159716 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3846/7742] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:15 2022] DELETE /identity/v3/projects/68ca1c9ce32f45d48a7ad400f9946cfa => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:16.163768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:16.165266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:16.221454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8f19f-f8a0-4cb9-86b3-926dcb02470c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:16.300566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc6cf8-e016-43ff-8e6f-fe69e6895daf admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:16.310495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:16.311165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:16.311449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:16.311726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] PATH_INFO: `/v3/users/ebfa4443e8f44e8489dcd602fe738ac9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:16.315750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfa4443e8f44e8489dcd602fe738ac9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:16.317706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:16.337948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:16.352995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:16.355887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:16.356385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:16.357233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/cad39cb7f24c4c03a8814d04476fb00c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:16.360696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cad39cb7f24c4c03a8814d04476fb00c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:16.364289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:16.451944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfa4443e8f44e8489dcd602fe738ac9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.470007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfa4443e8f44e8489dcd602fe738ac9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.470924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfa4443e8f44e8489dcd602fe738ac9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.479589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad39cb7f24c4c03a8814d04476fb00c', 'request_id': 'req-40cff081-42b9-47cf-ad67-038161ebb04a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.488498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfa4443e8f44e8489dcd602fe738ac9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.489629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfa4443e8f44e8489dcd602fe738ac9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.493017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad39cb7f24c4c03a8814d04476fb00c', 'request_id': 'req-40cff081-42b9-47cf-ad67-038161ebb04a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.512305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad39cb7f24c4c03a8814d04476fb00c', 'request_id': 'req-40cff081-42b9-47cf-ad67-038161ebb04a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.543380 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3847/7743] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:16 2022] DELETE /identity/v3/users/ebfa4443e8f44e8489dcd602fe738ac9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:16.568750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project cad39cb7f24c4c03a8814d04476fb00c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:16.569085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.571273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:16.576028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3897/7744] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:16 2022] DELETE /identity/v3/projects/cad39cb7f24c4c03a8814d04476fb00c => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:16.580770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:16.583199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:16.697955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fddedbf-bac8-43dd-8075-9620c3974a03 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:16.705577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:16.706987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:16.707472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:16.707892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:16.708825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:16.711603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:16.747289 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3848/7745] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:16 2022] POST /identity/v3/projects => generated 348 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:16.748008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:16.749659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:16.989592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cff081-42b9-47cf-ad67-038161ebb04a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:17.019987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:17.130629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:17.131392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.131774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.131931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.133389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:17.133389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:17.134999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:17.166494 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3898/7746] 10.222.0.16 () {58 vars in 1160 bytes} [Sat Oct 29 03:22:16 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:17.173575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:17.187250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df149f0-2a21-4cb0-8f40-b0dc8e0cc37c tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:17.199446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:17.200317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.200740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.201052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.201763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:17.204698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:17.242955 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3849/7747] 10.222.0.16 () {58 vars in 1128 bytes} [Sat Oct 29 03:22:17 2022] GET /identity/v3/domains => generated 829 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:17.247458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:17.276944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926d6c3-e84b-41c7-975a-bd958b564546 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:17.290751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:17.291700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.292428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.292859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/205bcf6e8e91465f83a7c55914d75fe1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.305020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:update_project(project_id=205bcf6e8e91465f83a7c55914d75fe1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:17.309890 n-d-862964-4 devstack@keystone.service[82080]: WARNING py.warnings [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:22:17.309890 n-d-862964-4 devstack@keystone.service[82080]: warnings.warn(msg) Oct 29 03:22:17.309890 n-d-862964-4 devstack@keystone.service[82080]: Oct 29 03:22:17.309890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:17.332675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.333680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.371787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.372874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.382551 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3899/7748] 10.222.0.16 () {60 vars in 1252 bytes} [Sat Oct 29 03:22:17 2022] PATCH /identity/v3/projects/205bcf6e8e91465f83a7c55914d75fe1 => generated 362 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:17.385735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:17.387652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:17.394506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:17.403249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:17.424950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257ee57-a5c5-43b9-90e5-c6a5f6cebe3b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:17.512657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa437471-ff56-467e-b2fe-af4fa968029b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:17.519380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:17.520456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.520748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.521186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] PATH_INFO: `/v3/projects/f305e6b9316c4718bcdf6d007b682be7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.542749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f305e6b9316c4718bcdf6d007b682be7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:17.544920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:17.550917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:17.551582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.551863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.552135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/205bcf6e8e91465f83a7c55914d75fe1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.564029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:17.567931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=205bcf6e8e91465f83a7c55914d75fe1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:17.570666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:17.617360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.629170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.662053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f305e6b9316c4718bcdf6d007b682be7', 'request_id': 'req-ab05881a-4442-48ea-9fbc-0b907a202d65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.664194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f305e6b9316c4718bcdf6d007b682be7', 'request_id': 'req-ab05881a-4442-48ea-9fbc-0b907a202d65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.694081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f305e6b9316c4718bcdf6d007b682be7', 'request_id': 'req-ab05881a-4442-48ea-9fbc-0b907a202d65'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.708539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1', 'request_id': 'req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.717517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] The token cache is being invalidate because project f305e6b9316c4718bcdf6d007b682be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:17.717982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.720383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-ab05881a-4442-48ea-9fbc-0b907a202d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.724230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1', 'request_id': 'req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.725197 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3900/7749] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:17 2022] DELETE /identity/v3/projects/f305e6b9316c4718bcdf6d007b682be7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:17.730302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047f98d-f35e-4f29-8f77-d12cd1827abf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.730589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047f98d-f35e-4f29-8f77-d12cd1827abf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.730866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047f98d-f35e-4f29-8f77-d12cd1827abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.736661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1', 'request_id': 'req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.752414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:17.757712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 205bcf6e8e91465f83a7c55914d75fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:17.758162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.759173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.764041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7047f98d-f35e-4f29-8f77-d12cd1827abf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:17.768051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7047f98d-f35e-4f29-8f77-d12cd1827abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:17.777118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1', 'request_id': 'req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.778042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1', 'request_id': 'req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.779355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '205bcf6e8e91465f83a7c55914d75fe1', 'request_id': 'req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:17.790344 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3850/7750] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:17 2022] DELETE /identity/v3/projects/205bcf6e8e91465f83a7c55914d75fe1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:17.795540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:17.797366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:17.932219 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3901/7751] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:17.940040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:17.940393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:17.940586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:17.979188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:17.980587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:18.003173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceaa19e-ccea-4e20-847a-a1bbb07a0d03 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.013412 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3902/7752] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:18.018714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.019441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.019732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.020011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.020666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.021612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.027312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.039037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3be91a-101e-41ae-a5a8-5b975494bf18 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.046756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.047574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.047952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.048314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.049068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:18.049497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.051443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.090086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3903/7753] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:18.102222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.114866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3851/7754] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:17 2022] POST /identity/v3/projects => generated 358 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:18.133094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.153188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acf7e6-7d7b-4476-9ec1-b077a072efb7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.207641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:18.275253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb06e3-b776-4c3d-a3e9-d4c53f8c8155 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.282620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.283471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.283756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.284566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/0718e71e68444f5bba37c7e49cb79f7c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.286071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=0718e71e68444f5bba37c7e49cb79f7c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.288520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.290642 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3852/7755] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:18 2022] GET /identity/v3/projects/0718e71e68444f5bba37c7e49cb79f7c => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:18.294666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.306852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72149c53-bed9-4fe8-8b52-1b1d26ce63c1 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.311818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.312527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.312815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.313091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/0718e71e68444f5bba37c7e49cb79f7c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.314659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0718e71e68444f5bba37c7e49cb79f7c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.316550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.323057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.324240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.324933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.327893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.328837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.332483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.408500 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3904/7756] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:18 2022] POST /identity/v3/projects => generated 377 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:18.413753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.435060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0718e71e68444f5bba37c7e49cb79f7c', 'request_id': 'req-fbe24dae-9523-4b00-a5e0-979181f409e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:18.448113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0718e71e68444f5bba37c7e49cb79f7c', 'request_id': 'req-fbe24dae-9523-4b00-a5e0-979181f409e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:18.469838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0718e71e68444f5bba37c7e49cb79f7c', 'request_id': 'req-fbe24dae-9523-4b00-a5e0-979181f409e7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:18.491638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 0718e71e68444f5bba37c7e49cb79f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:18.491931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:18.497649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:18.503963 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3853/7757] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:18 2022] DELETE /identity/v3/projects/0718e71e68444f5bba37c7e49cb79f7c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:18.509110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.513191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:18.584769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34ed6-c712-40ba-90c3-2ea06c8e7e99 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.618447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:18.704548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe24dae-9523-4b00-a5e0-979181f409e7 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.714288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.715492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.715922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.716364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.717251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.719350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.737299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.741405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.743820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.744206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.744968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.749102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.793892 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3854/7758] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:18 2022] POST /identity/v3/projects => generated 361 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:18.794233 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3905/7759] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:18 2022] POST /identity/v3/users => generated 289 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:18.794936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.797784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:18.798412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.827301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195ad0e-55a3-4322-843d-83c6c6ca9f67 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.902782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:18.959508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:18.960536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:18.961211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:18.961687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/9d13621a317b4737b7d66e18ceb5f06c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:18.963408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=9d13621a317b4737b7d66e18ceb5f06c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:18.966409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:18.968509 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3906/7760] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:18 2022] GET /identity/v3/projects/9d13621a317b4737b7d66e18ceb5f06c => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:18.972849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:18.988384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61403925-567b-412f-85d7-e7a894e0af62 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:18.997122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e882e-99fd-46ce-b37e-1495399030fb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.001426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.002245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.002631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.003005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.003812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.007663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.017465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.018096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.018391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.018706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/9d13621a317b4737b7d66e18ceb5f06c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.019862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d13621a317b4737b7d66e18ceb5f06c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.021988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.023429 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3855/7761] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:19.030165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:19.065155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d830f-7661-4bf5-8003-9fabe92d476f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.078264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.081374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.082466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.083173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.084280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.106174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.139863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d13621a317b4737b7d66e18ceb5f06c', 'request_id': 'req-a374b10f-204a-44e5-8688-4660378be71e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.145280 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3856/7762] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:19.153761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d13621a317b4737b7d66e18ceb5f06c', 'request_id': 'req-a374b10f-204a-44e5-8688-4660378be71e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.154156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:19.168942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d13621a317b4737b7d66e18ceb5f06c', 'request_id': 'req-a374b10f-204a-44e5-8688-4660378be71e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.186414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3921b9c-8726-4c29-9185-e9e363a4127a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.197136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 9d13621a317b4737b7d66e18ceb5f06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:19.197467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.200240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.204031 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3907/7763] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:18 2022] DELETE /identity/v3/projects/9d13621a317b4737b7d66e18ceb5f06c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:19.209740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:19.213142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:19.282976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82479c-b537-49e2-8fc7-2acd58dfbbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.284775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82479c-b537-49e2-8fc7-2acd58dfbbe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.287287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82479c-b537-49e2-8fc7-2acd58dfbbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.287657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82479c-b537-49e2-8fc7-2acd58dfbbe3 admin admin] PATH_INFO: `/v3/projects/b4617319827242caafd25613f453d96d/users/13a322fb1ffd4b94b17bfd32b22c920e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.298585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:19.327156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82479c-b537-49e2-8fc7-2acd58dfbbe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4617319827242caafd25613f453d96d, user_id=13a322fb1ffd4b94b17bfd32b22c920e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.341846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82479c-b537-49e2-8fc7-2acd58dfbbe3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.367980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b10f-204a-44e5-8688-4660378be71e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.390757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3857/7764] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:19 2022] PUT /identity/v3/projects/b4617319827242caafd25613f453d96d/users/13a322fb1ffd4b94b17bfd32b22c920e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:19.392950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.393329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.393697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.480919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] MFA Rules not processed for user `13a322fb1ffd4b94b17bfd32b22c920e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:19.484821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:19.529385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.530141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.530488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.530821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.548159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.550221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.657265 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3908/7765] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:22:19 2022] POST /identity/v3/projects => generated 347 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:19.661730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:19.708763 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3858/7766] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:19.721347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:19.722970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:19.808229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:19.842941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecafd0-7a39-43e5-9cd1-4327d7835bd5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.850832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.851551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.851836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.852248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/354f20a8eb8b4b0aaf72bf8aecc2179e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.853879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=354f20a8eb8b4b0aaf72bf8aecc2179e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.856131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.856453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9feffb0-8bd5-44fc-838c-f23e1f0a6f13 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.861522 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3909/7767] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:19 2022] GET /identity/v3/projects/354f20a8eb8b4b0aaf72bf8aecc2179e => generated 347 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:19.863297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:19.877964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fdabb9-42e2-45fa-b781-eefdfc1d3fbb tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:19.884614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.885365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.885717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.886086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/354f20a8eb8b4b0aaf72bf8aecc2179e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.888119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=354f20a8eb8b4b0aaf72bf8aecc2179e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:19.890828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:19.931606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:19.932572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:19.933053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:19.933617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:19.960831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '354f20a8eb8b4b0aaf72bf8aecc2179e', 'request_id': 'req-5b28da39-d590-4809-9a2d-f2e03eebff06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.970501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '354f20a8eb8b4b0aaf72bf8aecc2179e', 'request_id': 'req-5b28da39-d590-4809-9a2d-f2e03eebff06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.978590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '354f20a8eb8b4b0aaf72bf8aecc2179e', 'request_id': 'req-5b28da39-d590-4809-9a2d-f2e03eebff06'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:19.983278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:20.008077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 354f20a8eb8b4b0aaf72bf8aecc2179e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:20.008742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:20.011043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:20.014413 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3910/7768] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:19 2022] DELETE /identity/v3/projects/354f20a8eb8b4b0aaf72bf8aecc2179e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:20.018985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:20.023238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:20.057570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:20.059300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:20.109729 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3859/7769] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:20.264740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28da39-d590-4809-9a2d-f2e03eebff06 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:20.274246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:20.274951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:20.275285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:20.276320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:20.279299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:20.297284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:20.365763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:20.366034 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3911/7770] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:22:20 2022] POST /identity/v3/domains => generated 277 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:20.388292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c61e6d-2d7e-4e78-8077-9e3e843cfd1e service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:20.594567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:20.595218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:20.596580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:20.596861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:20.597841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:20.601274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:20.697463 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3860/7771] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:20 2022] POST /identity/v3/projects => generated 404 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:20.709393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:20.748711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1ea73-8d7b-4bc2-9ff5-5a947de45483 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:20.894370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:20.895100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:20.895387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:20.895713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/92c818efabef4595a62fc99e79513f3b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:20.897036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=92c818efabef4595a62fc99e79513f3b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:20.899242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:20.904756 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3912/7772] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:20 2022] GET /identity/v3/projects/92c818efabef4595a62fc99e79513f3b => generated 404 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:20.909777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:20.925155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd384ad-ee0f-4222-9b52-b671f5fb9816 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:20.932510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:20.933576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:20.933976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:20.934328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/92c818efabef4595a62fc99e79513f3b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:20.936855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=92c818efabef4595a62fc99e79513f3b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:20.938993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:20.949600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:21.030713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c818efabef4595a62fc99e79513f3b', 'request_id': 'req-485c4e0c-e938-4f5a-98c9-2aea26ace083'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.041018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c818efabef4595a62fc99e79513f3b', 'request_id': 'req-485c4e0c-e938-4f5a-98c9-2aea26ace083'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.058400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c818efabef4595a62fc99e79513f3b', 'request_id': 'req-485c4e0c-e938-4f5a-98c9-2aea26ace083'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.078854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 92c818efabef4595a62fc99e79513f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:21.079374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.080438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.086788 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3861/7773] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:20 2022] DELETE /identity/v3/projects/92c818efabef4595a62fc99e79513f3b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:21.088884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:21.090645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:21.108300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6857-af67-4fb7-a7bf-516c5d80e1c5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:21.256712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:21.256712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:21.256712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:21.257206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains/a155683917e44d30ab22448155893e73` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:21.261931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=a155683917e44d30ab22448155893e73)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:21.266774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:21.327933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'a155683917e44d30ab22448155893e73'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.328718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'a155683917e44d30ab22448155893e73'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.335831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:21.338875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:21.371625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:21.404251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'a155683917e44d30ab22448155893e73'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.404929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'a155683917e44d30ab22448155893e73'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.407467 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3913/7774] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:22:21 2022] PATCH /identity/v3/domains/a155683917e44d30ab22448155893e73 => generated 278 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:21.412337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:21.413757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:21.454475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c4e0c-e938-4f5a-98c9-2aea26ace083 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:21.540114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307c657-81d2-4f8d-b780-7785704e2596 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:21.568740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:21.569703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:21.570171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:21.570620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains/a155683917e44d30ab22448155893e73` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:21.587194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=a155683917e44d30ab22448155893e73)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:21.589090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:21.592040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:21.592708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:21.592990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:21.593268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] PATH_INFO: `/v3/users/b612ecc5516f4f6ead6ca28d74911292` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:21.595674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b612ecc5516f4f6ead6ca28d74911292)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:21.602370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:21.647542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'a155683917e44d30ab22448155893e73'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.675722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'a155683917e44d30ab22448155893e73'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.717468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:21.727304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b612ecc5516f4f6ead6ca28d74911292'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.747965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b612ecc5516f4f6ead6ca28d74911292'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.749107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b612ecc5516f4f6ead6ca28d74911292'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.760021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b612ecc5516f4f6ead6ca28d74911292'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.763127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a155683917e44d30ab22448155893e73', 'request_id': 'req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.764995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d4710a7-7fe9-4a9c-bc55-10c16834c4f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b612ecc5516f4f6ead6ca28d74911292'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.778081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a155683917e44d30ab22448155893e73', 'request_id': 'req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.786139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a155683917e44d30ab22448155893e73', 'request_id': 'req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.796794 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3862/7775] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:21 2022] DELETE /identity/v3/users/b612ecc5516f4f6ead6ca28d74911292 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:21.801361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:21.802005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:21.802405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:21.804663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project a155683917e44d30ab22448155893e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:21.805177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.806018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.820659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'a155683917e44d30ab22448155893e73', 'request_id': 'req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.821659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'a155683917e44d30ab22448155893e73', 'request_id': 'req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.825683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'a155683917e44d30ab22448155893e73', 'request_id': 'req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:21.839201 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3914/7776] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:21 2022] DELETE /identity/v3/domains/a155683917e44d30ab22448155893e73 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:21.840634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:21.842140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:21.858036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:21.859278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:21.903594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:21.958592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9f37-50b0-480e-9b4a-1dfa24cd5843 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:21.971038 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3863/7777] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:21.981757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:21.984511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:22.096883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:22.097839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:22.098337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:22.099378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:22.100470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:22.102114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:22.131461 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3915/7778] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Oct 29 03:22:21 2022] POST /identity/v3/domains => generated 275 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:22.132913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248455d-cbf7-4b87-8086-4e4ceaed8e63 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:22.135830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:22.228810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:22.229885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:22.230235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:22.230832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:22.269347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f2109-f6d8-43bc-8614-fa1743506217 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:22.274825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:22.275524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:22.275873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:22.276212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:22.276916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:22.278999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:22.287594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:22.393466 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3916/7779] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:22 2022] POST /identity/v3/projects => generated 410 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:22.396338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:22.403820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:22.407485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:22.423893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3864/7780] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:22.497290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:22.515864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861ab30-7b27-43a4-933d-2af9bfbbf32d tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:22.523833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:22.524536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:22.524995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:22.525247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:22.525989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:22.528121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:22.621237 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3917/7781] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:22 2022] POST /identity/v3/projects => generated 404 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:22.626568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:22.657665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84364572-ad0d-4308-ab97-444dd9f6db26 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:22.713516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:22.717240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:22.867851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:22.868818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:22.869323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:22.872973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/2a967716342e4301aa10033271e50422` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:22.877777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b139bb-c9a0-4241-b7b8-f20f90914c52 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:22.884121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:22.885200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:22.885733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:22.886233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] PATH_INFO: `/v3/projects/277ad94ea2a64ebf892a59f204307814` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:22.887563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] RBAC: Authorizing `identity:delete_project(project_id=277ad94ea2a64ebf892a59f204307814)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:22.890548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:22.891179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a967716342e4301aa10033271e50422)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:22.903028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:22.988332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277ad94ea2a64ebf892a59f204307814', 'request_id': 'req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:22.996751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a967716342e4301aa10033271e50422', 'request_id': 'req-618f13f1-db55-4771-a85a-aad50a424fea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.000295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277ad94ea2a64ebf892a59f204307814', 'request_id': 'req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.007041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a967716342e4301aa10033271e50422', 'request_id': 'req-618f13f1-db55-4771-a85a-aad50a424fea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.008840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277ad94ea2a64ebf892a59f204307814', 'request_id': 'req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.014683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a967716342e4301aa10033271e50422', 'request_id': 'req-618f13f1-db55-4771-a85a-aad50a424fea'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.043284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] The token cache is being invalidate because project 277ad94ea2a64ebf892a59f204307814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:23.043684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.044917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.046247 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3918/7782] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:22 2022] DELETE /identity/v3/projects/277ad94ea2a64ebf892a59f204307814 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:23.050074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:23.051818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:23.060180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 2a967716342e4301aa10033271e50422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:23.060594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.061474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.065851 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3865/7783] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:22 2022] DELETE /identity/v3/projects/2a967716342e4301aa10033271e50422 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:23.067480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:23.072234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:23.190543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:23.195662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904ff9a-3a7f-460e-a9ad-6b8804fb961d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:23.199413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:23.203493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f13f1-db55-4771-a85a-aad50a424fea tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:23.210656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:23.211382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:23.211665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:23.212087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/dad4dc3e215942e28894cd82a795272b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:23.213510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dad4dc3e215942e28894cd82a795272b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:23.216440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:23.359099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad4dc3e215942e28894cd82a795272b', 'request_id': 'req-2aefefb2-55df-4879-bb93-b08b4aa3c273'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.363763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:23.364443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:23.364853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:23.365205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] PATH_INFO: `/v3/users/6baab7fbebff4a53ad81e7a932212ee0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:23.366568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6baab7fbebff4a53ad81e7a932212ee0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:23.368814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:23.375264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad4dc3e215942e28894cd82a795272b', 'request_id': 'req-2aefefb2-55df-4879-bb93-b08b4aa3c273'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.390456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad4dc3e215942e28894cd82a795272b', 'request_id': 'req-2aefefb2-55df-4879-bb93-b08b4aa3c273'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.411397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project dad4dc3e215942e28894cd82a795272b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:23.411800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.412739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.418367 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3866/7784] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:23 2022] DELETE /identity/v3/projects/dad4dc3e215942e28894cd82a795272b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:23.419696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:23.421455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:23.479799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6baab7fbebff4a53ad81e7a932212ee0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.497894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6baab7fbebff4a53ad81e7a932212ee0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.498686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6baab7fbebff4a53ad81e7a932212ee0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.517871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6baab7fbebff4a53ad81e7a932212ee0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.519424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6baab7fbebff4a53ad81e7a932212ee0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.544007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3919/7785] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:23 2022] DELETE /identity/v3/users/6baab7fbebff4a53ad81e7a932212ee0 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:23.587350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefefb2-55df-4879-bb93-b08b4aa3c273 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:23.698872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:23.699553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:23.700144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:23.700438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains/b46e2d47b0f74b0ca01763ebe960e8a9` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:23.702168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b46e2d47b0f74b0ca01763ebe960e8a9)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:23.705521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:23.753077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.761285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.812719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:23.829978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.832596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:23.840927 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3867/7786] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:22:23 2022] PATCH /identity/v3/domains/b46e2d47b0f74b0ca01763ebe960e8a9 => generated 276 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:23.843966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:23.845596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:23.870308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c7e6-ac32-493f-b26d-e7125560b50b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:23.986547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:23.987391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:23.987835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:23.988397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains/b46e2d47b0f74b0ca01763ebe960e8a9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.011966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b46e2d47b0f74b0ca01763ebe960e8a9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.022253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:24.054307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:24.059976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.080381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.107972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:24.110379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:24.186266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9', 'request_id': 'req-77f7fef8-ac56-464a-987c-54de987b08f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.198810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9', 'request_id': 'req-77f7fef8-ac56-464a-987c-54de987b08f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.218861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9', 'request_id': 'req-77f7fef8-ac56-464a-987c-54de987b08f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.242944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project b46e2d47b0f74b0ca01763ebe960e8a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:24.243297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.244070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.253561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9', 'request_id': 'req-77f7fef8-ac56-464a-987c-54de987b08f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.254652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9', 'request_id': 'req-77f7fef8-ac56-464a-987c-54de987b08f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.260282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b46e2d47b0f74b0ca01763ebe960e8a9', 'request_id': 'req-77f7fef8-ac56-464a-987c-54de987b08f9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.272353 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3920/7787] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:23 2022] DELETE /identity/v3/domains/b46e2d47b0f74b0ca01763ebe960e8a9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:24.274344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:24.275923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb51f9-efd4-41e4-83a3-a96bcf50414e tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:24.276066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:24.416899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:24.419492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:24.419959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:24.420404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] PATH_INFO: `/v3/projects/5615f75cf2bf4030b44a167c659c6241` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.422511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5615f75cf2bf4030b44a167c659c6241)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.424605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:24.433281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7fef8-ac56-464a-987c-54de987b08f9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:24.439749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:24.441043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:24.441398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:24.441762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.442535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.445332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:24.498937 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3921/7788] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:24 2022] POST /identity/v3/projects => generated 376 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:24.503200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:24.541751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5615f75cf2bf4030b44a167c659c6241', 'request_id': 'req-9b69bef2-952d-4978-8a2e-57f98b13fc98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.549424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5615f75cf2bf4030b44a167c659c6241', 'request_id': 'req-9b69bef2-952d-4978-8a2e-57f98b13fc98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.558203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5615f75cf2bf4030b44a167c659c6241', 'request_id': 'req-9b69bef2-952d-4978-8a2e-57f98b13fc98'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.592284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] The token cache is being invalidate because project 5615f75cf2bf4030b44a167c659c6241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:24.592605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.593647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.597843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3868/7789] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:24 2022] DELETE /identity/v3/projects/5615f75cf2bf4030b44a167c659c6241 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:24.600735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:24.604809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:24.632427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:24.666937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11aa27b-3f1b-4095-92b0-d87099c0e0e9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:24.701426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:24.752682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69bef2-952d-4978-8a2e-57f98b13fc98 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:24.775948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:24.776976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:24.777257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:24.777511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] PATH_INFO: `/v3/users/7091f82316104bc2b5d35f28c1e9a83b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.779776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=7091f82316104bc2b5d35f28c1e9a83b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.787470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:24.796606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:24.798905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:24.799131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:24.799359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/4ec2d72e74a440a49f02805078b312a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.800623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ec2d72e74a440a49f02805078b312a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.803308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:24.805710 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3922/7790] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:24 2022] GET /identity/v3/projects/4ec2d72e74a440a49f02805078b312a2 => generated 376 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:24.811046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:24.819918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:24.844814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f2964-a0f0-4c8b-ba15-b7bb61945714 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:24.859928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:24.860706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:24.861248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:24.861550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.862306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.864636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:24.874580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7091f82316104bc2b5d35f28c1e9a83b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.887885 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3923/7791] 10.222.0.16 () {58 vars in 1131 bytes} [Sat Oct 29 03:22:24 2022] GET /identity/v3/projects => generated 5452 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:24.894365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7091f82316104bc2b5d35f28c1e9a83b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.895464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:24.896696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7091f82316104bc2b5d35f28c1e9a83b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.907433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:24.910105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7091f82316104bc2b5d35f28c1e9a83b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.911803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7091f82316104bc2b5d35f28c1e9a83b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:24.930947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a131a-f870-4172-b1d4-64ae2264b36a tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:24.935887 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3869/7792] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:24 2022] DELETE /identity/v3/users/7091f82316104bc2b5d35f28c1e9a83b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:24.940521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:24.941104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:24.941532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:24.942130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/4ec2d72e74a440a49f02805078b312a2` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:24.944212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ec2d72e74a440a49f02805078b312a2)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:24.946683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:25.039653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec2d72e74a440a49f02805078b312a2', 'request_id': 'req-961d241e-ef04-48f3-bfcd-be7b2b67afc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.050266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec2d72e74a440a49f02805078b312a2', 'request_id': 'req-961d241e-ef04-48f3-bfcd-be7b2b67afc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.056916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec2d72e74a440a49f02805078b312a2', 'request_id': 'req-961d241e-ef04-48f3-bfcd-be7b2b67afc2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.076679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 4ec2d72e74a440a49f02805078b312a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:25.076895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.077672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.080092 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3924/7793] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:24 2022] DELETE /identity/v3/projects/4ec2d72e74a440a49f02805078b312a2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:25.085772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:25.195194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53dcec-9b0d-4926-8460-fcd4bf9be6ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:25.217108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:25.219394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:25.312328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:25.313120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:25.314112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:25.314469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:25.315572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:25.317857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:25.326524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d241e-ef04-48f3-bfcd-be7b2b67afc2 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:25.331733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:25.332326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:25.332465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:25.332729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:25.333069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] PATH_INFO: `/v3/projects/7aa693b53e2a4272a039510c8b840fd1` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:25.334385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aa693b53e2a4272a039510c8b840fd1)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:25.336482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:25.351819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:25.375988 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3870/7794] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Oct 29 03:22:25 2022] POST /identity/v3/projects => generated 347 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:25.377617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:25.380223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:25.465720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aa693b53e2a4272a039510c8b840fd1', 'request_id': 'req-71a082e1-6ba4-49ec-b4d4-b55dd201124c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.475778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e8840-303d-443f-8e52-0b46dda786b9 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:25.485225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aa693b53e2a4272a039510c8b840fd1', 'request_id': 'req-71a082e1-6ba4-49ec-b4d4-b55dd201124c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.500924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aa693b53e2a4272a039510c8b840fd1', 'request_id': 'req-71a082e1-6ba4-49ec-b4d4-b55dd201124c'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.561768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] The token cache is being invalidate because project 7aa693b53e2a4272a039510c8b840fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:25.562084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.562857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:25.581308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3925/7795] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:25 2022] DELETE /identity/v3/projects/7aa693b53e2a4272a039510c8b840fd1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:25.648029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:25.648716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:25.649007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:25.649287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/9f059f4976f944b9bd19df1ac6a24d8a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:25.655779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:update_project(project_id=9f059f4976f944b9bd19df1ac6a24d8a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:25.657191 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:22:25.657191 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:22:25.657191 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:22:25.658487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:25.762972 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3871/7796] 10.222.0.16 () {60 vars in 1252 bytes} [Sat Oct 29 03:22:25 2022] PATCH /identity/v3/projects/9f059f4976f944b9bd19df1ac6a24d8a => generated 361 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:25.764100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:25.767401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:25.814363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a082e1-6ba4-49ec-b4d4-b55dd201124c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:25.833068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:25.833764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:25.834107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:25.834387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/9f059f4976f944b9bd19df1ac6a24d8a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:25.874432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=9f059f4976f944b9bd19df1ac6a24d8a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:25.880057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:25.887417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:25.889751 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3926/7797] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:25 2022] GET /identity/v3/projects/9f059f4976f944b9bd19df1ac6a24d8a => generated 348 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:25.900048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c7b49-d360-4ee4-8538-57bd32c7cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:25.905225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:25.906211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:25.906706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:25.907035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/9f059f4976f944b9bd19df1ac6a24d8a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:25.908684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f059f4976f944b9bd19df1ac6a24d8a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:25.910817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:26.048234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f059f4976f944b9bd19df1ac6a24d8a', 'request_id': 'req-bc4a4357-cc7f-4dd4-958b-b3da425528ef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.074170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f059f4976f944b9bd19df1ac6a24d8a', 'request_id': 'req-bc4a4357-cc7f-4dd4-958b-b3da425528ef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.090883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f059f4976f944b9bd19df1ac6a24d8a', 'request_id': 'req-bc4a4357-cc7f-4dd4-958b-b3da425528ef'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.116501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:26.124385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 9f059f4976f944b9bd19df1ac6a24d8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:26.125001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.127145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.130274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3872/7798] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:25 2022] DELETE /identity/v3/projects/9f059f4976f944b9bd19df1ac6a24d8a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:26.142962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:26.155541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:26.175201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f746a27-f5bf-47b9-9b8c-49988553cb66 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:26.256850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:26.257519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:26.257773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:26.258164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:26.258905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:26.260939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:26.297838 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3927/7799] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:26 2022] POST /identity/v3/projects => generated 360 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:26.302786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:26.317091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4357-cc7f-4dd4-958b-b3da425528ef tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:26.393451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:26.394722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:26.395373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:26.395900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/5d39a0b5943c47888396c8cc7e395c66` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:26.398805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:update_project(project_id=5d39a0b5943c47888396c8cc7e395c66)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:26.402133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:26.467654 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3873/7800] 10.222.0.16 () {60 vars in 1252 bytes} [Sat Oct 29 03:22:26 2022] PATCH /identity/v3/projects/5d39a0b5943c47888396c8cc7e395c66 => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:26.469098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:26.481957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9164e161-0c70-4eed-9d40-208f0cd8614b tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:26.488383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:26.489154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:26.489534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:26.489936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/5d39a0b5943c47888396c8cc7e395c66` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:26.507172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=5d39a0b5943c47888396c8cc7e395c66)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:26.509788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:26.516304 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3928/7801] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:26 2022] GET /identity/v3/projects/5d39a0b5943c47888396c8cc7e395c66 => generated 359 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:26.516823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:26.533676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea22038-c3bc-41c7-9609-fea11588d228 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:26.545923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:26.548090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:26.549923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:26.550146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/5d39a0b5943c47888396c8cc7e395c66` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:26.552320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5d39a0b5943c47888396c8cc7e395c66)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:26.558933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:26.646396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d39a0b5943c47888396c8cc7e395c66', 'request_id': 'req-7e32634f-f2e4-42a4-8016-db9098cd1283'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.655082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d39a0b5943c47888396c8cc7e395c66', 'request_id': 'req-7e32634f-f2e4-42a4-8016-db9098cd1283'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.664216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d39a0b5943c47888396c8cc7e395c66', 'request_id': 'req-7e32634f-f2e4-42a4-8016-db9098cd1283'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.680388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project 5d39a0b5943c47888396c8cc7e395c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:26.680759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.681530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:26.687978 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3874/7802] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:26 2022] DELETE /identity/v3/projects/5d39a0b5943c47888396c8cc7e395c66 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:26.692238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:26.699027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:26.721138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac4ddb-8c9e-486c-92fd-111a2a7ae163 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:26.797445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:26.813038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:26.814538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:26.814824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:26.815101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:26.815735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:26.820758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:26.874988 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3929/7803] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:26 2022] POST /identity/v3/projects => generated 354 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:26.879158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:26.891610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32634f-f2e4-42a4-8016-db9098cd1283 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:26.941712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:26.964771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:26.965794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:26.966172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:26.967259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/f31c218cdfd5435fb830105c54467a94` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:26.968858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:update_project(project_id=f31c218cdfd5435fb830105c54467a94)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:26.972625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:27.018698 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3875/7804] 10.222.0.16 () {60 vars in 1252 bytes} [Sat Oct 29 03:22:26 2022] PATCH /identity/v3/projects/f31c218cdfd5435fb830105c54467a94 => generated 368 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:27.023140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:27.034506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05b1c6-b346-4fed-8f0e-770a62a7c185 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:27.040185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:27.041119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:27.042174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:27.042174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/f31c218cdfd5435fb830105c54467a94` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:27.064876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:get_project(project_id=f31c218cdfd5435fb830105c54467a94)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:27.067286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:27.069560 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3930/7805] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:27 2022] GET /identity/v3/projects/f31c218cdfd5435fb830105c54467a94 => generated 355 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:27.074410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:27.091047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb022596-f413-4060-a7e3-b55330fbf2a5 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:27.098535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:27.100377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:27.100670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:27.102630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/projects/f31c218cdfd5435fb830105c54467a94` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:27.105788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f31c218cdfd5435fb830105c54467a94)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:27.108970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:27.183454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31c218cdfd5435fb830105c54467a94', 'request_id': 'req-5cbc779d-3252-40a3-9666-a3ce94d8aecd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.190502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31c218cdfd5435fb830105c54467a94', 'request_id': 'req-5cbc779d-3252-40a3-9666-a3ce94d8aecd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.197579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31c218cdfd5435fb830105c54467a94', 'request_id': 'req-5cbc779d-3252-40a3-9666-a3ce94d8aecd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.215321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] The token cache is being invalidate because project f31c218cdfd5435fb830105c54467a94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:27.216059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.217209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.223239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3876/7806] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:27 2022] DELETE /identity/v3/projects/f31c218cdfd5435fb830105c54467a94 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:27.223981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:27.226483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:27.245399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0ec95-0e36-485c-8e09-8b3f9320be2f tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:27.356234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:27.356882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:27.357120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:27.357388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains/b46e2d47b0f74b0ca01763ebe960e8a9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:27.367645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Could not find domain: b46e2d47b0f74b0ca01763ebe960e8a9.: keystone.exception.DomainNotFound: Could not find domain: b46e2d47b0f74b0ca01763ebe960e8a9. Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b46e2d47b0f74b0ca01763ebe960e8a9. Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:22:27.374168 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:27.375238 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application with Lock( Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b46e2d47b0f74b0ca01763ebe960e8a9. Oct 29 03:22:27.376230 n-d-862964-4 devstack@keystone.service[82080]: ERROR keystone.server.flask.application Oct 29 03:22:27.377284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3931/7807] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:22:27 2022] PATCH /identity/v3/domains/b46e2d47b0f74b0ca01763ebe960e8a9 => generated 112 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:22:27.380021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:27.399506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc779d-3252-40a3-9666-a3ce94d8aecd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:27.405785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99308ae6-89a2-43a2-98c9-b32a7db43920 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f05d64f260943f09f79cab4413bd493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7767ac8215d44607836d5e5c101c5831', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:27.406717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99308ae6-89a2-43a2-98c9-b32a7db43920 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:27.407009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99308ae6-89a2-43a2-98c9-b32a7db43920 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:27.407291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99308ae6-89a2-43a2-98c9-b32a7db43920 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] PATH_INFO: `/v3/domains/a155683917e44d30ab22448155893e73` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:27.416952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99308ae6-89a2-43a2-98c9-b32a7db43920 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-99308ae6-89a2-43a2-98c9-b32a7db43920 tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Could not find domain: a155683917e44d30ab22448155893e73.: keystone.exception.DomainNotFound: Could not find domain: a155683917e44d30ab22448155893e73. Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: a155683917e44d30ab22448155893e73. Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:22:27.428018 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:27.429121 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.get_or_create( Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application with Lock( Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self._enter() Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.creator() Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application created_value = creator( Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: a155683917e44d30ab22448155893e73. Oct 29 03:22:27.430042 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:22:27.433639 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3877/7808] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Oct 29 03:22:27 2022] PATCH /identity/v3/domains/a155683917e44d30ab22448155893e73 => generated 112 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 03:22:27.434510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:27.436358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:27.579637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f1bd0-14af-4a4e-9b08-ccbd90221efd tempest-ProjectsTestJSON-1412287353 tempest-ProjectsTestJSON-1412287353-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:27.585862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:27.586516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:27.586798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:27.587077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] PATH_INFO: `/v3/users/158668c4dc634fe1b66defd7e59e014e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:27.589332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158668c4dc634fe1b66defd7e59e014e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:27.600045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:27.711776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158668c4dc634fe1b66defd7e59e014e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.727122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158668c4dc634fe1b66defd7e59e014e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.728636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158668c4dc634fe1b66defd7e59e014e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.745607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158668c4dc634fe1b66defd7e59e014e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.747300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158668c4dc634fe1b66defd7e59e014e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:27.753874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:27.789518 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3932/7809] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:27 2022] DELETE /identity/v3/users/158668c4dc634fe1b66defd7e59e014e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:27.796395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:27.796699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:27.796995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:27.824839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:27.827394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:27.935295 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3878/7810] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:27.935777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:27.936807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:28.063600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e2700-a800-42fe-8e21-9c4e190d01e3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:28.067356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:28.068124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:28.068530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:28.068874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:28.084412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:28.086922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:28.099874 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3933/7811] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:28.639114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:28.641036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:28.671117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115309a-1f26-4800-b993-f861d6b06fd5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:28.676064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:28.679562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:28.680440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:28.680440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] PATH_INFO: `/v3/projects/380165076cd84243a617f3fc4b4ef5da` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:28.681601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=380165076cd84243a617f3fc4b4ef5da)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:28.683993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:28.745757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:28.762875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380165076cd84243a617f3fc4b4ef5da', 'request_id': 'req-cfb587e3-2494-4b93-9384-8b1b0f0d8928'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:28.773189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380165076cd84243a617f3fc4b4ef5da', 'request_id': 'req-cfb587e3-2494-4b93-9384-8b1b0f0d8928'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:28.780392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380165076cd84243a617f3fc4b4ef5da', 'request_id': 'req-cfb587e3-2494-4b93-9384-8b1b0f0d8928'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:28.798681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] The token cache is being invalidate because project 380165076cd84243a617f3fc4b4ef5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:28.798982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:28.799741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:28.804920 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3879/7812] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:28 2022] DELETE /identity/v3/projects/380165076cd84243a617f3fc4b4ef5da => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:28.806278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:28.840398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69bf416-7a67-440f-a0ad-c24bac65de37 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:28.928890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:28.929732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:28.930170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:28.930485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] PATH_INFO: `/v3/users/6f05d64f260943f09f79cab4413bd493` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:28.933094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f05d64f260943f09f79cab4413bd493)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:28.936079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:29.061641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f05d64f260943f09f79cab4413bd493'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.071496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f05d64f260943f09f79cab4413bd493'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.074097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f05d64f260943f09f79cab4413bd493'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.084155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f05d64f260943f09f79cab4413bd493'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.085319 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f05d64f260943f09f79cab4413bd493'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.109502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3934/7813] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:28 2022] DELETE /identity/v3/users/6f05d64f260943f09f79cab4413bd493 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:29.216710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:29.218558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:29.242835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb587e3-2494-4b93-9384-8b1b0f0d8928 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:29.336390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:29.337470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:29.338093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:29.338594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] PATH_INFO: `/v3/users/dc93f2087f8546c4808f6d8c79bc048c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:29.340195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc93f2087f8546c4808f6d8c79bc048c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:29.342575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:29.416966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc93f2087f8546c4808f6d8c79bc048c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.442028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc93f2087f8546c4808f6d8c79bc048c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.443534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc93f2087f8546c4808f6d8c79bc048c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.457904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc93f2087f8546c4808f6d8c79bc048c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.459241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc93f2087f8546c4808f6d8c79bc048c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.483213 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3880/7814] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:29 2022] DELETE /identity/v3/users/dc93f2087f8546c4808f6d8c79bc048c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:29.533301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:29.536623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:29.548935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:29.575348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f48709-9450-4397-8536-4f85bbae1182 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:29.677717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:29.678809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:29.679299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:29.679733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] PATH_INFO: `/v3/projects/7767ac8215d44607836d5e5c101c5831` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:29.681476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7767ac8215d44607836d5e5c101c5831)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:29.684114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:29.723035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:29.724555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:29.759227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7767ac8215d44607836d5e5c101c5831', 'request_id': 'req-462a6492-da26-4ca0-aa84-e36df4dd7a33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.759450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772d73a-b7bc-4486-a965-c15d4edefcb8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:29.776796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7767ac8215d44607836d5e5c101c5831', 'request_id': 'req-462a6492-da26-4ca0-aa84-e36df4dd7a33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.795915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7767ac8215d44607836d5e5c101c5831', 'request_id': 'req-462a6492-da26-4ca0-aa84-e36df4dd7a33'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.816823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] The token cache is being invalidate because project 7767ac8215d44607836d5e5c101c5831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:29.817417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.818583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-462a6492-da26-4ca0-aa84-e36df4dd7a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.836475 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3935/7815] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:29 2022] DELETE /identity/v3/projects/7767ac8215d44607836d5e5c101c5831 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:29.838410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1c28-b303-42af-abd6-739bcb6ca6a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:29.838766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1c28-b303-42af-abd6-739bcb6ca6a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:29.839110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1c28-b303-42af-abd6-739bcb6ca6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:29.852817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:29.866943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-44bd1c28-b303-42af-abd6-739bcb6ca6a0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:29.870856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-44bd1c28-b303-42af-abd6-739bcb6ca6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:29.882127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:29.882803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:29.883153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:29.883433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] PATH_INFO: `/v3/projects/2b1b4358363c4472b054ba19c0bda83a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:29.884633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1b4358363c4472b054ba19c0bda83a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:29.887645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:29.950258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1b4358363c4472b054ba19c0bda83a', 'request_id': 'req-b5f38763-c9a1-443c-b6d9-1a126bf5e901'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.963145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1b4358363c4472b054ba19c0bda83a', 'request_id': 'req-b5f38763-c9a1-443c-b6d9-1a126bf5e901'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.969944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1b4358363c4472b054ba19c0bda83a', 'request_id': 'req-b5f38763-c9a1-443c-b6d9-1a126bf5e901'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.970543 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3936/7816] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:29.980264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:29.980739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:29.980883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:29.991640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] The token cache is being invalidate because project 2b1b4358363c4472b054ba19c0bda83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:29.991943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.993204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:29.998990 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3881/7817] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:29 2022] DELETE /identity/v3/projects/2b1b4358363c4472b054ba19c0bda83a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:30.000177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.002030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.021566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:30.024083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.067407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:30.096169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f38763-c9a1-443c-b6d9-1a126bf5e901 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.104570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.105617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.105937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.106216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] PATH_INFO: `/v3/users/7b9b20cffff144c59dd1293a9f938254` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.107519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9b20cffff144c59dd1293a9f938254)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.110044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.142832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3937/7818] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:30.147560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.162195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97705-8888-4055-b771-c16a8013a3eb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.168820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.169451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.169738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.170048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.170849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:30.171387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.173948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.174181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9b20cffff144c59dd1293a9f938254'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.189851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3938/7819] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:30.192063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.192219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9b20cffff144c59dd1293a9f938254'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.192866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9b20cffff144c59dd1293a9f938254'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.195275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.201072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9b20cffff144c59dd1293a9f938254'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.201826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:30.202976 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9b20cffff144c59dd1293a9f938254'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.213279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dffe88-ea38-46bd-8121-057d8569b931 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.218907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.219710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.220236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.220461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.221094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.221690 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3882/7820] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:29 2022] DELETE /identity/v3/users/7b9b20cffff144c59dd1293a9f938254 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:30.223199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.260492 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3939/7821] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:30.265032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.336231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f25ce8-4507-4508-afb9-0b80a46ce0d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.416104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.416104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.416104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.416104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.416462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.417156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.417294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.418933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.435076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d88c8-e9c2-4c02-9b15-279dbeb9a3de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.439988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.440641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.440926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.441204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] PATH_INFO: `/v3/projects/7099010e6162411aa62c4c483606fc3b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.442541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7099010e6162411aa62c4c483606fc3b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.444837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.454965 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3883/7822] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:30.459078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.473358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f946039-254f-4a60-a810-e497c996a8b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.480883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.481644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.482093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.482439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.483203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.485009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.497853 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3884/7823] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:30.500396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.502420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7099010e6162411aa62c4c483606fc3b', 'request_id': 'req-725acd57-5cf4-4c05-9832-7556e3675cb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.509984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7099010e6162411aa62c4c483606fc3b', 'request_id': 'req-725acd57-5cf4-4c05-9832-7556e3675cb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.511722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c50bdd-93b7-4643-a3ca-f13c424f454e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.517195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7099010e6162411aa62c4c483606fc3b', 'request_id': 'req-725acd57-5cf4-4c05-9832-7556e3675cb3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.532694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] The token cache is being invalidate because project 7099010e6162411aa62c4c483606fc3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:30.532986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.533738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-725acd57-5cf4-4c05-9832-7556e3675cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:30.535872 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3940/7824] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:30 2022] DELETE /identity/v3/projects/7099010e6162411aa62c4c483606fc3b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:30.540353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde16a2-6583-46e7-a9ef-21a3343dcca3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.540690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde16a2-6583-46e7-a9ef-21a3343dcca3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.540969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde16a2-6583-46e7-a9ef-21a3343dcca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.570750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0cde16a2-6583-46e7-a9ef-21a3343dcca3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:30.572070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0cde16a2-6583-46e7-a9ef-21a3343dcca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.586047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.586916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.587618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.587857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.588566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.590646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.603812 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3885/7825] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:30.608128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.625941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.634681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d574106-69ee-4e30-b36f-3095b04463f7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.639926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32907-e708-4972-b7ed-d3725289af1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.640611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32907-e708-4972-b7ed-d3725289af1b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.641189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32907-e708-4972-b7ed-d3725289af1b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.641476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32907-e708-4972-b7ed-d3725289af1b admin admin] PATH_INFO: `/v3/projects/b3af71012a444d249c3a8fed16c9def2/users/457ae36c80b14cd2adf0fb51c3cd9458/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.650880 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3941/7826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:30.654487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:30.659049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.659412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.659746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.667257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d32907-e708-4972-b7ed-d3725289af1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3af71012a444d249c3a8fed16c9def2, user_id=457ae36c80b14cd2adf0fb51c3cd9458, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.671494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d32907-e708-4972-b7ed-d3725289af1b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.683578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:30.685096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.691532 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3886/7827] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:30 2022] PUT /identity/v3/projects/b3af71012a444d249c3a8fed16c9def2/users/457ae36c80b14cd2adf0fb51c3cd9458/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:30.701481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.701769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.702107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.707061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:30.735872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] MFA Rules not processed for user `457ae36c80b14cd2adf0fb51c3cd9458`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:30.737429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:30.760403 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3942/7828] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:30.763652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.774795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da12fd-311e-4542-930c-e1eb816de4dd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.779815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.780438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.780723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.780986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.781635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:30.781963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.783563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.796364 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3943/7829] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:30.801517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.815669 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc85273-8498-4867-bfb9-4afee150f52b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.821133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.822115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.822403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.822682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.823317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.824517 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3887/7830] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:30.825386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.828520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.842312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47de8f3-9d2a-4fbc-8e63-dbff2d369daf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.847483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.848471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.848744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.850056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.852460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.854611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:30.860098 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3944/7831] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:30.864185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.900961 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3888/7832] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:30.910160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:30.940356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edd0f9-7ae2-440d-9b0b-0ab6b3a21c38 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.986037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c058d11-006f-4004-8a8e-c1d708b760ec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:30.991537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:30.992473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:30.992759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:30.993031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:30.993702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:30.996538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.004480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.005292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.005591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.006377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.007399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.010378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.020068 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3889/7833] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:31.024323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.037069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d4cb-903a-4b4e-b761-51091f36649f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.041828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3945/7834] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:30 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:31.045961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.048926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.049561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.049884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.050168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.050822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.052436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.057272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c01ce-6aec-4779-842c-670f3edc1d47 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.065941 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3890/7835] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:31.069740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.070082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.070680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.071026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.071312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.072012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.073955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.084999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd735950-1de8-4238-bc5c-521f676a0b87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.090017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3946/7836] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:31.091395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.092776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.094541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.095087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.095573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] PATH_INFO: `/v3/projects/0aa9e22f72204b3c9746495000c85300/users/bd7382fb3a5e4742b9167d990c5e675d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.104719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c6f1f-f7b7-4f07-8fe2-62d7d660497e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.114644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa9e22f72204b3c9746495000c85300, user_id=bd7382fb3a5e4742b9167d990c5e675d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.116097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.116734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.117019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.117604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.118200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.119243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.121742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.138435 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3947/7837] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:31.138600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3891/7838] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:31 2022] PUT /identity/v3/projects/0aa9e22f72204b3c9746495000c85300/users/bd7382fb3a5e4742b9167d990c5e675d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:31.140330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.140539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.147605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:31.157587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:31.158795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21dbe-d71d-4e30-9a54-037400b9619d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.225932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e91765-cccf-4c9b-8790-8eadd6432a79 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.236378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.237338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.237688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.238367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.239644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.241312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.244364 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911bf2f-0bbd-4beb-85b2-29b0047659bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.245599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911bf2f-0bbd-4beb-85b2-29b0047659bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.246131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911bf2f-0bbd-4beb-85b2-29b0047659bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.246627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911bf2f-0bbd-4beb-85b2-29b0047659bb admin admin] PATH_INFO: `/v3/projects/7c563ef86a7d4cda8fad83e55a82066a/users/7957037f88554a3b9fe2f25501e32447/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.255236 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3892/7839] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:31.259381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.270676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78adc0e-de21-47a3-b4d3-1ef7f49c0b9c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.274109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911bf2f-0bbd-4beb-85b2-29b0047659bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c563ef86a7d4cda8fad83e55a82066a, user_id=7957037f88554a3b9fe2f25501e32447, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.276666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109f31b-a3ed-4051-a91e-b03b98ca36e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.276842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911bf2f-0bbd-4beb-85b2-29b0047659bb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.277427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109f31b-a3ed-4051-a91e-b03b98ca36e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.277711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109f31b-a3ed-4051-a91e-b03b98ca36e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.278170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109f31b-a3ed-4051-a91e-b03b98ca36e6 admin admin] PATH_INFO: `/v3/projects/0aa9e22f72204b3c9746495000c85300/users/bd7382fb3a5e4742b9167d990c5e675d/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.280803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109f31b-a3ed-4051-a91e-b03b98ca36e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aa9e22f72204b3c9746495000c85300, user_id=bd7382fb3a5e4742b9167d990c5e675d, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.283614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109f31b-a3ed-4051-a91e-b03b98ca36e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.300959 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3893/7840] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:31 2022] PUT /identity/v3/projects/0aa9e22f72204b3c9746495000c85300/users/bd7382fb3a5e4742b9167d990c5e675d/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:31.312529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920eba-8863-460d-82dd-eb5404813769 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.312812 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920eba-8863-460d-82dd-eb5404813769 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.313086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920eba-8863-460d-82dd-eb5404813769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.319069 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3948/7841] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:31 2022] PUT /identity/v3/projects/7c563ef86a7d4cda8fad83e55a82066a/users/7957037f88554a3b9fe2f25501e32447/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:31.321623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.322417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.323159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.354789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-66920eba-8863-460d-82dd-eb5404813769 None None] MFA Rules not processed for user `bd7382fb3a5e4742b9167d990c5e675d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:31.356131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-66920eba-8863-460d-82dd-eb5404813769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:31.363367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] MFA Rules not processed for user `7957037f88554a3b9fe2f25501e32447`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:31.365945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:31.464757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3894/7842] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:31.472230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920eba-8863-460d-82dd-eb5404813769 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.484452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920eba-8863-460d-82dd-eb5404813769 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.490868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.492469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.492975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.494787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.495566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.497497 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3949/7843] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:31.504277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.515239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.517453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:31.548152 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3895/7844] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:31 2022] POST /identity/v3/projects => generated 358 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:31.548937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.604008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac2c8e-289d-4efb-8fa6-580abf2e1af9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.631873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:31.635622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:31.640303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9df3f-9574-4a89-92b7-2bbd6be997ad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.646424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.647106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.647396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.647678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.648353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.650700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.663352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.664224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.664507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.665014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.681175 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3896/7845] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:31 2022] POST /identity/v3/users => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:31.686741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.703026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1465f-cc7c-4435-b259-11dc89a6f27f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.709483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.710441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.710991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.711511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/1864fd2f26e04b7f8e1558396184c88e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.734712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:get_user(user_id=1864fd2f26e04b7f8e1558396184c88e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.737277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.741178 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3897/7846] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:22:31 2022] GET /identity/v3/users/1864fd2f26e04b7f8e1558396184c88e => generated 371 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:31.743273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.744896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.745437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.757317 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3950/7847] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:31.761137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab877f43-7083-42a9-a7dc-b1ffb0a219d0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.768663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.769630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.770164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.770800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/1864fd2f26e04b7f8e1558396184c88e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.772542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1864fd2f26e04b7f8e1558396184c88e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.775174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.780572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.851500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1864fd2f26e04b7f8e1558396184c88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.861395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8990f-abee-4176-b7f8-921925fc7cd0 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:31.866893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:31.867865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:31.868146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:31.868422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] PATH_INFO: `/v3/users/7957037f88554a3b9fe2f25501e32447` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:31.869602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7957037f88554a3b9fe2f25501e32447)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:31.871856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:31.872954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1864fd2f26e04b7f8e1558396184c88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.873963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1864fd2f26e04b7f8e1558396184c88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.884041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1864fd2f26e04b7f8e1558396184c88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.885334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1864fd2f26e04b7f8e1558396184c88e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.904951 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3898/7848] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:31 2022] DELETE /identity/v3/users/1864fd2f26e04b7f8e1558396184c88e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:31.911973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:31.914300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:31.936626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7957037f88554a3b9fe2f25501e32447'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.947276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7957037f88554a3b9fe2f25501e32447'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.947979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7957037f88554a3b9fe2f25501e32447'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.963646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7957037f88554a3b9fe2f25501e32447'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:31.965147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b705d6a-2ea4-4fa9-92be-f26e34dc86f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7957037f88554a3b9fe2f25501e32447'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.000496 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3951/7849] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:31 2022] DELETE /identity/v3/users/7957037f88554a3b9fe2f25501e32447 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:32.005227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.006187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.007323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.012353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e5ee0-77b3-46bd-9aeb-5310a500a98c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.025589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:32.033225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:32.035206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:32.068545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:32.087331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.088082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.088512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.088794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/53aa2b8a829e4112bc20e9436b3db51c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.089958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=53aa2b8a829e4112bc20e9436b3db51c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.092347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.118820 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3952/7850] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:32.127365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.130012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:32.166967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53aa2b8a829e4112bc20e9436b3db51c', 'request_id': 'req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.177134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53aa2b8a829e4112bc20e9436b3db51c', 'request_id': 'req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.187845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53aa2b8a829e4112bc20e9436b3db51c', 'request_id': 'req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.207642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] The token cache is being invalidate because project 53aa2b8a829e4112bc20e9436b3db51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:32.207858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e61ca-5a8d-48ab-82db-136c9e35e59a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.207950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.208696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.210870 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3899/7851] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:31 2022] DELETE /identity/v3/projects/53aa2b8a829e4112bc20e9436b3db51c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:32.216193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.217762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:32.284882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.285429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.285708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.286029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.287975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:32.322792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3826-25b5-45b3-aee4-ae2e13e1fe62 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.332245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.332882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.333235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.334214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.335116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.338504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.387051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.388528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.390840 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3900/7852] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/projects => generated 358 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:32.395859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.400784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3953/7853] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:32.495908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c5f43-0d43-486a-85b7-78017b5a972e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.501778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.502753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.502984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.503363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.504237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.507383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.520644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:32.551620 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3901/7854] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/users => generated 414 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:32.555924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.568022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf147fb-892a-4b16-8713-9bfe75da6aa4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.574086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.574721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.575004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.575278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.575990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.577598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.590894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:32.604249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.605017 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3954/7855] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/roles => generated 239 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:32.618999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48e17b-f846-42ef-9fee-86e6f1f63d3f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.623647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.625062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.625425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.625766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/bbdc47950ad94f1f93a01c4d650c3e91` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.642800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:get_user(user_id=bbdc47950ad94f1f93a01c4d650c3e91)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.645187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.649852 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3902/7856] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:22:32 2022] GET /identity/v3/users/bbdc47950ad94f1f93a01c4d650c3e91 => generated 414 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:32.651212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.663246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3ceca-d586-40ef-842e-d3870c4fca0e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.668744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.669434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.669726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.670037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/roles/ea740871550548ad996d51ed84c1a5ab` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.671519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:get_role(role_id=ea740871550548ad996d51ed84c1a5ab)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.673163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.679387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.680519 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3955/7857] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:22:32 2022] GET /identity/v3/roles/ea740871550548ad996d51ed84c1a5ab => generated 239 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:32.690414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9c55e-fa2d-4e3f-a81a-28fa2b31a436 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.696206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.697004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.697446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.698136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.698985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.701087 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.741275 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3903/7858] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:32.745375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.758394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0393e-bab1-4d6c-b45f-910f2822e59c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.761386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.764196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:32.846997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.847860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.848152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.848683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/1aedbabeff0a42d4a0f90164045287de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.850255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:get_project(project_id=1aedbabeff0a42d4a0f90164045287de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.851166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f70f21-d365-432e-ae34-f3521d244f3c tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.852640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.858173 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3956/7859] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:32 2022] GET /identity/v3/projects/1aedbabeff0a42d4a0f90164045287de => generated 359 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:32.858371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.859038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.859164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.859325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.859603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] PATH_INFO: `/v3/projects/7c563ef86a7d4cda8fad83e55a82066a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.861706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c563ef86a7d4cda8fad83e55a82066a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.864732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.870227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18eab6-ea16-4152-a3e8-69ecf0004033 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.875755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:32.876643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.876995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.877337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/1aedbabeff0a42d4a0f90164045287de/users/bbdc47950ad94f1f93a01c4d650c3e91/roles/ea740871550548ad996d51ed84c1a5ab` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.880014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1aedbabeff0a42d4a0f90164045287de, user_id=bbdc47950ad94f1f93a01c4d650c3e91, role_id=ea740871550548ad996d51ed84c1a5ab)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:32.882716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:32.898409 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3957/7860] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:32 2022] PUT /identity/v3/projects/1aedbabeff0a42d4a0f90164045287de/users/bbdc47950ad94f1f93a01c4d650c3e91/roles/ea740871550548ad996d51ed84c1a5ab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:32.902646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:32.925311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c563ef86a7d4cda8fad83e55a82066a', 'request_id': 'req-fbeb2b78-8a52-46ce-9844-44c4da0beb80'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.934864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c563ef86a7d4cda8fad83e55a82066a', 'request_id': 'req-fbeb2b78-8a52-46ce-9844-44c4da0beb80'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.941227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c563ef86a7d4cda8fad83e55a82066a', 'request_id': 'req-fbeb2b78-8a52-46ce-9844-44c4da0beb80'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.957820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] The token cache is being invalidate because project 7c563ef86a7d4cda8fad83e55a82066a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:32.958114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.958938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-fbeb2b78-8a52-46ce-9844-44c4da0beb80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:32.960562 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3904/7861] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:32 2022] DELETE /identity/v3/projects/7c563ef86a7d4cda8fad83e55a82066a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:32.965433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e61fc-9d73-4e38-bab7-0986128fd1b1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:32.965719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e61fc-9d73-4e38-bab7-0986128fd1b1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:32.966025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e61fc-9d73-4e38-bab7-0986128fd1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:32.985343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee47aec-d194-4ac0-ac5e-ad974cf8719e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:32.986746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ee7e61fc-9d73-4e38-bab7-0986128fd1b1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:32.987977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ee7e61fc-9d73-4e38-bab7-0986128fd1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.042625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.067070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.067850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.068286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.068586 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.069345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.069629 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3905/7862] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:33.074325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.077874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.078276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.078630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.101889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:33.103291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.108284 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3958/7863] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:32 2022] POST /identity/v3/projects => generated 360 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:33.112547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.114842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.140218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.175135 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3906/7864] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:33.179942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.189457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b63a3-4768-4e86-89b8-6b149522480b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.194709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.195464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.195922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.196205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.196865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:33.197170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.198817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.199021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ce2b8-8fd7-417c-b1aa-978edaa50678 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.204353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.205009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.205308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.205583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/248d3575fa7d444f844809d5de65915b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.206769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:get_project(project_id=248d3575fa7d444f844809d5de65915b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.209274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.214038 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3959/7865] 10.222.0.16 () {58 vars in 1230 bytes} [Sat Oct 29 03:22:33 2022] GET /identity/v3/projects/248d3575fa7d444f844809d5de65915b => generated 360 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:33.214222 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3907/7866] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:33.215957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.216155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.226550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8643b6-b99c-4b0e-81aa-b21131894801 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.229939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5ff3-7311-4580-8672-5940e8483a1e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.231694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.232330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.232620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.232895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.233561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.234994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.235656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.235781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.235942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.236210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/248d3575fa7d444f844809d5de65915b/users/bbdc47950ad94f1f93a01c4d650c3e91/roles/ea740871550548ad996d51ed84c1a5ab` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.238415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_grant(project_id=248d3575fa7d444f844809d5de65915b, user_id=bbdc47950ad94f1f93a01c4d650c3e91, role_id=ea740871550548ad996d51ed84c1a5ab)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.241317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.260639 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3960/7867] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:33 2022] PUT /identity/v3/projects/248d3575fa7d444f844809d5de65915b/users/bbdc47950ad94f1f93a01c4d650c3e91/roles/ea740871550548ad996d51ed84c1a5ab => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:33.265244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.273851 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3908/7868] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:33 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:33.274762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.342677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac9abe-f35c-4fe3-a42c-0fbc634cfbd6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.347016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f9c90-6d1d-4bc8-a58b-1002efc6cd70 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.352075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.352734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.353157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.353549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.354343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.356292 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.383753 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3909/7869] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:33 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:33.389177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.401987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761ad8a-f0df-4b18-8e80-48bbd1aa294e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.410513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.411288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.411638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.412142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.413222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.414952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.417502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.418384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.418665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.418940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/bbdc47950ad94f1f93a01c4d650c3e91/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.420164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=bbdc47950ad94f1f93a01c4d650c3e91)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.422447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.428823 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3910/7870] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:33 2022] GET /identity/v3/roles => generated 1650 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:33.433673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.446271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdb8aa4-cc31-4ffe-a675-24fe4c92ccf3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.452080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.452791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.453140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.453488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.454257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.456297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.465028 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3961/7871] 10.222.0.16 () {58 vars in 1248 bytes} [Sat Oct 29 03:22:33 2022] GET /identity/v3/users/bbdc47950ad94f1f93a01c4d650c3e91/projects => generated 843 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:33.466159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.470560 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3911/7872] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:33 2022] GET /identity/v3/roles => generated 1650 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:33.474918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.479293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4aab8e-574c-4bf3-9bcf-3db7a06e6cc2 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.485898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0156cf0-e44e-48fa-b7a8-a0660df676ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.486414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.487251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.487698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.488132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/248d3575fa7d444f844809d5de65915b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.489440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=248d3575fa7d444f844809d5de65915b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.490698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94465744-9f43-4e62-918b-53ddf1234835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.491453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94465744-9f43-4e62-918b-53ddf1234835 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.491729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94465744-9f43-4e62-918b-53ddf1234835 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.491952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.492381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94465744-9f43-4e62-918b-53ddf1234835 admin admin] PATH_INFO: `/v3/projects/08b45727a0f54252849e3874791d383f/users/b7086d661978449d9e5979667a526b60/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.509163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94465744-9f43-4e62-918b-53ddf1234835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b45727a0f54252849e3874791d383f, user_id=b7086d661978449d9e5979667a526b60, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.511228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94465744-9f43-4e62-918b-53ddf1234835 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.514677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.530312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.533364 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3912/7873] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:33 2022] PUT /identity/v3/projects/08b45727a0f54252849e3874791d383f/users/b7086d661978449d9e5979667a526b60/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:33.553022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2832-f566-4d84-929b-abd386793caf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.553321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2832-f566-4d84-929b-abd386793caf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.553598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c2832-f566-4d84-929b-abd386793caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.592847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248d3575fa7d444f844809d5de65915b', 'request_id': 'req-2b8b18e7-7c17-4f42-8db8-4da17105b24f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.597657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-284c2832-f566-4d84-929b-abd386793caf None None] MFA Rules not processed for user `b7086d661978449d9e5979667a526b60`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:33.599284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-284c2832-f566-4d84-929b-abd386793caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.600015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248d3575fa7d444f844809d5de65915b', 'request_id': 'req-2b8b18e7-7c17-4f42-8db8-4da17105b24f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.611818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248d3575fa7d444f844809d5de65915b', 'request_id': 'req-2b8b18e7-7c17-4f42-8db8-4da17105b24f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.627562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] The token cache is being invalidate because project 248d3575fa7d444f844809d5de65915b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:33.627947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.628792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.630557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3962/7874] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:33 2022] DELETE /identity/v3/projects/248d3575fa7d444f844809d5de65915b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:33.635193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.636819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.686569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3913/7875] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:33.700182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c2832-f566-4d84-929b-abd386793caf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.701986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-284c2832-f566-4d84-929b-abd386793caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.715221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b18e7-7c17-4f42-8db8-4da17105b24f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.723998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.724737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.725022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.725299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/1aedbabeff0a42d4a0f90164045287de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.726620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1aedbabeff0a42d4a0f90164045287de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.728781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.790069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c2832-f566-4d84-929b-abd386793caf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.794664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aedbabeff0a42d4a0f90164045287de', 'request_id': 'req-819e42ee-2c5d-4acc-92d5-3d277021caf0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.801401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aedbabeff0a42d4a0f90164045287de', 'request_id': 'req-819e42ee-2c5d-4acc-92d5-3d277021caf0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.809447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aedbabeff0a42d4a0f90164045287de', 'request_id': 'req-819e42ee-2c5d-4acc-92d5-3d277021caf0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.832401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] The token cache is being invalidate because project 1aedbabeff0a42d4a0f90164045287de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:33.832695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.833571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:33.835322 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3963/7876] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:33 2022] DELETE /identity/v3/projects/1aedbabeff0a42d4a0f90164045287de => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:33.839514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.841204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.855332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.855876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.856150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.856421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.858302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:33.894081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.931644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e42ee-2c5d-4acc-92d5-3d277021caf0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:33.936384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:33.939300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.941515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.942123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:33.942794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:33.943134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:33.943407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/roles/ea740871550548ad996d51ed84c1a5ab` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:33.945336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ea740871550548ad996d51ed84c1a5ab)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:33.949213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:33.954251 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3914/7877] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:33.981257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:33.983636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.010251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invalidating the token cache because role ea740871550548ad996d51ed84c1a5ab has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:34.011087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.015716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.019080 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3964/7878] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:33 2022] DELETE /identity/v3/roles/ea740871550548ad996d51ed84c1a5ab => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:34.023770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.025022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.088100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce87afe-3c5f-4538-8165-fe5b9bd0a807 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:34.144026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9face-45a1-4125-9063-67bd6e4cdb09 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:34.152305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:34.153742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.154291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.154701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/bbdc47950ad94f1f93a01c4d650c3e91` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.156780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bbdc47950ad94f1f93a01c4d650c3e91)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:34.160013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:34.173043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:34.173696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.174007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.174283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] PATH_INFO: `/v3/users/b7086d661978449d9e5979667a526b60` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.175466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7086d661978449d9e5979667a526b60)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:34.177408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:34.224037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdc47950ad94f1f93a01c4d650c3e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.234418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdc47950ad94f1f93a01c4d650c3e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.235539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdc47950ad94f1f93a01c4d650c3e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.249497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdc47950ad94f1f93a01c4d650c3e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.250628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdc47950ad94f1f93a01c4d650c3e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.259566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7086d661978449d9e5979667a526b60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.279230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7086d661978449d9e5979667a526b60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.280016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7086d661978449d9e5979667a526b60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.280942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3965/7879] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:34 2022] DELETE /identity/v3/users/bbdc47950ad94f1f93a01c4d650c3e91 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:34.285779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.287720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.290127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7086d661978449d9e5979667a526b60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.291342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a339e8d8-be84-4d8a-acc4-5ef6c3dc6e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7086d661978449d9e5979667a526b60'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.315864 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3915/7880] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:33 2022] DELETE /identity/v3/users/b7086d661978449d9e5979667a526b60 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:34.321777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:34.325514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.325850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.326148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.346136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:34.347501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.369444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:34.376708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215cd41-1a5f-48e5-baee-b6125f700537 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:34.428967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3916/7881] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:34.439455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.441187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.466078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:34.467289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.467650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.467878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/f5ecd4fe1fda4a8187663bd7700a394c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.469777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f5ecd4fe1fda4a8187663bd7700a394c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:34.472528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:34.514540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd68ad28-f229-4590-a113-c4015284c010 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:34.518977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:34.520767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.521419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.523729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.534236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:34.535956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:34.548342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ecd4fe1fda4a8187663bd7700a394c', 'request_id': 'req-c1260d32-b33a-465d-9920-88ad5125b31a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.550514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ecd4fe1fda4a8187663bd7700a394c', 'request_id': 'req-c1260d32-b33a-465d-9920-88ad5125b31a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.561063 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3917/7882] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:34.567942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ecd4fe1fda4a8187663bd7700a394c', 'request_id': 'req-c1260d32-b33a-465d-9920-88ad5125b31a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.593002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] The token cache is being invalidate because project f5ecd4fe1fda4a8187663bd7700a394c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:34.593436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.594470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c1260d32-b33a-465d-9920-88ad5125b31a tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.600624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3966/7883] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:34 2022] DELETE /identity/v3/projects/f5ecd4fe1fda4a8187663bd7700a394c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:34.602209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.606192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.630066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf565a-4b0d-4e2b-8bb0-3b0fd484a95a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:34.716263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:34.717737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.718167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.718758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/457ae36c80b14cd2adf0fb51c3cd9458` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.722334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:update_user(user_id=457ae36c80b14cd2adf0fb51c3cd9458)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:34.724735 n-d-862964-4 devstack@keystone.service[82079]: WARNING py.warnings [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 03:22:34.724735 n-d-862964-4 devstack@keystone.service[82079]: warnings.warn(msg) Oct 29 03:22:34.724735 n-d-862964-4 devstack@keystone.service[82079]: Oct 29 03:22:34.727344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:34.789418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.805196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invalidating the token cache because user 457ae36c80b14cd2adf0fb51c3cd9458 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:34.805980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.806801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.809867 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3918/7884] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Oct 29 03:22:34 2022] PATCH /identity/v3/users/457ae36c80b14cd2adf0fb51c3cd9458 => generated 296 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:34.813948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.814531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.814909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.859550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] MFA Rules not processed for user `457ae36c80b14cd2adf0fb51c3cd9458`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:34.861064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.864608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3967/7885] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:34 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:34.869619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.871293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.888602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cffe35f-d732-4209-9bac-7ad9e4191dad tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:34.893859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:34.894817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:34.895257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:34.895604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/457ae36c80b14cd2adf0fb51c3cd9458` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:34.896984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:update_user(user_id=457ae36c80b14cd2adf0fb51c3cd9458)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:34.899166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:34.946934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.949298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:34.956657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.972476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invalidating the token cache because user 457ae36c80b14cd2adf0fb51c3cd9458 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:34.972973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.974936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:34.978521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3919/7886] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Oct 29 03:22:34 2022] PATCH /identity/v3/users/457ae36c80b14cd2adf0fb51c3cd9458 => generated 296 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:34.982783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:34.986944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.002870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdc73-628d-40f0-a105-ccceab80b74d tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.009536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.010314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.010610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.010912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/457ae36c80b14cd2adf0fb51c3cd9458` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.023538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:UPDATE=2,keystone:INSERT=4,keystone:DELETE=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:35.035592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:update_user(user_id=457ae36c80b14cd2adf0fb51c3cd9458)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.039617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.041278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:35.076306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a6a77-3a02-458a-973b-44ae9e52758e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.081889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.082696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.083075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.083492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] PATH_INFO: `/v3/projects/08b45727a0f54252849e3874791d383f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.085502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b45727a0f54252849e3874791d383f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.087472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.088820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.101210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invalidating the token cache because user 457ae36c80b14cd2adf0fb51c3cd9458 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:35.101512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.102518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7eccab09-4ad6-4dc8-b82a-5dee85d426c6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.108041 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3920/7887] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Oct 29 03:22:34 2022] PATCH /identity/v3/users/457ae36c80b14cd2adf0fb51c3cd9458 => generated 296 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:35.110275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.110419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.110657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.154809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] MFA Rules not processed for user `457ae36c80b14cd2adf0fb51c3cd9458`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:35.156084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.163781 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3921/7888] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:35.163978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b45727a0f54252849e3874791d383f', 'request_id': 'req-26dc5fcf-ccca-4841-aebc-465be2b225c2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.165108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.167460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.171759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b45727a0f54252849e3874791d383f', 'request_id': 'req-26dc5fcf-ccca-4841-aebc-465be2b225c2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.178751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b45727a0f54252849e3874791d383f', 'request_id': 'req-26dc5fcf-ccca-4841-aebc-465be2b225c2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.201287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] The token cache is being invalidate because project 08b45727a0f54252849e3874791d383f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:35.201644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.202396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-26dc5fcf-ccca-4841-aebc-465be2b225c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.218250 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3968/7889] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:34 2022] DELETE /identity/v3/projects/08b45727a0f54252849e3874791d383f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:35.226250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedf484-63a0-4a7c-b509-114f567ff74f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.226250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedf484-63a0-4a7c-b509-114f567ff74f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.226250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedf484-63a0-4a7c-b509-114f567ff74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.249097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-aeedf484-63a0-4a7c-b509-114f567ff74f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:35.250494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aeedf484-63a0-4a7c-b509-114f567ff74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.284977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc9742-6db9-4641-b215-59fff958fd2e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.292914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.293575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.293885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.294166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/457ae36c80b14cd2adf0fb51c3cd9458` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.295431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:update_user(user_id=457ae36c80b14cd2adf0fb51c3cd9458)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.298223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.330537 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3969/7890] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:35.340517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.340774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.341038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.344856 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.356722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invalidating the token cache because user 457ae36c80b14cd2adf0fb51c3cd9458 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:35.358105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.359037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.362678 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3922/7891] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Oct 29 03:22:35 2022] PATCH /identity/v3/users/457ae36c80b14cd2adf0fb51c3cd9458 => generated 296 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:35.368082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.368689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:35.369920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.370074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.381649 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3970/7892] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:35.382849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.387013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89574d6-06e3-475e-a394-989f0fc0b9f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.393203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.394197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.394335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7424fc5-f430-4a54-9676-1bfc1245a5d2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.394449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.394843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.395471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.397575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.400545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.401598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.401986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.402426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.403293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:35.404577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.406942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.427797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3971/7893] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:35.429607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.436511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3923/7894] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/users => generated 265 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:35.440490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.444790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dd6c25-c881-40f4-86dd-f5fa0f90f893 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.449527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.450334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.450617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.450906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.451544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.454288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.460875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8cc50-6f71-41af-821c-464dd10d61d6 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.469391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.470688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.471230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.473055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/84ff6730cb354e63bbdfb395431b26bb/password` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.486839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3972/7895] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:35.490867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.538387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:35.586020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92d3c7-dfac-4f59-a8e2-30bbe8f76c4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.592039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.592676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.592958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.593236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.594104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.596124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.596259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '84ff6730cb354e63bbdfb395431b26bb'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:35.612086 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3924/7896] 10.222.0.16 () {60 vars in 1269 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/users/84ff6730cb354e63bbdfb395431b26bb/password => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:35.626862 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3973/7897] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:35.628051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.640177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec53d307-96d8-442d-ae32-c9dd2fd0840e tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.645575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.646362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.646903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.647454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.648065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.649898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.666834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.673461 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3925/7898] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:35.678609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40feef-eeea-46e5-9268-4236be6fc2c3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.683644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bbd31-f3e2-4f37-8386-b9d68546fd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.684400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bbd31-f3e2-4f37-8386-b9d68546fd09 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.684738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bbd31-f3e2-4f37-8386-b9d68546fd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.685107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bbd31-f3e2-4f37-8386-b9d68546fd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.685874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bbd31-f3e2-4f37-8386-b9d68546fd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.687612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bbd31-f3e2-4f37-8386-b9d68546fd09 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.704122 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3974/7899] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:35.705754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.714077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=83,keystone:UPDATE=3,keystone:INSERT=9,keystone:DELETE=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:35.719388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0322c7f8-5a58-4927-b906-890010dea8e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.729721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.731560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.732090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.733092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] PATH_INFO: `/v3/projects/919c6b20390844a2ad0e038633095281/users/3a7b1bab1a534cbeac585962387853c6/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.751613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919c6b20390844a2ad0e038633095281, user_id=3a7b1bab1a534cbeac585962387853c6, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.754545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:35.773923 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3926/7900] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:35 2022] PUT /identity/v3/projects/919c6b20390844a2ad0e038633095281/users/3a7b1bab1a534cbeac585962387853c6/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:35.782912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda9679-2746-4c7e-bc9c-2e3a18c5b32f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.783271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda9679-2746-4c7e-bc9c-2e3a18c5b32f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.783621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda9679-2746-4c7e-bc9c-2e3a18c5b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.816054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7bda9679-2746-4c7e-bc9c-2e3a18c5b32f None None] MFA Rules not processed for user `3a7b1bab1a534cbeac585962387853c6`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:35.817478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7bda9679-2746-4c7e-bc9c-2e3a18c5b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.889590 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3975/7901] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:35.901995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:35.904125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:35.975385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4bddc-f55d-4196-bd10-63e923d1cce3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:35.979394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:35.980219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:35.980655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:35.981081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:35.990429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:35.992468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:36.014894 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3927/7902] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:36.617557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:36.618177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:36.618177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:36.643175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] MFA Rules not processed for user `84ff6730cb354e63bbdfb395431b26bb`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:36.644391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:36.648339 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3976/7903] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:36 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:36.652203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:36.745584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d9462-1feb-4514-b4f4-f9550df06fc7 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:36.752230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:36.752934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:36.754016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:36.755153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:36.767813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:36.770338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:36.778203 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3928/7904] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Oct 29 03:22:36 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:36.782463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:36.799464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21785c3-ecf5-4a40-bbb4-67453385230b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:36.809414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:36.810868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:36.811327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:36.811789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/84ff6730cb354e63bbdfb395431b26bb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:36.813866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_user(user_id=84ff6730cb354e63bbdfb395431b26bb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:36.816892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:36.891163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ff6730cb354e63bbdfb395431b26bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:36.904416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ff6730cb354e63bbdfb395431b26bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:36.905246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ff6730cb354e63bbdfb395431b26bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:36.917332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ff6730cb354e63bbdfb395431b26bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:36.918471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ff6730cb354e63bbdfb395431b26bb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:36.949309 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3977/7905] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:36 2022] DELETE /identity/v3/users/84ff6730cb354e63bbdfb395431b26bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:36.950235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:36.960814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbe4c-e83f-4ad8-aaa6-25a8025f779f tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:37.046191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:37.046854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:37.047200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:37.047546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:37.048296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:37.051621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:37.089720 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3929/7906] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:36 2022] POST /identity/v3/users => generated 364 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:37.092859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:37.094510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:37.105998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:37.110748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df141d0-0627-4536-95e7-0f30aaa8d06b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:37.119591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:37.120840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:37.121288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:37.121770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:37.122660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:37.127227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:37.172526 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3978/7907] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:37 2022] POST /identity/v3/projects => generated 360 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:37.174041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:37.187210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2748aa-a00a-49bd-96db-604fe8cea47b tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:37.194379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:37.290484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:37.290484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `PATCH` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:37.290966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:37.291313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/faa302fbaaeb419e88d2c3e0305e3e2b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:37.308275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:update_user(user_id=faa302fbaaeb419e88d2c3e0305e3e2b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:37.310641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:37.372339 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3930/7908] 10.222.0.16 () {60 vars in 1244 bytes} [Sat Oct 29 03:22:37 2022] PATCH /identity/v3/users/faa302fbaaeb419e88d2c3e0305e3e2b => generated 521 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:37.376313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:37.394121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0e83ba-8265-4cad-869f-5c34d5b56071 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:37.403354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:37.404052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:37.404951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:37.404951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/faa302fbaaeb419e88d2c3e0305e3e2b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:37.594479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:get_user(user_id=faa302fbaaeb419e88d2c3e0305e3e2b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:37.596840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:37.598883 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3979/7909] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Oct 29 03:22:37 2022] GET /identity/v3/users/faa302fbaaeb419e88d2c3e0305e3e2b => generated 388 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:37.603355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:37.613791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537585cf-7f14-4dc4-860b-4dc4451a4cd0 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:37.619461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:37.620105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:37.620381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:37.620672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/projects/da92dadb372748d7ac30d6275bb5f791` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:37.621873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da92dadb372748d7ac30d6275bb5f791)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:37.623810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:37.678878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da92dadb372748d7ac30d6275bb5f791', 'request_id': 'req-497fe3a2-c577-4f66-aeec-6a6508cf2d70'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.687318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da92dadb372748d7ac30d6275bb5f791', 'request_id': 'req-497fe3a2-c577-4f66-aeec-6a6508cf2d70'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.693876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da92dadb372748d7ac30d6275bb5f791', 'request_id': 'req-497fe3a2-c577-4f66-aeec-6a6508cf2d70'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.709897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] The token cache is being invalidate because project da92dadb372748d7ac30d6275bb5f791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:37.710580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.711147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.713204 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3931/7910] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:37 2022] DELETE /identity/v3/projects/da92dadb372748d7ac30d6275bb5f791 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:37.717373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:37.720230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:37.739417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f20f95-2321-4dc8-9adf-f8bee215a565 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:37.812957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7382fb3a5e4742b9167d990c5e675d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0aa9e22f72204b3c9746495000c85300', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:37.813715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:37.814234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:37.814528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] PATH_INFO: `/v3/users/faa302fbaaeb419e88d2c3e0305e3e2b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:37.815827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorizing `identity:delete_user(user_id=faa302fbaaeb419e88d2c3e0305e3e2b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:37.818249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:37.875019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa302fbaaeb419e88d2c3e0305e3e2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.886220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa302fbaaeb419e88d2c3e0305e3e2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.887225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa302fbaaeb419e88d2c3e0305e3e2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.897731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa302fbaaeb419e88d2c3e0305e3e2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.898787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0b729749-62ae-44d2-8f08-3b69536a63f4 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa302fbaaeb419e88d2c3e0305e3e2b'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:37.921486 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3980/7911] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:37 2022] DELETE /identity/v3/users/faa302fbaaeb419e88d2c3e0305e3e2b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:37.926372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:37.928618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:38.011285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fe3a2-c577-4f66-aeec-6a6508cf2d70 tempest-UsersV3TestJSON-376709305 tempest-UsersV3TestJSON-376709305-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:38.018508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:38.085407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:38.086092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:38.086582 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:38.086857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] PATH_INFO: `/v3/users/457ae36c80b14cd2adf0fb51c3cd9458` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:38.104270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=457ae36c80b14cd2adf0fb51c3cd9458)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:38.106282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:38.166080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.187992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.189025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.198490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.199162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457ae36c80b14cd2adf0fb51c3cd9458'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.215748 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3932/7912] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:37 2022] DELETE /identity/v3/users/457ae36c80b14cd2adf0fb51c3cd9458 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:38.220684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:38.221074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:38.221443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:38.242583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:38.243952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:38.288506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:38.313692 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3981/7913] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:38.321423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:38.322869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:38.405260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc7279-2f50-4bc6-ad83-1ead15199b84 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:38.410102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:38.410744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:38.411023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:38.411297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:38.429861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:38.431490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:38.441897 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3933/7914] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:38.783435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:38.787469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:38.809437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:38.811101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:38.836257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d806f65-b5ae-4ee3-85c4-ac285369ff96 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:38.842380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:38.843193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:38.843569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:38.843941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] PATH_INFO: `/v3/projects/b3af71012a444d249c3a8fed16c9def2` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:38.845266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3af71012a444d249c3a8fed16c9def2)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:38.848947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:38.873066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:38.923438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7287d18e-891e-4be0-bdaf-45f0ad0835b9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:38.937116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3af71012a444d249c3a8fed16c9def2', 'request_id': 'req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.945567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3af71012a444d249c3a8fed16c9def2', 'request_id': 'req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.952143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3af71012a444d249c3a8fed16c9def2', 'request_id': 'req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.970905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] The token cache is being invalidate because project b3af71012a444d249c3a8fed16c9def2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:38.972891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.974078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:38.978437 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3934/7915] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:38 2022] DELETE /identity/v3/projects/b3af71012a444d249c3a8fed16c9def2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:38.982516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:38.984446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:39.016005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:39.016851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:39.017241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:39.017526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:39.019779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:39.090829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c3d35-b0eb-40fe-bfb2-b227873aa6a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:39.098067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:39.098913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:39.099374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:39.099753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] PATH_INFO: `/v3/users/bd7382fb3a5e4742b9167d990c5e675d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:39.101122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd7382fb3a5e4742b9167d990c5e675d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:39.103525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:39.106813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:39.108892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:39.123345 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3982/7916] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:39.188257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd7382fb3a5e4742b9167d990c5e675d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.207118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd7382fb3a5e4742b9167d990c5e675d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.208496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd7382fb3a5e4742b9167d990c5e675d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.218370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd7382fb3a5e4742b9167d990c5e675d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.219368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e77e35e2-05cc-474e-bba4-3d353f7307e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd7382fb3a5e4742b9167d990c5e675d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.240264 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3935/7917] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:38 2022] DELETE /identity/v3/users/bd7382fb3a5e4742b9167d990c5e675d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:39.623466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:39.638129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c228492f-ee57-4f1a-8e1f-7f38c28fce19 service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:39.715006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:39.722368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:39.723009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:39.723290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:39.723688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] PATH_INFO: `/v3/projects/0aa9e22f72204b3c9746495000c85300` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:39.725469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aa9e22f72204b3c9746495000c85300)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:39.727503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:39.782703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aa9e22f72204b3c9746495000c85300', 'request_id': 'req-fae65362-78c7-4c38-ae00-f5f62449d4e2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.790527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aa9e22f72204b3c9746495000c85300', 'request_id': 'req-fae65362-78c7-4c38-ae00-f5f62449d4e2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.796680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aa9e22f72204b3c9746495000c85300', 'request_id': 'req-fae65362-78c7-4c38-ae00-f5f62449d4e2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.811034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] The token cache is being invalidate because project 0aa9e22f72204b3c9746495000c85300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:39.811349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.812108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fae65362-78c7-4c38-ae00-f5f62449d4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:39.813825 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3983/7918] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:39 2022] DELETE /identity/v3/projects/0aa9e22f72204b3c9746495000c85300 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:39.820102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:39.820641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:39.820641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:39.860689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:39.862085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:39.891484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:39.944707 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3936/7919] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:39.948187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:39.948480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:39.948786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:39.970499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:39.971721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:39.980409 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3984/7920] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:39.984904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:39.996289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f7ade-fc50-4600-810e-3ebf6a049756 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.001353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.002066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.002410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.002741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.003453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:40.003819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.005671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.023583 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3937/7921] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:40.024803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.035560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad915c-a382-4cf3-8595-e85c79ba3752 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.040556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.041305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.041689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.042244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.042952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.044925 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.077558 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3985/7922] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:40 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:40.081573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.093252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd760aaf-4884-4221-88a8-8a899e1fb224 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.159755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.160289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.160575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.160848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.161504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.163913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.196729 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3938/7923] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:40 2022] POST /identity/v3/users => generated 280 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:40.198274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.209700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118634-0eb1-471e-89cf-75cdad9e766d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.215802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.216532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.216890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.217223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.218006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.219724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.232251 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3986/7924] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:40.236328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.248096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0fc673-33ad-448c-a477-8907ecbc2e1c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.253729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1cb9c-65d1-454b-bea0-8570d31c7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.254499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cb9c-65d1-454b-bea0-8570d31c7132 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.254852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cb9c-65d1-454b-bea0-8570d31c7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.255222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1cb9c-65d1-454b-bea0-8570d31c7132 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.255994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1cb9c-65d1-454b-bea0-8570d31c7132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.257850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1cb9c-65d1-454b-bea0-8570d31c7132 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.270529 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3939/7925] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:40.274992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.295613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007185c8-b7df-4def-8539-51f009add64e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.300552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8bdc55-8aff-4e03-a02a-5b7f9d576b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.301498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bdc55-8aff-4e03-a02a-5b7f9d576b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.301778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bdc55-8aff-4e03-a02a-5b7f9d576b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.302219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8bdc55-8aff-4e03-a02a-5b7f9d576b8a admin admin] PATH_INFO: `/v3/projects/12c4e456584c4f899ea2d83fdb2f1f54/users/c7cdb1fcf43345f9b9311ea9685ea1f5/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.323425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bdc55-8aff-4e03-a02a-5b7f9d576b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c4e456584c4f899ea2d83fdb2f1f54, user_id=c7cdb1fcf43345f9b9311ea9685ea1f5, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.326191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8bdc55-8aff-4e03-a02a-5b7f9d576b8a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.345244 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3987/7926] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:40 2022] PUT /identity/v3/projects/12c4e456584c4f899ea2d83fdb2f1f54/users/c7cdb1fcf43345f9b9311ea9685ea1f5/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:40.357464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72f04-72db-4f51-b5b0-6bb3fe2e9067 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.357776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72f04-72db-4f51-b5b0-6bb3fe2e9067 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.358181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72f04-72db-4f51-b5b0-6bb3fe2e9067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.399234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9bc72f04-72db-4f51-b5b0-6bb3fe2e9067 None None] MFA Rules not processed for user `c7cdb1fcf43345f9b9311ea9685ea1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:40.400580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bc72f04-72db-4f51-b5b0-6bb3fe2e9067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:40.492482 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3940/7927] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:40.493722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.494212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.494485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.525462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] MFA Rules not processed for user `c7cdb1fcf43345f9b9311ea9685ea1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:40.526700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:40.533577 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3988/7928] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:40 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 29 03:22:40.535493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.535781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.536062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.572326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] MFA Rules not processed for user `c7cdb1fcf43345f9b9311ea9685ea1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:40.573793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:40.580479 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3941/7929] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:40 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:40.584855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.609677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e4a31-2309-479a-9651-7d69c7585c22 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.613846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.614540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `HEAD` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.614945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.615284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.622936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorizing `identity:check_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.624634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.631854 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3989/7930] 10.222.0.16 () {56 vars in 1264 bytes} [Sat Oct 29 03:22:40 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 29 03:22:40.635947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.650709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400763e-7e10-4136-b775-ed7e59323d65 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.655139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.655829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.656111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.656463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.664252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.666062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.668765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:40.681453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.681652 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3942/7931] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Oct 29 03:22:40 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 29 03:22:40.691434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a3bbd-8ab0-4607-bcbd-517c11058b61 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.696147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45f0f7-28c7-429a-a204-e14aacd43afe tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.697100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f0f7-28c7-429a-a204-e14aacd43afe tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.697557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f0f7-28c7-429a-a204-e14aacd43afe tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.697951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f0f7-28c7-429a-a204-e14aacd43afe tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.705885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45f0f7-28c7-429a-a204-e14aacd43afe tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.707793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d45f0f7-28c7-429a-a204-e14aacd43afe tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.733223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.738145 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3990/7932] 10.222.0.16 () {56 vars in 1266 bytes} [Sat Oct 29 03:22:40 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:40.745427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4fd1f-102f-43bb-a45e-c97f2e042469 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.750381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.751084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `HEAD` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.751432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.751969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.754435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 29 03:22:40.771747 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 29 03:22:40.772905 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 29 03:22:40.774216 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.774216 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.774216 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 29 03:22:40.774216 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 29 03:22:40.774216 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 29 03:22:40.774216 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:22:40.780597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.780881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.781155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.787730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3943/7933] 10.222.0.16 () {56 vars in 1264 bytes} [Sat Oct 29 03:22:40 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 29 03:22:40.804134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] MFA Rules not processed for user `c7cdb1fcf43345f9b9311ea9685ea1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:40.805541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:40.813145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.820683 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3991/7934] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:40 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 29 03:22:40.826291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3ae1c-6cc6-49d5-8f66-cab483858328 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.831024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.831716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.832065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.832512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.841768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.844085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.853856 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3944/7935] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Oct 29 03:22:40 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 29 03:22:40.856457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.874490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514cd912-fcf1-46ad-a321-33a424b41a15 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.880090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.881513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.882190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.883141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.894897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:40.899171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:40.921617 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3992/7936] 10.222.0.16 () {56 vars in 1266 bytes} [Sat Oct 29 03:22:40 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:40.925913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:40.940081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dd5d3-9310-43f6-accf-f71f71ef7baf tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:40.946890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b6fba-9c2d-4085-9063-c54ad0cadff0 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7cdb1fcf43345f9b9311ea9685ea1f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12c4e456584c4f899ea2d83fdb2f1f54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:40.947616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6fba-9c2d-4085-9063-c54ad0cadff0 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:40.947905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6fba-9c2d-4085-9063-c54ad0cadff0 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:40.949274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6fba-9c2d-4085-9063-c54ad0cadff0 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:40.951350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-035b6fba-9c2d-4085-9063-c54ad0cadff0 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application [None req-035b6fba-9c2d-4085-9063-c54ad0cadff0 tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 29 03:22:40.968721 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 29 03:22:40.969696 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: ERROR keystone.server.flask.application Oct 29 03:22:40.975388 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3945/7937] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Oct 29 03:22:40 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 03:22:41.064393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:41.064393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=9,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:41.165420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdeac5-a981-4757-9eb5-c28b3ea529ce tempest-TokensV3Test-193752734 tempest-TokensV3Test-193752734-project] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:41.165420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:41.165420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:41.165420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:41.168022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] PATH_INFO: `/v3/users/c7cdb1fcf43345f9b9311ea9685ea1f5` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:41.168022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7cdb1fcf43345f9b9311ea9685ea1f5)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:41.168022 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:41.217315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7cdb1fcf43345f9b9311ea9685ea1f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:41.234441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7cdb1fcf43345f9b9311ea9685ea1f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:41.235695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7cdb1fcf43345f9b9311ea9685ea1f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:41.252890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7cdb1fcf43345f9b9311ea9685ea1f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:41.254262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7cdb1fcf43345f9b9311ea9685ea1f5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:41.293392 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3993/7938] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:40 2022] DELETE /identity/v3/users/c7cdb1fcf43345f9b9311ea9685ea1f5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:41.295446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:41.295798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:41.296138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:41.323753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:41.325248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:41.444055 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3946/7939] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:41.451491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:41.452884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:41.521551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ab72b-2d45-4bb5-9714-64e0650092e5 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:41.525961 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:41.526593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:41.526871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:41.527142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:41.538324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:41.539836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:41.566532 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3994/7940] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:41.977875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:41.981767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:42.035125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431f36-866a-4a2d-b648-2c6ec8a073f1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:42.044572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:42.046032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:42.057302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:42.058699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.058990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.059269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] PATH_INFO: `/v3/projects/12c4e456584c4f899ea2d83fdb2f1f54` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.062400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c4e456584c4f899ea2d83fdb2f1f54)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:42.076037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b9d08-74ce-4824-affd-01e69a55fd00 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:42.086639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:42.107977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:42.109016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.109453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.109948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] PATH_INFO: `/v3/users/3a7b1bab1a534cbeac585962387853c6` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.113579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a7b1bab1a534cbeac585962387853c6)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:42.117760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:42.188275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:42.209617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a7b1bab1a534cbeac585962387853c6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.220021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c4e456584c4f899ea2d83fdb2f1f54', 'request_id': 'req-84ca1ec7-8150-4e03-b37c-feed36551ffd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.227208 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a7b1bab1a534cbeac585962387853c6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.228755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a7b1bab1a534cbeac585962387853c6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.242918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a7b1bab1a534cbeac585962387853c6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.253728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2d45193c-fe90-408a-b7a8-243b45595372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a7b1bab1a534cbeac585962387853c6'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.272693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c4e456584c4f899ea2d83fdb2f1f54', 'request_id': 'req-84ca1ec7-8150-4e03-b37c-feed36551ffd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.291228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c4e456584c4f899ea2d83fdb2f1f54', 'request_id': 'req-84ca1ec7-8150-4e03-b37c-feed36551ffd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.295165 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3995/7941] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:42 2022] DELETE /identity/v3/users/3a7b1bab1a534cbeac585962387853c6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:42.299507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.299910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.300614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.310874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] The token cache is being invalidate because project 12c4e456584c4f899ea2d83fdb2f1f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:42.311192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.314296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-84ca1ec7-8150-4e03-b37c-feed36551ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:42.316813 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3947/7942] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:41 2022] DELETE /identity/v3/projects/12c4e456584c4f899ea2d83fdb2f1f54 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:42.322881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828990f2-4627-4283-9184-f54d12f556fc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.323166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828990f2-4627-4283-9184-f54d12f556fc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.323443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828990f2-4627-4283-9184-f54d12f556fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.329521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:42.330853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:42.368872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-828990f2-4627-4283-9184-f54d12f556fc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:42.370153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-828990f2-4627-4283-9184-f54d12f556fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:42.466986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:42.487050 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3996/7943] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:42.497790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:42.498048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3948/7944] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:42.507204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:42.507406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.507577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.507855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.544832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:42.546129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:42.565048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3949/7945] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:42.569742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:42.585583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c0b6-4223-40cd-aad4-9fc7cd85cd36 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:42.596608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:42.597291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.597670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.598061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.598809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:42.601107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:42.607604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:42.658341 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3950/7946] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:42.662613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:42.668064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bc5595-1fa3-4fee-8359-72a3b06b02ee None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:42.680040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:42.680980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.681588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.681982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.683427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0006b5-f1bf-418e-8fce-03d1efa6e0fa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:42.695700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:42.696336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.696612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.696885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.697536 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:42.699519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:42.700517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:42.701981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:42.733608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3997/7947] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:42.758743 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3951/7948] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:42 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:42.763810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:42.785607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c944b-aee8-4bef-8c57-ac0a63da349b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:42.917073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:42.926956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:42.928257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:42.928878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:42.929154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:42.930121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:42.944379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.015737 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3998/7949] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:42 2022] POST /identity/v3/users => generated 303 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:43.020141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.031904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bee5b4-3cee-45f0-9859-813cbb9ea570 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.039000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.039739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.040246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.040741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.041630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.043789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.064894 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3952/7950] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:43.065221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.080798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf283d-4fde-432a-badb-36f122297ce2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.087065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.087302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.087614 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.094140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] PATH_INFO: `/v3/projects/04c81cd1bcdb4f1faeb205da2aa42a4b/users/7e0aa17bb13b43cfb84a0bf9a321a732/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.129503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c81cd1bcdb4f1faeb205da2aa42a4b, user_id=7e0aa17bb13b43cfb84a0bf9a321a732, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.134767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.167449 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 3999/7951] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:43 2022] PUT /identity/v3/projects/04c81cd1bcdb4f1faeb205da2aa42a4b/users/7e0aa17bb13b43cfb84a0bf9a321a732/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:43.168992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.189884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd382b4-d91b-4cac-8f9d-0d07672b7b2b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.231292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.233827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:43.317082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.318490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.318913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.319282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.320100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.322250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.338081 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3953/7952] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:43.341870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.358677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d2ff2-74de-49e0-aa6b-b3b363a3be52 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.370046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd88b31-e795-46da-95d6-4f67c487c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.371104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd88b31-e795-46da-95d6-4f67c487c8f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.371870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd88b31-e795-46da-95d6-4f67c487c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.372670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd88b31-e795-46da-95d6-4f67c487c8f0 admin admin] PATH_INFO: `/v3/projects/04c81cd1bcdb4f1faeb205da2aa42a4b/users/7e0aa17bb13b43cfb84a0bf9a321a732/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.376757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd88b31-e795-46da-95d6-4f67c487c8f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04c81cd1bcdb4f1faeb205da2aa42a4b, user_id=7e0aa17bb13b43cfb84a0bf9a321a732, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.379739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd88b31-e795-46da-95d6-4f67c487c8f0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.400869 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3954/7953] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:43 2022] PUT /identity/v3/projects/04c81cd1bcdb4f1faeb205da2aa42a4b/users/7e0aa17bb13b43cfb84a0bf9a321a732/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:43.412975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.413518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.413789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.423529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7e15-887f-4a62-8c5f-ecea6830f928 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.459871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] MFA Rules not processed for user `7e0aa17bb13b43cfb84a0bf9a321a732`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:43.461082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:43.502443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.503243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.503628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.503905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] PATH_INFO: `/v3/projects/919c6b20390844a2ad0e038633095281` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.505548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919c6b20390844a2ad0e038633095281)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.508436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.561693 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3955/7954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:43.564493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.581277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622bd19-ee89-49c4-894b-3b33ab963af5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.584776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919c6b20390844a2ad0e038633095281', 'request_id': 'req-7a2d76fb-2ed6-48a1-943c-8187783644a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:43.587152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:43.594818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919c6b20390844a2ad0e038633095281', 'request_id': 'req-7a2d76fb-2ed6-48a1-943c-8187783644a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:43.603187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919c6b20390844a2ad0e038633095281', 'request_id': 'req-7a2d76fb-2ed6-48a1-943c-8187783644a2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:43.623470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:43.632316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] The token cache is being invalidate because project 919c6b20390844a2ad0e038633095281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:43.632738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:43.633472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7a2d76fb-2ed6-48a1-943c-8187783644a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:43.640658 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4000/7955] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:43 2022] DELETE /identity/v3/projects/919c6b20390844a2ad0e038633095281 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:43.643670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8463f55-fa9a-4f93-90b8-b962f28cc1eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.644003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8463f55-fa9a-4f93-90b8-b962f28cc1eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.644583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8463f55-fa9a-4f93-90b8-b962f28cc1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.671091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e8463f55-fa9a-4f93-90b8-b962f28cc1eb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:43.672689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e8463f55-fa9a-4f93-90b8-b962f28cc1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:43.673447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.674399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.674688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.675048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.675755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.678011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.682932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4001/7956] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:43.690989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b42817-16c4-424c-9537-d09814fd704b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.691617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b42817-16c4-424c-9537-d09814fd704b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.691899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b42817-16c4-424c-9537-d09814fd704b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.722480 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3956/7957] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:43.724384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-30b42817-16c4-424c-9537-d09814fd704b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:43.726013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-30b42817-16c4-424c-9537-d09814fd704b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:43.728266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.730370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:43.831414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1bccd-520f-4119-a90a-c8f41a4c8233 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.837684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.838636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.838941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.839476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.840457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.843249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.861565 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4002/7958] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:43.876299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b42817-16c4-424c-9537-d09814fd704b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.888386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b42817-16c4-424c-9537-d09814fd704b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.893568 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3957/7959] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:43.894968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.895361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.895692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.896220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.896703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.897359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:43.897894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.900072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.915482 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd27c4-360d-4429-9859-bc44af8e31e7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.922320 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4003/7960] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:43.923305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.927475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.928196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.928552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.928905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.929672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.931884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.936850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e016374-e597-445a-9293-5d232dc6a9c6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.943033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:43.943995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:43.944424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:43.945119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:43.946097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:43.949354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:43.957309 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3958/7961] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:43.961607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:43.988696 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4004/7962] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:43.988911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabfae2-ada9-4c26-8b8c-ca3bd050613d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:43.989975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.068007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3deca-6fc4-4142-95f5-c5cd5bd50077 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.073688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.074579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.074857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.075258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.076050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.077272 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.077995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.078120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.078408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.078681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.079328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.081293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.094705 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3959/7963] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:44.100378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.113877 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4005/7964] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:43 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:44.113877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.115353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6cbdc-863b-4c59-9c1f-f64e159115ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.121217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d53c27-3650-42d3-9999-4c0eb726f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.121959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d53c27-3650-42d3-9999-4c0eb726f7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.122265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d53c27-3650-42d3-9999-4c0eb726f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.122615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d53c27-3650-42d3-9999-4c0eb726f7b8 admin admin] PATH_INFO: `/v3/projects/68142be9962b46ffae1db875fb58d783/users/e3e5f4bdd2264826883e9b0404b8e7d1/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.125230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:44.127156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e8972-d610-4364-a929-63cd728a3cc0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.134486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.135143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.135452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.135742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.136796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.139039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.143144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d53c27-3650-42d3-9999-4c0eb726f7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68142be9962b46ffae1db875fb58d783, user_id=e3e5f4bdd2264826883e9b0404b8e7d1, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.146206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d53c27-3650-42d3-9999-4c0eb726f7b8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.151124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4006/7965] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:44.158792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.167455 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3960/7966] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:44 2022] PUT /identity/v3/projects/68142be9962b46ffae1db875fb58d783/users/e3e5f4bdd2264826883e9b0404b8e7d1/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:44.170692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55e29b-4094-4a38-bccb-5bb070286e56 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.179017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.179435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.179842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.215431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:44.221339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] MFA Rules not processed for user `e3e5f4bdd2264826883e9b0404b8e7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:44.222680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:44.250146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.250779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.251060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.251336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.251978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.255072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.270394 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4007/7967] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:44.274817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.289537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3270-53c0-45e4-a179-545bad1f2817 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.300881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a8dea-7a2c-4d3b-ba8e-315e08503959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.301626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a8dea-7a2c-4d3b-ba8e-315e08503959 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.302398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a8dea-7a2c-4d3b-ba8e-315e08503959 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.302398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a8dea-7a2c-4d3b-ba8e-315e08503959 admin admin] PATH_INFO: `/v3/projects/5bfef6703fc942d39ab43d6049a45680/users/3094a9ae7d43422c9394636dca5278f5/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.315270 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3961/7968] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:44.324061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a8dea-7a2c-4d3b-ba8e-315e08503959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bfef6703fc942d39ab43d6049a45680, user_id=3094a9ae7d43422c9394636dca5278f5, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.326944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a8dea-7a2c-4d3b-ba8e-315e08503959 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.330122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.331716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:44.350422 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4008/7969] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:44 2022] PUT /identity/v3/projects/5bfef6703fc942d39ab43d6049a45680/users/3094a9ae7d43422c9394636dca5278f5/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:44.360486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.360785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.361067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.392638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] MFA Rules not processed for user `3094a9ae7d43422c9394636dca5278f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:44.394125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:44.402650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c7dac-5a54-4962-8fee-2b93f2f54e54 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.473674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.474917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.476124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.476615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.478946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:44.481717 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4009/7970] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:44.502408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:44.507706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:44.531063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:44.566823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.568423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.597076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3962/7971] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:44 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:44.599676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab328a3-ee90-44aa-85b5-6ddd9dec6e84 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:44.603849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff45a7-f6a3-4611-b9a6-a608c6eebff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:44.604667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff45a7-f6a3-4611-b9a6-a608c6eebff0 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:44.605100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff45a7-f6a3-4611-b9a6-a608c6eebff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:44.605530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff45a7-f6a3-4611-b9a6-a608c6eebff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:44.615795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff45a7-f6a3-4611-b9a6-a608c6eebff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:44.618345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff45a7-f6a3-4611-b9a6-a608c6eebff0 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:44.642583 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4010/7972] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:45.703891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:45.789593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c52af6-1886-441c-a02d-ba75980da766 service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:45.794621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:45.795570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:45.795845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:45.796120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] PATH_INFO: `/v3/users/7e0aa17bb13b43cfb84a0bf9a321a732` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:45.797527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0aa17bb13b43cfb84a0bf9a321a732)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:45.799760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:45.866868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0aa17bb13b43cfb84a0bf9a321a732'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:45.881477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0aa17bb13b43cfb84a0bf9a321a732'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:45.882496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0aa17bb13b43cfb84a0bf9a321a732'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:45.894044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0aa17bb13b43cfb84a0bf9a321a732'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:45.894870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0aa17bb13b43cfb84a0bf9a321a732'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:45.912174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3963/7973] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:45 2022] DELETE /identity/v3/users/7e0aa17bb13b43cfb84a0bf9a321a732 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:45.916933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:45.917517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:45.917517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:45.940433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:45.941276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:46.004343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:46.056924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4011/7974] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:46.064012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:46.065991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:46.158765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c41b46-df3a-4644-8765-97942eae846d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:46.163028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:46.163676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:46.164015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:46.164355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:46.174136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:46.184821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:46.188699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:46.213091 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3964/7975] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:46.683129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:46.684713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:46.716950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384eb42-4c4f-440c-990f-f6392f2a261d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:46.738389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:46.739257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:46.740309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:46.740742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] PATH_INFO: `/v3/projects/04c81cd1bcdb4f1faeb205da2aa42a4b` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:46.742579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04c81cd1bcdb4f1faeb205da2aa42a4b)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:46.747275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:46.859615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04c81cd1bcdb4f1faeb205da2aa42a4b', 'request_id': 'req-06d75ea2-c808-4011-a992-c9eddb989159'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:46.868353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04c81cd1bcdb4f1faeb205da2aa42a4b', 'request_id': 'req-06d75ea2-c808-4011-a992-c9eddb989159'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:46.875822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04c81cd1bcdb4f1faeb205da2aa42a4b', 'request_id': 'req-06d75ea2-c808-4011-a992-c9eddb989159'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:46.891994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] The token cache is being invalidate because project 04c81cd1bcdb4f1faeb205da2aa42a4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:46.892321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:46.893023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:46.897687 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4012/7976] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:46 2022] DELETE /identity/v3/projects/04c81cd1bcdb4f1faeb205da2aa42a4b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:46.899291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:46.927541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf1d94-e134-4442-b963-20a05a6668bf service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:47.019691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:47.020503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:47.020786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:47.021107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] PATH_INFO: `/v3/users/e3e5f4bdd2264826883e9b0404b8e7d1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:47.022356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3e5f4bdd2264826883e9b0404b8e7d1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:47.024662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:47.092682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3e5f4bdd2264826883e9b0404b8e7d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.115966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3e5f4bdd2264826883e9b0404b8e7d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.116886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3e5f4bdd2264826883e9b0404b8e7d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.125685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3e5f4bdd2264826883e9b0404b8e7d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.126727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e32e3fd4-0c48-40f7-b667-722dba10a4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3e5f4bdd2264826883e9b0404b8e7d1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.142723 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3965/7977] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:46 2022] DELETE /identity/v3/users/e3e5f4bdd2264826883e9b0404b8e7d1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:47.566202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:47.568519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:47.593481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d75ea2-c808-4011-a992-c9eddb989159 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:47.684860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:47.686015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:47.686015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:47.686253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] PATH_INFO: `/v3/projects/68142be9962b46ffae1db875fb58d783` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:47.688041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68142be9962b46ffae1db875fb58d783)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:47.690122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:47.781145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68142be9962b46ffae1db875fb58d783', 'request_id': 'req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.811337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68142be9962b46ffae1db875fb58d783', 'request_id': 'req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.826847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68142be9962b46ffae1db875fb58d783', 'request_id': 'req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.831478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:47.853384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] The token cache is being invalidate because project 68142be9962b46ffae1db875fb58d783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:47.854420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.856281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b5c7270e-8dbe-4fe2-90c4-8e4f2032e48e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:47.860031 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4013/7978] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:47 2022] DELETE /identity/v3/projects/68142be9962b46ffae1db875fb58d783 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:47.872080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:47.872477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:47.872853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:47.914476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:47.915750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:47.996085 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3966/7979] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:48.005255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.005599 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.005913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.028993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:48.030412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:48.040208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4014/7980] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:48.044588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.058615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e22b3a-ee74-4e80-8826-77f5cab858c8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.064436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.065278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.065686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.066010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.066678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:48.066999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.068855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.087129 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3967/7981] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:48.088284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.099199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523936a-565e-4ed2-88c3-7700ae79784c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.104819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.105942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.106327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.106666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.107413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.109446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.141206 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4015/7982] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:48 2022] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:48.145207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.155897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb14b9-61f4-4c32-b583-7b139d8c3d4e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.159771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:48.226891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.227562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.227746 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.227995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.228632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.230624 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.260670 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3968/7983] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:48 2022] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:22:48.262131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.273659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84f446-943c-42f1-b37a-f8beec303c28 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.278770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.279399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.279729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.280004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.280767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.282421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.295208 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4016/7984] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:48.297896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.308755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd841-ed2f-478f-8b9d-66b0fc639e3f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.313694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c127097-d7b5-4838-8d0d-72bbd932d711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.314338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c127097-d7b5-4838-8d0d-72bbd932d711 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.314618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c127097-d7b5-4838-8d0d-72bbd932d711 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.314893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c127097-d7b5-4838-8d0d-72bbd932d711 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.315678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c127097-d7b5-4838-8d0d-72bbd932d711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.317307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c127097-d7b5-4838-8d0d-72bbd932d711 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.333230 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3969/7985] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:48.334543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.352793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef61c-210e-4b21-8c3b-2d2556adbf07 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.358481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.359237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.359587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.359861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] PATH_INFO: `/v3/projects/7dc594a7c01b4cfb9c2a282e0e618c34/users/371bafd5d07e4ed3841fe512633c8815/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.376748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc594a7c01b4cfb9c2a282e0e618c34, user_id=371bafd5d07e4ed3841fe512633c8815, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.383818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.409888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4017/7986] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:48 2022] PUT /identity/v3/projects/7dc594a7c01b4cfb9c2a282e0e618c34/users/371bafd5d07e4ed3841fe512633c8815/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:48.415258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defcbef-a70f-449a-bf12-a2da59dbb4d9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.416227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defcbef-a70f-449a-bf12-a2da59dbb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.416565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defcbef-a70f-449a-bf12-a2da59dbb4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.448888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8defcbef-a70f-449a-bf12-a2da59dbb4d9 None None] MFA Rules not processed for user `371bafd5d07e4ed3841fe512633c8815`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:48.450580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8defcbef-a70f-449a-bf12-a2da59dbb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:48.527480 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3970/7987] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:48.539254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.645198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c535c8-d1f6-47f8-8c82-4fc8c426d6c2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.650693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.651369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.651652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.651930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] PATH_INFO: `/v3/users/371bafd5d07e4ed3841fe512633c8815` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.653129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371bafd5d07e4ed3841fe512633c8815)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.655126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:48.720552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371bafd5d07e4ed3841fe512633c8815'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:48.733374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371bafd5d07e4ed3841fe512633c8815'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:48.734098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371bafd5d07e4ed3841fe512633c8815'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:48.743609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371bafd5d07e4ed3841fe512633c8815'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:48.744335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371bafd5d07e4ed3841fe512633c8815'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:48.766931 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4018/7988] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:48 2022] DELETE /identity/v3/users/371bafd5d07e4ed3841fe512633c8815 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:48.773434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.774501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.775047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.799230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:48.800470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:48.876409 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3971/7989] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:48.886695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:48.888167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:48.900860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:48.975810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29547d0c-f499-425c-8755-a5b428595717 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:48.980036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3c0d1-3b5c-4c06-8f4b-74caba94b225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:48.980660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c0d1-3b5c-4c06-8f4b-74caba94b225 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:48.981299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c0d1-3b5c-4c06-8f4b-74caba94b225 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:48.981585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3c0d1-3b5c-4c06-8f4b-74caba94b225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:48.997931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3c0d1-3b5c-4c06-8f4b-74caba94b225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:48.999437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3c0d1-3b5c-4c06-8f4b-74caba94b225 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:49.023245 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4019/7990] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:49.419723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:49.422148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:49.443337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3204814-c772-4063-889a-bc4fc7612457 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:49.451350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:49.452337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:49.452787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:49.453223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] PATH_INFO: `/v3/projects/7dc594a7c01b4cfb9c2a282e0e618c34` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:49.455363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc594a7c01b4cfb9c2a282e0e618c34)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:49.458017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:49.480593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:49.534485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc594a7c01b4cfb9c2a282e0e618c34', 'request_id': 'req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.558133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc594a7c01b4cfb9c2a282e0e618c34', 'request_id': 'req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.575622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc594a7c01b4cfb9c2a282e0e618c34', 'request_id': 'req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.593188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] The token cache is being invalidate because project 7dc594a7c01b4cfb9c2a282e0e618c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:49.593548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.594626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.596956 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3972/7991] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:49 2022] DELETE /identity/v3/projects/7dc594a7c01b4cfb9c2a282e0e618c34 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:49.602416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee897ae-f11b-4397-8ec8-a1a3cc64422c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:49.603664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee897ae-f11b-4397-8ec8-a1a3cc64422c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:49.603993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee897ae-f11b-4397-8ec8-a1a3cc64422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:49.639028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bee897ae-f11b-4397-8ec8-a1a3cc64422c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:49.640607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bee897ae-f11b-4397-8ec8-a1a3cc64422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:49.669393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:49.670961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:49.769169 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4020/7992] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:49.770835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:49.771186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:49.772004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:49.797849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:49.799305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:49.816251 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4021/7993] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:49.820538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:49.831237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dd869-75e8-4166-9ad4-d1a66b97bd06 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:49.836444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:49.837069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:49.837344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:49.837613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:49.838312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:49.838611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:49.840754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:49.855820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b716b87-b8f1-4c68-9f91-cb61fe4eaa6f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:49.859848 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4022/7994] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:49.861230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:49.863114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:49.864074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:49.864501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:49.864956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] PATH_INFO: `/v3/users/13a322fb1ffd4b94b17bfd32b22c920e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:49.873629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575ddf3-454c-416a-ac51-e93273b7b017 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:49.874590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a322fb1ffd4b94b17bfd32b22c920e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:49.876973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:49.879953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:49.880933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:49.881215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:49.881489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:49.882249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:49.884460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:49.937828 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4023/7995] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:49 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:49.938809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:49.963626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a322fb1ffd4b94b17bfd32b22c920e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.992025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a322fb1ffd4b94b17bfd32b22c920e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:49.994372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a322fb1ffd4b94b17bfd32b22c920e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:50.006959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a322fb1ffd4b94b17bfd32b22c920e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:50.007793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-69688a16-eb4c-4c65-9a92-1a66dbc762f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a322fb1ffd4b94b17bfd32b22c920e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:50.054972 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3973/7996] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:49 2022] DELETE /identity/v3/users/13a322fb1ffd4b94b17bfd32b22c920e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:50.059895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.060846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.061609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.092967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794c8d4-bea2-43f0-ade1-75417d19d328 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.098988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:50.100287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:50.109554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:50.133007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:50.170941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.172394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.172835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.173261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.174101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.176226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.222264 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3974/7997] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:50.222987 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4024/7998] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:49 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:50.224902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.226416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:50.236672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.238792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:50.247620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fa01f-5ef9-4434-9a6d-dc6def4868a0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.253168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.253914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.254361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.254637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.255350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.257345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.273850 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3975/7999] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:50.276774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.305890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a278d7c-d805-4c63-819f-7de8fdd32b85 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.317667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.318481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.318756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.319543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.321064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.323997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.377941 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3976/8000] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:50.387689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.400281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb5e44-9da9-4754-8151-bb912fdc5ee4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.408133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.408961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.409346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.409692 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] PATH_INFO: `/v3/projects/e6087601628a4979a85a14f03779051f/users/d58fa8833a1e4c999b8b612038247dba/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.411374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7ba5a-de74-4101-8304-77d945536f63 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.415775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409b2ec-019a-4626-b0de-d8ced74b626c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.416415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b2ec-019a-4626-b0de-d8ced74b626c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.416692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b2ec-019a-4626-b0de-d8ced74b626c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.416965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b2ec-019a-4626-b0de-d8ced74b626c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.430477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409b2ec-019a-4626-b0de-d8ced74b626c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.431443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6087601628a4979a85a14f03779051f, user_id=d58fa8833a1e4c999b8b612038247dba, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.433233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409b2ec-019a-4626-b0de-d8ced74b626c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.434835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.457318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4025/8002] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:50.462325 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3977/8002] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:50 2022] PUT /identity/v3/projects/e6087601628a4979a85a14f03779051f/users/d58fa8833a1e4c999b8b612038247dba/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:50.483884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.484279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.484652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.526129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] MFA Rules not processed for user `d58fa8833a1e4c999b8b612038247dba`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:50.527503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:50.618468 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4026/8003] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:50.622849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.738579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c58de4-e888-402b-8b9b-7ea7da191da8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.744260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.745170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.745458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.745795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.746628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.748608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.787233 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3978/8004] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:50 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:50.791560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.804499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.805328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a1abf-331c-403e-94db-af1fb9595279 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.807707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:50.877049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:50.901419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.902067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.903103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:50.903235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.903331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.903918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.905875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.906908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed426-b360-4183-817c-09926e00d62f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.912950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.913930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.914230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.914500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] PATH_INFO: `/v3/projects/b4617319827242caafd25613f453d96d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.915841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4617319827242caafd25613f453d96d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.919143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.931711 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4027/8005] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:50 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:50.935396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.945720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a28e4-72f7-482c-a909-b31aa1b5e7d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.950537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:50.951153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:50.951441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:50.951827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:50.952473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:50.954435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:50.970882 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4028/8006] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:50.976428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:50.983003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4617319827242caafd25613f453d96d', 'request_id': 'req-a5601f48-2eb3-4930-b3e8-75e9775c63a1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:50.990997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4617319827242caafd25613f453d96d', 'request_id': 'req-a5601f48-2eb3-4930-b3e8-75e9775c63a1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:50.995001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f27a8b0-0782-4730-9a78-024bce9b7fd2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:50.999108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4617319827242caafd25613f453d96d', 'request_id': 'req-a5601f48-2eb3-4930-b3e8-75e9775c63a1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:51.015370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] The token cache is being invalidate because project b4617319827242caafd25613f453d96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:51.015717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:51.016324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a5601f48-2eb3-4930-b3e8-75e9775c63a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:51.022040 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3979/8007] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:50 2022] DELETE /identity/v3/projects/b4617319827242caafd25613f453d96d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:51.023701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070928ab-6a8c-4d7d-b398-a5b7de065b87 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.023988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070928ab-6a8c-4d7d-b398-a5b7de065b87 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.024257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070928ab-6a8c-4d7d-b398-a5b7de065b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.046735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-070928ab-6a8c-4d7d-b398-a5b7de065b87 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:51.048645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-070928ab-6a8c-4d7d-b398-a5b7de065b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:51.070841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.071530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.071816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.072090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] PATH_INFO: `/v3/projects/f511bf745dfd444381bc39d73ada71b3/users/a57e5a54daf94ff4b70e1f9ce247e482/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.089957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f511bf745dfd444381bc39d73ada71b3, user_id=a57e5a54daf94ff4b70e1f9ce247e482, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.092976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.108597 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4029/8008] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:50 2022] PUT /identity/v3/projects/f511bf745dfd444381bc39d73ada71b3/users/a57e5a54daf94ff4b70e1f9ce247e482/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:51.112712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.115653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:51.139341 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3980/8009] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:51.147416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.147706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.147992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.167765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:51.169018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:51.189715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca32412-650c-495a-b846-3f1e7284cfb6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.195726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.196894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.197347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.197941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.198593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.200464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.221885 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4030/8010] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:51.226808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.236613 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3981/8011] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:51.238030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0876ce-6468-49db-9e7c-b7ef56946eb7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.241487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.243716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5241222c-b339-471c-b6d6-630952152481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.244399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241222c-b339-471c-b6d6-630952152481 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.244676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241222c-b339-471c-b6d6-630952152481 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.244946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241222c-b339-471c-b6d6-630952152481 admin admin] PATH_INFO: `/v3/projects/f511bf745dfd444381bc39d73ada71b3/users/a57e5a54daf94ff4b70e1f9ce247e482/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.247516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241222c-b339-471c-b6d6-630952152481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f511bf745dfd444381bc39d73ada71b3, user_id=a57e5a54daf94ff4b70e1f9ce247e482, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.250626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5241222c-b339-471c-b6d6-630952152481 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.251484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fcd3e-5927-476f-8e09-48f0a39e93a8 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.256730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.257419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.257701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.258023 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.258671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:51.258974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.260583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.263622 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4031/8012] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:51 2022] PUT /identity/v3/projects/f511bf745dfd444381bc39d73ada71b3/users/a57e5a54daf94ff4b70e1f9ce247e482/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:51.275929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.276223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.276477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.284541 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3982/8013] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:51.286801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.300030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd7f3a-cc11-41d7-ba69-7c2c1b92d95b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.307397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] MFA Rules not processed for user `a57e5a54daf94ff4b70e1f9ce247e482`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:51.308625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:51.312540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:51.323814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:51.375288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.377717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.377889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.378084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.378830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.380982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.405845 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4032/8014] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:51.409333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.415902 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3983/8015] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:51.417815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.422653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdda20a-7f62-4be9-b8df-524c0d84059e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.489165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e5a54daf94ff4b70e1f9ce247e482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f511bf745dfd444381bc39d73ada71b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.489868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.490165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.490549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.491327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:51.491693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.493839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.498389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c858d-8325-488c-ab56-799a602fe256 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.510277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4033/8016] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:22:51.511462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.515222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.516093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.516955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.517601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.519263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.522840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.523437 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf771e-6221-41f3-b4e6-42237f8f0c3b tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.528989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e5a54daf94ff4b70e1f9ce247e482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f511bf745dfd444381bc39d73ada71b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.530179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.530306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.530625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.531592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.533656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.552770 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3984/8017] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:51.563563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.571729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdb426-915e-4e18-aa98-2de529927a4a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.577090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.577918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.578298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.578666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.579429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.581047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.586207 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4034/8018] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/projects => generated 350 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:51.587393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.608334 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3985/8019] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:51.612376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.624816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf29dff-fd3d-407e-85b8-3e1a4dfc55ab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.674175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5c2d5-0501-4f60-bc2c-ac49114283b3 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.680947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e5a54daf94ff4b70e1f9ce247e482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f511bf745dfd444381bc39d73ada71b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.681584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.681894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.682223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.682876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:51.683179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.685214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.707505 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4035/8020] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:51.719704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.723236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:51.727786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.728532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.728898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.729290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.730175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.732121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.743784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3986/8021] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:51.748024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.754560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:51.760208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3a390-617d-44e5-8b57-eb16a4790235 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.766813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3aafdb-cae1-4c33-ad9e-8041f9c10e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.767671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aafdb-cae1-4c33-ad9e-8041f9c10e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.768089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aafdb-cae1-4c33-ad9e-8041f9c10e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.768376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3aafdb-cae1-4c33-ad9e-8041f9c10e4e admin admin] PATH_INFO: `/v3/projects/3854eeed984341d4a87c49eedf243a53/users/099e1f7107484087bca33a38ce40ed69/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.787940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:51.791007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aafdb-cae1-4c33-ad9e-8041f9c10e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3854eeed984341d4a87c49eedf243a53, user_id=099e1f7107484087bca33a38ce40ed69, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:51.794297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3aafdb-cae1-4c33-ad9e-8041f9c10e4e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:51.824413 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3987/8022] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:51 2022] PUT /identity/v3/projects/3854eeed984341d4a87c49eedf243a53/users/099e1f7107484087bca33a38ce40ed69/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:51.830416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.830703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.830977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.842346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213d22fe-dd14-4274-92c1-4aa37c1ca4ce tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:51.872451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:51.874295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:51.907777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c159-ca5f-43ce-b3f9-0882a050f04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:51.908476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c159-ca5f-43ce-b3f9-0882a050f04f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:51.908825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c159-ca5f-43ce-b3f9-0882a050f04f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:51.909168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c159-ca5f-43ce-b3f9-0882a050f04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:51.959947 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3988/8023] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:51.970942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:51.999247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f15b2-a968-4200-9558-d828a25ca463 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:52.007586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:52.008460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:52.008813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:52.009212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:52.019924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c159-ca5f-43ce-b3f9-0882a050f04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:52.021085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:52.021435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c159-ca5f-43ce-b3f9-0882a050f04f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:52.022973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:52.033204 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4036/8024] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:52.034568 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3989/8025] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:53.139170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:53.139664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:53.139760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:53.189717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] MFA Rules not processed for user `099e1f7107484087bca33a38ce40ed69`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:53.191051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:53.329465 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4037/8026] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:53.341853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:53.343271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:53.490175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6e03b-e590-487e-8692-4c875142b289 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:53.501516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:53.502266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:53.502553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:53.502821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:53.524634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:53.528486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:53.565756 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3990/8027] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:54.208434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:54.245384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9322ca0b-65c2-4b2b-a0e7-16c0ca9e0dd8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:54.262376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57e5a54daf94ff4b70e1f9ce247e482', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f511bf745dfd444381bc39d73ada71b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:54.263363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:54.263791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:54.264169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] PATH_INFO: `/v3/projects/463f31b6feb549489d2b1c21edaa9e9d` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:54.265648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=463f31b6feb549489d2b1c21edaa9e9d)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:54.267965 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:54.281057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:54.342030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463f31b6feb549489d2b1c21edaa9e9d', 'request_id': 'req-aed8ce0c-e697-420a-81e5-595e526a8974'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.352077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463f31b6feb549489d2b1c21edaa9e9d', 'request_id': 'req-aed8ce0c-e697-420a-81e5-595e526a8974'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.365260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463f31b6feb549489d2b1c21edaa9e9d', 'request_id': 'req-aed8ce0c-e697-420a-81e5-595e526a8974'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.384194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] The token cache is being invalidate because project 463f31b6feb549489d2b1c21edaa9e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:54.385012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.385886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aed8ce0c-e697-420a-81e5-595e526a8974 tempest-QuotasNegativeTest-560628211 tempest-QuotasNegativeTest-560628211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.387844 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4038/8028] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:54 2022] DELETE /identity/v3/projects/463f31b6feb549489d2b1c21edaa9e9d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:54.393947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:54.410952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f861867-0d2f-4eb6-a622-c19642f8891f service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:54.496325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:54.497305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:54.497699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:54.498097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] PATH_INFO: `/v3/users/d58fa8833a1e4c999b8b612038247dba` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:54.499499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58fa8833a1e4c999b8b612038247dba)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:54.503722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:54.541317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:54.583405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58fa8833a1e4c999b8b612038247dba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.596042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58fa8833a1e4c999b8b612038247dba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.596904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58fa8833a1e4c999b8b612038247dba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.605215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58fa8833a1e4c999b8b612038247dba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.606101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58fa8833a1e4c999b8b612038247dba'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:54.623497 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3991/8029] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:54 2022] DELETE /identity/v3/users/d58fa8833a1e4c999b8b612038247dba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:54.627928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:54.628436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:54.628932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:54.652797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:54.659922 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:54.735270 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4039/8030] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:54.745660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:54.747311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:54.830484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3ccf5-9503-4cb2-b999-31c6517e6d5b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:54.835203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:54.836196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:54.836479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:54.836754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:54.851883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:54.853405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:54.866278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3992/8031] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:22:55.354311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:55.356651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:55.372793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa75c5-46ae-4e4f-abeb-c23b4ae3597c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:55.380297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:55.381455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:55.381869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:55.382342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] PATH_INFO: `/v3/projects/e6087601628a4979a85a14f03779051f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:55.385301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6087601628a4979a85a14f03779051f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:55.388678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:55.456596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6087601628a4979a85a14f03779051f', 'request_id': 'req-eddeb34a-99d2-42d2-b796-6050b91a4c81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.463672 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6087601628a4979a85a14f03779051f', 'request_id': 'req-eddeb34a-99d2-42d2-b796-6050b91a4c81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.472037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6087601628a4979a85a14f03779051f', 'request_id': 'req-eddeb34a-99d2-42d2-b796-6050b91a4c81'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.486564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] The token cache is being invalidate because project e6087601628a4979a85a14f03779051f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:55.487061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.487702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.489501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4040/8032] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:55 2022] DELETE /identity/v3/projects/e6087601628a4979a85a14f03779051f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:55.493750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:55.503843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba97aa-f242-4f05-aca0-02fcabd1c922 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:55.579372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:55.580147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:55.580493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:55.580869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] PATH_INFO: `/v3/users/a57e5a54daf94ff4b70e1f9ce247e482` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:55.582229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57e5a54daf94ff4b70e1f9ce247e482)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:55.584321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:55.635117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:55.637392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57e5a54daf94ff4b70e1f9ce247e482'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.657228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57e5a54daf94ff4b70e1f9ce247e482'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.658131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57e5a54daf94ff4b70e1f9ce247e482'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.666045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57e5a54daf94ff4b70e1f9ce247e482'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.666754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1c208885-2874-407b-a3d5-5b0cdcfba0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57e5a54daf94ff4b70e1f9ce247e482'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:55.681728 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3993/8033] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:22:55 2022] DELETE /identity/v3/users/a57e5a54daf94ff4b70e1f9ce247e482 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:56.022627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.024600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:56.038847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb34a-99d2-42d2-b796-6050b91a4c81 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.055751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:56.121231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.122002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.122354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.122730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] PATH_INFO: `/v3/projects/f511bf745dfd444381bc39d73ada71b3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.124041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f511bf745dfd444381bc39d73ada71b3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.126131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.178275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f511bf745dfd444381bc39d73ada71b3', 'request_id': 'req-8d518a8d-fbf4-453f-9712-7eee81f34139'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:56.185147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f511bf745dfd444381bc39d73ada71b3', 'request_id': 'req-8d518a8d-fbf4-453f-9712-7eee81f34139'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:56.192778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f511bf745dfd444381bc39d73ada71b3', 'request_id': 'req-8d518a8d-fbf4-453f-9712-7eee81f34139'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:56.214182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] The token cache is being invalidate because project f511bf745dfd444381bc39d73ada71b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:22:56.214412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:56.215052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8d518a8d-fbf4-453f-9712-7eee81f34139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:22:56.216905 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4041/8034] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:22:56 2022] DELETE /identity/v3/projects/f511bf745dfd444381bc39d73ada71b3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:56.221538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02f154-0b20-44a4-b026-67a07fa4fb41 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.221873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02f154-0b20-44a4-b026-67a07fa4fb41 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.222445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02f154-0b20-44a4-b026-67a07fa4fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.261557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9f02f154-0b20-44a4-b026-67a07fa4fb41 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:56.263484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9f02f154-0b20-44a4-b026-67a07fa4fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:56.340293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.340703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.340817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.364265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] MFA Rules not processed for user `099e1f7107484087bca33a38ce40ed69`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:56.365855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:56.369079 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3994/8035] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:56.370907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.371207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.371488 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.407596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:56.409463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:56.437299 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3995/8036] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:56.450988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.462511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace0885-10a9-46e6-a621-db2d82494bcc None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.463999 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4042/8037] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:22:56.472487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.473083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.473366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.473622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.474551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:22:56.475296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.476427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.490097 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3996/8038] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:22:56.497064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.529789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4738a-a516-4f67-bb54-86e32ab0814e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.534868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.535601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.536025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.536361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.537382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.539624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.613563 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4043/8039] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:56 2022] POST /identity/v3/projects => generated 395 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:56.614686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.637059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd99748-79f6-4dc3-9ea1-792c6bb96a13 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.722005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.722552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.722834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.723110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.723775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.726179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.752940 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3997/8040] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:56 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:56.770568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.783083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e077a-3af1-470b-b9e2-a72b1a0b3a19 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.788407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.789051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.789329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.789604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.790343 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.792122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.809394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.810619 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4044/8041] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:56.824352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405478-6f36-4878-955d-716c5167f4c2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.829636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7ab82-fc53-49a6-bd40-0f8d16a752f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.830941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7ab82-fc53-49a6-bd40-0f8d16a752f3 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.831446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7ab82-fc53-49a6-bd40-0f8d16a752f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.831816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7ab82-fc53-49a6-bd40-0f8d16a752f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.832587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7ab82-fc53-49a6-bd40-0f8d16a752f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.834610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7ab82-fc53-49a6-bd40-0f8d16a752f3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.858108 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3998/8042] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:56.862274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:56.874895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18657119-31ba-413a-9814-f533b34db236 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:56.880939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:56.882178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.882535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.882878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] PATH_INFO: `/v3/projects/78287a2806414a35893ef04379e69ba5/users/69eda29bc87e4654abc42f9e8b8e74a0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:56.904752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78287a2806414a35893ef04379e69ba5, user_id=69eda29bc87e4654abc42f9e8b8e74a0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:56.907871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:56.912701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:56.933472 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4045/8043] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:56 2022] PUT /identity/v3/projects/78287a2806414a35893ef04379e69ba5/users/69eda29bc87e4654abc42f9e8b8e74a0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:22:56.945321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:56.945611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:56.945916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.003699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] MFA Rules not processed for user `69eda29bc87e4654abc42f9e8b8e74a0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:57.005466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:57.019690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:57.110039 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 3999/8044] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:57.114353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.246410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.247845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:57.265335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe920-04c4-47e1-9c90-44ae82dcf804 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.281269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.284144 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.284577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.285337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.287278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.293172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.351412 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4046/8045] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:22:57 2022] POST /identity/v3/projects => generated 399 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:57.353994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.362651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca9d3b-f7f4-4454-9ef9-02eb6333db2a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.431170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec7334-6dd0-412e-a24c-c0c91c644962 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.437566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.438221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.438743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.438956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.439931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.442655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.462873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.463515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.463803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.464080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.470871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:57.478202 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4047/8046] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:22:57 2022] POST /identity/v3/users => generated 306 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:22:57.484525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.493277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.495193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.499843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facb9ee9-72df-438b-b322-937bff4a0419 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.505773 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.506433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.506712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.506986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.507628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.509276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.521719 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4048/8047] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:22:57.524768 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4000/8048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:57.526829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.538858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354add76-431e-4059-bc70-94fb02609524 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.561349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.562425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.563513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.563967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] PATH_INFO: `/v3/projects/67f4e37f3750468daac68975f4a7c126/users/4ff23684f5bf4db0aa8d566f8c2a2071/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.582422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f4e37f3750468daac68975f4a7c126, user_id=4ff23684f5bf4db0aa8d566f8c2a2071, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.585838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.603364 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4049/8049] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:57 2022] PUT /identity/v3/projects/67f4e37f3750468daac68975f4a7c126/users/4ff23684f5bf4db0aa8d566f8c2a2071/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:57.607233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.621433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b82a5a-af5e-49da-a40f-cd40e6d71cf5 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.682018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:57.703871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b2f8-c66c-486e-9f35-1b2a2e9c0473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.704686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b2f8-c66c-486e-9f35-1b2a2e9c0473 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.705041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b2f8-c66c-486e-9f35-1b2a2e9c0473 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.705412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b2f8-c66c-486e-9f35-1b2a2e9c0473 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.706236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b2f8-c66c-486e-9f35-1b2a2e9c0473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.708148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b2f8-c66c-486e-9f35-1b2a2e9c0473 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.732784 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4001/8050] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:22:57.737502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.752013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed3fc38-e704-487c-8a36-d0b8af9d6855 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:57.757395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:57.758158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.758441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.758722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] PATH_INFO: `/v3/projects/67f4e37f3750468daac68975f4a7c126/users/4ff23684f5bf4db0aa8d566f8c2a2071/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.761015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67f4e37f3750468daac68975f4a7c126, user_id=4ff23684f5bf4db0aa8d566f8c2a2071, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:57.763918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:57.777795 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4050/8051] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:22:57 2022] PUT /identity/v3/projects/67f4e37f3750468daac68975f4a7c126/users/4ff23684f5bf4db0aa8d566f8c2a2071/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:22:57.794467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:57.794773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:57.795158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:57.850509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] MFA Rules not processed for user `4ff23684f5bf4db0aa8d566f8c2a2071`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:22:57.853719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:57.938742 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4002/8052] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:22:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:22:57.949518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:57.952583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:58.002753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:22:58.061260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc594c64-151a-4a5f-a7e0-e95cefd996b2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:58.066609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:58.067100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:58.067385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:58.067747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:58.145278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:58.147346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:58.173307 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4051/8053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:57 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:22:58.605325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:22:58.607059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:22:58.742490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369bfb8-2bea-4515-bb2b-bb7f4ce00669 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:22:58.772558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:22:58.773462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:22:58.774180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:22:58.774649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:22:58.786057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:22:58.788384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:22:58.806294 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4003/8054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:22:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:23:01.528503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:01.530274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:01.570386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cae57d-9354-491c-890f-0456af4d8e03 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:01.577395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:01.578122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:01.578464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:01.578799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:01.580798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:01.602245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:01.604545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c11931-60a2-4e03-9e63-dd7ac2119389 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:01.635613 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4052/8055] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:23:04.249772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:04.251341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:04.359562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:04.377257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9ab09-5330-4c63-8f10-3b9d57b1b1de service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:04.383039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:04.383838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:04.384217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:04.384586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] PATH_INFO: `/v3/users/3094a9ae7d43422c9394636dca5278f5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:04.385958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3094a9ae7d43422c9394636dca5278f5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:04.390379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:04.468360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3094a9ae7d43422c9394636dca5278f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:04.488061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3094a9ae7d43422c9394636dca5278f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:04.489051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3094a9ae7d43422c9394636dca5278f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:04.499583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3094a9ae7d43422c9394636dca5278f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:04.500512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3094a9ae7d43422c9394636dca5278f5'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:04.523647 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4004/8056] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:23:04 2022] DELETE /identity/v3/users/3094a9ae7d43422c9394636dca5278f5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:04.525138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:04.525611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:04.525916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:04.558578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:04.560116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:04.658810 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4053/8057] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:23:04.670728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:04.676094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:04.785406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d739b3-6cc5-428f-b6a9-78fdf69b9043 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:04.789486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23054d-9b09-4f16-9498-9a03d8487a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:04.790373 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23054d-9b09-4f16-9498-9a03d8487a8b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:04.790916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23054d-9b09-4f16-9498-9a03d8487a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:04.791361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23054d-9b09-4f16-9498-9a03d8487a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:04.825939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23054d-9b09-4f16-9498-9a03d8487a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:04.827616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23054d-9b09-4f16-9498-9a03d8487a8b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:04.840064 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4005/8058] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:23:05.392369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:05.395332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:05.445835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b61a4-ca66-4dd0-9d8d-447f20ba3f0b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:05.458890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:05.460044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:05.460707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:05.462026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] PATH_INFO: `/v3/projects/5bfef6703fc942d39ab43d6049a45680` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:05.465785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bfef6703fc942d39ab43d6049a45680)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:05.471473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:05.592722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bfef6703fc942d39ab43d6049a45680', 'request_id': 'req-47443b9c-df54-4ff1-b607-0c56d80bcabb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:05.600165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bfef6703fc942d39ab43d6049a45680', 'request_id': 'req-47443b9c-df54-4ff1-b607-0c56d80bcabb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:05.605794 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:05.609190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bfef6703fc942d39ab43d6049a45680', 'request_id': 'req-47443b9c-df54-4ff1-b607-0c56d80bcabb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:05.634129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] The token cache is being invalidate because project 5bfef6703fc942d39ab43d6049a45680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:23:05.634706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:05.635826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-47443b9c-df54-4ff1-b607-0c56d80bcabb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:05.637908 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4054/8059] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:23:05 2022] DELETE /identity/v3/projects/5bfef6703fc942d39ab43d6049a45680 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:05.644326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:05.644877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:05.645998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:05.701829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:05.706306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:05.813082 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4006/8060] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:05.814529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:05.814819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:05.815099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:05.835266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:05.836484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:05.844609 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4055/8061] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:23:05.848847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:05.859495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11801e00-c924-49ff-a436-824f3549a4e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:05.865431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:05.866124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:05.866407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:05.866683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:05.868425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:23:05.868425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:05.869898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:05.881342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:05.890476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:05.901049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4007/8062] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:23:05.901741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e9460-4c4a-4c49-884e-7bf881faf931 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:05.907340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:05.908073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:05.908423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:05.908768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:05.909849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:05.912424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:05.955402 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4056/8063] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:23:05 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:23:05.960463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:05.977842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e982fd-e9a6-409b-9c8d-b7bbf7fca596 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.068787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.069416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.069697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.070019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.070668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.072592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.103194 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4008/8064] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:23:05 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:23:06.104500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:06.115830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ac50-1aed-4975-9a53-626425b955aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.121029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.121653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.122025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.122229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.122875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.124480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.135488 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4057/8065] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:23:06.139334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:06.150024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b20c1d-059d-41aa-94d8-2d6d97bf5063 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.154803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8153a3c-9cb8-485a-bc5e-1cc030e41043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.155421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8153a3c-9cb8-485a-bc5e-1cc030e41043 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.155704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8153a3c-9cb8-485a-bc5e-1cc030e41043 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.156000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8153a3c-9cb8-485a-bc5e-1cc030e41043 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.156691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8153a3c-9cb8-485a-bc5e-1cc030e41043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.158515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8153a3c-9cb8-485a-bc5e-1cc030e41043 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.169789 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4009/8066] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:23:06.174088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:06.185739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3122a4f-ca74-4620-8c11-e9d4e72aba64 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.191007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.191775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.192147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.192849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] PATH_INFO: `/v3/projects/2e2dc80c89d5446a984f37afa34271af/users/3c0026cd8eb242e08d70ff1cf1d07319/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.208930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e2dc80c89d5446a984f37afa34271af, user_id=3c0026cd8eb242e08d70ff1cf1d07319, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.211838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.229185 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4058/8067] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:23:06 2022] PUT /identity/v3/projects/2e2dc80c89d5446a984f37afa34271af/users/3c0026cd8eb242e08d70ff1cf1d07319/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:23:06.240854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.241144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.241425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.271151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] MFA Rules not processed for user `3c0026cd8eb242e08d70ff1cf1d07319`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:06.272541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:06.384345 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4010/8068] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:23:06.385193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:06.387642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:06.463070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecf087-a316-4655-b200-bbeeb71f9d02 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.467210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0cad9-74ae-4665-b05a-aa60393421a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.468252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0cad9-74ae-4665-b05a-aa60393421a6 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.468709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0cad9-74ae-4665-b05a-aa60393421a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.469132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0cad9-74ae-4665-b05a-aa60393421a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.472577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:06.474439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:06.482536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0cad9-74ae-4665-b05a-aa60393421a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.484400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0cad9-74ae-4665-b05a-aa60393421a6 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.495794 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4059/8069] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:23:06.594117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b664a-ccbc-4a57-b197-6173ef7db346 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.600061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.600728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.601080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.601376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] PATH_INFO: `/v3/users/69eda29bc87e4654abc42f9e8b8e74a0` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.602645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69eda29bc87e4654abc42f9e8b8e74a0)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.608959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.620819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:06.675671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69eda29bc87e4654abc42f9e8b8e74a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:06.695899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69eda29bc87e4654abc42f9e8b8e74a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:06.697163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69eda29bc87e4654abc42f9e8b8e74a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:06.706890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69eda29bc87e4654abc42f9e8b8e74a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:06.707768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69eda29bc87e4654abc42f9e8b8e74a0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:06.727845 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4011/8070] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:23:06 2022] DELETE /identity/v3/users/69eda29bc87e4654abc42f9e8b8e74a0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:06.732529 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.733017 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.733598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.759011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:06.760817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:06.836586 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4060/8071] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:06.848236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:06.849979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:06.916794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772ad9a-901d-4241-9cf1-849f8c62dc67 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:06.921028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:06.921818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:06.922112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:06.922383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:06.934397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:06.935849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:06.965866 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4012/8072] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:23:07.133454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:07.135819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:07.184605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:07.190905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:07.193204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:07.217577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed28d-646c-4906-a41d-410ddb784c39 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:07.226109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:07.227011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:07.227474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:07.228022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] PATH_INFO: `/v3/projects/78287a2806414a35893ef04379e69ba5` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:07.229287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78287a2806414a35893ef04379e69ba5)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:07.231953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:07.269619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96387c4d-2187-4247-9b25-6ba73af157bb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:07.276002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:07.276683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:07.277156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:07.277470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:07.279526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:07.290691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78287a2806414a35893ef04379e69ba5', 'request_id': 'req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.295992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:07.298283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:07.298402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78287a2806414a35893ef04379e69ba5', 'request_id': 'req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.304281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78287a2806414a35893ef04379e69ba5', 'request_id': 'req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.317709 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4061/8073] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:23:07.335015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] The token cache is being invalidate because project 78287a2806414a35893ef04379e69ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:23:07.336001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.337061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.342927 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4013/8074] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:23:07 2022] DELETE /identity/v3/projects/78287a2806414a35893ef04379e69ba5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:07.343211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:07.360868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d80d2-becc-4c7e-878a-0424ccdca2e2 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:07.430458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:07.431104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:07.431451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:07.431723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] PATH_INFO: `/v3/users/4ff23684f5bf4db0aa8d566f8c2a2071` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:07.432865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff23684f5bf4db0aa8d566f8c2a2071)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:07.439491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:07.508306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff23684f5bf4db0aa8d566f8c2a2071'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.518057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff23684f5bf4db0aa8d566f8c2a2071'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.519057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff23684f5bf4db0aa8d566f8c2a2071'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.527611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff23684f5bf4db0aa8d566f8c2a2071'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.528518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-4d342002-98ec-484a-94f8-b1d9d7e98303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff23684f5bf4db0aa8d566f8c2a2071'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:07.565525 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4062/8075] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:23:07 2022] DELETE /identity/v3/users/4ff23684f5bf4db0aa8d566f8c2a2071 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:07.879116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:07.881128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:07.910943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09ff67-7dae-4a1b-85a6-4b80a0e5d205 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:07.930051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:08.006337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.007121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.007408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.007687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] PATH_INFO: `/v3/projects/67f4e37f3750468daac68975f4a7c126` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.008932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67f4e37f3750468daac68975f4a7c126)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.011128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.072686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67f4e37f3750468daac68975f4a7c126', 'request_id': 'req-e1d246bb-5dc3-4570-ae55-5342fe15101d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:08.081054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67f4e37f3750468daac68975f4a7c126', 'request_id': 'req-e1d246bb-5dc3-4570-ae55-5342fe15101d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:08.088892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67f4e37f3750468daac68975f4a7c126', 'request_id': 'req-e1d246bb-5dc3-4570-ae55-5342fe15101d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:08.105053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] The token cache is being invalidate because project 67f4e37f3750468daac68975f4a7c126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:23:08.105345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:08.106112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e1d246bb-5dc3-4570-ae55-5342fe15101d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:08.107648 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4014/8076] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:23:07 2022] DELETE /identity/v3/projects/67f4e37f3750468daac68975f4a7c126 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:08.115828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.116361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.116361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.138774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:08.140011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:08.166497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:08.206104 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4063/8077] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:08.215351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.215713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.216070 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.236938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:08.238290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:08.248157 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4015/8078] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:08.252550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.263315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924b8e-d876-4f7c-986b-0d088ddc3421 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.268223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.268842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.269131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.269472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.270171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:23:08.270551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.272523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.284772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4064/8079] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:23:08.289501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.299231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaeab31-73a4-4fc6-b37d-7096fa4ff19a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.304391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.305002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.305282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.305547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.306195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.308103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.339254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4016/8080] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:23:08 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:23:08.340382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.350632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb2c57-cbef-499c-9810-aa17975115ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.410200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.410745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.411821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.412099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.412733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.414696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.438396 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4065/8081] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:23:08 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:23:08.442637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.453560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024f49d-f457-425b-bdb2-9aa4a9965568 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.458410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.459086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.459352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.459621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.460256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.461854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.475162 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4017/8082] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:23:08.476667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.487398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cd015-6158-409d-aa91-721d1d707c6e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.497763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e13cf-e573-424b-aea3-29d21320adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.498603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e13cf-e573-424b-aea3-29d21320adce admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.499061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e13cf-e573-424b-aea3-29d21320adce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.499486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e13cf-e573-424b-aea3-29d21320adce admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.500339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e13cf-e573-424b-aea3-29d21320adce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.502207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e13cf-e573-424b-aea3-29d21320adce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.518553 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4066/8083] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:23:08.525785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.543375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fed53-916d-4318-86e5-14cb2e290ccd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.548862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.549966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.550249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.550521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] PATH_INFO: `/v3/projects/96b23db6eeaf4d1780712896e92a9781/users/7964587c09ca4b47b3d170d6322e9a11/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.567384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b23db6eeaf4d1780712896e92a9781, user_id=7964587c09ca4b47b3d170d6322e9a11, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.571340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.587288 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4018/8084] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:23:08 2022] PUT /identity/v3/projects/96b23db6eeaf4d1780712896e92a9781/users/7964587c09ca4b47b3d170d6322e9a11/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:08.598046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143231f-3c22-41f7-8510-4db64ab123eb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.598339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143231f-3c22-41f7-8510-4db64ab123eb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.598657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143231f-3c22-41f7-8510-4db64ab123eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.629970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a143231f-3c22-41f7-8510-4db64ab123eb None None] MFA Rules not processed for user `7964587c09ca4b47b3d170d6322e9a11`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:08.631293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a143231f-3c22-41f7-8510-4db64ab123eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:08.705439 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4067/8085] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:08.715957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:08.717765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:08.764177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:08.784930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766beac-0be6-4efd-8c88-a3eb43cd2971 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:08.789734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:08.790384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:08.790662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:08.790933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:08.799859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:08.801299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:08.811383 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4019/8086] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:23:13.783865 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d4d1-7d7e-4d39-9a06-797172bb5dee None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:13.784424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d4d1-7d7e-4d39-9a06-797172bb5dee None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:13.784424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d4d1-7d7e-4d39-9a06-797172bb5dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:13.814316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3c12d4d1-7d7e-4d39-9a06-797172bb5dee None None] MFA Rules not processed for user `099e1f7107484087bca33a38ce40ed69`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:13.816496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3c12d4d1-7d7e-4d39-9a06-797172bb5dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:13.853272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:13.901686 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4068/8087] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:17.334796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:17.337615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:17.593951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c2d0b-5f62-40a1-8e46-cb4e243a8791 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:17.614059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:17.614751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:17.615858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:17.615858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] PATH_INFO: `/v3/users/3c0026cd8eb242e08d70ff1cf1d07319` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:17.618717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0026cd8eb242e08d70ff1cf1d07319)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:17.621246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:17.704716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0026cd8eb242e08d70ff1cf1d07319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:17.736601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0026cd8eb242e08d70ff1cf1d07319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:17.737657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0026cd8eb242e08d70ff1cf1d07319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:17.769877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0026cd8eb242e08d70ff1cf1d07319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:17.770868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0026cd8eb242e08d70ff1cf1d07319'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:17.807076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4020/8088] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:23:17 2022] DELETE /identity/v3/users/3c0026cd8eb242e08d70ff1cf1d07319 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:17.811582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:17.812071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:17.812189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:17.842818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:17.844403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:18.019232 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4069/8089] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:23:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:23:18.040200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:18.041681 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:18.167398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82b499-6cac-4e41-9605-6bd8dacac942 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:18.175933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf658a9-7b74-4000-a2c1-ded60e5a47c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:18.176667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf658a9-7b74-4000-a2c1-ded60e5a47c6 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:18.176952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf658a9-7b74-4000-a2c1-ded60e5a47c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:18.177229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf658a9-7b74-4000-a2c1-ded60e5a47c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:18.207540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf658a9-7b74-4000-a2c1-ded60e5a47c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:18.209462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf658a9-7b74-4000-a2c1-ded60e5a47c6 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:18.234981 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4021/8090] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:23:19.089032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:19.091124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:19.117986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616fb1ce-922e-41e4-9b6e-b5946a1fdecd None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:19.129122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:19.130805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:19.133132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:19.133768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] PATH_INFO: `/v3/projects/2e2dc80c89d5446a984f37afa34271af` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:19.135267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e2dc80c89d5446a984f37afa34271af)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:19.141784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:19.212661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e2dc80c89d5446a984f37afa34271af', 'request_id': 'req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:19.221043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e2dc80c89d5446a984f37afa34271af', 'request_id': 'req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:19.246954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e2dc80c89d5446a984f37afa34271af', 'request_id': 'req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:19.271090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] The token cache is being invalidate because project 2e2dc80c89d5446a984f37afa34271af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:23:19.271433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:19.272960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:23:19.275486 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4070/8091] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:23:19 2022] DELETE /identity/v3/projects/2e2dc80c89d5446a984f37afa34271af => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:23:28.221562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:29.264862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=67,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:33.355132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:33.355656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:33.355772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:33.420504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:23:33.423379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:33.533665 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4022/8092] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:23:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:23:33.663389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:33.665467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:33.811676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfef102-61b5-4dd0-9c7d-dacd94623ea2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:33.817699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:33.818370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:33.818651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:33.820751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:33.847810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:33.849490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:33.874747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4071/8093] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:43.532112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=38 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:43.863616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=43 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:23:53.329137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:53.356223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8efae-3712-45d2-a0ff-db8d9509e8b6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:53.378702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:53.379716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:53.380189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:53.385496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:53.390109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:53.529708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:53.531396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11870d2-8215-45ef-9b9f-09039623130d service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:53.575274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4023/8094] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:23:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:23:54.865164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:23:54.865164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:55.058702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818557f0-5b21-4e4c-9799-f41a21e2f25b service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:23:55.074862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:23:55.076077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:23:55.076560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:23:55.077044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:23:55.080103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:23:55.107531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:23:55.109842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:23:55.164779 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4072/8095] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:23:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:03.550538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=28 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:03.876958 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:03.877635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:03.878183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:03.915896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:03.917497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:03.930125 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4024/8096] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:24:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:24:03.945186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:03.967709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8d3ed-2fd1-455d-8801-4f30833510f7 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:03.978282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:03.979452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:03.979742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:03.980069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:03.990844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:03.993158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:04.004395 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4073/8097] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:24:06.724637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:06.748448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726917-0cfa-410b-ac94-2a8303aebba6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:06.759774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:06.760404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:06.760680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:06.760946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:06.764762 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:06.791298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:06.793331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:06.818003 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4025/8098] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:09.034202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:09.055907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2563bc6-7082-4000-9cdf-f00819a84d69 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:09.066557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:09.067471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:09.067855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:09.068136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:09.070284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:09.120969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:09.123676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:09.152362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:09.154384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:09.183721 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4074/8099] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:09.293333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a2862-0bb7-4862-8d36-818a13141f5a service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:09.298661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:09.299572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:09.300048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:09.300517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] PATH_INFO: `/v3/users/099e1f7107484087bca33a38ce40ed69` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:09.302790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099e1f7107484087bca33a38ce40ed69)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:09.318212 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:09.391484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099e1f7107484087bca33a38ce40ed69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.409780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099e1f7107484087bca33a38ce40ed69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.411025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099e1f7107484087bca33a38ce40ed69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.427990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099e1f7107484087bca33a38ce40ed69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.428898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099e1f7107484087bca33a38ce40ed69'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.458275 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4026/8100] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:24:09 2022] DELETE /identity/v3/users/099e1f7107484087bca33a38ce40ed69 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:09.802885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:09.817455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc3320-abaa-42dc-9aac-f10ea41d742e service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:09.909291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:09.910183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:09.910464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:09.910789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] PATH_INFO: `/v3/projects/3854eeed984341d4a87c49eedf243a53` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:09.911949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3854eeed984341d4a87c49eedf243a53)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:09.914114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:09.976494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3854eeed984341d4a87c49eedf243a53', 'request_id': 'req-a0d496b4-c613-42bc-bb00-52243d010fa8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.985381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3854eeed984341d4a87c49eedf243a53', 'request_id': 'req-a0d496b4-c613-42bc-bb00-52243d010fa8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:09.988121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:09.995947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3854eeed984341d4a87c49eedf243a53', 'request_id': 'req-a0d496b4-c613-42bc-bb00-52243d010fa8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:10.017717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] The token cache is being invalidate because project 3854eeed984341d4a87c49eedf243a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:24:10.018353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:10.019316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a0d496b4-c613-42bc-bb00-52243d010fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:10.020855 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4075/8101] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:24:09 2022] DELETE /identity/v3/projects/3854eeed984341d4a87c49eedf243a53 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:19.446720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=66,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:20.012269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=4,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:42.998750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:43.001098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:43.042490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757879-9a64-4779-ba32-a2089f6f8c35 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:43.113112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:43.114381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.114666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.114935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] PATH_INFO: `/v3/users/7964587c09ca4b47b3d170d6322e9a11` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.116128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7964587c09ca4b47b3d170d6322e9a11)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:43.118560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:43.170238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7964587c09ca4b47b3d170d6322e9a11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.183289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7964587c09ca4b47b3d170d6322e9a11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.184044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7964587c09ca4b47b3d170d6322e9a11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.192004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7964587c09ca4b47b3d170d6322e9a11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.192726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7964587c09ca4b47b3d170d6322e9a11'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.207738 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4027/8102] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:24:42 2022] DELETE /identity/v3/users/7964587c09ca4b47b3d170d6322e9a11 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:43.212347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.212840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.212940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.232820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:43.233978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:43.295954 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4076/8103] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:24:43.306360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:43.308029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:43.384843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:43.404079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5abad-cd6b-4a64-8e44-fb6803468177 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:43.408556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e73b3-2446-47a3-9f4d-efd5fb634bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:43.409217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e73b3-2446-47a3-9f4d-efd5fb634bda service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.409649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e73b3-2446-47a3-9f4d-efd5fb634bda service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.409966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e73b3-2446-47a3-9f4d-efd5fb634bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.419709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e73b3-2446-47a3-9f4d-efd5fb634bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:43.421144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e73b3-2446-47a3-9f4d-efd5fb634bda service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:43.434043 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4028/8104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:43.612742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:43.614519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:43.629959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cffdf3-0ea5-4d80-9c1d-9cd42e07aef4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:43.634975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:43.635761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.636265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.636744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] PATH_INFO: `/v3/projects/96b23db6eeaf4d1780712896e92a9781` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.641693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b23db6eeaf4d1780712896e92a9781)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:43.644210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:43.700770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b23db6eeaf4d1780712896e92a9781', 'request_id': 'req-3510a46b-56f6-41de-be0a-e6909c484e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.708024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b23db6eeaf4d1780712896e92a9781', 'request_id': 'req-3510a46b-56f6-41de-be0a-e6909c484e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.714061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b23db6eeaf4d1780712896e92a9781', 'request_id': 'req-3510a46b-56f6-41de-be0a-e6909c484e91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.729399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] The token cache is being invalidate because project 96b23db6eeaf4d1780712896e92a9781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:24:43.729569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.730172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3510a46b-56f6-41de-be0a-e6909c484e91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:43.734336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4077/8105] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:24:43 2022] DELETE /identity/v3/projects/96b23db6eeaf4d1780712896e92a9781 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:43.740399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.740688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.740965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.775728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:43.776944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:43.842509 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4029/8106] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:24:43.850514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.851048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.851566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.876024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:43.877992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:43.886812 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4078/8107] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:43.891428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:43.901944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bda7a9-3ded-4537-bd1d-a246ee3c33e0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:43.906767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:43.907385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.907664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.907934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.908616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:24:43.908994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:43.910828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:43.924096 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4030/8108] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:24:43.928690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:43.938331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63318e-fa38-4234-b459-1bdd1cc190c0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:43.943409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:43.944053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:43.944301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:43.944563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:43.945221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:43.947212 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:43.975527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4079/8109] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:24:43 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:24:43.979778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:43.990798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131609e-a2e2-4b8c-a3a1-ddf188adc565 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:44.051731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:44.052406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:44.052729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:44.052932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:44.053633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:44.055721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:44.078569 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4031/8110] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:24:43 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:24:44.082973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:44.093635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082165dc-be62-4927-b2d7-3adede3c4d22 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:44.099019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:44.099712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:44.099994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:44.100261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:44.100910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:44.102575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:44.113925 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4080/8111] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:24:44.118202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:44.129550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591671ce-be54-4722-8d06-7cbb8dd12be9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:44.134525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c54a58a-2a1e-46df-b311-5805da63eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:44.135142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a58a-2a1e-46df-b311-5805da63eab9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:44.135416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a58a-2a1e-46df-b311-5805da63eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:44.135689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c54a58a-2a1e-46df-b311-5805da63eab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:44.136339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54a58a-2a1e-46df-b311-5805da63eab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:44.137968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c54a58a-2a1e-46df-b311-5805da63eab9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:44.149849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4032/8112] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:24:44.153964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:44.164705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6c9b-cd10-44a3-9de2-d03c33b719fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:44.169740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:44.170461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:44.170746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:44.171044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] PATH_INFO: `/v3/projects/f9d24a0b33244f7aa8dbf63c4f7249d6/users/e73546df7ccd48d087ab9a5079663a6e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:44.186894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d24a0b33244f7aa8dbf63c4f7249d6, user_id=e73546df7ccd48d087ab9a5079663a6e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:44.189557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:44.206936 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4081/8113] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:24:44 2022] PUT /identity/v3/projects/f9d24a0b33244f7aa8dbf63c4f7249d6/users/e73546df7ccd48d087ab9a5079663a6e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:44.217275 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:44.217673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:44.218004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:44.247977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] MFA Rules not processed for user `e73546df7ccd48d087ab9a5079663a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:44.249211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:44.284193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:44.325222 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4033/8114] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:44.336692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:44.338473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:44.362383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:44.406740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a995-b921-4c43-b21c-d4d16ff32a6e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:44.411213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:44.412021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:44.412302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:44.412576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:44.422292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:44.423744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:44.433778 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4082/8115] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:45.697430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:45.698960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:45.813404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcacc7-3588-4f51-8ae5-d30046065f8b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:45.821102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:45.821841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:45.822600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:45.822948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:45.824772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:45.846602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:45.848521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83610047-6c48-4bf1-b072-63763003cca8 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:45.863882 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4034/8116] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:51.327336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:51.328914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:51.398214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c18e6a-a3ca-4353-adee-ea500cf7ce4b service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:51.402904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:51.403533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:51.403806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:51.404073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] PATH_INFO: `/v3/users/c80163670b554c0398b7d752a9fc05fb` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:51.405205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80163670b554c0398b7d752a9fc05fb)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:51.407145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:51.465159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80163670b554c0398b7d752a9fc05fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:51.476928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80163670b554c0398b7d752a9fc05fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:51.478031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80163670b554c0398b7d752a9fc05fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:51.490110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80163670b554c0398b7d752a9fc05fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:51.491098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80163670b554c0398b7d752a9fc05fb'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:51.516576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4083/8117] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:24:51 2022] DELETE /identity/v3/users/c80163670b554c0398b7d752a9fc05fb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:51.521142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:51.521651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:51.521651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:51.558141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:51.559888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:51.625126 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4035/8118] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:51.635797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:51.637369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:51.689456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:51.707134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7b45e8-cc4e-4c2d-8c75-61bf2af715c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:51.711990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381f24e-d5dc-4b56-b727-d32500050481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:51.712730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f24e-d5dc-4b56-b727-d32500050481 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:51.713104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f24e-d5dc-4b56-b727-d32500050481 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:51.713475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f24e-d5dc-4b56-b727-d32500050481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:51.724425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f24e-d5dc-4b56-b727-d32500050481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:51.726264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381f24e-d5dc-4b56-b727-d32500050481 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:51.736924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4084/8119] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:51.931135 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:51.933035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:51.952530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bb663-6e1f-4f1c-a59d-4dc63f1200a1 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:51.958319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:51.959231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:51.959604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:51.960242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] PATH_INFO: `/v3/projects/a3d76d510f90412b8f2f2b8f8bec7b83` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:51.961724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d76d510f90412b8f2f2b8f8bec7b83)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:51.975584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.028015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:52.029662 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'request_id': 'req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:52.037683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'request_id': 'req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:52.043858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d76d510f90412b8f2f2b8f8bec7b83', 'request_id': 'req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:52.059225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] The token cache is being invalidate because project a3d76d510f90412b8f2f2b8f8bec7b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:24:52.059513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:52.060160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-30e8874a-a2a0-4cc1-ba3f-b62302979d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:52.061994 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4036/8120] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:24:51 2022] DELETE /identity/v3/projects/a3d76d510f90412b8f2f2b8f8bec7b83 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:52.067879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.068219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.068567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.111431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:52.112830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:52.180906 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4085/8121] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:24:52.188818 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.189071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.189366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.215723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:52.217239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:52.226949 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4037/8122] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:52.231417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.242881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c2065-8548-46ef-bc35-56698bfff47b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.248140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.248777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.249054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.249321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.250013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:24:52.250320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.251939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.269150 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4086/8123] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:24:52.270649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.280383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae67af-83c1-456e-b84b-90f33f10fafa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.285226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.285883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.286166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.286437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.287096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.289024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.319893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4038/8124] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:24:52 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:24:52.324388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.335542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998828e2-bd80-41d5-9855-27c584d0e5b8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.400183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.400718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.400991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.401252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.401944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.403847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.427294 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4087/8125] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:24:52 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:24:52.431586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.443379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263f711-ce56-4cc6-9a88-efc173d78635 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.448609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.449308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.449589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.449891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.450539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.452153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.463278 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4039/8126] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:24:52.468057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.478602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e3abe-064d-45b8-ae2a-bc040dff1c9b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.483323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d61041-93f0-4c08-991b-f082a9436815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.484070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d61041-93f0-4c08-991b-f082a9436815 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.484335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d61041-93f0-4c08-991b-f082a9436815 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.484605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d61041-93f0-4c08-991b-f082a9436815 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.485246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d61041-93f0-4c08-991b-f082a9436815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.486955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d61041-93f0-4c08-991b-f082a9436815 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.498625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4088/8127] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:24:52.503107 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.513394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c62544-d60a-4df3-aaf4-682b460d67ee admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.518420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.519079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.519359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.519631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] PATH_INFO: `/v3/projects/0f7e88983e954403b8c6dfdcfb98147d/users/7cd6cad9388641798a71e58075c11e4f/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.535050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7e88983e954403b8c6dfdcfb98147d, user_id=7cd6cad9388641798a71e58075c11e4f, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.537727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.554440 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4040/8128] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:24:52 2022] PUT /identity/v3/projects/0f7e88983e954403b8c6dfdcfb98147d/users/7cd6cad9388641798a71e58075c11e4f/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:52.566110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.566500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.566784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.596243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] MFA Rules not processed for user `7cd6cad9388641798a71e58075c11e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:52.597625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:52.623244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:52.669589 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4089/8129] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:52.684512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:52.686569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:52.759749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d324214-47ce-4e79-b1ca-c3f75023d19a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:52.764106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ab6ae-b1a4-40c6-8198-f598c9f9dd3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:52.764731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab6ae-b1a4-40c6-8198-f598c9f9dd3d service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:52.765008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab6ae-b1a4-40c6-8198-f598c9f9dd3d service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:52.765279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ab6ae-b1a4-40c6-8198-f598c9f9dd3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:52.774905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ab6ae-b1a4-40c6-8198-f598c9f9dd3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:52.776335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ab6ae-b1a4-40c6-8198-f598c9f9dd3d service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:52.785963 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4041/8130] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:55.328995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:55.330500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:55.420156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6d3a8-795a-41ee-9b2f-b5ad7ccb7aa3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:55.426250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:55.434462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:55.434753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:55.435032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] PATH_INFO: `/v3/users/e73546df7ccd48d087ab9a5079663a6e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:55.436323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e73546df7ccd48d087ab9a5079663a6e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:55.438514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:55.497692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e73546df7ccd48d087ab9a5079663a6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:55.506821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e73546df7ccd48d087ab9a5079663a6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:55.507558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e73546df7ccd48d087ab9a5079663a6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:55.515655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e73546df7ccd48d087ab9a5079663a6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:55.516471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e73546df7ccd48d087ab9a5079663a6e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:55.535253 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4090/8131] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:24:55 2022] DELETE /identity/v3/users/e73546df7ccd48d087ab9a5079663a6e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:55.539978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:55.540500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:55.540600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:55.564695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:55.565982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:55.633839 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4042/8132] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:55.641938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:55.643625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:55.693424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:55.710723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b02638-eb3c-42e2-a582-9b19530aa9e8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:55.714744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540c92-2889-4cef-9a6c-64e3554bd881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:55.715361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540c92-2889-4cef-9a6c-64e3554bd881 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:55.715761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540c92-2889-4cef-9a6c-64e3554bd881 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:55.716036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540c92-2889-4cef-9a6c-64e3554bd881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:55.726142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15540c92-2889-4cef-9a6c-64e3554bd881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:55.727628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15540c92-2889-4cef-9a6c-64e3554bd881 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:55.737907 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4091/8133] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:24:55.922846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:55.924495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:55.941542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05a9d-f1af-4d85-87d5-e33d1bb6ec4b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:55.949733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:55.950606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:55.951046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:55.951236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] PATH_INFO: `/v3/projects/f9d24a0b33244f7aa8dbf63c4f7249d6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:55.952796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d24a0b33244f7aa8dbf63c4f7249d6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:55.955443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:55.957565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:56.026041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d24a0b33244f7aa8dbf63c4f7249d6', 'request_id': 'req-075aac69-3539-4e71-b6df-ae7635e65421'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:56.033194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d24a0b33244f7aa8dbf63c4f7249d6', 'request_id': 'req-075aac69-3539-4e71-b6df-ae7635e65421'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:56.039404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d24a0b33244f7aa8dbf63c4f7249d6', 'request_id': 'req-075aac69-3539-4e71-b6df-ae7635e65421'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:56.055699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] The token cache is being invalidate because project f9d24a0b33244f7aa8dbf63c4f7249d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:24:56.056136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:56.056913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075aac69-3539-4e71-b6df-ae7635e65421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:24:56.058743 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4043/8134] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:24:55 2022] DELETE /identity/v3/projects/f9d24a0b33244f7aa8dbf63c4f7249d6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:56.063763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.064121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.064812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.089589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:56.091994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:56.153538 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4092/8135] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:56.161494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.161889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.162216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.186675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:56.188161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:56.196352 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4044/8136] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:56.200607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.210703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee8243-e6d8-40ec-8ca6-e7b580123fc6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.215893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.216508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.216788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.217065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.217715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:24:56.218044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.221411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.233123 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4093/8137] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:24:56.237309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.247763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3691762b-9514-4c90-b582-b9cd0258270d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.252592 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.253280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.253572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.253914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.254549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.256483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.285214 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4045/8138] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:24:56 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:24:56.291968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.309592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5bbe0-8d71-4d30-abdf-55e8eb1ef6d2 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.376458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.377136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.377784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.378092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.378775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.380695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.404203 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4094/8139] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:24:56 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:24:56.408279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.420441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5e720-881d-434b-a4ae-34f3126789ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.425613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.426346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.426627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.426944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.427590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.429238 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.440397 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4046/8140] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:24:56.444279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.456392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d233-6567-4148-aeaa-11691c7858f9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.467718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa252d6d-5230-488f-9efb-9f8d1cc3e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.467718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252d6d-5230-488f-9efb-9f8d1cc3e6ee admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.467718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252d6d-5230-488f-9efb-9f8d1cc3e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.467718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa252d6d-5230-488f-9efb-9f8d1cc3e6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.470120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252d6d-5230-488f-9efb-9f8d1cc3e6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.470120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa252d6d-5230-488f-9efb-9f8d1cc3e6ee admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.479998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4095/8141] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:24:56.483978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.497044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451030a-3b25-48e8-9eda-4d0ac4b49cb9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.502421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.503179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.503564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.503961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] PATH_INFO: `/v3/projects/2f7a7747fd664fafbb7635f008c05095/users/1cee14d8e7e74c7c8c960699df9c28ce/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.520026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7a7747fd664fafbb7635f008c05095, user_id=1cee14d8e7e74c7c8c960699df9c28ce, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.522813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.537314 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4047/8142] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:24:56 2022] PUT /identity/v3/projects/2f7a7747fd664fafbb7635f008c05095/users/1cee14d8e7e74c7c8c960699df9c28ce/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:24:56.548067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.548368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.548629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.582776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] MFA Rules not processed for user `1cee14d8e7e74c7c8c960699df9c28ce`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:24:56.584153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:56.636427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:24:56.664791 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4096/8143] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:24:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:24:56.676577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:24:56.678809 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:24:56.758982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00380e85-d5a0-4f7b-b0f2-34fbf580385f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:24:56.762939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78afb537-b551-4c5e-bcea-ec1f238ec8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:24:56.763639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb537-b551-4c5e-bcea-ec1f238ec8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:24:56.763985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb537-b551-4c5e-bcea-ec1f238ec8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:24:56.764344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78afb537-b551-4c5e-bcea-ec1f238ec8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:24:56.774648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afb537-b551-4c5e-bcea-ec1f238ec8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:24:56.776907 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78afb537-b551-4c5e-bcea-ec1f238ec8e2 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:24:56.786844 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4048/8144] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:24:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:25:04.701641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:04.774491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc2413-6804-4e6b-8b8f-eea9854bd12b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:04.779464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:04.780124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:04.780404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:04.780673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] PATH_INFO: `/v3/users/1cee14d8e7e74c7c8c960699df9c28ce` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:04.781980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cee14d8e7e74c7c8c960699df9c28ce)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:04.784347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:04.838036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cee14d8e7e74c7c8c960699df9c28ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:04.847992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cee14d8e7e74c7c8c960699df9c28ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:04.848785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cee14d8e7e74c7c8c960699df9c28ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:04.857602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cee14d8e7e74c7c8c960699df9c28ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:04.858446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cee14d8e7e74c7c8c960699df9c28ce'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:04.879998 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4097/8145] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:25:04 2022] DELETE /identity/v3/users/1cee14d8e7e74c7c8c960699df9c28ce => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:04.884585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:04.885130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:04.885130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:04.905528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:04.906799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:04.932922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:04.972241 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4049/8146] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:04.982281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:04.983710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:05.046542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848bec3-eee1-46fb-bca4-b737e165a5ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.050287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da733eb-cec4-4e6b-aba7-63119858bae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.050909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da733eb-cec4-4e6b-aba7-63119858bae2 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.051184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da733eb-cec4-4e6b-aba7-63119858bae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.051452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da733eb-cec4-4e6b-aba7-63119858bae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.061221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da733eb-cec4-4e6b-aba7-63119858bae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.062688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da733eb-cec4-4e6b-aba7-63119858bae2 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.072978 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4098/8147] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:25:05.243991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.246035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:05.260064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d8e7d-1a4d-4047-b9bf-e7d5f150290b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.266249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.266981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.267316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.267610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] PATH_INFO: `/v3/projects/2f7a7747fd664fafbb7635f008c05095` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.268992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7a7747fd664fafbb7635f008c05095)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.271032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.324695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7a7747fd664fafbb7635f008c05095', 'request_id': 'req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:05.331815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7a7747fd664fafbb7635f008c05095', 'request_id': 'req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:05.338382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7a7747fd664fafbb7635f008c05095', 'request_id': 'req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:05.352776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] The token cache is being invalidate because project 2f7a7747fd664fafbb7635f008c05095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:25:05.353069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:05.353704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01be0fd5-a7fe-4b83-819c-0cfa9245dcdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:05.355297 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4050/8148] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:25:05 2022] DELETE /identity/v3/projects/2f7a7747fd664fafbb7635f008c05095 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:05.360325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.360610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.360882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.369968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:05.382803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:05.384722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:05.451244 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4099/8149] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:05.459007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.459366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.459706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.481131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:05.482458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:05.492429 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4051/8150] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:05.496785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.507937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85118eba-cff7-483c-984d-02999e5a3821 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.513209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.513904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.514127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.514403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.515066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:25:05.515369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.517006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.529956 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4100/8151] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:25:05.534828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.544974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f246f-09b0-4192-a868-c29ca48f1868 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.549955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.550610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.550888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.551158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.551822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.553770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.587705 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4052/8152] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:25:05 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:25:05.592317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.603945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042b6a4-a5e6-49e2-968b-d7baf07dc57c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.660868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.661475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.661749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.662072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.662662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.664560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.687085 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4101/8153] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:25:05 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:25:05.691653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.702529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f505a-7665-41d2-81c4-fa33932d4eab admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.710046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.710667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.710964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.711233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.711871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.713494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.724604 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4053/8154] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:25:05.728645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.739436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a54202-e23b-4df2-a60f-552131fe8795 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.744619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce37b7-79ac-40fb-af0c-7cab6785d958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.745305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce37b7-79ac-40fb-af0c-7cab6785d958 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.745646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce37b7-79ac-40fb-af0c-7cab6785d958 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.746037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce37b7-79ac-40fb-af0c-7cab6785d958 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.746741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce37b7-79ac-40fb-af0c-7cab6785d958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.748392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce37b7-79ac-40fb-af0c-7cab6785d958 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.759924 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4102/8155] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:25:05.764320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.774927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26642495-ee57-4d85-a5b6-08a3c4db38e1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:05.779876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:05.780537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.780816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.781088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] PATH_INFO: `/v3/projects/078a1a3654a4439794614d05e88399ff/users/08a1f954f5d641ef95bb734a41f69505/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.796887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078a1a3654a4439794614d05e88399ff, user_id=08a1f954f5d641ef95bb734a41f69505, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:05.799700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:05.813695 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4054/8156] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:25:05 2022] PUT /identity/v3/projects/078a1a3654a4439794614d05e88399ff/users/08a1f954f5d641ef95bb734a41f69505/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:05.824912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:05.825214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:05.825543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:05.855160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] MFA Rules not processed for user `08a1f954f5d641ef95bb734a41f69505`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:05.856376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:05.918083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:05.922587 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4103/8157] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:05.934671 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:05.936596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:06.000618 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:06.007873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3367990-76c3-41fa-bbe9-7924c14b1349 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:06.012376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c065-1360-4716-b850-5f552edcb14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:06.013006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c065-1360-4716-b850-5f552edcb14b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:06.013775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c065-1360-4716-b850-5f552edcb14b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:06.014086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c065-1360-4716-b850-5f552edcb14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:06.023446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15c065-1360-4716-b850-5f552edcb14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:06.024908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15c065-1360-4716-b850-5f552edcb14b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:06.034413 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4055/8158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:25:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:25:16.029860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:28.745909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:28.747527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:28.830583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4cc9f-328e-47d5-9266-0ea473148ac2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:28.835639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:28.836324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:28.836611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:28.836879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] PATH_INFO: `/v3/users/7cd6cad9388641798a71e58075c11e4f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:28.838155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cd6cad9388641798a71e58075c11e4f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:28.840505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:28.903165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cd6cad9388641798a71e58075c11e4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:28.912882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cd6cad9388641798a71e58075c11e4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:28.913600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cd6cad9388641798a71e58075c11e4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:28.921407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cd6cad9388641798a71e58075c11e4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:28.922107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cd6cad9388641798a71e58075c11e4f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:28.940677 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4104/8159] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:25:28 2022] DELETE /identity/v3/users/7cd6cad9388641798a71e58075c11e4f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:28.945282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:28.945778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:28.945895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:28.966261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:28.970280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:29.062488 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4056/8160] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:29.069962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:29.071622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:29.147761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3cb81-bfbb-488d-a2ec-1cc28ee23d89 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:29.152563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374025d-bd4e-4314-be20-64c1916b4bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:29.153422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374025d-bd4e-4314-be20-64c1916b4bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:29.153872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374025d-bd4e-4314-be20-64c1916b4bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:29.154930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374025d-bd4e-4314-be20-64c1916b4bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:29.167192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374025d-bd4e-4314-be20-64c1916b4bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:29.169532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374025d-bd4e-4314-be20-64c1916b4bc1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:29.182963 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4105/8161] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:25:29.618988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:29.621084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:29.636216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0622e-202d-48be-96c9-b706c4552d31 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:29.641556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:29.642557 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:29.642760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:29.643046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] PATH_INFO: `/v3/projects/0f7e88983e954403b8c6dfdcfb98147d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:29.644208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7e88983e954403b8c6dfdcfb98147d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:29.646170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:29.708407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7e88983e954403b8c6dfdcfb98147d', 'request_id': 'req-149a89ff-cf40-4742-b84e-628e2e15e44d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:29.715035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7e88983e954403b8c6dfdcfb98147d', 'request_id': 'req-149a89ff-cf40-4742-b84e-628e2e15e44d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:29.721343 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7e88983e954403b8c6dfdcfb98147d', 'request_id': 'req-149a89ff-cf40-4742-b84e-628e2e15e44d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:29.736880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] The token cache is being invalidate because project 0f7e88983e954403b8c6dfdcfb98147d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:25:29.737168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:29.738277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-149a89ff-cf40-4742-b84e-628e2e15e44d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:29.740026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4057/8162] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:25:29 2022] DELETE /identity/v3/projects/0f7e88983e954403b8c6dfdcfb98147d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:29.744992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:29.745283 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:29.745568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:29.766235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:29.767842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:29.789104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:29.848801 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4106/8163] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:29.858179 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:29.858371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:29.858616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:29.883486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:29.884890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:29.893667 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4058/8164] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:29.898502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:29.910166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96dfc0-1cc9-4ddd-b979-551afa47fb8f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:29.914988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:29.915562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:29.915849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:29.916110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:29.916788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:25:29.917125 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:29.918710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:29.936315 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:29.945263 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4107/8165] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:25:29.947820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd64f-8bcd-4fbd-8f3f-c497c47e9f05 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:29.953570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:29.954360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:29.954744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:29.955263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:29.956168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:29.958615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:30.004900 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4059/8166] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:25:29 2022] POST /identity/v3/projects => generated 363 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:25:30.009263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:30.019490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99002a-0bbd-4655-a193-0a12afb0e3fe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:30.093691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:30.094389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:30.094668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:30.094944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:30.095642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:30.097595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:30.129745 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4108/8167] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:25:30 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:25:30.134834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:30.146408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda91dd1-d434-434d-942d-c003e21dc3d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:30.151213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:30.151842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:30.152130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:30.152404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:30.153050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:30.154892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:30.167650 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4060/8168] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:25:30.171699 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:30.181907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127e217-8ccf-4113-94f2-cebf939b0c03 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:30.186579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d3f86-f0fa-406f-8687-6ef54236852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:30.187224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d3f86-f0fa-406f-8687-6ef54236852d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:30.187515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d3f86-f0fa-406f-8687-6ef54236852d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:30.187781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d3f86-f0fa-406f-8687-6ef54236852d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:30.188504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d3f86-f0fa-406f-8687-6ef54236852d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:30.190181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d3f86-f0fa-406f-8687-6ef54236852d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:30.202118 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4109/8169] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:25:30.207132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:30.217356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd97362-5945-42b1-9316-9870084cc764 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:30.222642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:30.223307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:30.223588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:30.223862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] PATH_INFO: `/v3/projects/b1bed401b9034a1db63d2c55688b4f9c/users/5af73face5ca42228a6af51d930d8cec/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:30.239713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1bed401b9034a1db63d2c55688b4f9c, user_id=5af73face5ca42228a6af51d930d8cec, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:30.242730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:30.257765 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4061/8170] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:25:30 2022] PUT /identity/v3/projects/b1bed401b9034a1db63d2c55688b4f9c/users/5af73face5ca42228a6af51d930d8cec/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:30.269877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:30.270621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:30.271005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:30.301404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] MFA Rules not processed for user `5af73face5ca42228a6af51d930d8cec`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:30.303580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:30.370272 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4110/8171] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:25:30.381698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:30.383426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:30.406520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:30.470445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e0e97-ec6c-4953-a53d-612f5a260f62 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:30.475311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f023-ddd3-40f7-a6aa-f66cf9599edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:30.476018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f023-ddd3-40f7-a6aa-f66cf9599edc service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:30.476299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f023-ddd3-40f7-a6aa-f66cf9599edc service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:30.476573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f023-ddd3-40f7-a6aa-f66cf9599edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:30.485623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f023-ddd3-40f7-a6aa-f66cf9599edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:30.487247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f023-ddd3-40f7-a6aa-f66cf9599edc service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:30.498227 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4062/8172] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:25:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:25:40.367398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:40.493240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=21 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:51.486111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:51.487574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:51.566406 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539a5c9-bf4d-496e-9ae5-f37ed0871670 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:51.571073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:51.571761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:51.572037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:51.572303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] PATH_INFO: `/v3/users/08a1f954f5d641ef95bb734a41f69505` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:51.573433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a1f954f5d641ef95bb734a41f69505)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:51.575426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:51.625178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a1f954f5d641ef95bb734a41f69505'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:51.634288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a1f954f5d641ef95bb734a41f69505'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:51.635016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a1f954f5d641ef95bb734a41f69505'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:51.642589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a1f954f5d641ef95bb734a41f69505'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:51.643335 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a1f954f5d641ef95bb734a41f69505'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:51.668111 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4111/8173] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:25:51 2022] DELETE /identity/v3/users/08a1f954f5d641ef95bb734a41f69505 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:51.670080 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:51.670600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:51.670600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:51.692155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:51.693489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:51.761034 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4063/8174] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:51.771138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:51.772728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:51.834790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96bc72-1f9e-42ec-adfd-303b02da19f6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:51.838451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aba405-e256-4f35-b37e-2920bbc6177c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:51.839061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba405-e256-4f35-b37e-2920bbc6177c service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:51.839334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba405-e256-4f35-b37e-2920bbc6177c service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:51.839602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aba405-e256-4f35-b37e-2920bbc6177c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:51.849266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba405-e256-4f35-b37e-2920bbc6177c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:51.850770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aba405-e256-4f35-b37e-2920bbc6177c service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:51.860953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4112/8175] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:25:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:25:52.038833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.040336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:52.055520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f419317-8ede-4519-8e34-91afd2e6dfde None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.060418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.061029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.061763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.061763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] PATH_INFO: `/v3/projects/078a1a3654a4439794614d05e88399ff` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.062714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=078a1a3654a4439794614d05e88399ff)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.064808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.122137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078a1a3654a4439794614d05e88399ff', 'request_id': 'req-2d257493-b6bc-4a6b-b51b-810356b8ab7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:52.128601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078a1a3654a4439794614d05e88399ff', 'request_id': 'req-2d257493-b6bc-4a6b-b51b-810356b8ab7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:52.134122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078a1a3654a4439794614d05e88399ff', 'request_id': 'req-2d257493-b6bc-4a6b-b51b-810356b8ab7c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:52.150520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] The token cache is being invalidate because project 078a1a3654a4439794614d05e88399ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:25:52.150814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:52.151522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-2d257493-b6bc-4a6b-b51b-810356b8ab7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:25:52.153284 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4064/8176] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:25:52 2022] DELETE /identity/v3/projects/078a1a3654a4439794614d05e88399ff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:25:52.160514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.160805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.161104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.188293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:52.189615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:52.208535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:52.255583 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4113/8177] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:52.262861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663f18-743f-429d-a4db-1110659626ce None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.263143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663f18-743f-429d-a4db-1110659626ce None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.263414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663f18-743f-429d-a4db-1110659626ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.283638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-39663f18-743f-429d-a4db-1110659626ce None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:52.284760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-39663f18-743f-429d-a4db-1110659626ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:52.292745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4065/8178] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:25:52.297303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.307573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1541468b-f2ef-4012-bb11-1042a49aba8d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.312629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.313247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.313511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.314011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.314703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:25:52.314983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.316744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.329714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4114/8179] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:25:52.334398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663f18-743f-429d-a4db-1110659626ce None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.344825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663f18-743f-429d-a4db-1110659626ce None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.350854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.351665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.351921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.352209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.352849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.354782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.396421 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4066/8180] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:25:52 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:25:52.401274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.411417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe4bdc-510b-46b7-ae7b-b9e711241af9 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.467913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.468532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.468807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.469110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.469736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.471852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.494878 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4115/8181] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:25:52 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:25:52.499301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.510541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff917d-10c1-478b-b353-43576203db64 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.515946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.516569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.516925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.517346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.518223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.519782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.530443 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4067/8182] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:25:52.534753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.552717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5abff4-6800-4655-9306-b13ace6bd920 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.558943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe1c60-b3ab-4d87-bd04-6d8686a21071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.559172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe1c60-b3ab-4d87-bd04-6d8686a21071 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.559453 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe1c60-b3ab-4d87-bd04-6d8686a21071 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.559740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe1c60-b3ab-4d87-bd04-6d8686a21071 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.560381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe1c60-b3ab-4d87-bd04-6d8686a21071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.562061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe1c60-b3ab-4d87-bd04-6d8686a21071 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.574935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4116/8183] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:25:52.579344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.590702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699bfd0e-b5ca-463a-beb7-c7a4ecd8e694 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.595925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.596627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.596910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.597187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] PATH_INFO: `/v3/projects/11c54264f50b4a7aa62c642ca38f1be6/users/0569d1668ebf4767b9182b963ef18a22/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.612103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c54264f50b4a7aa62c642ca38f1be6, user_id=0569d1668ebf4767b9182b963ef18a22, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.614733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.628670 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4068/8184] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:25:52 2022] PUT /identity/v3/projects/11c54264f50b4a7aa62c642ca38f1be6/users/0569d1668ebf4767b9182b963ef18a22/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:25:52.639876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.640159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.640561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.669595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] MFA Rules not processed for user `0569d1668ebf4767b9182b963ef18a22`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:25:52.670875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:52.737852 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4117/8185] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:25:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:25:52.748797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:25:52.750823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:25:52.765640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:25:52.816635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb609180-3059-4d29-b147-56876db72b32 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:25:52.820277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76dbd-5ae7-4234-ab6c-0f015f2187be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:25:52.820895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76dbd-5ae7-4234-ab6c-0f015f2187be service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:25:52.821173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76dbd-5ae7-4234-ab6c-0f015f2187be service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:25:52.821473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76dbd-5ae7-4234-ab6c-0f015f2187be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:25:52.830207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76dbd-5ae7-4234-ab6c-0f015f2187be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:25:52.831649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76dbd-5ae7-4234-ab6c-0f015f2187be service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:25:52.840890 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4069/8186] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:25:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:00.546285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:00.567654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:00.614445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbabca6-0ab2-45b2-9529-5f3861556763 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:00.619483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:00.620138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:00.620481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:00.620761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] PATH_INFO: `/v3/users/0569d1668ebf4767b9182b963ef18a22` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:00.621909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0569d1668ebf4767b9182b963ef18a22)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:00.623876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:00.673522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0569d1668ebf4767b9182b963ef18a22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:00.684577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0569d1668ebf4767b9182b963ef18a22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:00.685250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0569d1668ebf4767b9182b963ef18a22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:00.693474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0569d1668ebf4767b9182b963ef18a22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:00.694179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0569d1668ebf4767b9182b963ef18a22'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:00.712168 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4118/8187] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:00 2022] DELETE /identity/v3/users/0569d1668ebf4767b9182b963ef18a22 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:00.716935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:00.717422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:00.717544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:00.737187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:00.738453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:00.805959 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4070/8188] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:00.816238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:00.817592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:00.881214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef9abb-2129-42db-973f-2c73b20f8a86 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:00.885299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb57e38-bd94-4a59-b2f6-d7daa07091fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:00.886148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57e38-bd94-4a59-b2f6-d7daa07091fb service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:00.886441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57e38-bd94-4a59-b2f6-d7daa07091fb service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:00.886716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb57e38-bd94-4a59-b2f6-d7daa07091fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:00.897094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb57e38-bd94-4a59-b2f6-d7daa07091fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:00.898558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb57e38-bd94-4a59-b2f6-d7daa07091fb service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:00.910286 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4119/8189] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:01.096075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.097905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:01.110808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6e979-ba09-4ce8-9fba-f37811e0edaf None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.116646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.118092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.118441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.118716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] PATH_INFO: `/v3/projects/11c54264f50b4a7aa62c642ca38f1be6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.120159 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c54264f50b4a7aa62c642ca38f1be6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.122366 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.175851 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c54264f50b4a7aa62c642ca38f1be6', 'request_id': 'req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:01.182472 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c54264f50b4a7aa62c642ca38f1be6', 'request_id': 'req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:01.187917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c54264f50b4a7aa62c642ca38f1be6', 'request_id': 'req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:01.203798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] The token cache is being invalidate because project 11c54264f50b4a7aa62c642ca38f1be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:01.204124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:01.204777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-427cf8ba-cc29-4959-82cb-4b5e33c2c7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:01.206358 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4071/8190] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:01 2022] DELETE /identity/v3/projects/11c54264f50b4a7aa62c642ca38f1be6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:01.211537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.211825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.212112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.233358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:01.234624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:01.268916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:01.301311 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4120/8191] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:01.308906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.309186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.309459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.330066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:01.331317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:01.339213 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4072/8192] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:01.343725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.353771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bead9-5982-4497-9fe0-f674ce242160 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.358384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.359000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.359272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.359538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.360179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:26:01.360508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.362129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.374600 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4121/8193] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 03:26:01.379301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.388758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b84854-4d3d-4e1b-b89b-84b8f5c18a3f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.393962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.394751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.395049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.395331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.395986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.397977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.428345 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4073/8194] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:26:01.432626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.443830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd6219-3333-4aa6-b822-5eccfde2ee0f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.508228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.508981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.509552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.514126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.514820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.516862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.544000 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4122/8195] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:01.546119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.557604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf20096-2f93-4a5d-b3a0-b155f36f61ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.562814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.563506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.564015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.564335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.565056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.566797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.569153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:01.580435 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4074/8196] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:01.584486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.595174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317a51b-44df-48c1-9af4-c6273b764470 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.600578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5cd8e-9afe-4e54-8f37-35a9ad3bef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.601269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cd8e-9afe-4e54-8f37-35a9ad3bef67 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.601548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cd8e-9afe-4e54-8f37-35a9ad3bef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.601840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5cd8e-9afe-4e54-8f37-35a9ad3bef67 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.602501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5cd8e-9afe-4e54-8f37-35a9ad3bef67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.604121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5cd8e-9afe-4e54-8f37-35a9ad3bef67 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.617848 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4123/8197] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:01.619568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.631268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5a5b8-5b87-4a76-887f-918d131a87f1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.636197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.636862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.637148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.637429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] PATH_INFO: `/v3/projects/adcd9fd57b8a4429a3013c649c64b6e0/users/d19ae2088fe54322bbd1f9e3228f62be/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.654223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adcd9fd57b8a4429a3013c649c64b6e0, user_id=d19ae2088fe54322bbd1f9e3228f62be, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.656911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.671165 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4075/8198] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:01 2022] PUT /identity/v3/projects/adcd9fd57b8a4429a3013c649c64b6e0/users/d19ae2088fe54322bbd1f9e3228f62be/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:26:01.682904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.683247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.683436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.714297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] MFA Rules not processed for user `d19ae2088fe54322bbd1f9e3228f62be`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:01.715531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:01.783547 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4124/8199] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:26:01.788082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.853352 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c8238-a4f8-47f2-aed4-db6bd597dea8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.858579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.859194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.859471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.859742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.860395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.862361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.890686 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4076/8200] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:01.894809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:01.906007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c0cf3-bc77-415d-bb7b-9bd9334ef72f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:01.942396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:01.968826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:01.969458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:01.969900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:01.970272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:01.970917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:01.972875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:01.996149 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4125/8201] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:01 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:02.000193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.011612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3338186-2fb9-49e8-bc13-b617389fad4f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.016311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.016970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.017249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.017518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.018192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.019792 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.034038 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4077/8202] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:02.035185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.045694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c9f88-7e02-43a5-b577-f9163b3bcb4c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.050500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.051174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.051452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.051728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] PATH_INFO: `/v3/projects/63582a9ff8c44b9fb009890ea647a167/users/750c96e5816d4125931c6501e3142107/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.068142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63582a9ff8c44b9fb009890ea647a167, user_id=750c96e5816d4125931c6501e3142107, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.070953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.087484 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4126/8203] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:02 2022] PUT /identity/v3/projects/63582a9ff8c44b9fb009890ea647a167/users/750c96e5816d4125931c6501e3142107/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:26:02.089587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.099986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb381ca-565f-45a4-bc4e-c2f5a07d731f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.173687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e12d3-8732-478a-b378-ac109b11588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.175669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e12d3-8732-478a-b378-ac109b11588c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.176039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e12d3-8732-478a-b378-ac109b11588c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.176381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e12d3-8732-478a-b378-ac109b11588c admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.177099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e12d3-8732-478a-b378-ac109b11588c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.178858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e12d3-8732-478a-b378-ac109b11588c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.192260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4078/8204] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:02.196380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.213247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775eed5-f346-405c-b9b3-3a3da94d3265 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.219594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.221605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.222705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.222705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] PATH_INFO: `/v3/projects/63582a9ff8c44b9fb009890ea647a167/users/750c96e5816d4125931c6501e3142107/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.224238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63582a9ff8c44b9fb009890ea647a167, user_id=750c96e5816d4125931c6501e3142107, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.226973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.240237 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4127/8205] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:02 2022] PUT /identity/v3/projects/63582a9ff8c44b9fb009890ea647a167/users/750c96e5816d4125931c6501e3142107/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:02.250805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.251259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.251588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.281356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] MFA Rules not processed for user `750c96e5816d4125931c6501e3142107`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:02.282701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:02.319938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:02.361475 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4079/8206] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:02.373170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.377436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:02.454334 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18d37f-5836-45dc-98aa-cb3dca755070 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.459889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6a837-4a73-4659-8ed4-ac9c14b68221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.460582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a837-4a73-4659-8ed4-ac9c14b68221 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.460936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a837-4a73-4659-8ed4-ac9c14b68221 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.461382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6a837-4a73-4659-8ed4-ac9c14b68221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.473396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a837-4a73-4659-8ed4-ac9c14b68221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.474951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6a837-4a73-4659-8ed4-ac9c14b68221 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.485420 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4128/8207] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:02.557431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.635817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de955b-e017-41ee-97c8-9da1c669523c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.640453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.641096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.641374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.641718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] PATH_INFO: `/v3/users/d19ae2088fe54322bbd1f9e3228f62be` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.644965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19ae2088fe54322bbd1f9e3228f62be)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.644965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.697360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19ae2088fe54322bbd1f9e3228f62be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:02.709977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19ae2088fe54322bbd1f9e3228f62be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:02.710654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19ae2088fe54322bbd1f9e3228f62be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:02.721154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19ae2088fe54322bbd1f9e3228f62be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:02.721884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19ae2088fe54322bbd1f9e3228f62be'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:02.737787 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4080/8208] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:02 2022] DELETE /identity/v3/users/d19ae2088fe54322bbd1f9e3228f62be => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:02.743342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.743956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.743956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.763481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:02.764952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:02.828336 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4129/8209] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:02.838456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:02.839939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:02.897210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:02.903765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940e0b6-5171-44c6-b792-887987cf3382 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:02.908694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:02.909358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:02.909817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:02.910101 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:02.919621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:02.921092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:02.931624 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4081/8210] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:03.212408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:03.214035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:03.235678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee75928-f4ef-4f3a-aab4-e474eba769ff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:03.241288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:03.242521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:03.242806 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:03.243101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] PATH_INFO: `/v3/projects/adcd9fd57b8a4429a3013c649c64b6e0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:03.244246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adcd9fd57b8a4429a3013c649c64b6e0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:03.246202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:03.282741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:03.302240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adcd9fd57b8a4429a3013c649c64b6e0', 'request_id': 'req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.308984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adcd9fd57b8a4429a3013c649c64b6e0', 'request_id': 'req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.315082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adcd9fd57b8a4429a3013c649c64b6e0', 'request_id': 'req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.329637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] The token cache is being invalidate because project adcd9fd57b8a4429a3013c649c64b6e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:03.329959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.330575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.332318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4130/8211] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:03 2022] DELETE /identity/v3/projects/adcd9fd57b8a4429a3013c649c64b6e0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:03.336141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:03.346355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4606ab0-569a-4810-8ee7-e1e3f29ff30f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:03.406111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:03.406761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:03.407042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:03.407398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] PATH_INFO: `/v3/users/750c96e5816d4125931c6501e3142107` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:03.408644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=750c96e5816d4125931c6501e3142107)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:03.410600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:03.460125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '750c96e5816d4125931c6501e3142107'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.472672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '750c96e5816d4125931c6501e3142107'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.473411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '750c96e5816d4125931c6501e3142107'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.480542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '750c96e5816d4125931c6501e3142107'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.481177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-05dd09c0-2bcf-4583-af24-7efa55ca36c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '750c96e5816d4125931c6501e3142107'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.499150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4082/8212] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:03 2022] DELETE /identity/v3/users/750c96e5816d4125931c6501e3142107 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:03.782180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:03.784020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:03.798732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e8b9b-daa8-4adb-8ebf-6d6e1fa3f2c8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:03.862801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:03.863770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:03.864044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:03.864312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] PATH_INFO: `/v3/projects/63582a9ff8c44b9fb009890ea647a167` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:03.865435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=63582a9ff8c44b9fb009890ea647a167)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:03.867740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:03.920131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63582a9ff8c44b9fb009890ea647a167', 'request_id': 'req-3659ba08-52d1-4f91-a91f-6bb50911bcab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.926590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63582a9ff8c44b9fb009890ea647a167', 'request_id': 'req-3659ba08-52d1-4f91-a91f-6bb50911bcab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.932563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63582a9ff8c44b9fb009890ea647a167', 'request_id': 'req-3659ba08-52d1-4f91-a91f-6bb50911bcab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.947220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] The token cache is being invalidate because project 63582a9ff8c44b9fb009890ea647a167 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:03.947648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.948372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3659ba08-52d1-4f91-a91f-6bb50911bcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:03.950351 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4131/8213] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:03 2022] DELETE /identity/v3/projects/63582a9ff8c44b9fb009890ea647a167 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:03.955331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:03.955842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:03.956026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:03.976784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:03.978129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:04.045433 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4083/8214] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:04.053028 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.053312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.053581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.074060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:04.075300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:04.084416 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4132/8215] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:04.088862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.099510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e1bb2-275b-4d85-ab09-558fed01235a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.104597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.105225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.105504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.105779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.106475 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:26:04.106785 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.108404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.115783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:04.128551 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4084/8216] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:26:04.129721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.139281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f91b160-c2f8-4ac4-ad26-93e9fbcd02d2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.144375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.144996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.145284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.145559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.146232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.148179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.183431 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4133/8217] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:04.187508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.198150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd08ac-2157-43ab-bc1d-899f86117d7f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.259267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.259910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.260187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.260509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.261180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.263146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.285739 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4085/8218] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:26:04.289990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.301472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d196-79ad-4eb2-9b87-d41a35018ba4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.306250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.306861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.307135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.307402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.308039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.309759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.320895 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4134/8219] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:04.324850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.335327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0eed-1dae-4fab-8441-94025a9febd1 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.342310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248a6fe-b6f8-4755-a2f0-2a1c9ef66760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.342947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a6fe-b6f8-4755-a2f0-2a1c9ef66760 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.343224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a6fe-b6f8-4755-a2f0-2a1c9ef66760 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.343513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248a6fe-b6f8-4755-a2f0-2a1c9ef66760 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.344153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a6fe-b6f8-4755-a2f0-2a1c9ef66760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.345930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248a6fe-b6f8-4755-a2f0-2a1c9ef66760 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.360592 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4086/8220] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:04.362101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.369316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:04.373435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca85fe83-9925-48d0-8ed9-b51d71f7a475 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.379778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.380719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.381020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.381423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] PATH_INFO: `/v3/projects/f14048368a0f419aac43de0fd0b8d4de/users/46288a1120264fcc9282feaeea98ef3d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.398396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14048368a0f419aac43de0fd0b8d4de, user_id=46288a1120264fcc9282feaeea98ef3d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.401046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.415318 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4135/8221] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:04 2022] PUT /identity/v3/projects/f14048368a0f419aac43de0fd0b8d4de/users/46288a1120264fcc9282feaeea98ef3d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:04.427541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.427911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.428258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.458734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] MFA Rules not processed for user `46288a1120264fcc9282feaeea98ef3d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:04.460065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:04.530558 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4087/8222] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:04.535386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.607971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e72d85-049a-4ec1-b627-a80a8f10baba admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.612725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.613389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.613670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.613986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.614630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.616581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.645638 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4136/8223] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:04.650033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.664800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99781566-c3c5-46ee-8b0f-6eca15dbb188 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.738858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.739489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.739813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.740091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.740759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.743370 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.755116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:04.770769 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4088/8224] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:26:04.771639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.782204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf70fa-8766-4d75-b088-b8e5d8c22f7f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.786904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.789250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.789250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.789250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.789250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.790422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.803471 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4137/8225] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:26:04.807701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.820412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1550-0cd4-4252-9d2d-6663a10d4e04 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.825162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.825921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.826197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.826465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] PATH_INFO: `/v3/projects/3f06a271a7704a9698d3a75c1fc36515/users/890b32d3773c4290bdc9b98ab86f1a34/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.843526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f06a271a7704a9698d3a75c1fc36515, user_id=890b32d3773c4290bdc9b98ab86f1a34, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.846858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.862081 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4089/8226] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:04 2022] PUT /identity/v3/projects/3f06a271a7704a9698d3a75c1fc36515/users/890b32d3773c4290bdc9b98ab86f1a34/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:04.866068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.877135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5e0d3-e295-4f3e-9041-d0e9c882f5fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.935843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ef40d-9b2a-4178-8258-8e07201c2b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.937043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef40d-9b2a-4178-8258-8e07201c2b07 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.937325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef40d-9b2a-4178-8258-8e07201c2b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.937601 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ef40d-9b2a-4178-8258-8e07201c2b07 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.938271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef40d-9b2a-4178-8258-8e07201c2b07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.940085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ef40d-9b2a-4178-8258-8e07201c2b07 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.953832 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4138/8227] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:04.955710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:04.966705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c33d9-d450-4066-99a9-da985b43bf4b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:04.971744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:04.972418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:04.972703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:04.972981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] PATH_INFO: `/v3/projects/3f06a271a7704a9698d3a75c1fc36515/users/890b32d3773c4290bdc9b98ab86f1a34/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:04.975267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f06a271a7704a9698d3a75c1fc36515, user_id=890b32d3773c4290bdc9b98ab86f1a34, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:04.977960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:04.990266 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4090/8228] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:04 2022] PUT /identity/v3/projects/3f06a271a7704a9698d3a75c1fc36515/users/890b32d3773c4290bdc9b98ab86f1a34/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:05.000419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:05.000702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:05.001146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:05.031510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] MFA Rules not processed for user `890b32d3773c4290bdc9b98ab86f1a34`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:05.032880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:05.076386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:05.106655 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4139/8229] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:04 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:05.118929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:05.120714 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:05.184808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d65895-fba4-4375-98b1-19a59236dfc0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:05.188690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:05.189440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:05.189720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:05.190019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:05.199819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:05.201254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:05.211757 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4091/8230] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:05.287642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:05.300282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fae7bd-7374-44e0-aea7-e40e0e1a98ac None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:05.304018 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a433b75-2c1c-4b82-a6e9-e35c0cd04493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:05.304701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a433b75-2c1c-4b82-a6e9-e35c0cd04493 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:05.305063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a433b75-2c1c-4b82-a6e9-e35c0cd04493 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:05.305413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a433b75-2c1c-4b82-a6e9-e35c0cd04493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:05.365906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a433b75-2c1c-4b82-a6e9-e35c0cd04493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:05.367620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a433b75-2c1c-4b82-a6e9-e35c0cd04493 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:05.377555 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4140/8231] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:05.669752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:05.756337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fe17-e9ee-402f-8d13-a70e9dddf4a7 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:05.761611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:05.767803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:05.767803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:05.767803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] PATH_INFO: `/v3/users/46288a1120264fcc9282feaeea98ef3d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:05.767803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=46288a1120264fcc9282feaeea98ef3d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:05.767803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:05.819385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46288a1120264fcc9282feaeea98ef3d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:05.831250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:05.832650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46288a1120264fcc9282feaeea98ef3d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:05.833461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46288a1120264fcc9282feaeea98ef3d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:05.842942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46288a1120264fcc9282feaeea98ef3d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:05.844013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46288a1120264fcc9282feaeea98ef3d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:05.858767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4092/8232] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:05 2022] DELETE /identity/v3/users/46288a1120264fcc9282feaeea98ef3d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:05.863613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:05.864148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:05.864271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:05.886637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:05.887936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:05.951951 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4141/8233] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:05.962345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:05.965065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:06.027862 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b8b79c-8fd9-4714-a51d-f4c8cd5638fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:06.034199 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:06.034842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:06.035121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:06.035387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:06.046337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:06.047873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:06.058132 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4093/8234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:06.342289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:06.344339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:06.358385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db3d29-a2ee-4499-a711-c3f2cf33020c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:06.363082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:06.363759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:06.364034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:06.364305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] PATH_INFO: `/v3/projects/f14048368a0f419aac43de0fd0b8d4de` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:06.365443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14048368a0f419aac43de0fd0b8d4de)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:06.368421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:06.421641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14048368a0f419aac43de0fd0b8d4de', 'request_id': 'req-be85e428-9e1d-424b-967b-df4ccc32b30e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.428854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14048368a0f419aac43de0fd0b8d4de', 'request_id': 'req-be85e428-9e1d-424b-967b-df4ccc32b30e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.434727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14048368a0f419aac43de0fd0b8d4de', 'request_id': 'req-be85e428-9e1d-424b-967b-df4ccc32b30e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.444711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:06.450375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] The token cache is being invalidate because project f14048368a0f419aac43de0fd0b8d4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:06.450680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.451557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.453516 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4142/8235] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:06 2022] DELETE /identity/v3/projects/f14048368a0f419aac43de0fd0b8d4de => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:26:06.457989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:06.468051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852171c-7bc7-4831-9116-f5f19f505a1e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:06.528265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:06.528940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:06.529215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:06.529487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] PATH_INFO: `/v3/users/890b32d3773c4290bdc9b98ab86f1a34` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:06.530729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] RBAC: Authorizing `identity:delete_user(user_id=890b32d3773c4290bdc9b98ab86f1a34)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:06.532808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:06.582943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890b32d3773c4290bdc9b98ab86f1a34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.595424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890b32d3773c4290bdc9b98ab86f1a34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.596145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890b32d3773c4290bdc9b98ab86f1a34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.603219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890b32d3773c4290bdc9b98ab86f1a34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.603876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-d1725a21-59c4-44d0-8435-9a28cde5f49d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890b32d3773c4290bdc9b98ab86f1a34'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:06.617767 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4094/8236] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:06 2022] DELETE /identity/v3/users/890b32d3773c4290bdc9b98ab86f1a34 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:06.906545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:06.908123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:06.931191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be85e428-9e1d-424b-967b-df4ccc32b30e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:06.992897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:06.993727 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:06.994054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:06.994327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] PATH_INFO: `/v3/projects/3f06a271a7704a9698d3a75c1fc36515` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:06.995632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f06a271a7704a9698d3a75c1fc36515)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:06.997720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.050112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f06a271a7704a9698d3a75c1fc36515', 'request_id': 'req-fe5ab1f9-3727-42f1-8386-66971b214bef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:07.056671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f06a271a7704a9698d3a75c1fc36515', 'request_id': 'req-fe5ab1f9-3727-42f1-8386-66971b214bef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:07.062904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f06a271a7704a9698d3a75c1fc36515', 'request_id': 'req-fe5ab1f9-3727-42f1-8386-66971b214bef'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:07.077859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] The token cache is being invalidate because project 3f06a271a7704a9698d3a75c1fc36515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:07.078209 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:07.078981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-fe5ab1f9-3727-42f1-8386-66971b214bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:07.080582 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4143/8237] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:06 2022] DELETE /identity/v3/projects/3f06a271a7704a9698d3a75c1fc36515 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:07.085723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.086253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.086467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.094097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:07.109548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:07.111514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:07.188498 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4095/8238] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:07.196511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.196795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.197067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.217736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:07.218981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:07.227704 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4144/8239] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:07.231731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.242637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299e8e5-fb59-4423-b98d-3f25eceacad9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.247739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.248328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.248610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.248887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.249542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:26:07.249941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.251742 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.267730 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4096/8240] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:26:07.268885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.278386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3170ad-9021-459e-ab82-8620d93f3993 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.283281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.283890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.284163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.284432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.285071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.287154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.316853 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4145/8241] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:07 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:07.321118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.332505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc65273-4644-41a3-b94d-e522b740bd13 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.392977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.393601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.393916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.394221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.394854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.396869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.419681 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4097/8242] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:07 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:07.423732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.434627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07059-6bd2-42c1-909b-874baee68c59 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.439828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.440439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.440713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.440979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.441620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.443336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.456032 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4146/8243] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:07.460204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.470670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7862ec-2e7b-45d3-ae01-0aeb5f3c0419 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.476035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815b0a3-2388-433a-8fbd-efc4dda91294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.476663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b0a3-2388-433a-8fbd-efc4dda91294 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.476947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b0a3-2388-433a-8fbd-efc4dda91294 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.477252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b0a3-2388-433a-8fbd-efc4dda91294 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.477931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815b0a3-2388-433a-8fbd-efc4dda91294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.479575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815b0a3-2388-433a-8fbd-efc4dda91294 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.491410 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4098/8244] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:07.495744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.506448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60268d-4183-4a95-8289-0fd154ecb245 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.511057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.511724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.511995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.512285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] PATH_INFO: `/v3/projects/97168f5338ec439e99dd858a6640ddef/users/77f1fdb21a1f45bb92ec8d66e089bd72/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.527807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97168f5338ec439e99dd858a6640ddef, user_id=77f1fdb21a1f45bb92ec8d66e089bd72, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.530549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.545850 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4147/8245] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:07 2022] PUT /identity/v3/projects/97168f5338ec439e99dd858a6640ddef/users/77f1fdb21a1f45bb92ec8d66e089bd72/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:26:07.559775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.560066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.560345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.591249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] MFA Rules not processed for user `77f1fdb21a1f45bb92ec8d66e089bd72`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:07.592585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:07.654317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:07.660811 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4099/8246] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:07.671979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:07.673932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:07.703990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:07.738637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0f09b-dafe-4b0c-a237-cbf88473c374 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:07.744429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b936a4-d063-4193-b7ae-26ed7f7b962a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:07.745063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b936a4-d063-4193-b7ae-26ed7f7b962a service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:07.745338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b936a4-d063-4193-b7ae-26ed7f7b962a service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:07.745607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b936a4-d063-4193-b7ae-26ed7f7b962a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:07.755514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b936a4-d063-4193-b7ae-26ed7f7b962a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:07.757082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b936a4-d063-4193-b7ae-26ed7f7b962a service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:07.766410 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4148/8247] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:17.666949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:17.762321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=15 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:23.733052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:23.734972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:23.821420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a276ad-e694-4ffb-8c4a-810479132a28 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:23.826316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:23.827048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:23.827501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:23.827850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] PATH_INFO: `/v3/users/5af73face5ca42228a6af51d930d8cec` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:23.829250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af73face5ca42228a6af51d930d8cec)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:23.831531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:23.884182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af73face5ca42228a6af51d930d8cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:23.898290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af73face5ca42228a6af51d930d8cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:23.899146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af73face5ca42228a6af51d930d8cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:23.907525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af73face5ca42228a6af51d930d8cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:23.908310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af73face5ca42228a6af51d930d8cec'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:23.923507 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4100/8248] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:23 2022] DELETE /identity/v3/users/5af73face5ca42228a6af51d930d8cec => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:23.928060 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:23.928585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:23.928585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:23.949744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:23.950992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:24.014555 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4149/8249] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:26:24.025285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.026778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:24.096196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d70949-f2ef-41d3-9d5e-7f06969c2dbd admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.100185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f442d-cab2-41ba-b2f6-1388e2b4bd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.102220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f442d-cab2-41ba-b2f6-1388e2b4bd58 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.102220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f442d-cab2-41ba-b2f6-1388e2b4bd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.102220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f442d-cab2-41ba-b2f6-1388e2b4bd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.119749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f442d-cab2-41ba-b2f6-1388e2b4bd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.121393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f442d-cab2-41ba-b2f6-1388e2b4bd58 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:24.132094 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4101/8250] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:24.452246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.454008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:24.474253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d25a33-e323-4a7f-ba42-1141a4e18ab6 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.480210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.481075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.481517 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.481987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] PATH_INFO: `/v3/projects/b1bed401b9034a1db63d2c55688b4f9c` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.483285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1bed401b9034a1db63d2c55688b4f9c)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.494997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:24.551725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1bed401b9034a1db63d2c55688b4f9c', 'request_id': 'req-0cd374be-a356-460e-a75c-04b2904a4728'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:24.560439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1bed401b9034a1db63d2c55688b4f9c', 'request_id': 'req-0cd374be-a356-460e-a75c-04b2904a4728'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:24.567657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1bed401b9034a1db63d2c55688b4f9c', 'request_id': 'req-0cd374be-a356-460e-a75c-04b2904a4728'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:24.584001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] The token cache is being invalidate because project b1bed401b9034a1db63d2c55688b4f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:24.584370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:24.585099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-0cd374be-a356-460e-a75c-04b2904a4728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:24.587030 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4150/8251] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:24 2022] DELETE /identity/v3/projects/b1bed401b9034a1db63d2c55688b4f9c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:24.591949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.592241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.592509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.620196 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:24.621541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:24.642365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:24.687829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4102/8252] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:24.696047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.696405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.696746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.718593 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:24.720029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:24.728470 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4151/8253] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:24.733219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.744408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4a7a8-6c46-44c0-a172-ee4639b9e229 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.750335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.751098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.751545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.751832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.752464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:26:24.752771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.754398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:24.766366 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4103/8254] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:26:24.770985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.781832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c982b-0dcf-4fd8-b8cd-1354a7581a70 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.788059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.788724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.788997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.789263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.789976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.791984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:24.828703 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4152/8255] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:24 2022] POST /identity/v3/projects => generated 391 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:24.830977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.841756 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430d04-0c53-4523-8559-aa4de12ca79f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.906048 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.906823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.907473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.907869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.908877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.911726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:24.941162 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4104/8256] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:24 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:24.944051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.955224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb607b-ecb6-436e-aa95-c6825d2fb634 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.960264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.960911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.961194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.961466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.962145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.963788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:24.974513 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4153/8257] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:24.978755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:24.989623 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba994583-f53d-414d-b1a2-9faa0b331a8c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:24.996232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ae21e0-8600-4329-8283-e3c43606f0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:24.996829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae21e0-8600-4329-8283-e3c43606f0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:24.997111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae21e0-8600-4329-8283-e3c43606f0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:24.997403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ae21e0-8600-4329-8283-e3c43606f0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:24.998079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae21e0-8600-4329-8283-e3c43606f0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:24.999685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ae21e0-8600-4329-8283-e3c43606f0b0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:25.011796 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4105/8258] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:25.016192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:25.027850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470b7f2-27c6-4f9a-a2ab-dd0fb621a2be admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:25.034958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:25.035613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:25.035889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:25.036166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] PATH_INFO: `/v3/projects/417f5dbcf4234355b2b9f886ac860601/users/2d0e07b7b50247e0bb3f1eb114581b56/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:25.052290 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417f5dbcf4234355b2b9f886ac860601, user_id=2d0e07b7b50247e0bb3f1eb114581b56, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:25.054971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:25.074109 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4154/8259] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:25 2022] PUT /identity/v3/projects/417f5dbcf4234355b2b9f886ac860601/users/2d0e07b7b50247e0bb3f1eb114581b56/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:25.084453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:25.084701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:25.084966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:25.114139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] MFA Rules not processed for user `2d0e07b7b50247e0bb3f1eb114581b56`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:25.115349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:25.180934 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4106/8260] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:25.192096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:25.194163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:25.216805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:25.257986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1437d-2542-4969-b9cc-3e3325311c96 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:25.261707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb74b8-e5cb-4ef6-887c-20bf274af779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:25.262349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb74b8-e5cb-4ef6-887c-20bf274af779 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:25.262628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb74b8-e5cb-4ef6-887c-20bf274af779 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:25.262898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb74b8-e5cb-4ef6-887c-20bf274af779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:25.271663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb74b8-e5cb-4ef6-887c-20bf274af779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:25.273092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb74b8-e5cb-4ef6-887c-20bf274af779 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:25.282133 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4155/8261] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:25 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:35.177790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:35.278043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=17 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:42.837296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:42.921331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9f0e-ff72-4b9d-be03-4a84ca167685 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:42.926749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:42.927422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:42.927705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:42.927981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] PATH_INFO: `/v3/users/2d0e07b7b50247e0bb3f1eb114581b56` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:42.929167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0e07b7b50247e0bb3f1eb114581b56)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:42.931151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:42.988985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0e07b7b50247e0bb3f1eb114581b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.002949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0e07b7b50247e0bb3f1eb114581b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.003669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0e07b7b50247e0bb3f1eb114581b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.011251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0e07b7b50247e0bb3f1eb114581b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.012019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0e07b7b50247e0bb3f1eb114581b56'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.030594 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4107/8262] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:26:42 2022] DELETE /identity/v3/users/2d0e07b7b50247e0bb3f1eb114581b56 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:43.032500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.032968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.033084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.054959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:43.056465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:43.118347 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4156/8263] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:43.128643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:43.130213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:43.192329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a908a7-2e57-406d-a9ef-f48004799f34 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:43.196282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca8903-b469-466f-a7ed-2444404e773d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:43.196900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8903-b469-466f-a7ed-2444404e773d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.197174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8903-b469-466f-a7ed-2444404e773d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.197459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca8903-b469-466f-a7ed-2444404e773d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.207607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8903-b469-466f-a7ed-2444404e773d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:43.209052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca8903-b469-466f-a7ed-2444404e773d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:43.220983 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4108/8264] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:26:43.578053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:43.580177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:43.593731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3029f76b-09cc-4bda-803d-3a0b7bc8dcfc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:43.606769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:43.607557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.607972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.608257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] PATH_INFO: `/v3/projects/417f5dbcf4234355b2b9f886ac860601` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.609465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=417f5dbcf4234355b2b9f886ac860601)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:43.611678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:43.683087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417f5dbcf4234355b2b9f886ac860601', 'request_id': 'req-2420e4a0-4715-4c9d-82f7-74a018c78983'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.698166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417f5dbcf4234355b2b9f886ac860601', 'request_id': 'req-2420e4a0-4715-4c9d-82f7-74a018c78983'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.707052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417f5dbcf4234355b2b9f886ac860601', 'request_id': 'req-2420e4a0-4715-4c9d-82f7-74a018c78983'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.726970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] The token cache is being invalidate because project 417f5dbcf4234355b2b9f886ac860601 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:26:43.727375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.728039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-2420e4a0-4715-4c9d-82f7-74a018c78983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:26:43.730289 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4157/8265] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:26:43 2022] DELETE /identity/v3/projects/417f5dbcf4234355b2b9f886ac860601 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:26:43.737823 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.740039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.740039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.773216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:43.774497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:43.794309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:43.856373 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4109/8266] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:26:43.866346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.866628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.866905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.890644 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:43.891996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:43.916418 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4158/8267] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:43.918099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:43.931588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d462f4-85f0-4cdc-b751-feb4b88e5f51 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:43.937269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:43.938038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.938393 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.938670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.939402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:26:43.939661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:43.941263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:43.953486 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4110/8268] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:26:43.958394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:43.968827 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe79734-42a9-4a27-9728-50331fa71125 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:43.974053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:43.974858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:43.975166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:43.975561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:43.976286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:43.978384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.009837 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4159/8269] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:43 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:44.013385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.025962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2addc-158f-4c74-b4ea-e5046da32e13 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.086500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.087121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.087411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.087675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.088306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.090385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.113888 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4111/8270] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:44 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:26:44.119109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.130889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029da70-4104-4a37-9074-444088759d75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.136540 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.138166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.138166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.138166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.139111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.140268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.151157 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4160/8271] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:26:44.155237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.165931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744fc8f-7430-47d0-b1a2-7db294b41c7b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.171576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb11da-d1ac-41ec-a4ec-db58f4159f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.172435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb11da-d1ac-41ec-a4ec-db58f4159f3f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.172835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb11da-d1ac-41ec-a4ec-db58f4159f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.173217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb11da-d1ac-41ec-a4ec-db58f4159f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.174001 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb11da-d1ac-41ec-a4ec-db58f4159f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.175593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb11da-d1ac-41ec-a4ec-db58f4159f3f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.186895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4112/8272] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:44.190962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.201567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abe826-4155-46a0-bdcd-058c332cad2b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.207610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.208237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.208492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.208907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] PATH_INFO: `/v3/projects/1d8e5b0759e64bc5a2118d6ab364bec3/users/6988b3809252496ca2f97a1f6eff5825/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.225259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8e5b0759e64bc5a2118d6ab364bec3, user_id=6988b3809252496ca2f97a1f6eff5825, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.228201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.243315 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4161/8273] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:44 2022] PUT /identity/v3/projects/1d8e5b0759e64bc5a2118d6ab364bec3/users/6988b3809252496ca2f97a1f6eff5825/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:26:44.253668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.254242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.254610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.283614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] MFA Rules not processed for user `6988b3809252496ca2f97a1f6eff5825`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:44.285062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:44.373691 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4113/8274] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:44.378478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.401636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:44.447503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403e6cb-42bf-4ba6-a349-2efe8f41856f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.452834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.453995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.454393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.454666 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.455436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.457380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.487434 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4162/8275] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:26:44 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:44.492787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.504355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6fad4-5de4-4b02-80f1-c081a44e7557 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.518802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:44.574825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.575439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.575715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.575977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.576614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.578704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.601992 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4114/8276] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:26:44 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:26:44.606249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.618035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4619-6b24-43dd-bdb0-abd657a34ba6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.623275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.623891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.624366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.624680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.625955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.627557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.643144 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4163/8277] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:44.644376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.655598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1b851-3f1a-437c-b91c-51505c0c4e21 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.661614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.662267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.662734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.663045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] PATH_INFO: `/v3/projects/2732e7d1faa543c8abe82f355fcdf7cf/users/242fc17348054226a14c87a3080b0e55/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.679282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2732e7d1faa543c8abe82f355fcdf7cf, user_id=242fc17348054226a14c87a3080b0e55, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.682033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.700049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4115/8278] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:44 2022] PUT /identity/v3/projects/2732e7d1faa543c8abe82f355fcdf7cf/users/242fc17348054226a14c87a3080b0e55/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:44.704138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.714589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b06448-187c-4bc8-9bbc-5da0ad0b40d8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.776300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be780e51-9faf-485b-a685-0b67571c241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.777003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780e51-9faf-485b-a685-0b67571c241c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.777348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780e51-9faf-485b-a685-0b67571c241c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.777716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be780e51-9faf-485b-a685-0b67571c241c admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.779011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780e51-9faf-485b-a685-0b67571c241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.781748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be780e51-9faf-485b-a685-0b67571c241c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.793110 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4164/8279] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:26:44.797698 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.809397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc1cd1-e675-4304-a5da-50d9b2445f2f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:44.815045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:44.815738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.816136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.816405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] PATH_INFO: `/v3/projects/2732e7d1faa543c8abe82f355fcdf7cf/users/242fc17348054226a14c87a3080b0e55/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.818501 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2732e7d1faa543c8abe82f355fcdf7cf, user_id=242fc17348054226a14c87a3080b0e55, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:44.821167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:44.832625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4116/8280] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:26:44 2022] PUT /identity/v3/projects/2732e7d1faa543c8abe82f355fcdf7cf/users/242fc17348054226a14c87a3080b0e55/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:26:44.844525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:44.844803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:44.845105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:44.875286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] MFA Rules not processed for user `242fc17348054226a14c87a3080b0e55`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:44.876755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:44.947973 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4165/8281] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:44 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:26:44.971229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:44.976112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:45.096992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd742f-b90e-44fb-af26-0310a439b943 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:45.103003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c909928-645f-4664-ae03-ae3f185c3edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:45.103752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909928-645f-4664-ae03-ae3f185c3edd service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:45.104052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909928-645f-4664-ae03-ae3f185c3edd service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:45.104320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909928-645f-4664-ae03-ae3f185c3edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:45.148483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:45.166704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c909928-645f-4664-ae03-ae3f185c3edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:45.168434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c909928-645f-4664-ae03-ae3f185c3edd service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:45.178168 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4117/8282] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:48.095741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:48.097525 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:48.118714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:26:48.168309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb65bb-7425-49b3-8959-f1bff26f9f61 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:48.172677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:48.173310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:48.174098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:48.174098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:48.184464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:48.185919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:48.205972 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4166/8283] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:51.209705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:51.210328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:51.210588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:51.233431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] MFA Rules not processed for user `6988b3809252496ca2f97a1f6eff5825`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:26:51.235185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:51.243468 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4118/8284] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:26:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:26:51.328692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:51.330268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:51.400589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533651e-2328-4bac-822d-5d8b2cbe94ff service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:51.404665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:51.405316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:51.405590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:51.405887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:51.407928 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:51.426648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:51.429180 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:51.446869 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4167/8285] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:51.796042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:51.797786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:51.817949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31df631-e67f-40d2-a456-f2e7451d2b19 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:51.829916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:51.830609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:51.830897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:51.831172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:51.840470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:51.864801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:51.870725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:51.888444 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4119/8286] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:52.318737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:52.343262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937faf5-e211-4498-a3e4-f4f44b2770d9 service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:52.349732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:52.350635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:52.350957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:52.351280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:52.353106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:52.371836 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:52.373227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:52.401774 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4168/8287] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:26:54.666987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:26:54.683157 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28917c51-9ac6-489c-a377-35e2d73d19b1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:26:54.688171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:26:54.688819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:26:54.689287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:26:54.690377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:26:54.699961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:26:54.720222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:26:54.722357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b64c4c-35a0-4fca-bb85-d8de7138bc09 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:26:54.748159 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4120/8288] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:26:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:00.854382 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:00.855904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:00.926678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ee76e-6b14-4bd4-88bc-7796605513b5 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:00.931616 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:00.932303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:00.932646 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:00.932983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] PATH_INFO: `/v3/users/77f1fdb21a1f45bb92ec8d66e089bd72` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:00.934207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f1fdb21a1f45bb92ec8d66e089bd72)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:00.936196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:00.993438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f1fdb21a1f45bb92ec8d66e089bd72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:00.996027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:01.002880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f1fdb21a1f45bb92ec8d66e089bd72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.003917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f1fdb21a1f45bb92ec8d66e089bd72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.013700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f1fdb21a1f45bb92ec8d66e089bd72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.014530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f1fdb21a1f45bb92ec8d66e089bd72'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.033535 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4169/8289] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:27:00 2022] DELETE /identity/v3/users/77f1fdb21a1f45bb92ec8d66e089bd72 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:27:01.038240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.038731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.038860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.078622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:01.080124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:01.144026 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4121/8290] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:27:01.154034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:01.155552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:01.219667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602284a2-9a91-448e-963c-69288ea2e007 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:01.223496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73d383-ac41-45b0-9389-5c80aaeff193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:01.224108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73d383-ac41-45b0-9389-5c80aaeff193 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.224414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73d383-ac41-45b0-9389-5c80aaeff193 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.224681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73d383-ac41-45b0-9389-5c80aaeff193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.233819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73d383-ac41-45b0-9389-5c80aaeff193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:01.235410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73d383-ac41-45b0-9389-5c80aaeff193 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:01.245295 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4170/8291] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:01.533456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:01.535040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:01.548164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0c657-bfb8-4363-a6ba-b0c83610da91 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:01.553796 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:01.554258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.554721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.555097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] PATH_INFO: `/v3/projects/97168f5338ec439e99dd858a6640ddef` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.556340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] RBAC: Authorizing `identity:delete_project(project_id=97168f5338ec439e99dd858a6640ddef)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:01.558895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:01.608892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97168f5338ec439e99dd858a6640ddef', 'request_id': 'req-21c49e06-81ae-4ff7-9abb-a3c61122340d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.615461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97168f5338ec439e99dd858a6640ddef', 'request_id': 'req-21c49e06-81ae-4ff7-9abb-a3c61122340d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.621589 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97168f5338ec439e99dd858a6640ddef', 'request_id': 'req-21c49e06-81ae-4ff7-9abb-a3c61122340d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.635136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] The token cache is being invalidate because project 97168f5338ec439e99dd858a6640ddef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:27:01.636047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.636768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-21c49e06-81ae-4ff7-9abb-a3c61122340d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:01.638385 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4122/8292] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:27:01 2022] DELETE /identity/v3/projects/97168f5338ec439e99dd858a6640ddef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:27:01.643527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.643828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.644131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.664254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:01.665457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:01.724518 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4171/8293] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:01.732726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.733025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.733383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.755163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:01.756470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:01.765572 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4123/8294] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:01.770048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:01.780444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e259e-a0a0-4d97-b19d-5075f9e84dd3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:01.786284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:01.786996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.787352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.787683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.788401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:27:01.788763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:01.790465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:01.803142 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4172/8295] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:27:01.807753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:01.818127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c42ff6f-ed19-4111-8cbc-9e78322ff385 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:01.822896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:01.823500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.823780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.824051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.824763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:01.826705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:01.857635 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4124/8296] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:27:01 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:27:01.862269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:01.873351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8706-2d95-48d6-b055-40b0f043405a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:01.930120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:01.939656 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:01.940328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.940634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.940941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.941791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:01.944058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:01.966576 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4173/8297] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:27:01 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:27:01.970781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:01.976327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:01.983155 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e2b63f-ebbf-4e65-ae42-a27121913567 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:01.989578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:01.990232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:01.990512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:01.990782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:01.991426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:01.993481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:02.007832 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4125/8298] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:27:02.009083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:02.020010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53423-64c2-4494-af2e-7defb39315df admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:02.025140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a4280-e30d-4f72-bd1f-4f8927de697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:02.025756 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a4280-e30d-4f72-bd1f-4f8927de697b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.026081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a4280-e30d-4f72-bd1f-4f8927de697b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.026379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a4280-e30d-4f72-bd1f-4f8927de697b admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.027011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a4280-e30d-4f72-bd1f-4f8927de697b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:02.028625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a4280-e30d-4f72-bd1f-4f8927de697b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:02.041329 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4174/8299] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:27:02.044593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:02.055265 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6cdc07-a96b-4b8d-8e68-0d7e92d5bea8 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:02.060261 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:02.060940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.061219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.061512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] PATH_INFO: `/v3/projects/a075a3a5ad1d42ae92c932ff4478be7b/users/a53c03579fba4d9c8c0ceb8a62b37572/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.078386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a075a3a5ad1d42ae92c932ff4478be7b, user_id=a53c03579fba4d9c8c0ceb8a62b37572, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:02.081075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:02.095101 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4126/8300] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:27:02 2022] PUT /identity/v3/projects/a075a3a5ad1d42ae92c932ff4478be7b/users/a53c03579fba4d9c8c0ceb8a62b37572/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:27:02.106013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.106305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.106567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.135861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] MFA Rules not processed for user `a53c03579fba4d9c8c0ceb8a62b37572`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:02.137092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:02.208768 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4175/8301] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:02.220461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:02.222414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:02.283855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38129421-58eb-49e9-b952-f33a83ca09d6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:02.287436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d74fa0-a706-4743-ba90-bf79606bddca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:02.288051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d74fa0-a706-4743-ba90-bf79606bddca service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.288297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d74fa0-a706-4743-ba90-bf79606bddca service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.288588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d74fa0-a706-4743-ba90-bf79606bddca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.297406 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d74fa0-a706-4743-ba90-bf79606bddca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:02.298852 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d74fa0-a706-4743-ba90-bf79606bddca service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:02.307993 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4127/8302] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:02.333633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:02.399682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279ad2f-b44d-40e1-bdb5-628657f24413 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:02.404337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:02.404984 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.405258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.406216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] PATH_INFO: `/v3/users/a53c03579fba4d9c8c0ceb8a62b37572` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.406726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a53c03579fba4d9c8c0ceb8a62b37572)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:02.408856 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:02.457205 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a53c03579fba4d9c8c0ceb8a62b37572'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:02.468718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a53c03579fba4d9c8c0ceb8a62b37572'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:02.469780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a53c03579fba4d9c8c0ceb8a62b37572'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:02.481825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a53c03579fba4d9c8c0ceb8a62b37572'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:02.482499 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a53c03579fba4d9c8c0ceb8a62b37572'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:02.494115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:02.507714 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4176/8303] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:27:02 2022] DELETE /identity/v3/users/a53c03579fba4d9c8c0ceb8a62b37572 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:27:02.512549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.512854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.513125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.536645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:02.537786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:02.628247 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4128/8304] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:02.639284 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:02.641153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:02.706479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47661d4-18e4-44be-92b5-33d880d8e2d7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:02.710715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae799033-b570-45c1-8151-44d497b38394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:02.711606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799033-b570-45c1-8151-44d497b38394 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:02.712058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799033-b570-45c1-8151-44d497b38394 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:02.712484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae799033-b570-45c1-8151-44d497b38394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:02.723527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799033-b570-45c1-8151-44d497b38394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:02.725103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae799033-b570-45c1-8151-44d497b38394 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:02.735819 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4177/8305] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:03.026056 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.027291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:03.040515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a88a727-cfd2-4fad-8cfa-8b71ec48e8f4 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.046391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.047134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.047410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.047673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] PATH_INFO: `/v3/projects/a075a3a5ad1d42ae92c932ff4478be7b` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.049191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a075a3a5ad1d42ae92c932ff4478be7b)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.051203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.107794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a075a3a5ad1d42ae92c932ff4478be7b', 'request_id': 'req-511a4810-8bae-43a3-b06b-ffc8f37a31c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:03.114252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a075a3a5ad1d42ae92c932ff4478be7b', 'request_id': 'req-511a4810-8bae-43a3-b06b-ffc8f37a31c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:03.120067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a075a3a5ad1d42ae92c932ff4478be7b', 'request_id': 'req-511a4810-8bae-43a3-b06b-ffc8f37a31c7'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:03.122753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:03.136490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] The token cache is being invalidate because project a075a3a5ad1d42ae92c932ff4478be7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:27:03.136817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:03.137704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-511a4810-8bae-43a3-b06b-ffc8f37a31c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:27:03.139323 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4129/8306] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:27:03 2022] DELETE /identity/v3/projects/a075a3a5ad1d42ae92c932ff4478be7b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:27:03.144572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.145128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.145301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.165950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:03.167163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:03.226557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4178/8307] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:27:03.234485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.234769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.235038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.257496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:03.258845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:03.268356 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4130/8308] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:03.272884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.283607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1da957-81c3-467c-b6a8-c27fc008e58c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.288443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.289058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.289332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.289598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.290282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:27:03.290582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.292199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.304645 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4179/8309] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:27:03.310286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.321026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45923594-f18d-487c-965c-ce7737d837b2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.325973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.326670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.327011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.327345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.328251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.330318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.362511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4131/8310] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:27:03 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:27:03.363647 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.375160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed114e-b36a-484d-98f4-4b34dee40c31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.434265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.434968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.435246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.435512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.436146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.438265 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.461077 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4180/8311] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:27:03 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:27:03.465415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.476360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944b613-b357-4a88-aa93-fcac12511230 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.481241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.481992 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.482368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.482723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.483470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.485173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.496961 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4132/8312] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:27:03.501513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.508898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:03.512945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49540a-f0ea-4ec5-9aba-e39061273e31 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.518983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fac9dc-83a8-4342-bc47-cfaccc59ade6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.519843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9dc-83a8-4342-bc47-cfaccc59ade6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.520221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9dc-83a8-4342-bc47-cfaccc59ade6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.520847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9dc-83a8-4342-bc47-cfaccc59ade6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.521946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fac9dc-83a8-4342-bc47-cfaccc59ade6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.523937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fac9dc-83a8-4342-bc47-cfaccc59ade6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.535861 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4181/8313] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:27:03.539790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.553041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a9d91-99d4-4b31-bda3-49b31a772aea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.558405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.559165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.559630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.559975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] PATH_INFO: `/v3/projects/2aae79e92fe04118abc223a15b0125c7/users/6164bf5a872d4a61affdfdc17ade47b0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.580173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aae79e92fe04118abc223a15b0125c7, user_id=6164bf5a872d4a61affdfdc17ade47b0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.582901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.597318 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4133/8314] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:27:03 2022] PUT /identity/v3/projects/2aae79e92fe04118abc223a15b0125c7/users/6164bf5a872d4a61affdfdc17ade47b0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:27:03.602495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f38ec5-cc9a-4e2c-a2c0-fe2992de57e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.602876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f38ec5-cc9a-4e2c-a2c0-fe2992de57e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.603253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f38ec5-cc9a-4e2c-a2c0-fe2992de57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.625235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-49f38ec5-cc9a-4e2c-a2c0-fe2992de57e9 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:03.626480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49f38ec5-cc9a-4e2c-a2c0-fe2992de57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:03.688702 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4182/8315] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:27:03.698940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:03.700744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:03.765401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd89e8-51bb-489a-8884-2f0edc92e4d0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:03.769207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:03.769829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:03.770130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:03.770398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:03.780391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:03.782120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:03.792862 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4134/8316] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:04.624271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:04.625063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:04.625449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:04.657318 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] MFA Rules not processed for user `6164bf5a872d4a61affdfdc17ade47b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:04.658846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:04.741426 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4183/8317] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:04.754703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:04.756242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:04.833720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6402e5f-2e7d-46ab-a5e8-851d2399b6c0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:04.837884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:04.838338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:04.838727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:04.839326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:04.850164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:04.851614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:04.863467 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4135/8318] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:14.737010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=62 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:14.858885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=1,keystone:SELECT=81,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:21.962287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:21.963819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:22.063261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd4e87-a1c6-47d7-a046-dc29019e1838 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:22.069379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:22.070034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:22.070440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:22.070718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:22.084126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:22.085541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:22.094480 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4184/8319] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:27:32.091071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=41 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:33.434378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:33.435816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:33.518752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8452f-685a-49bd-bf23-d34d75380cc2 service cinder] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:33.524397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:33.525044 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:33.525324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:33.525600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:33.527556 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:33.542095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:33.543689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:33.557076 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4136/8320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:33.780204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:33.781638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:33.802396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4723db-b390-4046-bbf8-39b1e6ffc244 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:33.807403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:33.808164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:33.808356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:33.808572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:33.811356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:33.824838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:33.826304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:33.837790 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4185/8321] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:33.940125 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:33.941707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:33.962949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed56639-770d-4eb0-a1a4-f104ca7bac87 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:33.968350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:33.969152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:33.969432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:33.969703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:33.972186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:33.987770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:33.989377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:34.003772 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4137/8322] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:34.180844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:34.192638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2323a-6a0f-4e5b-ac7b-71b4e56a8e61 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:34.196477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:34.197096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:34.197389 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:34.197677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:34.199503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:34.280997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:34.282590 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:34.297073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4186/8323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:43.998234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=42 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:44.289182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=40 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:48.044577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:48.057926 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec782f-6d97-4e90-a228-c93b5f51b382 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:48.061632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:48.062553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:48.063020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:48.063459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:48.065409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:48.079524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:48.081026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb72483-8e64-4187-b4e0-99b8732619a3 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:48.093709 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4138/8324] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:48.566175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:48.568306 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:48.588153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2618af5-740e-4145-b12c-a4c7b1390f03 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:48.595046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:48.596162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:48.596531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:48.596876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:48.598881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:48.614592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:48.616429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:27:48.631623 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4187/8325] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:27:58.085895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:58.624440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:27:59.317725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:59.318391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:59.318391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:59.344910 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] MFA Rules not processed for user `6164bf5a872d4a61affdfdc17ade47b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:27:59.346246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:59.356473 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4139/8326] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:27:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:27:59.947933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:27:59.962664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810b82c-4dfc-4066-8457-b8a667305928 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:27:59.967679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:27:59.968448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:27:59.968730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:27:59.969007 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:27:59.970790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:27:59.985766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:27:59.987867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:28:00.001552 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4188/8327] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:27:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:28:02.512960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:28:02.530678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7794c-eb16-43f1-944e-b8fb42f77c9f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:28:02.536609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:28:02.537302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:28:02.537586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:28:02.537886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:28:02.539676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:28:02.555819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:28:02.557510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c97b2-5f19-4edf-90d6-c8d348a44ce0 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:28:02.572312 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4140/8328] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:28:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:28:06.299101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:28:06.316440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fc363-2adf-4bcb-a176-1afd6374a1d3 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:28:06.322052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:28:06.322595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:28:06.322886 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:28:06.323145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:28:06.324884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:28:06.339754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:28:06.341325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:28:06.354967 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4189/8329] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:28:12.565082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:16.347767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:28:39.135842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222050-69c0-4fb5-89f7-fdf2d829b220 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:28:39.136422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222050-69c0-4fb5-89f7-fdf2d829b220 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:28:39.136422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222050-69c0-4fb5-89f7-fdf2d829b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:28:39.157665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1a222050-69c0-4fb5-89f7-fdf2d829b220 None None] MFA Rules not processed for user `6988b3809252496ca2f97a1f6eff5825`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:28:39.159110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a222050-69c0-4fb5-89f7-fdf2d829b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:28:39.257844 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4141/8330] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:28:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:28:49.247574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:01.678802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:29:01.698445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2641bd1-863d-4cdf-8225-2d3ee0d09557 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:29:01.705124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:29:01.705738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:29:01.706056 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:29:01.706276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:29:01.708467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:29:01.723704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:29:01.725338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:29:01.738415 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4190/8331] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:29:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:29:04.079293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:29:04.079758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:29:04.079864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:29:04.099948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] MFA Rules not processed for user `6164bf5a872d4a61affdfdc17ade47b0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:29:04.101152 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:29:04.109328 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4142/8332] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:29:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:29:10.695513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:29:10.708775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaaa5d1-7930-4376-88c4-372daf7670f3 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:29:10.714262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:29:10.714893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:29:10.715166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:29:10.715431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:29:10.717276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:29:10.732164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:29:10.734859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:29:10.752388 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4191/8333] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:29:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:29:14.094313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:20.744005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:30.149631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:29:30.163511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7800ec6-91b1-42ea-b0c8-acb6ce8130e5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:29:30.168189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:29:30.168868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:29:30.169146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:29:30.169413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:29:30.171282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:29:30.184038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:29:30.185516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:29:30.196189 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4143/8334] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:29:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:29:30.226438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:29:30.240127 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3d5bc-affe-4245-86c2-686ce2f4d974 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:29:30.246245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:29:30.246872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:29:30.247179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:29:30.247519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:29:30.249360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:29:30.264864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:29:30.266495 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:29:30.279785 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4192/8335] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:29:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:29:40.190040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:29:40.274631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:33.029794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.048927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2fca9-d6e6-491c-9609-1c7c54c4af65 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.054528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.055255 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.055629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.055994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.058052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:33.072431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.074355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.089868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4144/8336] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:30:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:30:33.099811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.115751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9ec9-d9ed-4b93-88c4-3edd1b2241d7 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.121184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.121841 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.122135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.122391 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] PATH_INFO: `/v3/users/6164bf5a872d4a61affdfdc17ade47b0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.123971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6164bf5a872d4a61affdfdc17ade47b0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.127237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.178358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6164bf5a872d4a61affdfdc17ade47b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.187042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6164bf5a872d4a61affdfdc17ade47b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.187643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6164bf5a872d4a61affdfdc17ade47b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.194760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6164bf5a872d4a61affdfdc17ade47b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.195383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a29df402-66a5-4b5e-8a19-4fefa8985d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6164bf5a872d4a61affdfdc17ade47b0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.212799 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4193/8337] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:30:33 2022] DELETE /identity/v3/users/6164bf5a872d4a61affdfdc17ade47b0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:30:33.400519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.411765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8396c-92ad-4832-9545-de29e17e7858 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.476088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.476665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.476968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.477260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] PATH_INFO: `/v3/projects/2aae79e92fe04118abc223a15b0125c7` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.478461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aae79e92fe04118abc223a15b0125c7)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.480617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.529170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aae79e92fe04118abc223a15b0125c7', 'request_id': 'req-82f69b45-c0f8-4368-9bb5-8da0037cef1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.535392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aae79e92fe04118abc223a15b0125c7', 'request_id': 'req-82f69b45-c0f8-4368-9bb5-8da0037cef1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.541223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aae79e92fe04118abc223a15b0125c7', 'request_id': 'req-82f69b45-c0f8-4368-9bb5-8da0037cef1d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.555760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] The token cache is being invalidate because project 2aae79e92fe04118abc223a15b0125c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:30:33.556053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.556719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-82f69b45-c0f8-4368-9bb5-8da0037cef1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:30:33.558618 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4145/8338] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:30:33 2022] DELETE /identity/v3/projects/2aae79e92fe04118abc223a15b0125c7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:30:33.563691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.563996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.564280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.584241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:33.585376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:33.650370 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4194/8339] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:33.658305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.658614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.658889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.681476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:33.682883 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:33.691607 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4146/8340] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:33.695966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.707183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f8544-5859-4511-949d-3b2c4a4e7ee5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.712897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.713523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.713878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.714272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.715015 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:30:33.715375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.716981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.730920 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4195/8341] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:30:33.735513 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.745719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746364bd-3959-40d0-a2ff-a73f51453bae None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.750594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.751193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.751489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.751743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.752386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.754319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.785413 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4147/8342] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:30:33 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:30:33.789661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.800706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a5e2-1a18-4823-b54b-dfff61b3594c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.858340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.858950 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.859227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.859497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.860116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.862075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.870623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:33.890935 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4196/8343] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:30:33 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:30:33.894846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.905411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f80340-5f5b-44e6-b0a9-7e0b2879de07 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.910012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.910613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.910889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.911156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.911770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.913382 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.923511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4148/8344] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:30:33.927528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.937917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfc04f-dbaf-4b4f-87dd-e55dd1587c7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.943077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bebb2b-da29-4c76-9fba-7fa4a2106eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.943808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bebb2b-da29-4c76-9fba-7fa4a2106eca admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.944089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bebb2b-da29-4c76-9fba-7fa4a2106eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.944356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bebb2b-da29-4c76-9fba-7fa4a2106eca admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.944994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bebb2b-da29-4c76-9fba-7fa4a2106eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.946663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bebb2b-da29-4c76-9fba-7fa4a2106eca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:33.957933 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4197/8345] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:30:33.962130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:33.972487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ba8e4-c383-4a4b-8406-16a8084687ba admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:33.977449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:33.978141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:33.978471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:33.978694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] PATH_INFO: `/v3/projects/7cd88f6886a243b58bd47c4dee34dde6/users/a1d987daa2f040aba031549b0071e4c7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:33.994089 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd88f6886a243b58bd47c4dee34dde6, user_id=a1d987daa2f040aba031549b0071e4c7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:33.996824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:34.010727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4149/8346] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:30:33 2022] PUT /identity/v3/projects/7cd88f6886a243b58bd47c4dee34dde6/users/a1d987daa2f040aba031549b0071e4c7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:30:34.016034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb45f-6f5e-4d98-b6bb-ea085770fc7e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:34.016313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb45f-6f5e-4d98-b6bb-ea085770fc7e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:34.016582 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bb45f-6f5e-4d98-b6bb-ea085770fc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:34.035518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-756bb45f-6f5e-4d98-b6bb-ea085770fc7e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:34.036718 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-756bb45f-6f5e-4d98-b6bb-ea085770fc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:34.098244 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4198/8347] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:34.108251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:34.110363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:34.126628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:34.174824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a808a2-c9bc-4d4d-83ec-f8f878a3302c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:34.179193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:34.179806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:34.180088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:34.180354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:34.190447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:34.191870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:34.201657 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4150/8348] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:30:34.828683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:34.829253 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:34.829380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:34.857971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] MFA Rules not processed for user `a1d987daa2f040aba031549b0071e4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:34.859220 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:34.929589 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4199/8349] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:34.934320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:34.944009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd770a4c-b0fc-4e6a-9cf1-c7ae68aee20a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:34.949357 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:34.950003 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:34.950282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:34.950547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:34.951189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:34.953102 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:34.982655 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4151/8350] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:30:34 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:30:34.986717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:34.998361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bd208-4e22-4ef6-9253-d4998ea99724 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:35.057866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:35.058490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:35.058770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:35.059043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:35.059681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:35.061640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:35.079232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:35.086823 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4200/8351] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:30:34 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:30:35.091209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:35.101865 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d14c0-5db8-4c2b-960e-eb4b693658f9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:35.106955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:35.107555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:35.107830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:35.108078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:35.108712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:35.110326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:35.121829 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4152/8352] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:30:35.126546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:35.140196 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbdd457-1b38-42b8-b501-efbc33f1757f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:35.145583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:35.146276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:35.146554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:35.146825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] PATH_INFO: `/v3/projects/e25bd5140ddb40518e3e51dfe35e3b65/users/e78d88d5c18b463481d28797f6ada69a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:35.162471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25bd5140ddb40518e3e51dfe35e3b65, user_id=e78d88d5c18b463481d28797f6ada69a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:35.165188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:35.179851 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4201/8353] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:30:35 2022] PUT /identity/v3/projects/e25bd5140ddb40518e3e51dfe35e3b65/users/e78d88d5c18b463481d28797f6ada69a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:30:35.183970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:35.194385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219d343-6c63-4a8f-bbd8-ca0ae01b1d87 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:35.254924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13aa57-772e-4be3-9607-94834d97a556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:35.255524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aa57-772e-4be3-9607-94834d97a556 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:35.255798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aa57-772e-4be3-9607-94834d97a556 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:35.256095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13aa57-772e-4be3-9607-94834d97a556 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:35.256721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13aa57-772e-4be3-9607-94834d97a556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:35.258356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13aa57-772e-4be3-9607-94834d97a556 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:35.268541 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4153/8354] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:30:35.272834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:35.283492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0552f-15fd-4aeb-856b-a72fb562816d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:35.288134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d56e-6053-4b45-98bb-22e46c19a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:35.288779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d56e-6053-4b45-98bb-22e46c19a619 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:35.289054 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d56e-6053-4b45-98bb-22e46c19a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:35.289322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d56e-6053-4b45-98bb-22e46c19a619 admin admin] PATH_INFO: `/v3/projects/e25bd5140ddb40518e3e51dfe35e3b65/users/e78d88d5c18b463481d28797f6ada69a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:35.291355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99d56e-6053-4b45-98bb-22e46c19a619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25bd5140ddb40518e3e51dfe35e3b65, user_id=e78d88d5c18b463481d28797f6ada69a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:35.294079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99d56e-6053-4b45-98bb-22e46c19a619 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:35.304466 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4202/8355] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:30:35 2022] PUT /identity/v3/projects/e25bd5140ddb40518e3e51dfe35e3b65/users/e78d88d5c18b463481d28797f6ada69a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:30:36.264531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:36.265141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:36.265141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:36.294937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] MFA Rules not processed for user `e78d88d5c18b463481d28797f6ada69a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:36.296217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:36.368158 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4154/8356] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:36.379198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:36.379753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:36.379753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:36.402237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] MFA Rules not processed for user `a1d987daa2f040aba031549b0071e4c7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:36.403452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:36.461213 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4203/8357] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:36.475593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:36.477034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:36.483667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:36.560347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e4745c-0d7f-448c-9efb-50a1dfa069aa None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:36.566484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1fade-147f-4972-8bc4-3baabd1a6e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:36.567395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1fade-147f-4972-8bc4-3baabd1a6e8a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:36.567680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1fade-147f-4972-8bc4-3baabd1a6e8a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:36.567950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1fade-147f-4972-8bc4-3baabd1a6e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:36.576077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1fade-147f-4972-8bc4-3baabd1a6e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:36.577650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1fade-147f-4972-8bc4-3baabd1a6e8a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:36.587049 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4155/8358] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:30:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:30:46.452948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=41,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:46.582625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=32 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:30:47.417569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:30:47.419233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:47.528930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0330a95-0c9a-4468-8a69-431510d47e3b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:30:47.536498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:30:47.537010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:47.537339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:47.537618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:47.539612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:47.566370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:30:47.568174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:30:47.583174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4204/8359] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:30:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:30:53.717749 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:30:53.718333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:30:53.718530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:30:53.747380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] MFA Rules not processed for user `6988b3809252496ca2f97a1f6eff5825`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:30:53.748727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:30:53.861573 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4156/8360] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:30:57.576524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=32 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:01.597946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:01.664598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fb39c6-fc69-4fcb-b95b-d916eca1ee81 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:01.669528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:01.670200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:01.670478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:01.670728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] PATH_INFO: `/v3/users/a1d987daa2f040aba031549b0071e4c7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:01.671890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1d987daa2f040aba031549b0071e4c7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:01.673903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:01.721705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1d987daa2f040aba031549b0071e4c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:01.730905 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1d987daa2f040aba031549b0071e4c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:01.731563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1d987daa2f040aba031549b0071e4c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:01.739523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1d987daa2f040aba031549b0071e4c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:01.740159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1d987daa2f040aba031549b0071e4c7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:01.761629 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4205/8361] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:31:01 2022] DELETE /identity/v3/users/a1d987daa2f040aba031549b0071e4c7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:31:01.990124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:02.003317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afa78f-762e-489c-8af0-24e26a400353 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:02.093942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:02.094695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.094975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.095246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] PATH_INFO: `/v3/projects/7cd88f6886a243b58bd47c4dee34dde6` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.096391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd88f6886a243b58bd47c4dee34dde6)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:02.098640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:02.158588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd88f6886a243b58bd47c4dee34dde6', 'request_id': 'req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.165563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd88f6886a243b58bd47c4dee34dde6', 'request_id': 'req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.171270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd88f6886a243b58bd47c4dee34dde6', 'request_id': 'req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.185645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] The token cache is being invalidate because project 7cd88f6886a243b58bd47c4dee34dde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:31:02.186031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.186653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.188166 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4157/8362] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:31:01 2022] DELETE /identity/v3/projects/7cd88f6886a243b58bd47c4dee34dde6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:31:02.192224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:02.193719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:02.207237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c574b-0cf7-494a-97c7-4c3f14ba1a36 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:02.268221 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:02.268875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.269151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.269423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] PATH_INFO: `/v3/users/e78d88d5c18b463481d28797f6ada69a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.270853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78d88d5c18b463481d28797f6ada69a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:02.272791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:02.296685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:02.327620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78d88d5c18b463481d28797f6ada69a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.335996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78d88d5c18b463481d28797f6ada69a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.336632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78d88d5c18b463481d28797f6ada69a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.343659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78d88d5c18b463481d28797f6ada69a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.344304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-28d2d5fe-0116-47d9-9166-ee6ee3b99c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78d88d5c18b463481d28797f6ada69a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.362902 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4206/8363] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:31:02 2022] DELETE /identity/v3/users/e78d88d5c18b463481d28797f6ada69a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:31:02.552413 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:02.554248 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:02.572575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ce90c-bff3-4e71-9b8c-bd31ac68e31b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:02.609234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:02.637574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:02.638246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.638522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.638791 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] PATH_INFO: `/v3/projects/e25bd5140ddb40518e3e51dfe35e3b65` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.639905 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25bd5140ddb40518e3e51dfe35e3b65)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:02.641821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:02.691990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25bd5140ddb40518e3e51dfe35e3b65', 'request_id': 'req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.700086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25bd5140ddb40518e3e51dfe35e3b65', 'request_id': 'req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.707646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25bd5140ddb40518e3e51dfe35e3b65', 'request_id': 'req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.724004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] The token cache is being invalidate because project e25bd5140ddb40518e3e51dfe35e3b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:31:02.724291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.724974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-e3bfd247-d91b-448c-acb3-5eea4c31c8b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:31:02.726594 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4158/8364] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:31:02 2022] DELETE /identity/v3/projects/e25bd5140ddb40518e3e51dfe35e3b65 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:31:02.734009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.734481 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.734970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.758353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:31:02.759605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:02.827273 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4207/8365] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:31:02.840235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.840526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.840781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.866518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:31:02.868395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:02.879826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4159/8366] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:31:02.884719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:02.899619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e202573-2c66-47ff-8718-16117499bfc2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:02.908112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:02.908911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.909210 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.909479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.911192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:31:02.912051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:02.916353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:02.929411 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4208/8367] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:31:02.937341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:02.947611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dba51-1fbe-4c24-80a8-ca68cdb86632 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:02.952895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:02.953506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:02.953784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:02.954082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:02.954724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:02.956676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:02.987674 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4160/8368] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:31:02 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:31:02.993027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:03.006187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33251957-4a60-4bd6-80ab-623d2050f02a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:03.076880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:03.077494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:03.077772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:03.078080 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:03.078808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:03.080684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:03.105985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4209/8369] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:31:02 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:31:03.110411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:03.122622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2580cc-c716-4f8d-8883-6247237fdc09 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:03.128748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:03.129369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:03.129640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:03.129916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:03.130560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:03.132291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:03.144993 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4161/8370] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:31:03.148224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:03.160170 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb782dc0-d558-40ca-b3d2-e451b4466525 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:03.166880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a45933-7abf-474e-902b-2d7a8ee4e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:03.167657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45933-7abf-474e-902b-2d7a8ee4e028 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:03.167964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45933-7abf-474e-902b-2d7a8ee4e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:03.168213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a45933-7abf-474e-902b-2d7a8ee4e028 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:03.168882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45933-7abf-474e-902b-2d7a8ee4e028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:03.170733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a45933-7abf-474e-902b-2d7a8ee4e028 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:03.183293 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4210/8371] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:31:03.187639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:03.198193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbf949-3024-43f2-91d7-8fcd6f29c82f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:03.203214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:03.203893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:03.204165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:03.204421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] PATH_INFO: `/v3/projects/b0e257e24d9845b187462412cbd149cf/users/26167e7cffbe4f3d8e63b6ce0253af66/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:03.220777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0e257e24d9845b187462412cbd149cf, user_id=26167e7cffbe4f3d8e63b6ce0253af66, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:03.223423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:03.238436 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4162/8372] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:31:03 2022] PUT /identity/v3/projects/b0e257e24d9845b187462412cbd149cf/users/26167e7cffbe4f3d8e63b6ce0253af66/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:31:03.244072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f5c4a-a706-4759-9af1-b7c43a25e94b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:03.244436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f5c4a-a706-4759-9af1-b7c43a25e94b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:03.244705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503f5c4a-a706-4759-9af1-b7c43a25e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:03.253797 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:03.277183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-503f5c4a-a706-4759-9af1-b7c43a25e94b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:31:03.278906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-503f5c4a-a706-4759-9af1-b7c43a25e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:03.352349 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4211/8373] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:31:03.367906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:03.370429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:03.434314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01212f7-b6a2-4e33-914a-001330910caa admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:03.438489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:03.439098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:03.439377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:03.439643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:03.450419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:03.451857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:03.462779 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4163/8374] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:08.343176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.343772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.344104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.401477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] MFA Rules not processed for user `26167e7cffbe4f3d8e63b6ce0253af66`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:31:08.402924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:08.506305 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4212/8375] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:31:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:31:08.507628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:08.516575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:08.521715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275fdcd-1792-4602-9a34-4208f3fa6b91 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:08.530146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:08.531201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.531691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.532119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.532954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:08.535163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:08.571527 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4164/8376] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:31:08 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:31:08.572753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:08.585035 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc5f3e-f962-4d6a-8e58-a518cf7fa8d4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:08.662336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:08.663535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.663983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.664443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.665267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:08.667804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:08.697844 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4213/8377] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:31:08 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:31:08.700342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:08.714434 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936206a-70e3-4c60-9532-df7bc6644b39 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:08.719326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:08.719982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.720403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.720833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.721486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:08.723146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:08.743862 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4165/8378] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:31:08.744998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:08.756163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c364c04-d5ba-4efa-afe7-6082f0d68666 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:08.762877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:08.763682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.764050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.764461 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] PATH_INFO: `/v3/projects/3ff01a56891a4c13a37b7c1e2df3b626/users/49e787a15b7741a4a4d91cca538427d3/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.782296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff01a56891a4c13a37b7c1e2df3b626, user_id=49e787a15b7741a4a4d91cca538427d3, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:08.785037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:08.799983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:08.814630 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4214/8379] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:31:08 2022] PUT /identity/v3/projects/3ff01a56891a4c13a37b7c1e2df3b626/users/49e787a15b7741a4a4d91cca538427d3/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:31:08.818895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:08.841288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a048f69-121d-4e13-8e0f-f0877e7daa2e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:08.908103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e832d52-cf9d-4a04-aefa-8d04623950a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:08.908739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832d52-cf9d-4a04-aefa-8d04623950a1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.909026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832d52-cf9d-4a04-aefa-8d04623950a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.909371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e832d52-cf9d-4a04-aefa-8d04623950a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.910081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e832d52-cf9d-4a04-aefa-8d04623950a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:08.911872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e832d52-cf9d-4a04-aefa-8d04623950a1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:08.923074 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4166/8380] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:31:08.927291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:08.941462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424495-fddf-4913-9a47-85b15ac3b69b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:08.946468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:08.947201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:08.947477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:08.947803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] PATH_INFO: `/v3/projects/3ff01a56891a4c13a37b7c1e2df3b626/users/49e787a15b7741a4a4d91cca538427d3/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:08.949755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff01a56891a4c13a37b7c1e2df3b626, user_id=49e787a15b7741a4a4d91cca538427d3, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:08.952992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:08.969882 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4215/8381] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:31:08 2022] PUT /identity/v3/projects/3ff01a56891a4c13a37b7c1e2df3b626/users/49e787a15b7741a4a4d91cca538427d3/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:31:13.423271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585c43d-696f-4c6c-9d17-da1f2f11103c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:13.423850 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585c43d-696f-4c6c-9d17-da1f2f11103c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:13.424002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585c43d-696f-4c6c-9d17-da1f2f11103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:13.452399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1585c43d-696f-4c6c-9d17-da1f2f11103c None None] MFA Rules not processed for user `49e787a15b7741a4a4d91cca538427d3`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:31:13.453753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1585c43d-696f-4c6c-9d17-da1f2f11103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:13.535434 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4167/8382] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:31:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:31:13.558256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:13.560658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:13.652214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2596b-5423-43a0-96ca-4cfa7613b638 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:13.659932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:13.660603 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:13.660844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:13.661120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:13.731435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:13.733152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:13.745747 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4216/8383] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:14.786580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:14.787109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:14.787109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:14.808063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] MFA Rules not processed for user `26167e7cffbe4f3d8e63b6ce0253af66`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:31:14.809396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:14.816948 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4168/8384] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:31:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:31:23.739943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=61,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:24.801849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:27.890824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:27.893192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:27.962916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bb2c2-7c86-42a9-bd13-bd17741f67e9 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:27.967158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:27.967787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:27.968064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:27.968332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:27.978801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:27.980274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:27.990653 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4217/8385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:27 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:37.986215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=26 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:31:44.808230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:44.809941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:44.829010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857c2c5-d005-49a6-b41b-cb2258e5b6a7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:44.835463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:44.836061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:44.836335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:44.836601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:44.838481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:44.902629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:44.904384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:44.913985 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4169/8386] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:48.072381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:48.084615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0385797-7aab-4188-85f5-138d3f06c299 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:48.089238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:48.089857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:48.090273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:48.090550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:48.092664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:48.169746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:48.171167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:48.181103 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4218/8387] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:48 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:50.958672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:50.971057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4ae35-8da2-43a3-acd9-a99b1fb9d09c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:50.974924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:50.975538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:50.975825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:50.976095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:50.977898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:50.994821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:50.996273 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:51.010261 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4170/8388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:52.290370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:52.302313 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997dd0d-b4a3-427c-9c6f-e4d8019393a4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:52.306872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:52.307477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:52.307754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:52.308023 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:52.310101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:52.326994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:52.328415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:52.342701 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4219/8389] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:31:55.488801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:31:55.502810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c58b25-598d-40da-adee-945745d1457a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:31:55.506774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:31:55.507391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:31:55.507668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:31:55.507937 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:31:55.509761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:31:55.522645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:31:55.524084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74132e77-29bd-457e-b2fa-b7b4bf1ea35d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:31:55.534826 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4171/8390] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:31:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:32:02.334728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=36 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:04.300073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:32:04.311908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35693978-6067-4f0e-b40c-d639b227a7be service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:32:04.317116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:32:04.318256 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:32:04.318605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:32:04.318938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:32:04.320997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:32:04.336769 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:32:04.339021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:32:04.350981 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4220/8391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:32:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:32:05.528708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=40 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:10.913166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:32:10.913718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:32:10.913718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:32:10.936402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] MFA Rules not processed for user `6988b3809252496ca2f97a1f6eff5825`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:32:10.937666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:32:10.945099 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4172/8392] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:32:14.344414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:32:20.928487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:02.516387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:02.531620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cd46b-ccca-4fdf-b3a0-ef83c059926e service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:02.536063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:02.536708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:02.536981 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:02.537251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:02.539361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:02.552090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:02.553576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:02.564721 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4221/8393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:33:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:33:12.558434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:14.833469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:14.851703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3be77-ed27-4200-8bee-0d0e81581380 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:14.858083 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:14.858709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:14.858987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:14.859260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:14.861191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:14.876857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:14.878561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:14.893693 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4173/8394] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:33:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:33:24.885834 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:51.926187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:51.983057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e51a8-d67e-42b4-9272-c5b4b1e768b1 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:51.989044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:51.989667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:51.989995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:51.990660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:51.992509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:52.032152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:52.033766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:52.048419 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4222/8395] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:33:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:33:54.313919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:54.362459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b3761-c21c-4dc8-86a3-608b4f3c210c service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:54.368341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:54.369243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:54.369243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:54.369503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:54.371658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:54.386902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:54.388522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efea955-551a-4bc6-b796-5ea4c55458fe service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:54.402206 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4174/8396] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:33:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:33:59.147805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:59.149363 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:59.219452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c149d5-410f-4dfe-993f-4342e9d3cd8f service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:59.224013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:59.224664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:59.224946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:59.225217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] PATH_INFO: `/v3/users/6988b3809252496ca2f97a1f6eff5825` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:59.226379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6988b3809252496ca2f97a1f6eff5825)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:59.228323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:59.277397 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6988b3809252496ca2f97a1f6eff5825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.286419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6988b3809252496ca2f97a1f6eff5825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.287067 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6988b3809252496ca2f97a1f6eff5825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.293992 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6988b3809252496ca2f97a1f6eff5825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.294611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-b187b7a5-63fa-407d-bf40-c1770b0a2037 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6988b3809252496ca2f97a1f6eff5825'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.311382 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4223/8397] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:33:59 2022] DELETE /identity/v3/users/6988b3809252496ca2f97a1f6eff5825 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:33:59.316397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:59.316872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:59.316872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:59.336755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:33:59.338019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:59.400914 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4175/8398] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:33:59.410600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:59.410916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:59.411194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:59.442409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:59.470096 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:33:59.471325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:59.526641 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4224/8399] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Oct 29 03:33:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:33:59.533007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:59.543099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffedc6d-8f29-40db-94de-e85a4931e455 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:59.547074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:59.547686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:59.547962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:59.548234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:59.558013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:59.559553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:59.569314 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4176/8400] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:33:59.751076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:59.752710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:33:59.768244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0770a39-8698-42e9-aed2-6fea546b06bb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:59.772978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:59.773621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:59.773956 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:59.774282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] PATH_INFO: `/v3/projects/1d8e5b0759e64bc5a2118d6ab364bec3` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:59.775415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8e5b0759e64bc5a2118d6ab364bec3)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:59.777622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:59.825302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8e5b0759e64bc5a2118d6ab364bec3', 'request_id': 'req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.831595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8e5b0759e64bc5a2118d6ab364bec3', 'request_id': 'req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.837275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8e5b0759e64bc5a2118d6ab364bec3', 'request_id': 'req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.852462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] The token cache is being invalidate because project 1d8e5b0759e64bc5a2118d6ab364bec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:33:59.852746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.853369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.855084 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4225/8401] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:33:59 2022] DELETE /identity/v3/projects/1d8e5b0759e64bc5a2118d6ab364bec3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:33:59.859695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:33:59.869739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7b844-29db-47ca-a045-7c8667e7a8c9 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:33:59.928781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:33:59.929451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:33:59.929754 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:33:59.930046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] PATH_INFO: `/v3/users/242fc17348054226a14c87a3080b0e55` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:33:59.931303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242fc17348054226a14c87a3080b0e55)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:33:59.933187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:33:59.984299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:33:59.986469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242fc17348054226a14c87a3080b0e55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:33:59.999876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242fc17348054226a14c87a3080b0e55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.000571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242fc17348054226a14c87a3080b0e55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.007499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242fc17348054226a14c87a3080b0e55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.008163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-941f2c8b-0295-4d23-a577-7fe74113f1d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242fc17348054226a14c87a3080b0e55'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.023136 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4177/8402] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:33:59 2022] DELETE /identity/v3/users/242fc17348054226a14c87a3080b0e55 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:34:00.207929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.209536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:00.223231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7d842-6c50-4b1d-a019-9e24dbb8ac16 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.281298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.281969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.282250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.282519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] PATH_INFO: `/v3/projects/2732e7d1faa543c8abe82f355fcdf7cf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.283634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2732e7d1faa543c8abe82f355fcdf7cf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.285550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.321287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:00.335243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2732e7d1faa543c8abe82f355fcdf7cf', 'request_id': 'req-64500ecc-3f48-4c07-84e7-b50f9c45ebab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.342012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2732e7d1faa543c8abe82f355fcdf7cf', 'request_id': 'req-64500ecc-3f48-4c07-84e7-b50f9c45ebab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.348373 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2732e7d1faa543c8abe82f355fcdf7cf', 'request_id': 'req-64500ecc-3f48-4c07-84e7-b50f9c45ebab'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.362486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] The token cache is being invalidate because project 2732e7d1faa543c8abe82f355fcdf7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:34:00.362771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.363395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64500ecc-3f48-4c07-84e7-b50f9c45ebab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:34:00.364987 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4226/8403] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:34:00 2022] DELETE /identity/v3/projects/2732e7d1faa543c8abe82f355fcdf7cf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:34:00.370563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.371061 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.371163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.391399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:00.392533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:00.463845 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4178/8404] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:00.473399 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.473665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.473982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.497844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:00.499048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:00.508843 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4227/8405] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:00.513895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.524188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece6322-9734-4d87-8175-1164a5db13c7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.530039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.530639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.530914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.531180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.531815 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:34:00.532108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.533695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.546727 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4179/8406] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:34:00.551719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.565558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5bb40-7fb2-4e86-b7b4-9a693ab0253f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.574291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.574904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.575174 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.575438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.576062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.578030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.607509 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4228/8407] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:34:00 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:34:00.611894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.622443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960860e-676f-4541-aa5f-de749c6f868c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.681462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.682027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.682299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.682569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.683216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.685193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.707949 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4180/8408] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:34:00 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:34:00.712254 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.723531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8b62a1-a706-474c-bc00-879d9f695cbe admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.728124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.728725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.729002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.729274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.729983 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.731594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.742083 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4229/8409] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:34:00.746160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.756378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ccdfc-5e6a-4eb9-b503-1f22f0f22d6a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.761593 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5bbe43-c623-493d-9d6f-f13e8a14ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.762231 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bbe43-c623-493d-9d6f-f13e8a14ad58 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.762507 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bbe43-c623-493d-9d6f-f13e8a14ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.762776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5bbe43-c623-493d-9d6f-f13e8a14ad58 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.763409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bbe43-c623-493d-9d6f-f13e8a14ad58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.765017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5bbe43-c623-493d-9d6f-f13e8a14ad58 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.776103 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4181/8410] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:34:00.780186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:00.790291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a1c6-e236-461f-8f5b-afa8fcfa4bb4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:00.795393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb2fcb-093b-4acb-837d-6d6157ef8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:00.796044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2fcb-093b-4acb-837d-6d6157ef8dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.796328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2fcb-093b-4acb-837d-6d6157ef8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.796597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb2fcb-093b-4acb-837d-6d6157ef8dcf admin admin] PATH_INFO: `/v3/projects/6ef2904fbf9e4666952c7f14bfb45c4e/users/3bf87a4bd94c45fa9b30f01267ec743d/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.811971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb2fcb-093b-4acb-837d-6d6157ef8dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef2904fbf9e4666952c7f14bfb45c4e, user_id=3bf87a4bd94c45fa9b30f01267ec743d, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:00.814661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efb2fcb-093b-4acb-837d-6d6157ef8dcf admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:00.829637 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4230/8411] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:34:00 2022] PUT /identity/v3/projects/6ef2904fbf9e4666952c7f14bfb45c4e/users/3bf87a4bd94c45fa9b30f01267ec743d/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:34:00.834909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.835194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.835473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.855466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:00.856813 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:00.881567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:00.921216 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4182/8412] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:00.930879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:00.931162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:00.931421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:00.951585 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:00.952812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:01.007144 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4231/8413] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Oct 29 03:34:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:01.013422 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:01.023921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d5269-8dd2-440d-a6c8-23693b56140d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:01.028635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffcfa9-21e7-4ec6-a193-27156fbe9131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:01.029241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffcfa9-21e7-4ec6-a193-27156fbe9131 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:01.029517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffcfa9-21e7-4ec6-a193-27156fbe9131 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:01.029786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffcfa9-21e7-4ec6-a193-27156fbe9131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:01.039830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffcfa9-21e7-4ec6-a193-27156fbe9131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:01.041251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffcfa9-21e7-4ec6-a193-27156fbe9131 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:01.051890 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4183/8414] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:03.802240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:03.803845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:03.889976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:03.928293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df9587-e728-4962-89c8-4d1099f423b4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:03.934578 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:03.935223 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:03.935502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:03.935776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:03.938449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:03.964468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:03.966219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:03.986073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4232/8415] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:05.541294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:05.541793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:05.542594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:05.573218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:05.574803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:05.645689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4184/8416] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:05.650340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:05.661560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ff010-7d5f-426d-bc76-aed909636b85 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:05.666189 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:05.666813 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:05.667202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:05.667611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:05.668247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:05.670188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:05.701497 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4233/8417] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:34:05 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:34:05.705920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:05.718444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a3368-61dd-4761-98b6-29305205744b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:05.788577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:05.789233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:05.789506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:05.789837 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:05.790483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:05.792881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:05.816414 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4185/8418] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:34:05 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:34:05.820316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:05.831173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39c42-44f5-4489-a6e8-9cfa121dfd72 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:05.836089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:05.836700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:05.836960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:05.837227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:05.837903 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:05.839552 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:05.850756 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4234/8419] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:34:05.856243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:05.869190 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689de19e-9e12-455d-a708-ab6dec8fe6ea admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:05.873960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:05.874625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:05.874902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:05.875173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] PATH_INFO: `/v3/projects/410b32e9e82d4885baad09edf6dd1716/users/4f17c102806d4a7198ec640a2c10eba1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:05.893328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=410b32e9e82d4885baad09edf6dd1716, user_id=4f17c102806d4a7198ec640a2c10eba1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:05.896057 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:05.913591 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4186/8420] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:34:05 2022] PUT /identity/v3/projects/410b32e9e82d4885baad09edf6dd1716/users/4f17c102806d4a7198ec640a2c10eba1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:34:05.918977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:05.932978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4b1e9-9914-4be2-8a2a-e4d287503aef admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:06.010162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835654b-54b6-48f8-ad13-1f8005d92eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:06.011006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835654b-54b6-48f8-ad13-1f8005d92eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:06.011353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835654b-54b6-48f8-ad13-1f8005d92eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:06.011757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835654b-54b6-48f8-ad13-1f8005d92eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:06.012638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835654b-54b6-48f8-ad13-1f8005d92eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:06.015556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835654b-54b6-48f8-ad13-1f8005d92eb7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:06.033732 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4235/8421] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:34:06.038968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:06.054384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb012aa-f48c-439b-b18a-914f6182b0fc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:06.061881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:06.062890 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:06.063311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:06.063605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] PATH_INFO: `/v3/projects/410b32e9e82d4885baad09edf6dd1716/users/4f17c102806d4a7198ec640a2c10eba1/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:06.066885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410b32e9e82d4885baad09edf6dd1716, user_id=4f17c102806d4a7198ec640a2c10eba1, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:06.070367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:06.077310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:06.085313 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4187/8422] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:34:06 2022] PUT /identity/v3/projects/410b32e9e82d4885baad09edf6dd1716/users/4f17c102806d4a7198ec640a2c10eba1/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:34:10.447418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:10.447924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:10.448010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:10.476032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] MFA Rules not processed for user `4f17c102806d4a7198ec640a2c10eba1`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:10.477200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:10.553290 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4236/8423] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:10.567808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:10.569759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:10.645444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687bec0-13da-485d-b3c0-dea8cede0493 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:10.649215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780abb0-fc02-4f19-b10a-fd70a81f1280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:10.649893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780abb0-fc02-4f19-b10a-fd70a81f1280 service cinder] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:10.650191 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780abb0-fc02-4f19-b10a-fd70a81f1280 service cinder] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:10.650459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780abb0-fc02-4f19-b10a-fd70a81f1280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:10.659819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780abb0-fc02-4f19-b10a-fd70a81f1280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:10.661253 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780abb0-fc02-4f19-b10a-fd70a81f1280 service cinder] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:10.671333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4188/8424] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:10.761498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:10.773706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23936-e24b-455d-9cbd-56a4d689ea30 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:10.777622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:10.778274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:10.778594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:10.778866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:10.810243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:10.843194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:10.844698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:10.855979 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4237/8425] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:12.391758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:12.392334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:12.392334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:12.413349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:12.414822 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:12.424095 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4189/8426] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:13.196704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:13.285496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fa041-659d-4703-81a7-0d450a41883d service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:13.290698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:13.291314 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:13.291588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:13.291968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:13.293705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:13.308026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:13.309613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657ba66-51ba-467f-9929-128daa7be5e9 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:13.322488 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4238/8427] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:15.710304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:15.728215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57734-aeb4-47c7-b475-b9290438adc6 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:15.736323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:15.737345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:15.737345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:15.737766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:15.739759 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:15.755911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:15.758607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:15.772598 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4190/8428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:23.315470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=46 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:25.767563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:43.768175 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7fad-23c3-4c28-b077-b9ec4b1a827d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:43.768808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7fad-23c3-4c28-b077-b9ec4b1a827d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:43.768808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7fad-23c3-4c28-b077-b9ec4b1a827d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:43.788287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-823a7fad-23c3-4c28-b077-b9ec4b1a827d None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:43.789478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-823a7fad-23c3-4c28-b077-b9ec4b1a827d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:43.797054 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4239/8429] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:34:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:44.087908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:44.090195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:44.176474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5057e73-1d52-4947-bb05-c29dea4906ec service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:44.180927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:44.181528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:44.181827 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:44.182100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:44.184015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:44.197502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:44.198968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:44.209655 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4191/8430] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:44.666297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8d014-ea2f-4495-916c-6b3f1e3e2456 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:44.666750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8d014-ea2f-4495-916c-6b3f1e3e2456 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:44.667121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8d014-ea2f-4495-916c-6b3f1e3e2456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:44.721107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-17b8d014-ea2f-4495-916c-6b3f1e3e2456 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:34:44.722378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17b8d014-ea2f-4495-916c-6b3f1e3e2456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:34:44.731490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4240/8431] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:34:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:34:44.743500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:34:44.758455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204ae40-c003-4e0f-8aef-8f36020d555e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:34:44.763516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:34:44.764117 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:34:44.764395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:34:44.764664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:34:44.773174 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:34:44.774821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:34:44.784815 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4192/8432] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:34:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:34:54.717770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=16 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:34:54.781049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:31.177645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccb21-fc16-475d-b1d5-6e05c0b3ed97 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:35:31.178200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccb21-fc16-475d-b1d5-6e05c0b3ed97 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:35:31.178289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeccb21-fc16-475d-b1d5-6e05c0b3ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:35:31.206059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bbeccb21-fc16-475d-b1d5-6e05c0b3ed97 None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:35:31.207272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbeccb21-fc16-475d-b1d5-6e05c0b3ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:35:31.215745 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4241/8433] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:35:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:35:31.559193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:35:31.569427 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630df3f3-55f2-4a42-9c5e-09c8b331bcda service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:35:31.574091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:35:31.574705 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:35:31.574982 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:35:31.575286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:35:31.577485 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:35:31.592845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:35:31.594426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:35:31.605260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4193/8434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:35:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:35:31.971855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:35:31.972138 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:35:31.972452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:35:31.998844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:35:32.000177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:35:32.010527 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4242/8435] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:35:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:35:32.022748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:35:32.024399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:35:32.042079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521e4b2-7019-4338-9e77-40e17700883d service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:35:32.047493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:35:32.048097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:35:32.048385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:35:32.048655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:35:32.057045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:35:32.058669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:35:32.068402 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4194/8436] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:35:41.988448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:35:42.064425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=12 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:12.503116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:12.504615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:12.600428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef347ac-56fd-4d39-98d2-5b2a944fd37e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:12.608014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:12.609123 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:12.609449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:12.609942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:12.611954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:12.685795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:12.687621 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:12.699283 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4243/8437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:13.508697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:13.518119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afb2a3-268c-4349-b795-26af9e59a57b service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:13.521707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:13.522359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:13.522638 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:13.522914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:13.524634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:13.619690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:13.621137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:13.644285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4195/8438] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:17.018202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:17.036434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3cde-5db0-43a4-a16f-96d079e0f912 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:17.044535 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:17.045571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:17.045885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:17.046163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:17.048301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:17.079038 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:17.082890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:17.118875 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4244/8439] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:20.714833 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:20.716696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:20.737345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f48c2-b8cf-41ad-9c82-7c001b478fc5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:20.742709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:20.743409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:20.743695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:20.743995 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] PATH_INFO: `/v3/users/26167e7cffbe4f3d8e63b6ce0253af66` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:20.745131 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26167e7cffbe4f3d8e63b6ce0253af66)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:20.750321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:20.805601 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26167e7cffbe4f3d8e63b6ce0253af66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:20.818825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26167e7cffbe4f3d8e63b6ce0253af66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:20.819527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26167e7cffbe4f3d8e63b6ce0253af66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:20.826806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26167e7cffbe4f3d8e63b6ce0253af66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:20.827447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26167e7cffbe4f3d8e63b6ce0253af66'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:20.842790 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4196/8440] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:36:20 2022] DELETE /identity/v3/users/26167e7cffbe4f3d8e63b6ce0253af66 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:21.044419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:21.058286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8d38-4e7e-4319-b79c-959bcb75f7ad service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:21.131685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:21.134305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.134305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.134305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] PATH_INFO: `/v3/projects/b0e257e24d9845b187462412cbd149cf` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.134305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0e257e24d9845b187462412cbd149cf)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:21.136176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:21.173029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:21.191269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0e257e24d9845b187462412cbd149cf', 'request_id': 'req-7ddfb5af-3ad6-4852-90ba-ec10a798293e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.197980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0e257e24d9845b187462412cbd149cf', 'request_id': 'req-7ddfb5af-3ad6-4852-90ba-ec10a798293e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.205230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0e257e24d9845b187462412cbd149cf', 'request_id': 'req-7ddfb5af-3ad6-4852-90ba-ec10a798293e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.218557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] The token cache is being invalidate because project b0e257e24d9845b187462412cbd149cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:36:21.218936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.219722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.221297 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4245/8441] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:36:21 2022] DELETE /identity/v3/projects/b0e257e24d9845b187462412cbd149cf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:21.225319 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:21.226816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:21.243008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01752a5a-894f-4ffa-807a-5b421968831e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:21.278605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:21.306768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:21.307435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.307848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.308127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] PATH_INFO: `/v3/users/49e787a15b7741a4a4d91cca538427d3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.309323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49e787a15b7741a4a4d91cca538427d3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:21.311326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:21.363628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49e787a15b7741a4a4d91cca538427d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.377658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49e787a15b7741a4a4d91cca538427d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.378517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49e787a15b7741a4a4d91cca538427d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.385665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49e787a15b7741a4a4d91cca538427d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.386440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5531ae68-3afb-46c2-815f-37cc557d7897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49e787a15b7741a4a4d91cca538427d3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.403161 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4197/8442] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:36:21 2022] DELETE /identity/v3/users/49e787a15b7741a4a4d91cca538427d3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:21.589394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:21.591072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:21.605900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfb5af-3ad6-4852-90ba-ec10a798293e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:21.679213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:21.679851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.680150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.680427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] PATH_INFO: `/v3/projects/3ff01a56891a4c13a37b7c1e2df3b626` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.681624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff01a56891a4c13a37b7c1e2df3b626)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:21.683602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:21.734892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff01a56891a4c13a37b7c1e2df3b626', 'request_id': 'req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.741741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff01a56891a4c13a37b7c1e2df3b626', 'request_id': 'req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.747704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff01a56891a4c13a37b7c1e2df3b626', 'request_id': 'req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.763828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] The token cache is being invalidate because project 3ff01a56891a4c13a37b7c1e2df3b626 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:36:21.764190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.764969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5d0e7b88-44c9-4788-93cb-d0ed6b2cf3a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:36:21.766766 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4246/8443] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:36:21 2022] DELETE /identity/v3/projects/3ff01a56891a4c13a37b7c1e2df3b626 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:21.772075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.772561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.772669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.827309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:21.828748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:21.892314 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4198/8444] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:21.900859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.901136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.901401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.922765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:21.924048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:21.932059 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4247/8445] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:21.936614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:21.946922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ec6c6-94de-4b57-91f3-8ff2a449146b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:21.951586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:21.952210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.952486 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.952757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.953512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:36:21.953831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:21.955455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:21.969104 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4199/8446] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:36:21.973478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:21.983106 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9acf93-13e3-4517-9b30-b88e57e97248 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:21.988297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:21.988875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:21.989152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:21.989418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:21.990424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:21.992338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:22.033734 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4248/8447] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:36:21 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:36:22.038173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:22.049224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8015de-23ef-4915-87b8-08aa9c5eeafe admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:22.070634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:22.112296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:22.112920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:22.113195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:22.113588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:22.114329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:22.116541 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:22.141462 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4200/8448] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:36:22 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:36:22.145880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:22.157532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2f2ed-f682-489e-9e83-c47eb6f8159c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:22.162830 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:22.163476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:22.163754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:22.164025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:22.164682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:22.166369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:22.167919 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:22.180125 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4249/8449] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:36:22.184353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:22.195647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39572ed-1345-45da-8ba5-1937f128b2f4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:22.200433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52c818-5355-4b0a-a308-dcab2c85d930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:22.201041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c818-5355-4b0a-a308-dcab2c85d930 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:22.201325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c818-5355-4b0a-a308-dcab2c85d930 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:22.201602 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52c818-5355-4b0a-a308-dcab2c85d930 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:22.202293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52c818-5355-4b0a-a308-dcab2c85d930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:22.204058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52c818-5355-4b0a-a308-dcab2c85d930 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:22.218943 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4201/8450] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:36:22.220239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:22.231163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c69009-0d45-42e8-98b0-0300b2407e73 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:22.238747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:22.239514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:22.240114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:22.240394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] PATH_INFO: `/v3/projects/6fe94d16651549bc8acbecea08763068/users/17b7ba02d4ff4ab3bfb1f4c8ba46b82c/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:22.256321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fe94d16651549bc8acbecea08763068, user_id=17b7ba02d4ff4ab3bfb1f4c8ba46b82c, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:22.259064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:22.274613 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4250/8451] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:36:22 2022] PUT /identity/v3/projects/6fe94d16651549bc8acbecea08763068/users/17b7ba02d4ff4ab3bfb1f4c8ba46b82c/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:22.280127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1320-9cb4-4e1b-ae4b-bd9e8f29d1c8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:22.280432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1320-9cb4-4e1b-ae4b-bd9e8f29d1c8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:22.280685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f1320-9cb4-4e1b-ae4b-bd9e8f29d1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:22.301586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a58f1320-9cb4-4e1b-ae4b-bd9e8f29d1c8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:22.302943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a58f1320-9cb4-4e1b-ae4b-bd9e8f29d1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:22.364622 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4202/8452] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:22.375361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:22.377271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:22.448519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17dce-17e3-43f6-9271-0b82d7f60ed7 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:22.453324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:22.453991 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:22.454305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:22.454611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:22.464885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:22.466604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:22.476985 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4251/8453] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:26.957194 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:26.957753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:26.958069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.017327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] MFA Rules not processed for user `17b7ba02d4ff4ab3bfb1f4c8ba46b82c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:27.018599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:27.139092 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4203/8454] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:27.143935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:27.154788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b233f-c862-44ec-a135-9485ce4d3bf8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:27.160243 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:27.161024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:27.161297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:27.161569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.162550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:27.165191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:27.225313 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4252/8455] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:36:27 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:36:27.229408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:27.263416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9ab72-318d-4e39-bb64-d4e414609ef2 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:27.306251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:27.341929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:27.342617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:27.342899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:27.343249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.343999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:27.346187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:27.375521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4204/8456] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:36:27 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:36:27.377004 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:27.390969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa94c9-6cc1-4deb-a2b5-05b9d590da04 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:27.396131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:27.396767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:27.397048 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:27.397325 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.398036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:27.399848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:27.411708 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4253/8457] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:36:27.416041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:27.427385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369d0a-b2c1-4583-b113-bbafd2d697e0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:27.432263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:27.432944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:27.433235 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:27.433510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] PATH_INFO: `/v3/projects/d22b116efcf74cfaa4f1679b3d771106/users/5a1209d131484e9eaba0d6e63b0efd42/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.457085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22b116efcf74cfaa4f1679b3d771106, user_id=5a1209d131484e9eaba0d6e63b0efd42, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:27.459861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:27.476684 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4205/8458] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:36:27 2022] PUT /identity/v3/projects/d22b116efcf74cfaa4f1679b3d771106/users/5a1209d131484e9eaba0d6e63b0efd42/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:27.480688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:27.491790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c11cf8-d61b-4dda-ace5-10dfe16a69ac admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:27.563575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8a610-18dd-497d-b65c-c2ca9b79740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:27.564230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8a610-18dd-497d-b65c-c2ca9b79740e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:27.564493 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8a610-18dd-497d-b65c-c2ca9b79740e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:27.564760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8a610-18dd-497d-b65c-c2ca9b79740e admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.565422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8a610-18dd-497d-b65c-c2ca9b79740e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:27.567129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8a610-18dd-497d-b65c-c2ca9b79740e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:27.583491 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4254/8459] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:36:27.584872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:27.596832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc239a-8baf-4109-84e2-5ede6fa33d31 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:27.601904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:27.602620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:27.603075 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:27.603349 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] PATH_INFO: `/v3/projects/d22b116efcf74cfaa4f1679b3d771106/users/5a1209d131484e9eaba0d6e63b0efd42/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:27.605423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d22b116efcf74cfaa4f1679b3d771106, user_id=5a1209d131484e9eaba0d6e63b0efd42, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:27.608208 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:27.621065 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4206/8460] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:36:27 2022] PUT /identity/v3/projects/d22b116efcf74cfaa4f1679b3d771106/users/5a1209d131484e9eaba0d6e63b0efd42/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:36:32.708860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73aab-d01c-438c-b8e6-a9e396451e4d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:32.709479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73aab-d01c-438c-b8e6-a9e396451e4d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:32.709479 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f73aab-d01c-438c-b8e6-a9e396451e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:32.754103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b6f73aab-d01c-438c-b8e6-a9e396451e4d None None] MFA Rules not processed for user `5a1209d131484e9eaba0d6e63b0efd42`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:32.755851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b6f73aab-d01c-438c-b8e6-a9e396451e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:32.792900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:32.861730 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4255/8461] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:32.887115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:32.889000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:32.987621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361666e-6f41-4852-a6e2-006aadc9aac0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:32.995000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105516d5-bbf4-4356-9cf1-04d9703b2a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:32.995622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105516d5-bbf4-4356-9cf1-04d9703b2a6a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:32.995947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105516d5-bbf4-4356-9cf1-04d9703b2a6a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:32.996285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105516d5-bbf4-4356-9cf1-04d9703b2a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:33.006330 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105516d5-bbf4-4356-9cf1-04d9703b2a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:33.008523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105516d5-bbf4-4356-9cf1-04d9703b2a6a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:33.024509 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4207/8462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:33.079470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9657a5-4f75-4822-8aab-d63b57a0a5d2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:33.079898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9657a5-4f75-4822-8aab-d63b57a0a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:33.080279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9657a5-4f75-4822-8aab-d63b57a0a5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:33.100132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c9657a5-4f75-4822-8aab-d63b57a0a5d2 None None] MFA Rules not processed for user `17b7ba02d4ff4ab3bfb1f4c8ba46b82c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:33.101912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c9657a5-4f75-4822-8aab-d63b57a0a5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:33.166067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4256/8463] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:34.712632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:34.713188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:34.713276 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:34.732963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:34.734294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:34.800113 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4208/8464] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:43.157873 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=42 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:44.792819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:36:45.377480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:45.378137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:45.378137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:45.399869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] MFA Rules not processed for user `17b7ba02d4ff4ab3bfb1f4c8ba46b82c`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:45.401168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:45.409564 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4257/8465] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:51.435224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:51.436881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:51.498096 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c45ad-a560-47b0-8206-1ecf5a8d7d12 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:51.502391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:51.503005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:51.503278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:51.503546 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:51.505405 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:51.542192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:51.543720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ddc7c-7e66-4e74-b639-538eae4012b9 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:51.570267 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4209/8466] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:52.868770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:52.880045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503c0d5-05c9-45b0-8f5c-e5a54746c446 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:52.884301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:52.885008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:52.885356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:52.885633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:52.887655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:52.905168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:52.907356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df679d06-206a-4d00-a88d-e936b486a67f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:52.922474 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4258/8467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:36:55.156810 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:55.157326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:55.157326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:55.210171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:55.211497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:55.292035 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4210/8468] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:36:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:55.344145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a1e58-62e4-4931-aa05-51b46758c990 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:55.344653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a1e58-62e4-4931-aa05-51b46758c990 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:55.344821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a1e58-62e4-4931-aa05-51b46758c990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:55.395322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a55a1e58-62e4-4931-aa05-51b46758c990 None None] MFA Rules not processed for user `5f8edd4b12d54ce39915d2e9831b3d88`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:55.397230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a55a1e58-62e4-4931-aa05-51b46758c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:55.460960 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4259/8469] 10.222.0.16 () {58 vars in 1040 bytes} [Sat Oct 29 03:36:55 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:55.467446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:55.480626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22630443-cdfc-4033-aa8e-101ae1d280c3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:55.487081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:55.487731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:55.488009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:55.488291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:55.498399 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:55.500236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:55.509577 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4211/8470] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:36:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:36:56.806716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:56.807295 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:56.807514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:56.827368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:36:56.828767 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:56.836592 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4260/8471] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:36:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:36:59.893722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:36:59.908642 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c455ac-cea5-44de-ac09-9ce72b087d17 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:36:59.915975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:36:59.916734 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:36:59.917079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:36:59.917421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:36:59.919414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:36:59.934719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:36:59.936391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:36:59.949612 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4212/8472] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:36:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:37:06.822297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=47 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:08.628622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:37:08.630989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:37:08.730195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d96e72-d6d1-460d-8294-a68d16dfb27a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:37:08.736667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:37:08.737386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:08.737735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:08.738179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:08.741448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:37:08.761137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:37:08.762901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:37:08.779191 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4261/8473] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:37:09.942176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:12.711474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:37:12.803731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c9ca0-0c9e-4455-acf7-4c292e2c9443 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:37:12.808980 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:37:12.809690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:12.810021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:12.810296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] PATH_INFO: `/v3/users/17b7ba02d4ff4ab3bfb1f4c8ba46b82c` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:12.811628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b7ba02d4ff4ab3bfb1f4c8ba46b82c)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:37:12.814021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:37:12.871606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b7ba02d4ff4ab3bfb1f4c8ba46b82c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:12.894720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b7ba02d4ff4ab3bfb1f4c8ba46b82c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:12.895682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b7ba02d4ff4ab3bfb1f4c8ba46b82c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:12.904446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b7ba02d4ff4ab3bfb1f4c8ba46b82c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:12.905249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b7ba02d4ff4ab3bfb1f4c8ba46b82c'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:12.922319 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4213/8474] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:37:12 2022] DELETE /identity/v3/users/17b7ba02d4ff4ab3bfb1f4c8ba46b82c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:37:13.136680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:37:13.158410 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30bafdb-c46b-4431-852b-e9811f0aba97 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:37:13.235650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:37:13.236324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:13.236609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:13.236878 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] PATH_INFO: `/v3/projects/6fe94d16651549bc8acbecea08763068` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:13.238072 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fe94d16651549bc8acbecea08763068)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:37:13.240488 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:37:13.293420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fe94d16651549bc8acbecea08763068', 'request_id': 'req-3db00e5d-3189-48a7-a618-5731c59655a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.299930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fe94d16651549bc8acbecea08763068', 'request_id': 'req-3db00e5d-3189-48a7-a618-5731c59655a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.305486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fe94d16651549bc8acbecea08763068', 'request_id': 'req-3db00e5d-3189-48a7-a618-5731c59655a1'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.319471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] The token cache is being invalidate because project 6fe94d16651549bc8acbecea08763068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:37:13.319757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.320392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.321971 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4262/8475] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:37:13 2022] DELETE /identity/v3/projects/6fe94d16651549bc8acbecea08763068 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:37:13.326069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:37:13.327747 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:37:13.341216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b8506-245a-4b89-98f8-935e1aade38e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:37:13.406177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:37:13.406765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:13.407098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:13.407377 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] PATH_INFO: `/v3/users/5a1209d131484e9eaba0d6e63b0efd42` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:13.408816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1209d131484e9eaba0d6e63b0efd42)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:37:13.411020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:37:13.579651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:13.606374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1209d131484e9eaba0d6e63b0efd42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.619483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1209d131484e9eaba0d6e63b0efd42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.620246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1209d131484e9eaba0d6e63b0efd42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.627474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1209d131484e9eaba0d6e63b0efd42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.628121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-57821fb6-8da3-4f68-957c-d4884e368067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1209d131484e9eaba0d6e63b0efd42'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.646750 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4214/8476] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:37:13 2022] DELETE /identity/v3/users/5a1209d131484e9eaba0d6e63b0efd42 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:37:13.835047 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:37:13.837185 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:37:13.851229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db00e5d-3189-48a7-a618-5731c59655a1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:37:13.872527 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:13.915670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:37:13.916310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:13.916611 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:13.916879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] PATH_INFO: `/v3/projects/d22b116efcf74cfaa4f1679b3d771106` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:13.918039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d22b116efcf74cfaa4f1679b3d771106)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:37:13.919954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:37:13.969238 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd22b116efcf74cfaa4f1679b3d771106', 'request_id': 'req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.976062 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd22b116efcf74cfaa4f1679b3d771106', 'request_id': 'req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.982463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd22b116efcf74cfaa4f1679b3d771106', 'request_id': 'req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.998231 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] The token cache is being invalidate because project d22b116efcf74cfaa4f1679b3d771106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:37:13.998682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:13.999539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:37:14.001424 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4263/8477] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:37:13 2022] DELETE /identity/v3/projects/d22b116efcf74cfaa4f1679b3d771106 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:37:23.642448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:23.995064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:49.386314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f00ad-b9fd-4e75-9b40-10fbfde20ded None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:49.386819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f00ad-b9fd-4e75-9b40-10fbfde20ded None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:49.386912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f00ad-b9fd-4e75-9b40-10fbfde20ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:49.407585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-495f00ad-b9fd-4e75-9b40-10fbfde20ded None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:37:49.408829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-495f00ad-b9fd-4e75-9b40-10fbfde20ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:37:49.466868 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4215/8478] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 03:37:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:37:49.479825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:37:49.481433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:37:49.577008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df71f8-1fc4-4dc0-9c95-6acccbe8a86d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:37:49.583960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:37:49.584894 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:37:49.585266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:37:49.585633 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:37:49.598789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:37:49.600401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:37:49.608949 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4264/8479] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:37:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:37:59.459979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:37:59.605553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=41 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:06.304843 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:38:06.305438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:38:06.305438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:38:06.325279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:38:06.326555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:38:06.385098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4216/8480] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:38:16.377408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=25 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:38:23.027642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:38:23.029278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:38:23.112755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d0d7a-24b7-456f-8ec3-e5ae3c6b8826 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:38:23.119326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:38:23.119968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:38:23.120241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:38:23.120511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:38:23.122439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:38:23.137687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:38:23.139536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:38:23.153368 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4265/8481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:38:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:38:33.146083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=34 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:39:06.822998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:39:06.824697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:39:06.909831 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336ec09-5486-4d7e-a55d-f837e3c85074 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:39:06.915400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:39:06.916019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:39:06.916297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:39:06.916565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:39:06.918679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:39:06.934047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:39:06.935652 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:39:06.948282 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4217/8482] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:39:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:39:16.941466 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=36 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:39:21.767708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:39:21.783674 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e443bf-bfde-4e3f-bccf-7b0888ed2a0c service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:39:21.790328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:39:21.790975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:39:21.791244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:39:21.791512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:39:21.793618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:39:21.809462 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:39:21.811077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:39:21.823829 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4266/8483] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:39:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:39:31.817193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:24.710298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:40:24.712069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:24.730416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d9e8-6677-442a-9d26-18c0accdb688 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:40:24.736893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:40:24.737487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:24.737764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:24.738066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:24.740339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:24.751441 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:40:24.753017 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67a6d7-ad52-4b63-9ef3-d9ad0b4fce5f service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:40:24.762286 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4218/8484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:40:27.452033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:40:27.473411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68692a9c-8d09-4ac2-9d08-3cbd75718b13 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:40:27.480425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:40:27.481475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:27.481942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:27.482308 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:27.490016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:27.507755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:40:27.509501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:40:27.526898 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4267/8485] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:40:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:40:32.919811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:32.920354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:32.920354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:32.940430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:40:32.941648 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:32.950019 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4219/8486] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:40:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:40:33.275160 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:40:33.277439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:33.336888 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995124d-5991-490d-9df4-48bdc26731f9 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:40:33.341387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:40:33.342050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:33.342328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:33.342580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:33.344796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:33.357900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:40:33.359303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:40:33.370436 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4268/8487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:40:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:40:33.869946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:40:33.871471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:33.890694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5921dad-b9e4-42ac-bda3-4a2dfc1d3dd9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:40:33.896358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:40:33.897064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:33.897389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:33.898112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:33.899532 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:33.911861 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:40:33.913433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:40:33.925860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4220/8488] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:40:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:40:43.364477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=32 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:43.921587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=15 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:40:52.109867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:40:52.123704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecf600-584d-4a82-8a7a-1f3ae4d8c9c4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:40:52.130926 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:40:52.131701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:52.132029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:52.132375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:52.135366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:52.207240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:40:52.208721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be175e34-f5c2-4df4-a21c-f9e520fa7f08 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:40:52.219647 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4269/8489] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:40:53.858877 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:40:53.874567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd6ccfe-8521-450f-88fa-8b7dd337ba35 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:40:53.880312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:40:53.880920 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:40:53.881182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:40:53.881455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:40:53.883256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:40:53.897959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:40:53.899533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:40:53.912715 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4221/8490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:40:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:41:02.214524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=30 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:03.905626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:23.698655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0c2c-943b-45e7-b4da-241118fc9dbd None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:41:23.699258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0c2c-943b-45e7-b4da-241118fc9dbd None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:41:23.699258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b0c2c-943b-45e7-b4da-241118fc9dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:41:23.729684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-0f3b0c2c-943b-45e7-b4da-241118fc9dbd None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:41:23.730910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-0f3b0c2c-943b-45e7-b4da-241118fc9dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:41:23.744979 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4270/8491] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Oct 29 03:41:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:41:23.758132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:41:23.772239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514bffd-097d-4f2a-961e-c659ffbed631 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:41:23.778567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0beb6fa-ac82-413d-be52-401d5ec6dd90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:41:23.779169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb6fa-ac82-413d-be52-401d5ec6dd90 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:41:23.779439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb6fa-ac82-413d-be52-401d5ec6dd90 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:41:23.779703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0beb6fa-ac82-413d-be52-401d5ec6dd90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:41:23.788411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb6fa-ac82-413d-be52-401d5ec6dd90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:41:23.790011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0beb6fa-ac82-413d-be52-401d5ec6dd90 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:41:23.799540 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4222/8492] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:41:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:41:33.722791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:41:33.795580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:09.821678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:09.822328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:09.822328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:09.844545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:42:09.845760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:09.856120 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4271/8493] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 29 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:42:09.872110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:09.872566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:09.872661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:09.893826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:42:09.895074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:09.905521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4223/8494] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:42:09.911713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:09.922843 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7afe0-97ea-4261-9c5e-58b7e5ae8e08 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:09.928469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c893f9c7-032e-4a32-b38c-93d54fa098fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:09.929068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893f9c7-032e-4a32-b38c-93d54fa098fa service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:09.929344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893f9c7-032e-4a32-b38c-93d54fa098fa service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:09.929612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c893f9c7-032e-4a32-b38c-93d54fa098fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:09.938743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893f9c7-032e-4a32-b38c-93d54fa098fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:09.940338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c893f9c7-032e-4a32-b38c-93d54fa098fa service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:09.950602 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4272/8495] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:42:12.410123 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:12.411775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:12.424300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16d887-2024-40df-9d4a-ed6cc8df317f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:12.428374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:12.429012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:12.429290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:12.429561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:12.431605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:12.444293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:12.445825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bce87-d984-4819-9408-ff3701b54bb4 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:12.456991 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4224/8496] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:42:19.946466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=9 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:22.450553 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:32.470347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:32.470951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:32.470951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:32.491519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] MFA Rules not processed for user `3bf87a4bd94c45fa9b30f01267ec743d`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:42:32.492916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:32.501764 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4273/8497] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:42:32.558112 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324366-b4a2-4987-8337-7e2c472125da None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:32.558632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324366-b4a2-4987-8337-7e2c472125da None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:32.558632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97324366-b4a2-4987-8337-7e2c472125da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:32.598322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-97324366-b4a2-4987-8337-7e2c472125da None None] MFA Rules not processed for user `8e709a640a524fd0a3e272d397c75e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:42:32.599479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-97324366-b4a2-4987-8337-7e2c472125da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:32.662463 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4225/8498] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Oct 29 03:42:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:42:32.668945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:32.680458 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23d6e-b511-4c5b-8b39-ce2fce6c73a1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:32.686093 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:32.686704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:32.686941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:32.687246 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:32.689472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:32.707248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:32.708686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673a1df-b70f-45ec-8d9c-c95eb76e9b1a service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:32.722680 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4274/8499] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:42:33.024694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324366-b4a2-4987-8337-7e2c472125da None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:33.034537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97324366-b4a2-4987-8337-7e2c472125da None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:33.038455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:33.039060 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:33.039335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:33.039603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:33.041408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:33.054142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:33.055573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:33.067098 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4226/8500] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:42:33.552227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:33.552755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:33.552755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:33.572525 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:33.574317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:42:33.575584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:33.581961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb117030-3f2d-4a1e-a24d-011bb343fa46 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:33.584493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4275/8501] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 03:42:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:42:33.585713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:33.586355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:33.586632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:33.586959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:33.588761 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:33.590631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:33.600368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715354c9-997e-4e2c-ae6b-bc52f2ffded2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:33.605425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:33.605570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:33.606069 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:33.606344 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:33.606610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:33.606879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:33.608387 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:33.620791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:33.621487 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4227/8502] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:42:33.622411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01824fb1-7e28-4be1-847d-22f99a0b60b1 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:33.632942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4276/8503] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:42:35.543028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:42:35.552977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0678cad-8362-4760-abbd-34f924d042ab service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:42:35.557216 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:42:35.558042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:42:35.558539 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:42:35.559031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:42:35.561389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:42:35.576962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:42:35.578773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:42:35.591260 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4228/8504] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:42:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:42:43.628571 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=18 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:42:45.584584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=51 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:11.460728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb24c6-e24a-47fc-a4ff-f8bfe0fa6fc1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:11.461386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb24c6-e24a-47fc-a4ff-f8bfe0fa6fc1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:11.461386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb24c6-e24a-47fc-a4ff-f8bfe0fa6fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:11.522388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-fffb24c6-e24a-47fc-a4ff-f8bfe0fa6fc1 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:11.523613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fffb24c6-e24a-47fc-a4ff-f8bfe0fa6fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:11.551784 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4277/8505] 10.222.0.50 () {58 vars in 1015 bytes} [Sat Oct 29 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:11.565520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:11.585533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4583e1-925a-4a0a-b40f-46184c563e5a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:11.589724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:11.590383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:11.590658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:11.590952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:11.598612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:11.600040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:11.608211 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4229/8506] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:44:12.379379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570935-9ab3-40c5-9250-8a5c1c2f6110 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:12.379668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570935-9ab3-40c5-9250-8a5c1c2f6110 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:12.379910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5570935-9ab3-40c5-9250-8a5c1c2f6110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:12.405497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d5570935-9ab3-40c5-9250-8a5c1c2f6110 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:12.406771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d5570935-9ab3-40c5-9250-8a5c1c2f6110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:12.414624 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4278/8507] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Oct 29 03:44:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:12.427909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:12.437188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0f9b3-b886-4c8e-9211-0b09a484dfa1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:12.441966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925690d-1742-4eeb-9794-90372004dffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:12.442751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925690d-1742-4eeb-9794-90372004dffc service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:12.443138 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925690d-1742-4eeb-9794-90372004dffc service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:12.443511 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925690d-1742-4eeb-9794-90372004dffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:12.452304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925690d-1742-4eeb-9794-90372004dffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:12.453773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925690d-1742-4eeb-9794-90372004dffc service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:12.462432 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4230/8508] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:44:22.400201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=29 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:22.458376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=17 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:33.421643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:33.421643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:33.422133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:33.471247 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:33.472478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:33.506266 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4279/8509] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:33.533110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567600fb-beb3-406c-92fb-02b86ff981d8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:33.534361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567600fb-beb3-406c-92fb-02b86ff981d8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:33.534839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567600fb-beb3-406c-92fb-02b86ff981d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:33.560766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-567600fb-beb3-406c-92fb-02b86ff981d8 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:33.562320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-567600fb-beb3-406c-92fb-02b86ff981d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:33.572549 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4231/8510] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:33.579394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:33.592098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35890e43-de97-4cd0-9c6b-840466e1bf6d None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:33.600259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b5234-df0f-4682-9abb-0545096a17f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:33.600955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b5234-df0f-4682-9abb-0545096a17f4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:33.601159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b5234-df0f-4682-9abb-0545096a17f4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:33.601425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b5234-df0f-4682-9abb-0545096a17f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:33.611324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b5234-df0f-4682-9abb-0545096a17f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:33.612931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b5234-df0f-4682-9abb-0545096a17f4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:33.625953 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4280/8511] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:44:33.640954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:33.641492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:33.641951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:33.666386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:33.667621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:33.677224 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4232/8512] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Oct 29 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:33.683407 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091400ec-5e0e-48bd-9f17-2c4a8f894711 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:33.683717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091400ec-5e0e-48bd-9f17-2c4a8f894711 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:33.683996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091400ec-5e0e-48bd-9f17-2c4a8f894711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:33.707592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-091400ec-5e0e-48bd-9f17-2c4a8f894711 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:33.708829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-091400ec-5e0e-48bd-9f17-2c4a8f894711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:33.720365 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4281/8513] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:33.732839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:33.743326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db0bc5-54be-4ead-972e-5aef013b5dda None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:33.747301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:33.747924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:33.748195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:33.748458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:33.760076 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:33.761568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:33.774241 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4233/8514] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:44:34.956690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8ab7d-ca26-4433-9a07-8e53be844154 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:34.957274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8ab7d-ca26-4433-9a07-8e53be844154 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:34.957378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8ab7d-ca26-4433-9a07-8e53be844154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:34.978347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-92a8ab7d-ca26-4433-9a07-8e53be844154 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:34.979575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-92a8ab7d-ca26-4433-9a07-8e53be844154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:34.989598 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4282/8515] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:35.003268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:35.012490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2e1b-0c25-46e7-bc77-38def7a48666 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:35.016968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:35.017576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:35.017963 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:35.018334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:35.030967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:35.032398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:35.043980 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4234/8516] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:44:44.973090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=30 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:45.038508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=18 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:44:50.447880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:50.448414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:50.448508 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:50.484796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:44:50.487181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:50.500693 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4283/8517] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:44:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:44:50.513045 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:50.523938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c9208-924a-49fb-91ae-ed8c27b03dc8 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:50.529840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:50.530452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:50.530724 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:50.530993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:50.539983 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:50.541580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:50.554055 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4235/8518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:44:59.171198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:44:59.190921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdaf2eb-d3aa-44b8-a5fe-357c6081f7e2 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:44:59.194808 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:44:59.195420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:44:59.195700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:44:59.195986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:44:59.197723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:44:59.264622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:44:59.266142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:44:59.276169 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4284/8519] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:00.548005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:02.515549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:02.528124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3df2-cfee-4d9d-852c-81fff637e88e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:02.534469 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:02.535093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:02.535378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:02.535697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:02.537777 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:02.570281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:02.571875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:02.585628 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4236/8520] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:05.528541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:05.541825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea93492-48b7-452d-836c-a812b90ae9fc service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:05.552742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:05.561568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:05.562077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:05.562854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:05.564880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:05.582825 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:05.585576 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:05.602485 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4285/8521] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:05.606619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:05.608619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:05.624423 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893ee5-05ef-40a9-9223-3201818b1ae2 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:05.631897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:05.632545 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:05.632819 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:05.633084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] PATH_INFO: `/v3/users/3bf87a4bd94c45fa9b30f01267ec743d` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:05.647575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf87a4bd94c45fa9b30f01267ec743d)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:05.649619 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:05.698739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf87a4bd94c45fa9b30f01267ec743d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:05.711576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf87a4bd94c45fa9b30f01267ec743d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:05.712270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf87a4bd94c45fa9b30f01267ec743d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:05.720079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf87a4bd94c45fa9b30f01267ec743d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:05.720782 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf87a4bd94c45fa9b30f01267ec743d'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:05.745914 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4237/8522] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:45:05 2022] DELETE /identity/v3/users/3bf87a4bd94c45fa9b30f01267ec743d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:05.932707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:05.944242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421d5b4-ef97-4422-b1c6-c44128a2abce service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:06.004754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:06.005388 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:06.005665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:06.005972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] PATH_INFO: `/v3/projects/6ef2904fbf9e4666952c7f14bfb45c4e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:06.017427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef2904fbf9e4666952c7f14bfb45c4e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:06.019401 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:06.069423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef2904fbf9e4666952c7f14bfb45c4e', 'request_id': 'req-08f209d4-00c4-4a32-b41b-da380618dc0e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.070466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:06.078321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef2904fbf9e4666952c7f14bfb45c4e', 'request_id': 'req-08f209d4-00c4-4a32-b41b-da380618dc0e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.084296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef2904fbf9e4666952c7f14bfb45c4e', 'request_id': 'req-08f209d4-00c4-4a32-b41b-da380618dc0e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.097009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] The token cache is being invalidate because project 6ef2904fbf9e4666952c7f14bfb45c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:45:06.097299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.097958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.099510 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4286/8523] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:45:05 2022] DELETE /identity/v3/projects/6ef2904fbf9e4666952c7f14bfb45c4e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:06.103625 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:06.105528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:06.120308 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b7ea-2a86-484a-823f-76895c9e34e6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:06.180753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:06.181392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:06.181664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:06.181968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] PATH_INFO: `/v3/users/4f17c102806d4a7198ec640a2c10eba1` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:06.196855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f17c102806d4a7198ec640a2c10eba1)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:06.198909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:06.227765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:06.249715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f17c102806d4a7198ec640a2c10eba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.261233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f17c102806d4a7198ec640a2c10eba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.261938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f17c102806d4a7198ec640a2c10eba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.268924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f17c102806d4a7198ec640a2c10eba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.269632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-12af1fa5-ac12-4c07-a345-fa6ab83408d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f17c102806d4a7198ec640a2c10eba1'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.284101 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4238/8524] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:45:06 2022] DELETE /identity/v3/users/4f17c102806d4a7198ec640a2c10eba1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:06.463510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:06.465032 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:06.480445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f209d4-00c4-4a32-b41b-da380618dc0e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:06.541969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:06.542675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:06.543001 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:06.543404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] PATH_INFO: `/v3/projects/410b32e9e82d4885baad09edf6dd1716` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:06.558070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410b32e9e82d4885baad09edf6dd1716)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:06.558070 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:06.606995 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410b32e9e82d4885baad09edf6dd1716', 'request_id': 'req-64a82873-39f2-4b6e-b675-589a451bd1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.614237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410b32e9e82d4885baad09edf6dd1716', 'request_id': 'req-64a82873-39f2-4b6e-b675-589a451bd1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.620016 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410b32e9e82d4885baad09edf6dd1716', 'request_id': 'req-64a82873-39f2-4b6e-b675-589a451bd1c5'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.633945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] The token cache is being invalidate because project 410b32e9e82d4885baad09edf6dd1716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:45:06.634230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.634854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-64a82873-39f2-4b6e-b675-589a451bd1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:06.636344 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4287/8525] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:45:06 2022] DELETE /identity/v3/projects/410b32e9e82d4885baad09edf6dd1716 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:16.280699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=19,keystone:DELETE=5,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:16.534365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.534664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.534999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.560797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:16.562092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:16.627342 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4239/8526] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:16.630824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:16.639114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.639409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.639695 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.661675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:16.662953 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:16.672294 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4288/8527] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:16.677384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:16.688164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e300cd-5f19-434d-871b-df4d1a3f4424 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:16.693676 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:16.695401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.695689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.695964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.696635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:45:16.696939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:16.698614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:16.711409 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4240/8528] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:45:16.734124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:16.744818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e4077-ceb5-4738-8b27-090b2c86ace1 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:16.750242 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:16.750869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.751182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.751463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.752098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:16.754090 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:16.784490 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4289/8529] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:45:16 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:45:16.788869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:16.799355 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b231ca5-c7a5-4cb6-9d72-b591e24c68b7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:16.857490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:16.858103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.858380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.858649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.859260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:16.861169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:16.885347 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4241/8530] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:45:16 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:45:16.890215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:16.902543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19df0e-fc2a-42d5-8fff-b9729e3a7be1 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:16.907457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:16.908066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.908339 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.908610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.909255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:16.910916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:16.921038 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4290/8531] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:45:16.925839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:16.942097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d842aff-5cc0-4a8d-8536-5ae0656e64a7 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:16.950687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6684447-8bf1-41cd-a02c-5ba84c8325ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:16.951291 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684447-8bf1-41cd-a02c-5ba84c8325ed admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.951566 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684447-8bf1-41cd-a02c-5ba84c8325ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.951832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6684447-8bf1-41cd-a02c-5ba84c8325ed admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:16.952494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6684447-8bf1-41cd-a02c-5ba84c8325ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:16.954127 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6684447-8bf1-41cd-a02c-5ba84c8325ed admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:16.969347 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4242/8532] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:45:16.973898 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:16.984741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb105b-254d-4bff-afd5-5b14888f5ea6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:16.990657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:16.991361 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:16.991667 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:16.991971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] PATH_INFO: `/v3/projects/99bff39e69ff4791927279f6b5941930/users/740c8eda8ebe40ccaadc1fd0137f941e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.008316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bff39e69ff4791927279f6b5941930, user_id=740c8eda8ebe40ccaadc1fd0137f941e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.011082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.026029 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4291/8533] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:45:16 2022] PUT /identity/v3/projects/99bff39e69ff4791927279f6b5941930/users/740c8eda8ebe40ccaadc1fd0137f941e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:17.038250 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.038534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.038802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.067417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] MFA Rules not processed for user `740c8eda8ebe40ccaadc1fd0137f941e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:17.068633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:17.127082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:17.139746 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4243/8534] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:17.141286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.204679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a3e8a-b246-422c-a9c4-094a93c203da admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.210049 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.210651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.210929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.211193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.211824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.213723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.244119 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4292/8535] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:45:17 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:45:17.248687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.260202 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fedab6-2a88-4f2c-82bb-aea960d9b169 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.320716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.321407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.321586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.321871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.322913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.327404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.352017 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4244/8536] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:45:17 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:45:17.356206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.367420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d5ec-d891-4331-bbb1-dce95e3ad502 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.372664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.373275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.373549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.373837 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.374478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.376105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.387066 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4293/8537] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:45:17.391649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.402634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e63ce-de13-4174-86c3-40e4f7d582ef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.408444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.409103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.409387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.409666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] PATH_INFO: `/v3/projects/1d14af6903dc483e9b0c51c876b6d670/users/aa137ece7b434678b23f2a4dacdcbd93/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.426284 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d14af6903dc483e9b0c51c876b6d670, user_id=aa137ece7b434678b23f2a4dacdcbd93, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.428964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.444522 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4245/8538] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:45:17 2022] PUT /identity/v3/projects/1d14af6903dc483e9b0c51c876b6d670/users/aa137ece7b434678b23f2a4dacdcbd93/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:17.448757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.459044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5950e0e-c5f1-40d3-9cbb-9099ad57aaa8 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.517457 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119b050-f778-4bc1-8abf-2a31f8228274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.518091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b050-f778-4bc1-8abf-2a31f8228274 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.518366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b050-f778-4bc1-8abf-2a31f8228274 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.518632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119b050-f778-4bc1-8abf-2a31f8228274 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.519263 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119b050-f778-4bc1-8abf-2a31f8228274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.520893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119b050-f778-4bc1-8abf-2a31f8228274 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.530903 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4294/8539] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:45:17.535806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.547246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbfb9c-be60-463c-871d-296ec0de7eec admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.553015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0833a8-70c5-4b62-98f9-c656eb3138ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.553691 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0833a8-70c5-4b62-98f9-c656eb3138ab admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.553998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0833a8-70c5-4b62-98f9-c656eb3138ab admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.554268 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0833a8-70c5-4b62-98f9-c656eb3138ab admin admin] PATH_INFO: `/v3/projects/1d14af6903dc483e9b0c51c876b6d670/users/aa137ece7b434678b23f2a4dacdcbd93/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.556285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0833a8-70c5-4b62-98f9-c656eb3138ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d14af6903dc483e9b0c51c876b6d670, user_id=aa137ece7b434678b23f2a4dacdcbd93, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.558969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0833a8-70c5-4b62-98f9-c656eb3138ab admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.569774 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4246/8540] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:45:17 2022] PUT /identity/v3/projects/1d14af6903dc483e9b0c51c876b6d670/users/aa137ece7b434678b23f2a4dacdcbd93/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:17.580723 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.581006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.581276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.596178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:17.612448 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] MFA Rules not processed for user `aa137ece7b434678b23f2a4dacdcbd93`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:17.614030 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:17.684413 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4295/8541] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:17.703435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4d14c-0427-4f8a-a457-fac443c998d0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.703717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4d14c-0427-4f8a-a457-fac443c998d0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.703986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4d14c-0427-4f8a-a457-fac443c998d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.723386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a8c4d14c-0427-4f8a-a457-fac443c998d0 None None] MFA Rules not processed for user `740c8eda8ebe40ccaadc1fd0137f941e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:17.724598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a8c4d14c-0427-4f8a-a457-fac443c998d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:17.783954 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4247/8542] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:45:17.798299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:17.799968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:17.875323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4312029-976c-40f2-941a-7cd3497677aa None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:17.881014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:17.881634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:17.881942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:17.882214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:17.891708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:17.893288 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:17.902761 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4296/8543] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:17 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:27.775552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:27.898385 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=65 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:31.109793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:31.110321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:31.110411 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:31.130701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:31.131927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:31.141333 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4248/8544] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:45:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:31.161592 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:31.173273 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507f77a-9cf9-4a07-bd82-3e1b67408f47 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:31.179778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aad36d-c4c3-461b-8c27-1c9cb4c0ae75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:31.180342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad36d-c4c3-461b-8c27-1c9cb4c0ae75 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:31.180617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad36d-c4c3-461b-8c27-1c9cb4c0ae75 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:31.180889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aad36d-c4c3-461b-8c27-1c9cb4c0ae75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:31.190405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aad36d-c4c3-461b-8c27-1c9cb4c0ae75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:31.191997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aad36d-c4c3-461b-8c27-1c9cb4c0ae75 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:31.203037 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4297/8545] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:33.506508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:33.508229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:33.522897 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62558d46-53ff-4038-81d0-bd22c7d56b3e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:33.529170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:33.529772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:33.530088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:33.530684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:33.539342 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:33.541677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:33.552780 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4249/8546] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:33.568786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4d2b-ae1c-4a70-95c4-226fd22a1078 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:33.569216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4d2b-ae1c-4a70-95c4-226fd22a1078 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:33.569307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b4d2b-ae1c-4a70-95c4-226fd22a1078 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:33.570728 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4298/8547] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:45:33.575313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:45:33.586709 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:33.595120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827744a-ad13-424c-be4a-a6448cd67041 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:33.600835 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa137ece7b434678b23f2a4dacdcbd93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d14af6903dc483e9b0c51c876b6d670', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:33.601461 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:33.601737 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:33.602041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] PATH_INFO: `/v3/projects/1d14af6903dc483e9b0c51c876b6d670` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:33.603183 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d14af6903dc483e9b0c51c876b6d670)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:33.604969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:33.606600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4250/8548] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:45:33 2022] GET /identity/v3/projects/1d14af6903dc483e9b0c51c876b6d670 => generated 393 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:45:33.769133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040054ea-93f7-4e59-bc9a-5f877b45bd92 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:33.769375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040054ea-93f7-4e59-bc9a-5f877b45bd92 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:33.769668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040054ea-93f7-4e59-bc9a-5f877b45bd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:33.803258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-040054ea-93f7-4e59-bc9a-5f877b45bd92 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:33.804467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-040054ea-93f7-4e59-bc9a-5f877b45bd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:33.859440 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4299/8549] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:45:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:33.871645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:33.873772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:33.887074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc908f82-e4b3-418b-97bf-0f30dfb4cff8 tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:33.891321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:33.891919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:33.892229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:33.892495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:33.899635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:33.901052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:33.909065 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4251/8550] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:34.074427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1f224-c383-43eb-92e2-fd79a0740399 None None] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:34.074706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1f224-c383-43eb-92e2-fd79a0740399 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:34.074975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1f224-c383-43eb-92e2-fd79a0740399 None None] PATH_INFO: `/` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:34.076337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4300/8551] 10.222.0.16 () {54 vars in 912 bytes} [Sat Oct 29 03:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 03:45:34.081707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] Authenticating service token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 29 03:45:34.101432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:34.114264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d0df9-780b-425e-b347-900310fca9c0 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:34.120019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa137ece7b434678b23f2a4dacdcbd93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d14af6903dc483e9b0c51c876b6d670', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:34.120646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:34.120923 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:34.121176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] PATH_INFO: `/v3/projects/1d14af6903dc483e9b0c51c876b6d670` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:34.122583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] RBAC: Authorizing `identity:get_project(project_id=1d14af6903dc483e9b0c51c876b6d670)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:34.124429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:34.126087 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4252/8552] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Oct 29 03:45:34 2022] GET /identity/v3/projects/1d14af6903dc483e9b0c51c876b6d670 => generated 393 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:45:34.278597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:34.278829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:34.279104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:34.300557 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:34.301781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:34.308705 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4301/8553] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:45:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:34.320701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:34.322801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:34.336460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b603da4-aab9-43bf-932f-a6d8aa9d95fe tempest-ServersAdminNegativeTestJSON-1502500465 tempest-ServersAdminNegativeTestJSON-1502500465-project-admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:34.340732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4a84d-9b7f-4f37-a204-1eda5a576818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:34.341344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4a84d-9b7f-4f37-a204-1eda5a576818 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:34.341629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4a84d-9b7f-4f37-a204-1eda5a576818 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:34.341938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4a84d-9b7f-4f37-a204-1eda5a576818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:34.349088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4a84d-9b7f-4f37-a204-1eda5a576818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:34.350548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4a84d-9b7f-4f37-a204-1eda5a576818 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:34.358511 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4253/8554] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:38.208413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:38.283879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d61ad2-dc52-4cd7-858e-90b5325dd36c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:38.289498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:38.290193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:38.290472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:38.290741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] PATH_INFO: `/v3/users/740c8eda8ebe40ccaadc1fd0137f941e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:38.291937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=740c8eda8ebe40ccaadc1fd0137f941e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:38.293934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:38.349892 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740c8eda8ebe40ccaadc1fd0137f941e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.358884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740c8eda8ebe40ccaadc1fd0137f941e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.359536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740c8eda8ebe40ccaadc1fd0137f941e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.367940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740c8eda8ebe40ccaadc1fd0137f941e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.368591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740c8eda8ebe40ccaadc1fd0137f941e'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.382287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:38.388253 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4302/8555] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:45:38 2022] DELETE /identity/v3/users/740c8eda8ebe40ccaadc1fd0137f941e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:38.393678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:38.394214 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:38.394334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:38.414674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:38.415990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:38.480285 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4254/8556] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:38.491198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:38.493086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:38.553366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141aa9-57e2-4781-b02a-5737f312ac2e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:38.557299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:38.557996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:38.558279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:38.558545 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:38.568323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:38.569770 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:38.579611 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4303/8557] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:38.757914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:38.759354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:38.772949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c25862-527e-4150-82b3-92325c27e93a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:38.778217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:38.778863 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:38.779137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:38.779530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] PATH_INFO: `/v3/projects/99bff39e69ff4791927279f6b5941930` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:38.780750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bff39e69ff4791927279f6b5941930)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:38.783456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:38.839064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bff39e69ff4791927279f6b5941930', 'request_id': 'req-4d6cd508-fab1-43e9-b101-c418838b016a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.845314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bff39e69ff4791927279f6b5941930', 'request_id': 'req-4d6cd508-fab1-43e9-b101-c418838b016a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.851344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bff39e69ff4791927279f6b5941930', 'request_id': 'req-4d6cd508-fab1-43e9-b101-c418838b016a'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.866226 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] The token cache is being invalidate because project 99bff39e69ff4791927279f6b5941930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:45:38.866512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.867162 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:38.868690 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4255/8558] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:45:38 2022] DELETE /identity/v3/projects/99bff39e69ff4791927279f6b5941930 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:38.872910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:38.882876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60114b6e-0b65-4523-915f-169fe9ce5742 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:38.941824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:38.942615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:38.942924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:38.943229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] PATH_INFO: `/v3/users/aa137ece7b434678b23f2a4dacdcbd93` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:38.944554 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa137ece7b434678b23f2a4dacdcbd93)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:38.946598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:38.998057 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa137ece7b434678b23f2a4dacdcbd93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.008255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa137ece7b434678b23f2a4dacdcbd93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.008887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa137ece7b434678b23f2a4dacdcbd93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.016115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa137ece7b434678b23f2a4dacdcbd93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.016796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-8b1a84e0-ba58-483b-9a76-9781f59c35af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa137ece7b434678b23f2a4dacdcbd93'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.035478 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4304/8559] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:45:38 2022] DELETE /identity/v3/users/aa137ece7b434678b23f2a4dacdcbd93 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:39.316574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.318241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:39.332887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6cd508-fab1-43e9-b101-c418838b016a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.357042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:39.399197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.399879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.400088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.400354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] PATH_INFO: `/v3/projects/1d14af6903dc483e9b0c51c876b6d670` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.401464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d14af6903dc483e9b0c51c876b6d670)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.403431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.453606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d14af6903dc483e9b0c51c876b6d670', 'request_id': 'req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.460381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d14af6903dc483e9b0c51c876b6d670', 'request_id': 'req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.466186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d14af6903dc483e9b0c51c876b6d670', 'request_id': 'req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.481713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] The token cache is being invalidate because project 1d14af6903dc483e9b0c51c876b6d670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:45:39.482030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.482702 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-451c4fcb-bbad-4e66-bb10-5e4ac0b14869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:45:39.484323 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4256/8560] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:45:39 2022] DELETE /identity/v3/projects/1d14af6903dc483e9b0c51c876b6d670 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:39.491167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.491709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.491709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.514964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:39.516218 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:39.530444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:39.582377 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4305/8561] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:39.591141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.591424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.591679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.612439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:39.614047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:39.622529 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4257/8562] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:39.627230 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.637579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c390c43-5a4a-4337-bd52-ed618c0ebc89 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.642823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.643583 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.643861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.644136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.644807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:45:39.645120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.646774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.658952 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4306/8563] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:45:39.663500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.673016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca0c1a-d914-49d9-953a-086af5ecbcc5 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.679594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.680217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.680491 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.680752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.681444 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.683360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.714115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4258/8564] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:45:39 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:45:39.718551 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.729693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e7ba6-9560-4254-b622-ec407f0ca4ce admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.789823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.790473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.790752 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.791027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.791705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.793681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.818018 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4307/8565] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:45:39 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:45:39.822802 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.834024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bf62c-76a6-474f-905a-f374a9b73f2a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.838660 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.839296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.839613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.839880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.840527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.842168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.852672 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4259/8566] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:45:39.856746 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.867516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a7ed1-fba7-45f7-a67c-599bb5aef793 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.872883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6ab0d-0472-469e-b8b9-303f14940095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.873507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ab0d-0472-469e-b8b9-303f14940095 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.873781 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ab0d-0472-469e-b8b9-303f14940095 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.874088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6ab0d-0472-469e-b8b9-303f14940095 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.874741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ab0d-0472-469e-b8b9-303f14940095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.876377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6ab0d-0472-469e-b8b9-303f14940095 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.888090 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4308/8567] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:45:39.894620 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:39.910169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3506b-e382-409e-8cdd-457098314488 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:39.916140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:39.916798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.917077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.917345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] PATH_INFO: `/v3/projects/657860e2093040a09e076ca960101296/users/9ce61d1e5eef44ecb4f571978ec72352/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.934985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=657860e2093040a09e076ca960101296, user_id=9ce61d1e5eef44ecb4f571978ec72352, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:39.939051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:39.954798 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4260/8568] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:45:39 2022] PUT /identity/v3/projects/657860e2093040a09e076ca960101296/users/9ce61d1e5eef44ecb4f571978ec72352/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:45:39.960871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e034b-6ddf-4b40-b983-9ffeb8d8afb4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:39.961176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e034b-6ddf-4b40-b983-9ffeb8d8afb4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:39.961589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e034b-6ddf-4b40-b983-9ffeb8d8afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:39.986422 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-944e034b-6ddf-4b40-b983-9ffeb8d8afb4 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:39.987789 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-944e034b-6ddf-4b40-b983-9ffeb8d8afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:40.051811 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4309/8569] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:40.061868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:40.063981 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:40.120836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:40.127938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc0e4f-19d3-4687-ac75-474581cf33bb admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:40.133337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc254a42-806d-448d-b6b6-e54ff1188536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:40.134043 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254a42-806d-448d-b6b6-e54ff1188536 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:40.134371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254a42-806d-448d-b6b6-e54ff1188536 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:40.134636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc254a42-806d-448d-b6b6-e54ff1188536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:40.143924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc254a42-806d-448d-b6b6-e54ff1188536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:40.145347 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc254a42-806d-448d-b6b6-e54ff1188536 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:40.154791 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4261/8570] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:44.251643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:44.252322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:44.252322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:44.282375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] MFA Rules not processed for user `9ce61d1e5eef44ecb4f571978ec72352`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:44.283588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:44.296720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:44.351671 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4310/8571] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:44.363656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119033-1227-437c-bb53-01d057402d88 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:44.364151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119033-1227-437c-bb53-01d057402d88 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:44.364243 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82119033-1227-437c-bb53-01d057402d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:44.387128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-82119033-1227-437c-bb53-01d057402d88 None None] MFA Rules not processed for user `9ce61d1e5eef44ecb4f571978ec72352`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:44.388311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-82119033-1227-437c-bb53-01d057402d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:44.396254 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4262/8572] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:45:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:44.410492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:44.412432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:44.491064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8343-bb54-4960-bdf6-e4061f0baf2b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:44.498019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:44.498814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:44.499108 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:44.499375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:44.507947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:44.509567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:44.519520 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4311/8573] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:54.380954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=8 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:54.514608 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=54 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:45:57.162798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f59b-0a46-4037-aacb-b9c9b568d4f0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:57.163392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f59b-0a46-4037-aacb-b9c9b568d4f0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:57.163392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f59b-0a46-4037-aacb-b9c9b568d4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:57.184188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-45c9f59b-0a46-4037-aacb-b9c9b568d4f0 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:57.185415 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-45c9f59b-0a46-4037-aacb-b9c9b568d4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:57.193322 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4263/8574] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:45:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:57.207663 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:57.209298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:57.222287 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da743e-079d-4ea2-be17-300170c3cdf4 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:57.228040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:57.228337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:57.228687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:57.229042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:57.237489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:57.239492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:57.248487 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4312/8575] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:57.345969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:57.346206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:57.346667 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:57.390643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:45:57.392108 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:57.459820 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4264/8576] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:45:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:45:57.471876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:57.473470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:57.490167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec9e15-5c57-4045-9572-9c3efe485451 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:57.496303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:57.496915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:57.497195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:57.497467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:57.508648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:57.511272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:57.526805 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4313/8577] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:57.728404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:57.739113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe9168-bccc-435b-99b8-d8059b7fb923 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:57.743549 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:57.744182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:57.744457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:57.744727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:57.746725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:57.764657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:57.766172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:57.779666 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4265/8578] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:45:57.849852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:45:57.866376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84057dce-2774-483c-b6f8-740f42a6bfc6 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:45:57.876140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:45:57.876998 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:45:57.877368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:45:57.877929 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:45:57.879916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:45:57.892101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:45:57.893709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:45:57.903625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4314/8579] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:45:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:46:07.772489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=44 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:07.899424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=18 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:28.745596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:28.760172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff053a64-655a-44ae-ace8-ff0cb97f0173 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:28.766500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:28.767368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:28.767895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:28.768417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:28.772058 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:28.790074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:28.792205 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:28.804636 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4266/8580] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:46:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:46:38.173095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:38.207765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43738115-c18f-4515-91b4-3c79ed0be80a service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:38.212890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:38.213549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:38.213857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:38.214135 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] PATH_INFO: `/v3/users/9ce61d1e5eef44ecb4f571978ec72352` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:38.215393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce61d1e5eef44ecb4f571978ec72352)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:38.217350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:38.269902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce61d1e5eef44ecb4f571978ec72352'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.279088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce61d1e5eef44ecb4f571978ec72352'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.279698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce61d1e5eef44ecb4f571978ec72352'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.287053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce61d1e5eef44ecb4f571978ec72352'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.287679 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5eac49c0-bc39-4259-8847-efef947e9978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce61d1e5eef44ecb4f571978ec72352'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.305153 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4315/8581] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:46:38 2022] DELETE /identity/v3/users/9ce61d1e5eef44ecb4f571978ec72352 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:46:38.486884 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:38.499266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a3f6-78f6-498c-90b7-a09a4eb1664a service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:38.557854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:38.558518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:38.558798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:38.559097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] PATH_INFO: `/v3/projects/657860e2093040a09e076ca960101296` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:38.560217 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657860e2093040a09e076ca960101296)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:38.562239 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:38.610609 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657860e2093040a09e076ca960101296', 'request_id': 'req-c736c22b-11ff-4213-8903-7bccd6cacbc3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.617531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657860e2093040a09e076ca960101296', 'request_id': 'req-c736c22b-11ff-4213-8903-7bccd6cacbc3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.623585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657860e2093040a09e076ca960101296', 'request_id': 'req-c736c22b-11ff-4213-8903-7bccd6cacbc3'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.652004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] The token cache is being invalidate because project 657860e2093040a09e076ca960101296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:46:38.652299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.652989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-c736c22b-11ff-4213-8903-7bccd6cacbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:46:38.654720 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4267/8582] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:46:38 2022] DELETE /identity/v3/projects/657860e2093040a09e076ca960101296 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:46:38.660276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:38.660555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:38.660834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:38.712119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:46:38.713367 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:38.776330 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4316/8583] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:46:38.785332 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:38.785632 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:38.785940 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:38.809988 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:46:38.811259 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:38.820365 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4268/8584] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:46:38.824885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:38.835304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53fdf10-13ef-4a65-9a25-71ce5374c42a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:38.840490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:38.841092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:38.841369 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:38.841641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:38.842331 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:46:38.842635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:38.844244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:38.856188 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4317/8585] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:46:38.862996 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:38.877967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fce27-60fe-48da-982e-2d3ad3493b53 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:38.884659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:38.885258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:38.885548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:38.885824 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:38.886477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:38.888390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:38.928181 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4269/8586] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:46:38 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:46:38.932465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:38.943298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ee285-6d9c-473e-936c-f6dc9992b24e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:38.963282 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:39.005233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:39.005866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:39.006177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:39.006444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:39.007074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:39.008996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:39.032662 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4318/8587] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:46:38 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:46:39.038420 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:39.051696 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05feb48-ff64-4704-be94-b08d493ddc73 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:39.060959 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:39.061860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:39.062271 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:39.062597 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:39.063587 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:39.066041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:39.076977 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4270/8588] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:46:39.081193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:39.091859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b8c1-43f5-4645-9c36-c462d5beb210 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:39.097002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5c7c3-45f3-44af-a2e4-421726e633c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:39.097701 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5c7c3-45f3-44af-a2e4-421726e633c8 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:39.098019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5c7c3-45f3-44af-a2e4-421726e633c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:39.098315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5c7c3-45f3-44af-a2e4-421726e633c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:39.098955 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5c7c3-45f3-44af-a2e4-421726e633c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:39.100596 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d5c7c3-45f3-44af-a2e4-421726e633c8 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:39.112147 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4319/8589] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 03:46:39.116914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:39.127414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3926c72-ada4-49fa-a61b-6de682e92b3a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:39.132669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:39.133350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:39.133635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:39.133949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] PATH_INFO: `/v3/projects/676879256318463780dd131db996c8f3/users/20c5f53b760d49bf81a9377773210a24/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:39.150092 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676879256318463780dd131db996c8f3, user_id=20c5f53b760d49bf81a9377773210a24, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:39.152799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:39.155050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:39.168873 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4271/8590] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:46:39 2022] PUT /identity/v3/projects/676879256318463780dd131db996c8f3/users/20c5f53b760d49bf81a9377773210a24/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:46:39.174091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76b92-3695-4e11-b2a0-98aa449c035e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:39.174681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76b92-3695-4e11-b2a0-98aa449c035e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:39.174681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b76b92-3695-4e11-b2a0-98aa449c035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:39.194906 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a5b76b92-3695-4e11-b2a0-98aa449c035e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:46:39.196051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5b76b92-3695-4e11-b2a0-98aa449c035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:39.258876 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4320/8591] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:46:39.270515 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:39.272596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:39.333932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d079e03-2839-49fa-af83-0aed2f0defe5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:39.338038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ae3a1-c0cc-45ea-8227-84985d03deee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:39.338669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae3a1-c0cc-45ea-8227-84985d03deee service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:39.338944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae3a1-c0cc-45ea-8227-84985d03deee service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:39.339215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ae3a1-c0cc-45ea-8227-84985d03deee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:39.348984 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ae3a1-c0cc-45ea-8227-84985d03deee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:39.350471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ae3a1-c0cc-45ea-8227-84985d03deee service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:39.360554 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4272/8592] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:46:43.388908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:43.389432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:43.389531 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:43.419637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] MFA Rules not processed for user `20c5f53b760d49bf81a9377773210a24`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:46:43.420870 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:43.494533 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4321/8593] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:46:43.506457 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:43.507069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:43.507069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:43.528674 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] MFA Rules not processed for user `20c5f53b760d49bf81a9377773210a24`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:46:43.529950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:43.538365 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4273/8594] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:46:43.551570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:46:43.553195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:46:43.591604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:43.634734 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d39701-f58a-42df-bf88-834bb4dc5368 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:46:43.640187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97deb9-fa65-4d70-8368-3961ff0d5076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:46:43.640833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97deb9-fa65-4d70-8368-3961ff0d5076 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:46:43.641136 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97deb9-fa65-4d70-8368-3961ff0d5076 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:46:43.641402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97deb9-fa65-4d70-8368-3961ff0d5076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:46:43.649581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97deb9-fa65-4d70-8368-3961ff0d5076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:46:43.651226 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97deb9-fa65-4d70-8368-3961ff0d5076 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:46:43.660864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4322/8595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:46:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:46:53.521664 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=1,keystone:SELECT=31 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:46:53.656511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=20 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:15.835220 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:47:15.836901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:47:15.915396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143097d-f156-4728-b8b4-1a8aacdc72d9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:47:15.921675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:47:15.922612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:47:15.923067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:47:15.923345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:47:15.925400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:47:15.939105 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:47:15.940730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:47:15.951399 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4274/8596] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:47:25.946922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=32 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:40.314190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08174-0ebe-4ba0-8b8b-7f7adc24b397 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:47:40.314755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08174-0ebe-4ba0-8b8b-7f7adc24b397 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:47:40.314859 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b08174-0ebe-4ba0-8b8b-7f7adc24b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:47:40.335548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-55b08174-0ebe-4ba0-8b8b-7f7adc24b397 None None] MFA Rules not processed for user `20c5f53b760d49bf81a9377773210a24`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:47:40.336725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55b08174-0ebe-4ba0-8b8b-7f7adc24b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:47:40.344260 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4323/8597] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:47:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:47:40.936855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:47:40.938474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:47:40.951677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d5d0-1eac-4497-8236-d38c78699e79 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:47:40.957760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:47:40.958436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:47:40.958717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:47:40.958986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:47:40.960774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:47:40.973578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:47:40.975260 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:47:40.985518 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4275/8598] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:47:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:47:50.330044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:47:50.981104 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:35.470310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:35.470910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:35.470910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:35.491568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:48:35.492802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:35.502067 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4324/8599] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:48:35.513499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:35.527189 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b34ae-df2b-4f0a-8123-decd5cd46251 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:35.528039 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:35.532885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:35.533508 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:35.533855 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:35.534113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:35.540675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727ca31-41e3-40fc-881d-32cf6e9f0fc8 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:35.544780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:35.546487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:35.547629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:35.548594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:35.548879 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:35.549151 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] PATH_INFO: `/v3/users/20c5f53b760d49bf81a9377773210a24` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:35.550425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=20c5f53b760d49bf81a9377773210a24)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:35.552472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:35.561227 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4276/8600] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:48:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:48:35.606772 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20c5f53b760d49bf81a9377773210a24'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.616034 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20c5f53b760d49bf81a9377773210a24'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.616710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20c5f53b760d49bf81a9377773210a24'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.624213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20c5f53b760d49bf81a9377773210a24'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.624876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-204fd297-06fd-4d2c-a352-1f1f129bd6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20c5f53b760d49bf81a9377773210a24'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.642221 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4325/8601] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:48:35 2022] DELETE /identity/v3/users/20c5f53b760d49bf81a9377773210a24 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:48:35.820646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:35.833081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262c4a8-d3ae-4a5b-8af1-1885dad62991 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:35.895492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:35.896142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:35.896425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:35.896697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] PATH_INFO: `/v3/projects/676879256318463780dd131db996c8f3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:35.897860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=676879256318463780dd131db996c8f3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:35.899766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:35.950477 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676879256318463780dd131db996c8f3', 'request_id': 'req-b2e7a013-97e6-4562-98b4-4faede9146ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.957153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676879256318463780dd131db996c8f3', 'request_id': 'req-b2e7a013-97e6-4562-98b4-4faede9146ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.963537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676879256318463780dd131db996c8f3', 'request_id': 'req-b2e7a013-97e6-4562-98b4-4faede9146ee'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.978520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] The token cache is being invalidate because project 676879256318463780dd131db996c8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:48:35.979064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.979841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-b2e7a013-97e6-4562-98b4-4faede9146ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:48:35.981571 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4277/8602] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:48:35 2022] DELETE /identity/v3/projects/676879256318463780dd131db996c8f3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:48:35.986868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:35.987156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:35.987431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.008748 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:48:36.009996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:36.071730 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4326/8603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:48:36.080177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.080460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.080729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.101103 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:48:36.102362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:36.110967 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4278/8604] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:48:36.115771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.126652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068099f2-a15f-4a99-9378-1a12e62b1c83 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.132559 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.133164 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.133435 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.133698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.134379 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:48:36.134683 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.136278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.149310 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4327/8605] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:48:36.153966 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.163412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35709b1-cf03-47ed-a07c-aa31a026358d None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.169324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.169971 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.170245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.170492 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.171110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.173018 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.206337 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4279/8606] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:48:36 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:48:36.210980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.221899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758436a7-31d5-439e-93a5-9baea88041aa admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.272348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:36.284726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.285345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.285852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.286154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.286792 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.288831 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.312583 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4328/8607] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:48:36 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:48:36.316922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.327647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01b00f-b5f3-4b12-a050-b3a4f117293d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.333372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.334011 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.334368 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.334605 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.335274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.336869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.347168 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4280/8608] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:48:36.351315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.361643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262d19e-f156-4e37-9f83-6ce951559c96 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.367052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5d2a5-8377-41ef-8cf5-cb1dd792aeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.367655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5d2a5-8377-41ef-8cf5-cb1dd792aeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.367932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5d2a5-8377-41ef-8cf5-cb1dd792aeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.368233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5d2a5-8377-41ef-8cf5-cb1dd792aeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.368871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5d2a5-8377-41ef-8cf5-cb1dd792aeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.370528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d5d2a5-8377-41ef-8cf5-cb1dd792aeb6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.381627 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4329/8609] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:48:36.385908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.396143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c389d-4133-4ec6-91c4-9a32e8025fef admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.401227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.401829 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.402106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.402375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] PATH_INFO: `/v3/projects/4579636d272d407bae3af31a24201bb9/users/d88f049383ec4971b8c92bfde389e873/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.417704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4579636d272d407bae3af31a24201bb9, user_id=d88f049383ec4971b8c92bfde389e873, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.420574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.435626 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4281/8610] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:48:36 2022] PUT /identity/v3/projects/4579636d272d407bae3af31a24201bb9/users/d88f049383ec4971b8c92bfde389e873/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:48:36.440822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f618f-df10-4bb4-a3fd-997cdda7b1c3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.441104 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f618f-df10-4bb4-a3fd-997cdda7b1c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.441372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f618f-df10-4bb4-a3fd-997cdda7b1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.461910 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a21f618f-df10-4bb4-a3fd-997cdda7b1c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:48:36.463148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a21f618f-df10-4bb4-a3fd-997cdda7b1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:36.528285 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4330/8611] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:48:36.543097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:36.545289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:36.563237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:36.609082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c5c44-10bd-415e-8764-d47f04eaefc6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:36.614400 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:36.615012 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:36.615278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:36.615544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:36.626227 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:36.627673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:36.637349 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4282/8612] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:48:40.679968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bdfff-5e6d-4eb0-94d2-483ca4f7cc0a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:40.680465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bdfff-5e6d-4eb0-94d2-483ca4f7cc0a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:40.680654 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bdfff-5e6d-4eb0-94d2-483ca4f7cc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:40.711206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-197bdfff-5e6d-4eb0-94d2-483ca4f7cc0a None None] MFA Rules not processed for user `d88f049383ec4971b8c92bfde389e873`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:48:40.712443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-197bdfff-5e6d-4eb0-94d2-483ca4f7cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:40.793583 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4331/8613] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:48:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:48:40.811704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:48:40.813483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:40.926173 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7f2e-286b-4970-a5c7-9df9654f6fdd service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:48:40.932228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:48:40.932857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:40.933136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:40.933409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:40.942974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:48:40.944586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:48:40.954457 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4283/8614] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:48:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:48:42.320109 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:48:42.320623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:48:42.320623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:48:42.342005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] MFA Rules not processed for user `d88f049383ec4971b8c92bfde389e873`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:48:42.343245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:48:42.351124 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4332/8615] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:48:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:48:50.949739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=66 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:48:52.336796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:17.389544 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:49:17.400274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159605c-9dcb-4856-b389-e4695af2df1e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:49:17.405764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:49:17.406446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:49:17.406721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:49:17.406968 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:49:17.409257 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:17.420610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:49:17.422077 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:49:17.430623 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4284/8616] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:49:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:49:27.426538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:34.440890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:49:34.442627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:34.455416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969b064-bc3b-4a04-8b2b-a94aa1f9173f None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:49:34.459349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:49:34.459947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:49:34.460219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:49:34.460483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:49:34.462264 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:34.476169 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:49:34.477665 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:49:34.488942 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4333/8617] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:49:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:49:35.689344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:49:35.698283 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cf88ad-0885-4aed-a88c-7579dc87756a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:49:35.702497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:49:35.703095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:49:35.703372 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:49:35.703635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:49:35.705526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:35.720616 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:49:35.722065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:49:35.733438 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4285/8618] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:49:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:49:36.500122 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:49:36.509181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd43864-56bf-4992-bd24-9bb179ce3e08 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:49:36.513938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:49:36.514569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:49:36.514840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:49:36.515113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:49:36.517042 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:36.527031 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:49:36.528471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6645dc-22a0-471e-b225-93668f39c005 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:49:36.537203 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4334/8619] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:49:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:49:36.959378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:49:36.961019 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:36.977182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35710df7-2afd-4043-ab9e-55ceb670f616 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:49:36.984679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:49:36.985301 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:49:36.985657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:49:36.985880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:49:36.987717 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:37.001119 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:49:37.002726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:49:37.013737 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4286/8620] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:49:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:49:46.532949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:47.009148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=12 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:49:47.572844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:49:47.573315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:49:47.573416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:49:47.592731 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] MFA Rules not processed for user `d88f049383ec4971b8c92bfde389e873`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:49:47.594074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:49:47.601278 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4335/8621] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:49:57.587696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:47.914522 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:50:47.927569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641417-afa8-4a91-a481-20493b5ae9f3 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:50:47.933766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:50:47.934410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:50:47.934683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:50:47.934957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:50:47.936780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:50:47.949106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:50:47.952844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3495807-1a6b-46e9-b523-fa96679146bd service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:50:47.964114 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4287/8622] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:50:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:50:54.345216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:50:54.360053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee85824-a2b4-4308-9429-6cd5c08d92d9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:50:54.366784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:50:54.367613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:50:54.368063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:50:54.368323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:50:54.370327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:50:54.383301 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:50:54.385095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:50:54.397595 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4336/8623] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:50:57.960026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:50:58.887675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:50:58.887885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:50:58.888120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:50:58.908790 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] MFA Rules not processed for user `d88f049383ec4971b8c92bfde389e873`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:50:58.910297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:50:58.917657 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4288/8624] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:50:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:50:59.246521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:50:59.259340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc69fe3-c532-46b1-98ac-90b85aeeb9f0 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:50:59.263381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:50:59.264024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:50:59.264324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:50:59.264567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:50:59.266662 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:50:59.277450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:50:59.278923 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:50:59.287746 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4337/8625] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:50:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:51:08.902998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:09.283542 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:30.634113 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:51:30.635783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:51:30.719560 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3841c-a925-4c29-8d04-04cdaff6f3e9 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:51:30.729336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:51:30.730143 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:51:30.730428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:51:30.730769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:51:30.733744 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:51:30.747364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:51:30.748927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:51:30.758863 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4289/8626] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:51:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:51:40.754840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=36 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:51:50.110564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:51:50.120262 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d8cf0-4192-42ca-99e4-cf01ddc5e0c4 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:51:50.124466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:51:50.125157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:51:50.125503 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:51:50.126055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:51:50.128088 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:51:50.138050 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:51:50.139587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:51:50.148109 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4338/8627] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:51:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:51:50.243517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:51:50.254517 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2c301-ca9e-4f07-8060-00246b2f81da service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:51:50.263310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:51:50.263938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:51:50.264218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:51:50.264487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:51:50.266362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:51:50.278289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:51:50.279882 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:51:50.289625 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4290/8628] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:51:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:51:50.496248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:51:50.505641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a81b57-c160-4e25-ab22-43f0174cdc0f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:51:50.510403 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:51:50.511207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:51:50.511483 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:51:50.511729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:51:50.513829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:51:50.533506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:51:50.535006 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:51:50.549011 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4339/8629] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:51:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:51:50.610009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:51:50.621693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1622d8-0ddb-4b27-b322-2e468e98c1f5 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:51:50.628038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:51:50.628641 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:51:50.628911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:51:50.629176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:51:50.631032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:51:50.643277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:51:50.644804 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274ed74b-35ba-4e87-ad14-43ca912931ba service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:51:50.655338 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4291/8630] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:51:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:52:00.541613 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:00.650750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=12 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:19.355103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:52:19.356735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:52:19.371698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aca6d8-3f53-4c0c-a175-30962aa26989 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:52:19.376675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:52:19.377235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:52:19.377521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:52:19.377788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:52:19.379510 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:52:19.391768 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:52:19.393377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:52:19.403968 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4340/8631] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:52:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:52:20.436022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5560d-d9c7-4fc4-a553-dbd4bc08fd6f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:52:20.436666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5560d-d9c7-4fc4-a553-dbd4bc08fd6f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:52:20.436666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5560d-d9c7-4fc4-a553-dbd4bc08fd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:52:20.456989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5d5560d-d9c7-4fc4-a553-dbd4bc08fd6f None None] MFA Rules not processed for user `d88f049383ec4971b8c92bfde389e873`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:52:20.458146 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5d5560d-d9c7-4fc4-a553-dbd4bc08fd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:52:20.465493 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4292/8632] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:52:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:52:20.796805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:52:20.807717 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d77c20-6298-4a22-9ac1-aa7a46a32c51 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:52:20.811849 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:52:20.812446 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:52:20.812726 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:52:20.812990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:52:20.815025 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:52:20.825266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:52:20.826750 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:52:20.835244 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4341/8633] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:52:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:52:30.451459 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:52:30.831323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:40.494244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:53:40.494752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:53:40.494752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:53:40.547542 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] MFA Rules not processed for user `8e709a640a524fd0a3e272d397c75e6c`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:53:40.548775 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:53:40.610318 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4293/8634] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Oct 29 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:53:40.616952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:53:40.630784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c17d2-4ba0-4c09-b513-c66083fbcf54 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:53:40.635105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:53:40.635733 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:53:40.636011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:53:40.636286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:53:40.645507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:53:40.646969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:53:40.656301 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4342/8635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:53:50.607295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=38 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:53:50.651900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:09.028035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:09.037916 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432c3ed-2836-49bf-87a4-5634d8b419ff None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:09.041870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:09.042478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:09.042755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:09.043024 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:09.052375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:09.053826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:09.063314 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4294/8636] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:12.261008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:12.294799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf214d-6c01-4811-89ca-852241f8680b service cinder] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:12.303019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:12.303687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:12.303966 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:12.304297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:12.306278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:12.338201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:12.357099 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a726461-503f-483c-9401-85b088f1e036 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:12.360368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:12.362204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:12.362988 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:12.363654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:12.364424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:12.364965 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] PATH_INFO: `/v3/users/d88f049383ec4971b8c92bfde389e873` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:12.366432 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88f049383ec4971b8c92bfde389e873)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:12.368480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:12.375601 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4343/8637] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:12.427184 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88f049383ec4971b8c92bfde389e873'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.438918 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88f049383ec4971b8c92bfde389e873'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.439598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88f049383ec4971b8c92bfde389e873'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.446410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88f049383ec4971b8c92bfde389e873'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.447037 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7d948a9b-1bb4-4eb2-9071-ceb83409433f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88f049383ec4971b8c92bfde389e873'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.461791 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4295/8638] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:54:12 2022] DELETE /identity/v3/users/d88f049383ec4971b8c92bfde389e873 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:54:12.652055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:12.665014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0a11f-ed74-4107-b963-faa2f8fcdcdd service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:12.726043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:12.726685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:12.726964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:12.727229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] PATH_INFO: `/v3/projects/4579636d272d407bae3af31a24201bb9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:12.728347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4579636d272d407bae3af31a24201bb9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:12.730298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:12.782336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4579636d272d407bae3af31a24201bb9', 'request_id': 'req-5a1666e0-973b-4421-abd1-2d4eab706832'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.789184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4579636d272d407bae3af31a24201bb9', 'request_id': 'req-5a1666e0-973b-4421-abd1-2d4eab706832'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.795541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4579636d272d407bae3af31a24201bb9', 'request_id': 'req-5a1666e0-973b-4421-abd1-2d4eab706832'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.810272 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] The token cache is being invalidate because project 4579636d272d407bae3af31a24201bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:54:12.810561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.811187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-5a1666e0-973b-4421-abd1-2d4eab706832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:12.812865 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4344/8639] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:54:12 2022] DELETE /identity/v3/projects/4579636d272d407bae3af31a24201bb9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:54:12.818345 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:12.818634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:12.818906 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:12.840188 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:12.841519 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:12.907373 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4296/8640] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:12.974944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:12.975460 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:12.975804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:12.999184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:13.000485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:13.008564 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4345/8641] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:13.013067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.023264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702ded1-9fda-460d-900f-7869f4396792 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.028892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.029588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.029961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.030233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.030881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:54:13.031185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.032788 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.046560 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4297/8642] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:54:13.051278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.062229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9326a-2bf4-494f-a5a1-1704c9a232c3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.067970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.068575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.068855 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.069126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.069755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.071697 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.102656 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4346/8643] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:54:13 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:54:13.107168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.119036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf170119-a4bc-41a8-9f1f-b25d6006a06c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.163031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:13.182476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.183129 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.183404 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.183679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.184313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.186391 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.209860 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4298/8644] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:54:13 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:54:13.214152 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.225255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d8b9e-8b5f-485f-a415-e4b832cf0e75 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.230155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.230776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.231058 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.231320 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.231975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.233600 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.244302 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4347/8645] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:54:13.248430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.258467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21aa9-9198-4bd4-963c-76f5addc0e7f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.263425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4833d1-5e4d-452c-b2c0-61f2fb8e0eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.264021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4833d1-5e4d-452c-b2c0-61f2fb8e0eca admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.264294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4833d1-5e4d-452c-b2c0-61f2fb8e0eca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.264564 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4833d1-5e4d-452c-b2c0-61f2fb8e0eca admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.265207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4833d1-5e4d-452c-b2c0-61f2fb8e0eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.266826 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4833d1-5e4d-452c-b2c0-61f2fb8e0eca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.278112 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4299/8646] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:54:13.282418 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.293029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa88b5e-48e5-4f16-8218-024887eb1d78 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.297902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.298550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.298828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.299099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] PATH_INFO: `/v3/projects/2fa0fc78e7e6461484aa23de0f39e47e/users/a5095343d28645f3b3cffd8830ca2419/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.302386 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:13.320178 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa0fc78e7e6461484aa23de0f39e47e, user_id=a5095343d28645f3b3cffd8830ca2419, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.323141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.338007 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4348/8647] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:54:13 2022] PUT /identity/v3/projects/2fa0fc78e7e6461484aa23de0f39e47e/users/a5095343d28645f3b3cffd8830ca2419/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:54:13.343358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d34393-87e3-4f71-9aa0-4b0e52d2db5b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.343912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d34393-87e3-4f71-9aa0-4b0e52d2db5b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.343912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d34393-87e3-4f71-9aa0-4b0e52d2db5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.364889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e5d34393-87e3-4f71-9aa0-4b0e52d2db5b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:13.366128 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e5d34393-87e3-4f71-9aa0-4b0e52d2db5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:13.428641 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4300/8648] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:13.438980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:13.440858 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:13.505530 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305fc181-2546-457d-866f-940c92bf4518 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:13.510154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519f45-9fc8-40c1-a269-af119290cf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:13.510760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519f45-9fc8-40c1-a269-af119290cf4e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:13.511033 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519f45-9fc8-40c1-a269-af119290cf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:13.511302 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519f45-9fc8-40c1-a269-af119290cf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:13.520868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519f45-9fc8-40c1-a269-af119290cf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:13.522366 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519f45-9fc8-40c1-a269-af119290cf4e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:13.532384 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4349/8649] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:17.341203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299229-e751-4600-8f62-9913dd4747ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:17.341752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299229-e751-4600-8f62-9913dd4747ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:17.341752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90299229-e751-4600-8f62-9913dd4747ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:17.380658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-90299229-e751-4600-8f62-9913dd4747ac None None] MFA Rules not processed for user `a5095343d28645f3b3cffd8830ca2419`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:17.382021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90299229-e751-4600-8f62-9913dd4747ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:17.453256 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4301/8650] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:17.464742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:17.465329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:17.465329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:17.486071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] MFA Rules not processed for user `a5095343d28645f3b3cffd8830ca2419`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:17.487359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:17.494789 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4350/8651] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:17.506921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299229-e751-4600-8f62-9913dd4747ac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:17.508335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90299229-e751-4600-8f62-9913dd4747ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:17.563985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:17.588417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90299229-e751-4600-8f62-9913dd4747ac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:17.593951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16984f-8122-45e1-8516-20a490b49374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:17.594599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16984f-8122-45e1-8516-20a490b49374 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:17.594879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16984f-8122-45e1-8516-20a490b49374 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:17.595151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16984f-8122-45e1-8516-20a490b49374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:17.604371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16984f-8122-45e1-8516-20a490b49374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:17.605730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16984f-8122-45e1-8516-20a490b49374 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:17.617951 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4302/8652] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:54:18.224092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:18.225484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:18.321068 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22978b1d-5264-46a3-998d-82d79131a39a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:18.326652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:18.327524 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:18.327815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:18.328139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:18.330055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:18.342206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:18.343814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:18.354557 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4351/8653] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:27.611687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:28.349902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:29.419953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:29.420465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:29.420465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:29.439974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] MFA Rules not processed for user `a5095343d28645f3b3cffd8830ca2419`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:29.441185 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:29.448745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4303/8654] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:31.868423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:31.878940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9727c-a53b-4dab-8d26-020e1cf3b91a service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:31.885972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:31.886609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:31.887071 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:31.887526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:31.889901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:31.900686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:31.902176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:31.910976 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4352/8655] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:34.726136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:34.728279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:34.747192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff8181-4ee9-4897-a0bf-0338bda6dd67 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:34.754233 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:34.755053 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:34.755392 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:34.755726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:34.757795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:34.799680 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:34.801133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:34.812599 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4304/8656] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:36.002640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:36.012618 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef219355-8f69-4d42-bc7c-b9516107951f service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:36.017128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:36.017745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:36.018046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:36.018340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:36.020211 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:36.034307 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:36.035722 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:36.047691 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4353/8657] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:44.807505 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=18 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:46.042352 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:46.818763 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:46.820533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:46.835429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e7243-3cd6-4b66-baaa-46ca749e665f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:46.841821 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:46.842465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:46.842726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:46.843014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:46.844848 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:46.858252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:46.860025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:46.872550 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4305/8658] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:51.680754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:51.691676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0607b0e-f44f-4b68-bc18-4dec6444fddd service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:51.696390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:51.697084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:51.697368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:51.697643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] PATH_INFO: `/v3/users/a5095343d28645f3b3cffd8830ca2419` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:51.698796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5095343d28645f3b3cffd8830ca2419)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:51.700763 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:51.750553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5095343d28645f3b3cffd8830ca2419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:51.760041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5095343d28645f3b3cffd8830ca2419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:51.760707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5095343d28645f3b3cffd8830ca2419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:51.768126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5095343d28645f3b3cffd8830ca2419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:51.768885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-55850f18-7fa0-402e-bd00-e4abdebe5a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5095343d28645f3b3cffd8830ca2419'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:51.787888 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4354/8659] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:54:51 2022] DELETE /identity/v3/users/a5095343d28645f3b3cffd8830ca2419 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:54:51.964041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:51.978580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ab2b4-625c-433f-904c-dfdb0bb4a0d2 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.038160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.038772 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.039047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.039478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] PATH_INFO: `/v3/projects/2fa0fc78e7e6461484aa23de0f39e47e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.040688 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa0fc78e7e6461484aa23de0f39e47e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.042873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.095887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa0fc78e7e6461484aa23de0f39e47e', 'request_id': 'req-73552d3f-4417-42c6-8708-a0112a28d595'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:52.103416 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa0fc78e7e6461484aa23de0f39e47e', 'request_id': 'req-73552d3f-4417-42c6-8708-a0112a28d595'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:52.110150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa0fc78e7e6461484aa23de0f39e47e', 'request_id': 'req-73552d3f-4417-42c6-8708-a0112a28d595'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:52.124922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] The token cache is being invalidate because project 2fa0fc78e7e6461484aa23de0f39e47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:54:52.125206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:52.125841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-73552d3f-4417-42c6-8708-a0112a28d595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:54:52.128013 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4306/8660] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:54:51 2022] DELETE /identity/v3/projects/2fa0fc78e7e6461484aa23de0f39e47e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:54:52.133765 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.134316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.134661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.167757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:52.169041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:52.230086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4355/8661] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:54:52.241836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.242175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.242447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.263175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:52.264442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:52.274142 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4307/8662] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:52.278868 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.289642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44e926-97cb-4b9e-b8e7-07f788f748a3 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.295814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.296420 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.296703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.296970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.297623 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:54:52.297962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.299607 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.311794 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4356/8663] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:54:52.316311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.326523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92046202-c7a2-47ec-964a-bc320e4f740b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.332106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.332712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.332989 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.333264 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.333950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.336130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.365729 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4308/8664] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:54:52 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:54:52.370353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.380637 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0308bce-9aca-4148-96db-f7d8126f4d9f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.438500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:52.453753 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.454544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.454891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.455259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.456171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.459682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.484400 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4357/8665] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:54:52 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:54:52.489530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.500460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae10e0f-5dd3-4d19-ace7-3af33cab3904 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.506933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.507866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.508148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.508418 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.509054 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.510712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.521713 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4309/8666] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:54:52.526171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.536441 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ee93c-6c22-4011-9c16-935d9ca43433 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.542502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f3e48-218e-4268-9a55-405f454b3520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.543043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f3e48-218e-4268-9a55-405f454b3520 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.543338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f3e48-218e-4268-9a55-405f454b3520 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.543604 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f3e48-218e-4268-9a55-405f454b3520 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.544250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f3e48-218e-4268-9a55-405f454b3520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.546412 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f3e48-218e-4268-9a55-405f454b3520 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.557600 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4358/8667] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:54:52.562082 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.573072 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef118a78-9692-491e-b53f-0e9e9f18f513 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.578109 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.578784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.579066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.579337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] PATH_INFO: `/v3/projects/a317c011296145fb863da26396ce28cd/users/993ee587ea6546a1aac721fb34f9fee8/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.594730 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a317c011296145fb863da26396ce28cd, user_id=993ee587ea6546a1aac721fb34f9fee8, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.597474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.612849 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4310/8668] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:54:52 2022] PUT /identity/v3/projects/a317c011296145fb863da26396ce28cd/users/993ee587ea6546a1aac721fb34f9fee8/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:54:52.624724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a426-b907-4f52-bc8a-d7dfe078f231 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.625008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a426-b907-4f52-bc8a-d7dfe078f231 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.625303 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a426-b907-4f52-bc8a-d7dfe078f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.655492 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-a678a426-b907-4f52-bc8a-d7dfe078f231 None None] MFA Rules not processed for user `993ee587ea6546a1aac721fb34f9fee8`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:52.656743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a678a426-b907-4f52-bc8a-d7dfe078f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:52.721950 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4359/8669] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:54:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:52.732723 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:52.734670 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:52.750825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:54:52.798534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab50e65-f15a-4774-a3f1-18736ecd68be admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:52.802752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:52.803379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:52.803659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:52.803931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:52.813576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:52.815065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:52.825428 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4311/8670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:54:58.106884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:58.107487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:58.107487 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:58.143787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:54:58.145027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:58.266376 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4360/8671] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 03:54:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:54:58.278038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:54:58.279467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:54:58.302516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace59aa8-98dc-43a0-bd6b-0450cfb1137c service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:54:58.308153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa1e9f-bb1a-46e0-a66d-708cd3c625a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:54:58.308880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa1e9f-bb1a-46e0-a66d-708cd3c625a4 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:54:58.309224 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa1e9f-bb1a-46e0-a66d-708cd3c625a4 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:54:58.309569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa1e9f-bb1a-46e0-a66d-708cd3c625a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:54:58.320867 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa1e9f-bb1a-46e0-a66d-708cd3c625a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:54:58.322655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa1e9f-bb1a-46e0-a66d-708cd3c625a4 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:54:58.335150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4312/8672] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:54:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:03.335502 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:03.389902 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:03.406192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8bb37-273c-4163-a037-121a6629af06 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:03.411509 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:03.412153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:03.412433 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:03.412706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] PATH_INFO: `/v3/users/993ee587ea6546a1aac721fb34f9fee8` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:03.413931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=993ee587ea6546a1aac721fb34f9fee8)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:03.415890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:03.465563 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993ee587ea6546a1aac721fb34f9fee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.473197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993ee587ea6546a1aac721fb34f9fee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.473864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993ee587ea6546a1aac721fb34f9fee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.480908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993ee587ea6546a1aac721fb34f9fee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.481541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993ee587ea6546a1aac721fb34f9fee8'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.500491 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4361/8673] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:55:03 2022] DELETE /identity/v3/users/993ee587ea6546a1aac721fb34f9fee8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:03.505249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:03.505793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:03.505793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:03.528414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:03.529627 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:03.599874 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4313/8674] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:55:03.611140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:03.614005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:03.686340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa853f9b-0421-4fc5-912a-f68290a3b1ed admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:03.690475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c20bb-9577-458e-812b-8e38468a8e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:03.691095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c20bb-9577-458e-812b-8e38468a8e64 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:03.691374 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c20bb-9577-458e-812b-8e38468a8e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:03.691617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c20bb-9577-458e-812b-8e38468a8e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:03.701719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c20bb-9577-458e-812b-8e38468a8e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:03.703198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c20bb-9577-458e-812b-8e38468a8e64 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:03.712839 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4362/8675] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:03.896328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:03.897929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:03.917584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2426f-ec9b-4d1f-a424-5c0d4e43fc21 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:03.923478 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:03.924095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:03.924356 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:03.924612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] PATH_INFO: `/v3/projects/a317c011296145fb863da26396ce28cd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:03.925722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a317c011296145fb863da26396ce28cd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:03.927669 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:03.977025 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a317c011296145fb863da26396ce28cd', 'request_id': 'req-482ff767-3f40-43fd-8ad2-c63ff153da80'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.984579 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a317c011296145fb863da26396ce28cd', 'request_id': 'req-482ff767-3f40-43fd-8ad2-c63ff153da80'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:03.990520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a317c011296145fb863da26396ce28cd', 'request_id': 'req-482ff767-3f40-43fd-8ad2-c63ff153da80'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:04.004962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] The token cache is being invalidate because project a317c011296145fb863da26396ce28cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:55:04.005254 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:04.005933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-482ff767-3f40-43fd-8ad2-c63ff153da80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:04.007463 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4314/8676] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:55:03 2022] DELETE /identity/v3/projects/a317c011296145fb863da26396ce28cd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:04.013452 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.013739 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.014044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.035092 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:04.036309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:04.095675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:04.106932 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4363/8677] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:04.114991 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.115310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.115678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.138302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:04.139547 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:04.148232 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4315/8678] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:04.152932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.163199 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb347675-f92e-4bcc-a898-914582a0bbba None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.169036 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.169689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.170377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.170482 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.171823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:55:04.171823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.173465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.186229 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4364/8679] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:55:04.190925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.200198 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d9b9c-d019-4102-8654-66be6ab6b22f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.204805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.205421 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.205695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.205993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.206621 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.208506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.231894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:04.240271 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4316/8680] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:55:04 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:55:04.244872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.255337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27b8a4-5ca5-4c1b-95ec-9fc70c12db8e admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.323754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.324353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.324627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.324897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.325528 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.327486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.352057 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4365/8681] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:55:04 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:55:04.356604 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.367900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6fa99-ab12-4530-af95-89089f041e0b admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.373180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.373795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.374111 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.374383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.375030 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.376636 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.387585 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4317/8682] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:55:04.391645 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.402141 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90653d17-0d87-45ad-b3b6-bd8da23375fd admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.406940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7173c-7499-4e74-b635-d43fdb7223af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.407539 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7173c-7499-4e74-b635-d43fdb7223af admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.407817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7173c-7499-4e74-b635-d43fdb7223af admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.408085 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7173c-7499-4e74-b635-d43fdb7223af admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.408759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7173c-7499-4e74-b635-d43fdb7223af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.410428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7173c-7499-4e74-b635-d43fdb7223af admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.422694 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4366/8683] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:55:04.427000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.437122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905190f5-cb2f-4eb1-a1d3-cfb693710c39 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.441946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.442613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.442891 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.443150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] PATH_INFO: `/v3/projects/91b7a056bb43469b9f2d208de2c32318/users/61fb24a8059044689d0488b32c5d3ddd/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.458245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b7a056bb43469b9f2d208de2c32318, user_id=61fb24a8059044689d0488b32c5d3ddd, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.460893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.478966 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4318/8684] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:55:04 2022] PUT /identity/v3/projects/91b7a056bb43469b9f2d208de2c32318/users/61fb24a8059044689d0488b32c5d3ddd/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:55:04.490019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.490244 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.490520 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.518924 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] MFA Rules not processed for user `61fb24a8059044689d0488b32c5d3ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:04.520146 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:04.597277 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4367/8685] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:04.608640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:04.611679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:04.676643 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc7955-d7ce-407a-b3ff-4b6689136076 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:04.680326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677abc4b-db71-4260-87b6-596d480e3b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:04.680932 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677abc4b-db71-4260-87b6-596d480e3b13 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:04.681204 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677abc4b-db71-4260-87b6-596d480e3b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:04.681499 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677abc4b-db71-4260-87b6-596d480e3b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:04.690440 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677abc4b-db71-4260-87b6-596d480e3b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:04.691869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677abc4b-db71-4260-87b6-596d480e3b13 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:04.700566 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4319/8686] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:09.562918 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:09.622994 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:09.629505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19b4bb-e681-4043-b7a6-77f309c95a39 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:09.634790 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:09.635424 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:09.635738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:09.636005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] PATH_INFO: `/v3/users/61fb24a8059044689d0488b32c5d3ddd` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:09.637128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=61fb24a8059044689d0488b32c5d3ddd)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:09.639129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:09.690506 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61fb24a8059044689d0488b32c5d3ddd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:09.699268 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61fb24a8059044689d0488b32c5d3ddd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:09.699872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61fb24a8059044689d0488b32c5d3ddd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:09.707168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61fb24a8059044689d0488b32c5d3ddd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:09.707872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61fb24a8059044689d0488b32c5d3ddd'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:09.727696 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4368/8687] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:55:09 2022] DELETE /identity/v3/users/61fb24a8059044689d0488b32c5d3ddd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:09.733825 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:09.734333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:09.734428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:09.762743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:09.764684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:09.835466 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4320/8688] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:09.845469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:09.846985 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:09.905390 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984a0db-cefd-4599-94d5-94efeaef8cff admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:09.911052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a7ec9-417f-4d4e-875a-db576dd84513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:09.911957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a7ec9-417f-4d4e-875a-db576dd84513 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:09.912355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a7ec9-417f-4d4e-875a-db576dd84513 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:09.912693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a7ec9-417f-4d4e-875a-db576dd84513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:09.923749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a7ec9-417f-4d4e-875a-db576dd84513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:09.925202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a7ec9-417f-4d4e-875a-db576dd84513 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:09.935006 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4369/8689] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:10.117751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.119360 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:10.137518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be68e52-4a02-4bed-8f90-bd1ac535ef8c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.142282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.142944 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.143222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.143487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] PATH_INFO: `/v3/projects/91b7a056bb43469b9f2d208de2c32318` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.144635 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b7a056bb43469b9f2d208de2c32318)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.146585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.209091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b7a056bb43469b9f2d208de2c32318', 'request_id': 'req-76bf665e-ea94-48c1-834f-fd9133810da6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:10.215789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b7a056bb43469b9f2d208de2c32318', 'request_id': 'req-76bf665e-ea94-48c1-834f-fd9133810da6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:10.220628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:10.221949 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b7a056bb43469b9f2d208de2c32318', 'request_id': 'req-76bf665e-ea94-48c1-834f-fd9133810da6'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:10.236387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] The token cache is being invalidate because project 91b7a056bb43469b9f2d208de2c32318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:55:10.236675 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:10.237337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-76bf665e-ea94-48c1-834f-fd9133810da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:55:10.242966 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4321/8690] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:55:10 2022] DELETE /identity/v3/projects/91b7a056bb43469b9f2d208de2c32318 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:10.244640 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.244978 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.245257 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.266140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:10.267294 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:10.335797 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4370/8691] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:10.337414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.337697 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.337993 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.357904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:10.359114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:10.367600 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4322/8692] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:55:10.372000 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.382473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a028fb1-f412-43a8-8673-4868ab7df6bb None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.387641 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.388258 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.388533 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.388800 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.389573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:55:10.389907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.391617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.404437 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4371/8693] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:55:10.409223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.419004 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72eae8-cf47-4da3-a155-3be19ae197ac None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.423646 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.424247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.424520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.424784 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.425417 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.427359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.455519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4323/8694] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:55:10 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:55:10.459946 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.466536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:10.470678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed75d-7b14-4b9e-bdf0-0a9dd8d72646 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.531184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.531799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.532066 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.532333 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.532980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.534973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.560346 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4372/8695] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:55:10 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:55:10.564805 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.575847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ad069-6766-419b-b326-dae389bf0c48 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.580960 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.581565 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.581870 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.582142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.582779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.584397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.594974 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4324/8696] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:55:10.599077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.609987 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04631a0a-c403-4d34-a653-c23de0bf89a6 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.615959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc29d76-28f3-496d-b89c-a8d2cdcd04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.616568 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29d76-28f3-496d-b89c-a8d2cdcd04ff admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.616871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29d76-28f3-496d-b89c-a8d2cdcd04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.617114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc29d76-28f3-496d-b89c-a8d2cdcd04ff admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.617771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc29d76-28f3-496d-b89c-a8d2cdcd04ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.619454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc29d76-28f3-496d-b89c-a8d2cdcd04ff admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.630798 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4373/8697] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:55:10.635160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.645864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1a5aa-f10d-45f3-860a-e2869b4f09dc admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.651288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.651946 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.652225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.652497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] PATH_INFO: `/v3/projects/09aa2ca9146d4a69ac99e624f73339dd/users/4e76321c46fb4c659cf81f6f5e319df7/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.668201 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09aa2ca9146d4a69ac99e624f73339dd, user_id=4e76321c46fb4c659cf81f6f5e319df7, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.670933 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.685105 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4325/8698] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:55:10 2022] PUT /identity/v3/projects/09aa2ca9146d4a69ac99e624f73339dd/users/4e76321c46fb4c659cf81f6f5e319df7/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:10.692293 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c731-f733-4d59-bb21-518095cee8a0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.692598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c731-f733-4d59-bb21-518095cee8a0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.692877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736c731-f733-4d59-bb21-518095cee8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.713179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-c736c731-f733-4d59-bb21-518095cee8a0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:10.714649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c736c731-f733-4d59-bb21-518095cee8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:10.779473 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4374/8699] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:10.789456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:10.791266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:10.851237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7fe43-4d2e-4a45-a6d7-557cf24abe49 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:10.855558 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:10.856169 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:10.856447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:10.856718 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:10.866500 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:10.867935 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:10.877702 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4326/8700] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:14.589605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:14.590099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:14.590193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:14.619137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] MFA Rules not processed for user `4e76321c46fb4c659cf81f6f5e319df7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:14.620330 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:14.689296 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4375/8701] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:14.694218 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:14.704010 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67351680-83a8-4e14-9bb0-d0217f943b6e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:14.708693 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:14.709290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:14.709571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:14.709868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:14.710494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:14.712401 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:14.746913 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4327/8702] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:55:14 2022] POST /identity/v3/projects => generated 389 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:55:14.748312 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:14.759914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ae96-d884-4b23-baff-55278e5d8ee0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:14.769504 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:14.821328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:14.821997 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:14.822281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:14.822579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:14.823317 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:14.825338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:14.849205 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4376/8703] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:55:14 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:55:14.853612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:14.865338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6a886-581c-4bde-ac86-dc2f59e366ae admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:14.873649 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:14.874339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:14.874613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:14.874881 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:14.875495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:14.877310 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:14.888854 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4328/8704] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:55:14.893347 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:14.904474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04118a8-f7bd-4006-8eb4-06bfced97996 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:14.909414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:14.910162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:14.910494 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:14.910766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] PATH_INFO: `/v3/projects/f4086c05071549c496d60978d93817ba/users/d054f21b4abe49099185c93d1942bc91/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:14.927171 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4086c05071549c496d60978d93817ba, user_id=d054f21b4abe49099185c93d1942bc91, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:14.929832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:14.945106 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4377/8705] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:55:14 2022] PUT /identity/v3/projects/f4086c05071549c496d60978d93817ba/users/d054f21b4abe49099185c93d1942bc91/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:14.949495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:14.960029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b02b18f-37d2-4475-a075-70b9eb2bfe5e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:15.018465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:15.024389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d219e-a8a1-48db-a009-a940a272dcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:15.025316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d219e-a8a1-48db-a009-a940a272dcca admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:15.026845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d219e-a8a1-48db-a009-a940a272dcca admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:15.027337 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d219e-a8a1-48db-a009-a940a272dcca admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:15.028495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d219e-a8a1-48db-a009-a940a272dcca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:15.031677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d219e-a8a1-48db-a009-a940a272dcca admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:15.053559 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4329/8706] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:55:15.058358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:15.069735 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668b29c-681a-4e3a-ac05-19c5e200b261 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:15.077368 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:15.077680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:15.077897 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:15.078124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] PATH_INFO: `/v3/projects/f4086c05071549c496d60978d93817ba/users/d054f21b4abe49099185c93d1942bc91/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:15.080124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4086c05071549c496d60978d93817ba, user_id=d054f21b4abe49099185c93d1942bc91, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:15.082872 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:15.094407 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4378/8707] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:55:15 2022] PUT /identity/v3/projects/f4086c05071549c496d60978d93817ba/users/d054f21b4abe49099185c93d1942bc91/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:55:19.518137 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd09c3-93b1-45d8-b90f-a9302691c9b9 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:19.518658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd09c3-93b1-45d8-b90f-a9302691c9b9 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:19.518769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd09c3-93b1-45d8-b90f-a9302691c9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:19.553293 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-68bd09c3-93b1-45d8-b90f-a9302691c9b9 None None] MFA Rules not processed for user `d054f21b4abe49099185c93d1942bc91`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:19.554528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-68bd09c3-93b1-45d8-b90f-a9302691c9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:19.624530 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4330/8708] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:19 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:19.644332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:19.647691 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:19.726324 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614084bd-9359-4382-8f48-f15cd888f3d4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:19.732074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:19.732681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:19.732947 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:19.733214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:19.789834 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:19.791602 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:19.801031 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4379/8709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:19.876596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:19.876886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:19.877245 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:19.897339 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] MFA Rules not processed for user `4e76321c46fb4c659cf81f6f5e319df7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:19.898612 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:19.905701 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4331/8710] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:55:29.797121 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:29.891853 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:30.333719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:30.335414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:30.395829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8a7a-6baa-4112-b28c-6f3b93d6e53d service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:30.399889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f590ce2-504f-484c-828e-e53b0e02c968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e709a640a524fd0a3e272d397c75e6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:30.400507 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f590ce2-504f-484c-828e-e53b0e02c968 service cinder] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:30.400782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f590ce2-504f-484c-828e-e53b0e02c968 service cinder] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:30.401044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f590ce2-504f-484c-828e-e53b0e02c968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:30.410719 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f590ce2-504f-484c-828e-e53b0e02c968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:30.412194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f590ce2-504f-484c-828e-e53b0e02c968 service cinder] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:30.422618 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4380/8711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:40.418140 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=26 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:55:54.342868 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:55:54.344458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:54.362035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e264e3-2f38-4346-8c49-f295200d4324 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:55:54.368386 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:55:54.369153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:54.369462 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:54.369771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:54.371760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:54.384921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:55:54.386583 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:55:54.398158 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4332/8712] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:55:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:55:55.834275 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329502-89a2-4815-b344-3703a685c016 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:55:55.834862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329502-89a2-4815-b344-3703a685c016 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:55:55.834862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e329502-89a2-4815-b344-3703a685c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:55:55.855706 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-4e329502-89a2-4815-b344-3703a685c016 None None] MFA Rules not processed for user `4e76321c46fb4c659cf81f6f5e319df7`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:55:55.856921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e329502-89a2-4815-b344-3703a685c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:55:55.865095 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4381/8713] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:56:03.895124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:56:03.908086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974561f0-5c80-4acc-9714-926d4043876e service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:56:03.914132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:56:03.914767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:56:03.915046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:56:03.915317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:56:03.917134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:56:03.929892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:56:03.931567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf925b9-c63d-42f8-9c15-5b1a5898a650 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:56:03.943115 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4333/8714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:56:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:56:05.850064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:13.938533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=12 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:30.251652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329502-89a2-4815-b344-3703a685c016 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:56:30.253381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-4e329502-89a2-4815-b344-3703a685c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:56:30.352065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e329502-89a2-4815-b344-3703a685c016 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:56:30.357820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:56:30.358464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:56:30.358740 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:56:30.359010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:56:30.361129 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:56:30.374696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:56:30.376392 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:56:30.388064 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4382/8715] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:56:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:56:31.575336 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:56:31.575854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:56:31.575954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:56:31.595874 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] MFA Rules not processed for user `4e76321c46fb4c659cf81f6f5e319df7`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:56:31.597090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:56:31.604589 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4334/8716] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:56:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:56:40.383628 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=37 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:56:41.590685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:14.299907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:14.393005 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3374c-6d0f-407d-9345-242c6c247581 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:14.398630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:14.399276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:14.399548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:14.399812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] PATH_INFO: `/v3/users/4e76321c46fb4c659cf81f6f5e319df7` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:14.401029 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e76321c46fb4c659cf81f6f5e319df7)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:14.403233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:14.456986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e76321c46fb4c659cf81f6f5e319df7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.468466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e76321c46fb4c659cf81f6f5e319df7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.469087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e76321c46fb4c659cf81f6f5e319df7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.477159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e76321c46fb4c659cf81f6f5e319df7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.477881 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e76321c46fb4c659cf81f6f5e319df7'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.496152 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4383/8717] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:57:14 2022] DELETE /identity/v3/users/4e76321c46fb4c659cf81f6f5e319df7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:57:14.685306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:14.696955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90252b34-7bae-4992-9e08-773a390b5011 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:14.758246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:14.758811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:14.759093 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:14.759359 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] PATH_INFO: `/v3/projects/09aa2ca9146d4a69ac99e624f73339dd` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:14.760514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09aa2ca9146d4a69ac99e624f73339dd)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:14.762606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:14.823479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09aa2ca9146d4a69ac99e624f73339dd', 'request_id': 'req-075f71f2-58bc-4200-bd79-eb9d1c86578f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.829994 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09aa2ca9146d4a69ac99e624f73339dd', 'request_id': 'req-075f71f2-58bc-4200-bd79-eb9d1c86578f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.835596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09aa2ca9146d4a69ac99e624f73339dd', 'request_id': 'req-075f71f2-58bc-4200-bd79-eb9d1c86578f'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.862280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] The token cache is being invalidate because project 09aa2ca9146d4a69ac99e624f73339dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:57:14.862943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.863860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:14.865501 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4335/8718] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:57:14 2022] DELETE /identity/v3/projects/09aa2ca9146d4a69ac99e624f73339dd => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:57:14.869757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:14.871408 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:14.886574 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7797b-7b45-4b9e-9314-ef299978b678 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:14.957710 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:14.958423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:14.958704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:14.958977 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] PATH_INFO: `/v3/users/d054f21b4abe49099185c93d1942bc91` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:14.960134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d054f21b4abe49099185c93d1942bc91)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:14.962133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:14.964884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:15.013137 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd054f21b4abe49099185c93d1942bc91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.022619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd054f21b4abe49099185c93d1942bc91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.023638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd054f21b4abe49099185c93d1942bc91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.031249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd054f21b4abe49099185c93d1942bc91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.031911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-792b4970-668d-4772-a2ba-1da367ee3c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd054f21b4abe49099185c93d1942bc91'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.050422 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4384/8719] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 03:57:14 2022] DELETE /identity/v3/users/d054f21b4abe49099185c93d1942bc91 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:57:15.235780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.237287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:15.252027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f71f2-58bc-4200-bd79-eb9d1c86578f admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.314387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.315020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.315295 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.315567 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] PATH_INFO: `/v3/projects/f4086c05071549c496d60978d93817ba` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.316700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4086c05071549c496d60978d93817ba)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.318640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.341340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:15.368287 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4086c05071549c496d60978d93817ba', 'request_id': 'req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.374576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4086c05071549c496d60978d93817ba', 'request_id': 'req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.380344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4086c05071549c496d60978d93817ba', 'request_id': 'req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.394845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] The token cache is being invalidate because project f4086c05071549c496d60978d93817ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 03:57:15.395120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.395732 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-97cc2a94-0221-4ea0-91bd-65dfe917d3dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 03:57:15.397466 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4336/8720] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 03:57:15 2022] DELETE /identity/v3/projects/f4086c05071549c496d60978d93817ba => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:57:15.402931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.403465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.403465 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.452826 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:15.454097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:15.516140 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4385/8721] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:15.524661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.524954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.525228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.545751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:15.547021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:15.555519 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4337/8722] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:15.560562 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.570954 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf572bd-209c-4e10-95c1-6fe1f8bbd9d0 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.576968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.577619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.577963 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.578232 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.578875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 03:57:15.579186 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.581126 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.593308 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4386/8723] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 03:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 03:57:15.597955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.607346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9dedf-e666-40a4-9836-93d8a9d6954c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.612256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.613242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.613512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.613795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.614455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.616351 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.657593 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4338/8724] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:57:15 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:57:15.662844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.675443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8152f-7865-459d-bb25-912400057b8b admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.721829 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:15.737089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.738095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.738377 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.738651 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.739297 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.741251 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.765836 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4387/8725] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:57:15 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:57:15.771470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.782531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0c6913-6199-4fc7-839e-b2b7ebe4065d admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.787814 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.788430 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.788710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.788975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.789614 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.791277 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.802011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4339/8726] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:57:15.808143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.819687 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc476781-dfba-43ec-a736-11c42976eced admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.825518 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178167f9-9338-436d-ae6c-8e2978e7b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.826177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178167f9-9338-436d-ae6c-8e2978e7b9fd admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.826451 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178167f9-9338-436d-ae6c-8e2978e7b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.826721 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178167f9-9338-436d-ae6c-8e2978e7b9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.827370 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178167f9-9338-436d-ae6c-8e2978e7b9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.828990 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178167f9-9338-436d-ae6c-8e2978e7b9fd admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.840440 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4388/8727] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:57:15.844728 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.855538 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983bb8b-947e-4cf4-b6be-598f30e5cca6 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:15.860495 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:15.861153 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.861429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.861704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] PATH_INFO: `/v3/projects/4fc370103a044e3a949046b97cc17243/users/62e5edf3a5e948189b7ef1bfa80ffef0/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.878067 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc370103a044e3a949046b97cc17243, user_id=62e5edf3a5e948189b7ef1bfa80ffef0, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:15.880760 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:15.896189 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4340/8728] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:57:15 2022] PUT /identity/v3/projects/4fc370103a044e3a949046b97cc17243/users/62e5edf3a5e948189b7ef1bfa80ffef0/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:57:15.901566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2983-35ed-4d02-a41c-61d0c2282b4b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:15.901941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2983-35ed-4d02-a41c-61d0c2282b4b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:15.902252 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2983-35ed-4d02-a41c-61d0c2282b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:15.921322 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-411c2983-35ed-4d02-a41c-61d0c2282b4b None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:15.922550 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-411c2983-35ed-4d02-a41c-61d0c2282b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:15.985401 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4389/8729] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:15.996195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:15.998047 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:16.068161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988fb76-b48b-4b4c-961e-b804d4b35134 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:16.072154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:16.072766 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:16.073046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:16.073313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:16.082803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:16.084240 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:16.094145 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4341/8730] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:57:20.159780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.159780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.159780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.196359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] MFA Rules not processed for user `62e5edf3a5e948189b7ef1bfa80ffef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:20.197682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:20.272158 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4390/8731] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:57:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:20.276731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:20.286943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de7b7-9f33-490b-882d-4697862eef69 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:20.291743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:20.292433 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.292711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.292979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.293628 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:20.295647 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:20.334928 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4342/8732] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 03:57:20 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 03:57:20.335891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:20.348737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe858e-a770-42a7-a78e-6359e7341a3e None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:20.407323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:20.416933 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:20.418278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.418278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.418543 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.419549 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:20.421713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:20.448657 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4391/8733] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 03:57:20 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 03:57:20.452677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:20.464727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ed68c-45a7-49d3-ada4-0435d2d276c2 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:20.472033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:20.472666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.472951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.473225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.473894 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:20.475529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:20.477042 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:20.493371 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4343/8734] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:57:20.497472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:20.509414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb92174-af89-4413-a706-f0a9ecf13e13 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:20.515688 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:20.516456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.516876 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.517239 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] PATH_INFO: `/v3/projects/5029d6bdcec140b48497d284c1da8a88/users/4a73680c2de649b4a4c78fc927ea734f/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.534620 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5029d6bdcec140b48497d284c1da8a88, user_id=4a73680c2de649b4a4c78fc927ea734f, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:20.537304 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:20.552531 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4392/8735] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:57:20 2022] PUT /identity/v3/projects/5029d6bdcec140b48497d284c1da8a88/users/4a73680c2de649b4a4c78fc927ea734f/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 03:57:20.556779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:20.568353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197a93a2-4851-42a3-926f-f037b8092419 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:20.640800 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e4ad3-768f-4f68-a183-50c5830b1710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:20.641445 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e4ad3-768f-4f68-a183-50c5830b1710 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.641715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e4ad3-768f-4f68-a183-50c5830b1710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.642036 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e4ad3-768f-4f68-a183-50c5830b1710 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.642687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e4ad3-768f-4f68-a183-50c5830b1710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:20.644303 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e4ad3-768f-4f68-a183-50c5830b1710 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:20.655357 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4344/8736] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 03:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 03:57:20.659634 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:20.673224 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d95ca-1dd0-4551-97ef-31b17d9ac776 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:20.678228 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:20.678921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:20.679202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:20.679478 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] PATH_INFO: `/v3/projects/5029d6bdcec140b48497d284c1da8a88/users/4a73680c2de649b4a4c78fc927ea734f/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:20.681544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5029d6bdcec140b48497d284c1da8a88, user_id=4a73680c2de649b4a4c78fc927ea734f, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:20.684814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:20.697441 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4393/8737] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 03:57:20 2022] PUT /identity/v3/projects/5029d6bdcec140b48497d284c1da8a88/users/4a73680c2de649b4a4c78fc927ea734f/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 03:57:24.693281 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c9530-1637-45cc-8a88-4c5906353f1b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:24.693783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c9530-1637-45cc-8a88-4c5906353f1b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:24.693908 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c9530-1637-45cc-8a88-4c5906353f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:24.727378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a88c9530-1637-45cc-8a88-4c5906353f1b None None] MFA Rules not processed for user `4a73680c2de649b4a4c78fc927ea734f`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:24.729263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a88c9530-1637-45cc-8a88-4c5906353f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:24.746342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:24.749400 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:24.811493 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4345/8738] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:57:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:24.830490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a43cc-469f-4fde-9b65-06f06e89ed7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:24.837381 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:24.838173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:24.838396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:24.838784 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:24.841116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:24.844506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ec92b-1ebf-4e9d-ba2d-568b0feee602 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:24.844506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ec92b-1ebf-4e9d-ba2d-568b0feee602 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:24.844506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ec92b-1ebf-4e9d-ba2d-568b0feee602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:24.855142 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:24.856949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:24.868279 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4394/8739] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:57:24.899962 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-235ec92b-1ebf-4e9d-ba2d-568b0feee602 None None] MFA Rules not processed for user `e800c060beb045008c905a591d290cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:24.901200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-235ec92b-1ebf-4e9d-ba2d-568b0feee602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:24.959585 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=100 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:24.971521 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4346/8740] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Oct 29 03:57:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:57:24.978157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:24.988206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a5cd2-d514-4c61-a06b-668a2402af29 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:24.993266 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:24.993911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:24.994310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:24.994605 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:25.058393 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:25.059915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:25.069407 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4395/8741] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:57:25.225990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dd0f8-6e12-4a4f-a5a8-58fe610e31cd None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:25.226410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dd0f8-6e12-4a4f-a5a8-58fe610e31cd None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:25.226771 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6dd0f8-6e12-4a4f-a5a8-58fe610e31cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:25.289711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-9a6dd0f8-6e12-4a4f-a5a8-58fe610e31cd None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:25.290615 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9a6dd0f8-6e12-4a4f-a5a8-58fe610e31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:25.406686 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4347/8742] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:57:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:25.456311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:25.457908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:25.503201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:25.562673 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dec13-af64-449a-8c36-2826d19aa9a6 service glance] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:25.567821 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:25.568526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:25.568869 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:25.569202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:25.579116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:25.580704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:25.589845 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4396/8743] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:57:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 03:57:34.565830 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:34.566306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:34.566409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:34.587269 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] MFA Rules not processed for user `62e5edf3a5e948189b7ef1bfa80ffef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:34.588484 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:34.595693 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4348/8744] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 03:57:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 03:57:34.867061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:34.925791 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68ca96-25fc-4925-afb5-ebfb19e2f078 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:34.929828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:34.930450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:34.930728 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:34.930996 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:34.932896 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:34.942681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:34.944097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d791e-9eaa-4590-aa43-fe06d9320653 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:34.952408 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4397/8745] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:57:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:57:35.279832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:35.292032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e578f-ac0b-411a-b812-06e09e598a9f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:35.297740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:35.298431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:35.298710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:35.298961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:35.300711 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:35.312911 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:35.314534 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:35.325239 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4349/8746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:57:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:57:36.702702 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:36.703276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:36.703276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:36.725131 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 03:57:36.726349 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:57:36.735361 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4398/8747] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 03:57:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 03:57:36.748203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:57:36.759419 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3990276-c0ea-40c1-9975-10fe0f646c0c service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:57:36.764755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:57:36.765375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:57:36.765656 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:57:36.765969 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:57:36.774645 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:57:36.776228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:57:36.789692 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4350/8748] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 03:57:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 03:57:46.719501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=54 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:57:46.786443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=58 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:58:08.744516 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:58:08.746281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:58:08.758848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd15fe-cc00-461d-a3a2-201a2f6c30d4 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:58:08.763012 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:58:08.763619 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:58:08.763899 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:58:08.764229 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:58:08.774439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:58:08.775901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:58:08.785841 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4399/8749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:58:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:58:18.781909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 03:59:50.475752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:59:50.488381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fced08-e359-499a-b601-e0df69ebbddc service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:59:50.492575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:59:50.493167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:59:50.493453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:59:50.493713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:59:50.495683 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:59:50.504501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:59:50.513470 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c277bf-7342-417a-adf8-d23e0a4baff6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:59:50.517823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:59:50.518652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:59:50.518930 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:59:50.519200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:59:50.521248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:59:50.531939 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:59:50.533405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:59:50.541814 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4400/8750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 03:59:50.589974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:59:50.591555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:59:50.613274 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4351/8751] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:59:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 03:59:51.815867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 03:59:51.825376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccb0fb-8ad1-43e0-9234-91390650fb8d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 03:59:51.829941 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 03:59:51.830547 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 03:59:51.830824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 03:59:51.831091 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 03:59:51.833078 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 03:59:51.847037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 03:59:51.848447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 03:59:51.859493 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4401/8752] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 03:59:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:00:00.609719 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=46 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:00:01.854973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:05.042066 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:05.044633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:05.069987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe473924-e88d-4b99-9cbe-c16e0231a11e service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:05.076428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:05.077280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:05.077663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:05.078059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:05.079953 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:05.097514 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:05.099930 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18927af-1c64-4d71-8d77-079faae9c95e service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:05.143788 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4352/8753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:01:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:01:15.119572 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:18.392340 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:18.405943 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52919-12ce-4d07-86ae-481bda8ea664 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:18.411862 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:18.412889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:18.412889 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:18.413183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:18.415089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:18.428027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:18.429664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:18.440707 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4402/8754] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:01:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:01:19.823655 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7813-ef45-4063-8a57-84719efb2ceb None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:19.824140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7813-ef45-4063-8a57-84719efb2ceb None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:19.824242 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7813-ef45-4063-8a57-84719efb2ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:19.843866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a5db7813-ef45-4063-8a57-84719efb2ceb None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:01:19.845088 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a5db7813-ef45-4063-8a57-84719efb2ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:19.853080 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4353/8755] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 04:01:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:01:19.897484 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:19.910595 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f38b63-c647-421f-8954-0044f4af67a9 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:19.916346 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:19.916975 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:19.917245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:19.917513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:19.926052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:19.927632 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:19.935736 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4403/8756] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:01:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:01:20.451703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8f419-6dbb-416e-a938-68a2b4ddd918 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:20.452187 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8f419-6dbb-416e-a938-68a2b4ddd918 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:20.452463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8f419-6dbb-416e-a938-68a2b4ddd918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:20.472230 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e1e8f419-6dbb-416e-a938-68a2b4ddd918 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:01:20.473458 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e1e8f419-6dbb-416e-a938-68a2b4ddd918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:20.482873 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4354/8757] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:01:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 04:01:20.497351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:20.510475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22e10-fe68-49e7-819b-d910c108918a service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:20.516037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:20.516642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:20.516921 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:20.517193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:20.526086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:20.527682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:20.536112 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4404/8758] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:01:28.845165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:28.845701 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:28.845836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:28.866116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] MFA Rules not processed for user `62e5edf3a5e948189b7ef1bfa80ffef0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:01:28.867329 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:28.874872 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4355/8759] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:01:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:01:29.165612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:29.179021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5bc35c-69f3-4527-acce-b1337acfcba8 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:29.183560 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:29.184161 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:29.184427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:29.184671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:29.186904 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:29.198269 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:29.199747 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:29.208412 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4405/8760] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:01:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:01:29.559972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:29.561552 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:29.577142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c234d3-36e4-4482-b6ff-7af4be25be68 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:29.582563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:29.583158 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:29.583436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:29.583710 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:29.585569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:29.598442 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:29.600130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcdfd86-83ac-4089-92d6-050187cddbf0 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:29.610711 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4356/8761] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:01:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:01:30.151759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:30.164013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4993-5b24-40de-974c-3a2029630731 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:30.169278 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:30.169893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:30.170201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:30.170467 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:30.172471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:30.184052 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:30.185606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:30.195810 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4406/8762] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:01:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:01:31.045219 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:31.045752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:31.046395 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:31.066666 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:01:31.068084 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:31.075470 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4357/8763] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:01:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:01:31.088885 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:31.100893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25205817-8c85-448f-ad71-7fb1e417e6b8 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:31.106111 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:31.106822 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:31.107102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:31.107371 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:31.116271 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:31.117895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:31.126153 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4407/8764] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:01:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:01:41.061743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=18 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:41.122972 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=36 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:01:45.364895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:01:45.366449 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:45.385402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1b1c9-8c2e-4840-9e37-3c90664abf92 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:01:45.391071 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:01:45.391663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:01:45.392031 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:01:45.392311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:01:45.394346 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:01:45.407722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:01:45.409325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:01:45.421004 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4358/8765] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:01:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:01:55.416002 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:24.823040 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:02:24.838064 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3e3ea-b53c-4bfa-955d-9d65e70ab7b5 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:02:24.845617 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fb9b3-e01c-4126-b9fd-7c3d4ca4c251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:02:24.846248 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fb9b3-e01c-4126-b9fd-7c3d4ca4c251 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:02:24.846521 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fb9b3-e01c-4126-b9fd-7c3d4ca4c251 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:02:24.846788 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fb9b3-e01c-4126-b9fd-7c3d4ca4c251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:02:24.855854 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fb9b3-e01c-4126-b9fd-7c3d4ca4c251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:02:24.857439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fb9b3-e01c-4126-b9fd-7c3d4ca4c251 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:02:24.867213 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4408/8766] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:02:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:02:29.752869 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:02:29.774599 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51e33a-88c6-4113-a78c-20a374c41451 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:02:29.779722 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:02:29.780322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:02:29.780598 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:02:29.780924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:02:29.790474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:02:29.792098 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:02:29.802692 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4359/8767] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:02:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:02:34.863190 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:02:39.798704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:17.937761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:17.938315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:17.938315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:17.964907 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:03:17.966777 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:17.975911 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4409/8768] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 04:03:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:03:18.017106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:18.030902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a3f8a-25e4-4942-8666-60e2aef66445 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:18.037740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:18.038390 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:18.038650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:18.038914 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:18.047776 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:18.049358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:18.057831 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4360/8769] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:03:18.438957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:18.453555 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a196d-36c9-48f8-8fb8-43197ffb8b9c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:18.457846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:18.458476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:18.458751 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:18.459021 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:18.523449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:18.524927 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:18.535225 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4410/8770] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:03:21.748668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:21.760942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961b4e0-4bd6-4d05-aefd-f273980770b2 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:21.766367 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:21.766977 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:21.767251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:21.767520 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:21.769322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:21.788206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:21.790333 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:21.803102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4361/8771] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:03:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:03:25.182566 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:25.193786 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820feef-074e-41b0-b50b-9257dd12b246 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:25.198986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:25.199675 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:25.199948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:25.200217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] PATH_INFO: `/v3/users/62e5edf3a5e948189b7ef1bfa80ffef0` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:25.201337 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62e5edf3a5e948189b7ef1bfa80ffef0)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:25.203522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:25.259245 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62e5edf3a5e948189b7ef1bfa80ffef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.267309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62e5edf3a5e948189b7ef1bfa80ffef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.267967 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62e5edf3a5e948189b7ef1bfa80ffef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.275179 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62e5edf3a5e948189b7ef1bfa80ffef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.275809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62e5edf3a5e948189b7ef1bfa80ffef0'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.292830 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4411/8772] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:03:25 2022] DELETE /identity/v3/users/62e5edf3a5e948189b7ef1bfa80ffef0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:03:25.477941 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:25.489314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eede8-897e-4ad0-a9ea-1cc3f24d2e6c service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:25.550041 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:25.550685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:25.550986 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:25.551256 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] PATH_INFO: `/v3/projects/4fc370103a044e3a949046b97cc17243` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:25.552381 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc370103a044e3a949046b97cc17243)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:25.554323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:25.614446 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc370103a044e3a949046b97cc17243', 'request_id': 'req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.620921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc370103a044e3a949046b97cc17243', 'request_id': 'req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.627270 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc370103a044e3a949046b97cc17243', 'request_id': 'req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.643279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] The token cache is being invalidate because project 4fc370103a044e3a949046b97cc17243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:03:25.643571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.644207 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.645787 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4362/8773] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:03:25 2022] DELETE /identity/v3/projects/4fc370103a044e3a949046b97cc17243 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:03:25.650384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:25.652003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:25.666203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473776e-2885-48ae-a210-ed46a0f4c245 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:25.732019 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:25.732660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:25.732938 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:25.733207 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] PATH_INFO: `/v3/users/4a73680c2de649b4a4c78fc927ea734f` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:25.735044 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a73680c2de649b4a4c78fc927ea734f)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:25.738671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:25.740684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:25.790874 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a73680c2de649b4a4c78fc927ea734f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.800200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a73680c2de649b4a4c78fc927ea734f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.800851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a73680c2de649b4a4c78fc927ea734f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.808168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a73680c2de649b4a4c78fc927ea734f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.808809 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-39282ed1-1c74-40f3-8e9c-d3495d269db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a73680c2de649b4a4c78fc927ea734f'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:25.827409 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4412/8774] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:03:25 2022] DELETE /identity/v3/users/4a73680c2de649b4a4c78fc927ea734f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 04:03:26.017929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.019820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:26.034180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6783e-c179-44cf-a03a-c15e54ab7e0e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.095713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.096362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.096637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.096903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] PATH_INFO: `/v3/projects/5029d6bdcec140b48497d284c1da8a88` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.098091 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5029d6bdcec140b48497d284c1da8a88)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.100040 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.106727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:26.157388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5029d6bdcec140b48497d284c1da8a88', 'request_id': 'req-df955f37-cf7b-47c5-9398-b7e1c70e00fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:26.164571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5029d6bdcec140b48497d284c1da8a88', 'request_id': 'req-df955f37-cf7b-47c5-9398-b7e1c70e00fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:26.170668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5029d6bdcec140b48497d284c1da8a88', 'request_id': 'req-df955f37-cf7b-47c5-9398-b7e1c70e00fc'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:26.184743 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] The token cache is being invalidate because project 5029d6bdcec140b48497d284c1da8a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:03:26.184943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:26.185596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-df955f37-cf7b-47c5-9398-b7e1c70e00fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:03:26.187174 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4363/8775] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:03:26 2022] DELETE /identity/v3/projects/5029d6bdcec140b48497d284c1da8a88 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:03:26.192705 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.193222 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.193321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.214501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:03:26.215713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:26.279539 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4413/8776] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:03:26.288778 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.289059 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.289326 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.310115 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:03:26.311328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:26.321287 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4364/8777] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:03:26.325650 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.335678 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c58fb-bab2-4c00-979e-fea1078eeeff None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.340548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.341147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.341416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.341707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.342384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 04:03:26.342684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.344372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.357031 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4414/8778] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 04:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 04:03:26.362167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.372341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5bfda-84e0-4bd9-a021-743d63ce39b0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.378234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.378854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.379124 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.379424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.380085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.382009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.412660 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4365/8779] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:03:26.417073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.427884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775074f2-74d3-469b-b1c4-f51ddb4b01e0 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.487952 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.488567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.488844 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.489113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.489736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.491693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.502973 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:26.517982 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4415/8780] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:03:26.520901 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.532020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca2602-8770-4183-bf11-a0c4d4fe9c5c admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.537606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.538252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.538533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.538811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.539452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.541062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.551775 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4366/8781] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:03:26.556454 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.566999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe725f-1a3f-4708-aeb2-c1e7fa6ef36f admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.572848 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f470270-6a61-4870-8f70-6e8dbcfb2e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.573436 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470270-6a61-4870-8f70-6e8dbcfb2e4f admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.573738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470270-6a61-4870-8f70-6e8dbcfb2e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.574041 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f470270-6a61-4870-8f70-6e8dbcfb2e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.574762 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470270-6a61-4870-8f70-6e8dbcfb2e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.576375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f470270-6a61-4870-8f70-6e8dbcfb2e4f admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.587722 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4416/8782] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:03:26.592156 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.602740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793e5fb-341b-41db-b1c5-5bf00f5ab2db admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.607801 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.608455 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.608731 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.609051 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] PATH_INFO: `/v3/projects/fef87f25af434ef59f486bcca46f43f3/users/24c2655ccbad4be3b3d2fca5f3f01cf9/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.624757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef87f25af434ef59f486bcca46f43f3, user_id=24c2655ccbad4be3b3d2fca5f3f01cf9, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.627584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.644268 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4367/8783] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:03:26 2022] PUT /identity/v3/projects/fef87f25af434ef59f486bcca46f43f3/users/24c2655ccbad4be3b3d2fca5f3f01cf9/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:03:26.655280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.655606 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.655884 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.684447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] MFA Rules not processed for user `24c2655ccbad4be3b3d2fca5f3f01cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:03:26.685671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:26.753089 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4417/8784] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:03:26.757767 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.825626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55c32e-eeab-44a5-9711-54dbf73b7fd5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.831922 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.832639 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.832974 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.833344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.834063 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.836288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.866129 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4368/8785] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/projects => generated 393 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:03:26.870445 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.882120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342bd34-bef2-44ab-bca2-aab4205381e9 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.941591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.942285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.942569 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.942852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.943500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.945463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:26.970130 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4418/8786] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 04:03:26 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:03:26.974387 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:26.985161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc20f9-ab6e-44d3-8490-5ac93c594b5e admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:26.994062 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:26.995000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:26.995312 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:26.995634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:26.996630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:26.998957 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:27.010881 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4369/8787] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:03:27.015235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:27.027214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70d4e8-4f74-498f-bcc5-3a509de4db20 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:27.032962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:27.033817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:27.034100 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:27.034376 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] PATH_INFO: `/v3/projects/36be3f6b75654d71b5ff0851fb858e6a/users/6f5a3f42a8704d989c99f6456d085b7a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:27.049900 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36be3f6b75654d71b5ff0851fb858e6a, user_id=6f5a3f42a8704d989c99f6456d085b7a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:27.052630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:27.073174 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4419/8788] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:03:27 2022] PUT /identity/v3/projects/36be3f6b75654d71b5ff0851fb858e6a/users/6f5a3f42a8704d989c99f6456d085b7a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 04:03:27.074684 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:27.081358 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:27.085354 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114ead1-6043-4dae-9b9e-5556f46fd945 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:27.145118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb15e5d9-6b06-4288-903b-2076596eb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:27.145725 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e5d9-6b06-4288-903b-2076596eb05b admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:27.146029 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e5d9-6b06-4288-903b-2076596eb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:27.146297 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb15e5d9-6b06-4288-903b-2076596eb05b admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:27.146942 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e5d9-6b06-4288-903b-2076596eb05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:27.148575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb15e5d9-6b06-4288-903b-2076596eb05b admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:27.159045 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4370/8789] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:03:27.163537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:27.174851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ae9b8-7ede-4e27-b4e3-93771d020f6d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:27.179832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:27.180505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:27.180778 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:27.181046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] PATH_INFO: `/v3/projects/36be3f6b75654d71b5ff0851fb858e6a/users/6f5a3f42a8704d989c99f6456d085b7a/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:27.183051 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36be3f6b75654d71b5ff0851fb858e6a, user_id=6f5a3f42a8704d989c99f6456d085b7a, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:27.185703 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:27.196337 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4420/8790] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:03:27 2022] PUT /identity/v3/projects/36be3f6b75654d71b5ff0851fb858e6a/users/6f5a3f42a8704d989c99f6456d085b7a/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:03:27.207034 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:27.207321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:27.207594 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:27.237050 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] MFA Rules not processed for user `6f5a3f42a8704d989c99f6456d085b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:03:27.238325 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:27.314893 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4371/8791] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:03:27 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:03:27.330113 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:27.332575 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:27.370915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:27.418793 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02880ae-833c-4332-bfd7-7e477d4a8a70 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:27.426145 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591e078-ab97-4c77-8531-e9eaf76a9f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:27.426759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591e078-ab97-4c77-8531-e9eaf76a9f6c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:27.427027 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591e078-ab97-4c77-8531-e9eaf76a9f6c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:27.427299 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591e078-ab97-4c77-8531-e9eaf76a9f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:27.486444 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591e078-ab97-4c77-8531-e9eaf76a9f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:27.488438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591e078-ab97-4c77-8531-e9eaf76a9f6c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:27.497569 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4421/8792] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:03:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:03:30.328840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:30.330781 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:30.392009 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e40da9-01f1-412c-b07d-f6696e96776b None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:30.396175 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:30.396898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:30.397274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:30.397551 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:30.408022 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:30.409528 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:30.420745 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4372/8793] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:03:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:03:33.298581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:33.298980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:33.299182 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:33.320348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] MFA Rules not processed for user `24c2655ccbad4be3b3d2fca5f3f01cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:03:33.321622 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:33.333421 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4422/8794] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:03:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:03:33.712752 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:33.714569 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:33.727079 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cecb5c-2833-41b3-bd7c-823fb02133a5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:33.732925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:33.732925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:33.732925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:33.732925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:33.735925 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:33.750637 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:33.752494 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba44052-74eb-495c-8681-2b9989adb02b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:33.768339 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4373/8795] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:03:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:03:34.228944 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:03:34.233274 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:34.320931 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779bac8-e1ef-4099-a2a1-4b704ad0696a None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:03:34.328880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:03:34.329932 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:03:34.330404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:03:34.330851 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:03:34.333409 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:03:34.346815 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:03:34.348043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:03:34.360172 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4423/8796] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:03:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:03:43.760106 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=93 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:03:44.354958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=79 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:36.594789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:04:36.595527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:04:36.595527 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:04:36.628535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] MFA Rules not processed for user `24c2655ccbad4be3b3d2fca5f3f01cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:04:36.629903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:04:36.663795 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4374/8797] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:04:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:04:46.661679 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=15 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:04:50.295824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:04:50.319668 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3151954-08db-4112-b29c-01fcbbedfb1e service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:04:50.323798 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:04:50.324867 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:04:50.325158 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:04:50.325490 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:04:50.327267 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:04:50.332289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:04:50.343371 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79c365-3c0c-45f0-8f65-cf9d2208988c None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:04:50.349069 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:04:50.349769 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:04:50.350134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:04:50.350476 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:04:50.352464 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:04:50.362985 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:04:50.363188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:04:50.364512 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:04:50.364787 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743ed05-e831-450b-81ad-016f5f1d9611 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:04:50.374269 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4375/8798] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:04:50.377394 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4424/8799] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:05:00.370562 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:00.371564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=18 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:05:18.521163 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:05:18.553289 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a80c7c7-5231-4275-9104-3646401d076a service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:05:18.557463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:05:18.558320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:05:18.558607 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:05:18.558936 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:05:18.561014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:05:18.575948 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:05:18.578467 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:05:18.590617 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4376/8800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:05:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:05:28.585409 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:15.447730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:06:15.448316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:06:15.448316 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:06:15.469684 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] MFA Rules not processed for user `24c2655ccbad4be3b3d2fca5f3f01cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:06:15.471277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:06:15.479823 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4425/8801] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:06:15 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 04:06:18.897288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:06:18.899294 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:06:18.915879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec0a13-6b67-491d-bda5-f4e10ccfeb34 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:06:18.922653 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:06:18.923298 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:06:18.923561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:06:18.923836 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:06:18.926588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:06:18.941027 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:06:18.942712 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:06:18.955011 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4377/8802] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:06:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:06:25.463839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:28.950150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:28.970962 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:06:28.987133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589fe8f7-a621-4fa6-8b09-b5ba1e32fa4c None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:06:28.995277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:06:28.995936 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:06:28.996213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:06:28.996579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:06:28.998468 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:06:29.011580 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:06:29.013177 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4d2d5-ac5a-4df3-b248-20350381d33c service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:06:29.024484 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4426/8803] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:06:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:06:39.019959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:06:50.679690 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:06:50.681320 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:06:50.710100 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaae882-4574-427c-be9f-6ba790124a72 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:06:50.715700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:06:50.716313 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:06:50.716629 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:06:50.716887 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:06:50.719206 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:06:50.731650 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:06:50.733237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:06:50.743643 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4378/8804] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:06:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:00.739735 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:01.879760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4bb1e-d7b6-49e8-8c00-09473d35b3a5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:01.880425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4bb1e-d7b6-49e8-8c00-09473d35b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:01.880425 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4bb1e-d7b6-49e8-8c00-09473d35b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:01.940635 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-86a4bb1e-d7b6-49e8-8c00-09473d35b3a5 None None] MFA Rules not processed for user `0e12ad7dd0524e218c5d4be524ec7cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:07:01.941754 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-86a4bb1e-d7b6-49e8-8c00-09473d35b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:01.948840 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4427/8805] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 04:07:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:07:01.961311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:01.971299 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a4770-4fc2-4f85-af96-ff365f202f4a service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:01.975847 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:01.976474 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:01.976748 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:01.977020 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:01.984738 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:01.986610 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:01.994994 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4379/8806] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:02.076427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c54387-d7bd-48aa-96c1-5287f08f0887 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:02.076664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c54387-d7bd-48aa-96c1-5287f08f0887 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:02.076945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c54387-d7bd-48aa-96c1-5287f08f0887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:02.119259 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d2c54387-d7bd-48aa-96c1-5287f08f0887 None None] MFA Rules not processed for user `b6ca3aaf505f4d76bae1ad093ddb64f5`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:07:02.120497 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2c54387-d7bd-48aa-96c1-5287f08f0887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:02.130176 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4428/8807] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 04:07:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:07:02.142726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:02.156282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc06cd2-092b-4d06-ba5d-c2d4440b46c5 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:02.162013 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:02.162617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:02.162893 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:02.163161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:02.171611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:02.173180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:02.182755 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4380/8808] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:03.380882 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:03.381355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:03.381475 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:03.423421 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:07:03.424700 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:03.435524 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4429/8809] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 04:07:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:07:03.448039 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:03.460677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5d07a-cb47-4714-a4a8-5381f6116f67 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:03.465267 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:03.465885 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:03.466164 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:03.466431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:03.477376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:03.478845 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:03.490019 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4381/8810] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:03.554812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:03.567280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ef92d-d40b-4b42-a119-bd0fc26f0ecc None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:03.573625 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:03.574261 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:03.574548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:03.574863 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:03.576980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:03.589237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:03.590909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:03.601073 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4430/8811] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:13.485633 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=18 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:13.596725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=41 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:20.215773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:20.225116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd758a-f9ba-49d9-a1e3-5f462a87439f service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:20.229703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:20.230447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:20.230729 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:20.230999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:20.233074 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:20.256456 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:20.257879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:20.265948 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4382/8812] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:28.558942 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:28.574548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8b087-d561-47d4-bebd-13c799018034 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:28.581315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:28.581999 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:28.582277 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:28.582544 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:28.584780 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:28.597712 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:28.599567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:28.610697 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4431/8813] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:30.262504 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=11 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:32.746840 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:07:32.765903 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8aa082-47bf-4d05-98e5-59f020ee15af service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:07:32.773896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:07:32.774497 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:07:32.774774 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:07:32.775038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:07:32.776939 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:07:32.791363 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:07:32.792998 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3766d-9256-4023-bfbc-e5e208e77f18 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:07:32.804523 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4383/8814] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:07:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:07:38.605814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:07:42.800389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:04.878744 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:08:04.891008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fbbec-d24a-4f5f-a434-5dc3e7311b92 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:08:04.912795 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:08:04.914807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:08:04.914807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:08:04.914807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:08:04.916485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:08:04.940119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:08:04.941866 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:08:04.959450 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4432/8815] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:08:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:08:10.866987 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:08:10.867479 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:08:10.867590 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:08:10.894895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] MFA Rules not processed for user `24c2655ccbad4be3b3d2fca5f3f01cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:08:10.896170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:08:10.907216 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4384/8816] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:08:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:08:11.276652 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:08:11.286915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5f375-ba5a-4eb2-9666-abd0dbf4cbd5 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:08:11.290803 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:08:11.291459 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:08:11.291738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:08:11.292014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:08:11.293812 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:08:11.305823 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:08:11.307358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:08:11.316162 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4433/8817] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:08:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:08:20.887799 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:21.312355 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:08:44.945237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:08:44.960237 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3777b-934c-440f-a906-89da4d8fe46a None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:08:44.967249 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b122081-148f-4d27-968a-91bd2d2a71bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:08:44.967859 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b122081-148f-4d27-968a-91bd2d2a71bc service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:08:44.968142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b122081-148f-4d27-968a-91bd2d2a71bc service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:08:44.968410 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b122081-148f-4d27-968a-91bd2d2a71bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:08:44.976727 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b122081-148f-4d27-968a-91bd2d2a71bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:08:44.978340 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b122081-148f-4d27-968a-91bd2d2a71bc service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:08:44.987805 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4385/8818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:08:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:08:54.983496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:09:46.119758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:09:46.129020 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ded038-7a0c-4009-88df-4286797d9e82 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:09:46.133682 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:09:46.134342 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:09:46.134742 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:09:46.135002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:09:46.144659 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:09:46.146133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:09:46.156469 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4434/8819] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:09:49.035344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:09:49.035909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:09:49.035909 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:09:49.068362 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] MFA Rules not processed for user `24c2655ccbad4be3b3d2fca5f3f01cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:09:49.069658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:09:49.077394 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4386/8820] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:09:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:09:49.221852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:09:49.231236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0548-b923-4034-b9d1-453443615ffd service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:09:49.235300 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:09:49.235916 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:09:49.236193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:09:49.236463 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:09:49.251976 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:09:49.254197 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:09:49.266990 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4435/8821] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:09:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:09:52.052203 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:09:52.063919 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013db3f-71a9-409c-bffc-eea9b9c75f97 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:09:52.067780 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:09:52.068408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:09:52.068686 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:09:52.069234 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:09:52.078510 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:09:52.079954 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:09:52.094058 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4387/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:09:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:09:59.261511 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=12 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:02.085426 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=9 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:30.882055 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:30.891895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56d534-b88c-406f-8ddd-6f0a92ee769d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:30.898292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:30.899216 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:30.899587 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:30.899957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:30.919657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:30.921115 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:30.944631 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4436/8823] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:10:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:10:40.941132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=13 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:43.159888 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:43.172838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049e044-5f15-48bc-a13e-3184b7364c61 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:43.178000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:43.178634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:43.178912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:43.179186 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:43.180952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:43.193211 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:43.194880 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617d41a-b412-4447-9a54-ca3ccab3c942 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:43.205057 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4388/8824] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:10:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:10:43.470986 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:43.566356 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50289828-1446-426a-bd98-d25c73edf0f6 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:43.571920 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:43.572537 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:43.572818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:43.573114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] PATH_INFO: `/v3/users/24c2655ccbad4be3b3d2fca5f3f01cf9` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:43.574327 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c2655ccbad4be3b3d2fca5f3f01cf9)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:43.576378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:43.637624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c2655ccbad4be3b3d2fca5f3f01cf9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:43.648338 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c2655ccbad4be3b3d2fca5f3f01cf9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:43.650877 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c2655ccbad4be3b3d2fca5f3f01cf9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:43.672704 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c2655ccbad4be3b3d2fca5f3f01cf9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:43.673670 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c2655ccbad4be3b3d2fca5f3f01cf9'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:43.699648 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4437/8825] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:10:43 2022] DELETE /identity/v3/users/24c2655ccbad4be3b3d2fca5f3f01cf9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 04:10:43.701015 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:43.701306 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:43.701575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:43.747828 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:43.749095 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:43.822548 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4389/8826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:43.834442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:43.836279 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:43.909204 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869acab-fc6b-44b7-9a20-e673be930c7a admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:43.913486 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:43.914167 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:43.914440 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:43.914730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:43.927053 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:43.928485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:43.942476 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4438/8827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:10:44.170225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:44.171841 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:44.191085 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15568d0-4db5-43ca-bdb8-548c307a32d3 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:44.197171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:44.197895 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:44.198195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:44.198465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] PATH_INFO: `/v3/projects/fef87f25af434ef59f486bcca46f43f3` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:44.199808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef87f25af434ef59f486bcca46f43f3)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:44.201979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:44.255412 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef87f25af434ef59f486bcca46f43f3', 'request_id': 'req-594663c0-9f26-4eb2-b678-4d9ef877a5c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.262658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef87f25af434ef59f486bcca46f43f3', 'request_id': 'req-594663c0-9f26-4eb2-b678-4d9ef877a5c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.268274 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef87f25af434ef59f486bcca46f43f3', 'request_id': 'req-594663c0-9f26-4eb2-b678-4d9ef877a5c4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.285323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] The token cache is being invalidate because project fef87f25af434ef59f486bcca46f43f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:10:44.285699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.286721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.289144 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4390/8828] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:10:44 2022] DELETE /identity/v3/projects/fef87f25af434ef59f486bcca46f43f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:10:44.295133 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:44.301515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:44.305708 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315dbb8-4141-42c2-910e-384f19de8be8 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:44.370760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:44.371505 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:44.371970 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:44.372298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] PATH_INFO: `/v3/users/6f5a3f42a8704d989c99f6456d085b7a` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:44.374077 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5a3f42a8704d989c99f6456d085b7a)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:44.376875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:44.429372 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5a3f42a8704d989c99f6456d085b7a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.438964 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5a3f42a8704d989c99f6456d085b7a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.439730 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5a3f42a8704d989c99f6456d085b7a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.447181 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5a3f42a8704d989c99f6456d085b7a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.447832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-12f959b5-96f0-4e50-ac67-51b2cb977597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5a3f42a8704d989c99f6456d085b7a'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.467664 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4439/8829] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:10:44 2022] DELETE /identity/v3/users/6f5a3f42a8704d989c99f6456d085b7a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:10:44.759454 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:44.761288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:44.774842 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594663c0-9f26-4eb2-b678-4d9ef877a5c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:44.827606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:44.839369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:44.840016 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:44.840523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:44.840864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] PATH_INFO: `/v3/projects/36be3f6b75654d71b5ff0851fb858e6a` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:44.842150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36be3f6b75654d71b5ff0851fb858e6a)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:44.844116 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:44.895460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36be3f6b75654d71b5ff0851fb858e6a', 'request_id': 'req-a7db7b83-f8e7-452a-9c97-96867f5a52a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.901687 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36be3f6b75654d71b5ff0851fb858e6a', 'request_id': 'req-a7db7b83-f8e7-452a-9c97-96867f5a52a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.907816 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36be3f6b75654d71b5ff0851fb858e6a', 'request_id': 'req-a7db7b83-f8e7-452a-9c97-96867f5a52a4'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.923757 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] The token cache is being invalidate because project 36be3f6b75654d71b5ff0851fb858e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:10:44.924049 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.924678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-a7db7b83-f8e7-452a-9c97-96867f5a52a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:10:44.926261 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4391/8830] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:10:44 2022] DELETE /identity/v3/projects/36be3f6b75654d71b5ff0851fb858e6a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:10:44.934098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:44.934643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:44.934757 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:44.976993 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:44.978276 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:45.042695 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4440/8831] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:45.051899 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.052182 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.053055 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.073603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:45.074952 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:45.083501 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4392/8832] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:45.088114 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.098839 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5cd5f-5c40-40c2-b346-0e5b86995362 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.103824 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.104432 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.104716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.104989 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.105649 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 04:10:45.106014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.107677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.110774 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:45.123502 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4441/8833] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 04:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 04:10:45.128302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.138246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80d1ab-6ddf-4795-9ca9-cb1ce6148f78 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.143286 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.144241 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.144529 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.144793 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.145408 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.147429 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.188112 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4393/8834] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 04:10:45 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:10:45.192624 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.203523 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb3f7ba-4c5e-4ab7-8ead-2d052aa616d3 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.264402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.265013 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.265289 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.265558 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.266240 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.268176 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.290931 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4442/8835] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 04:10:45 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 04:10:45.295447 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.309311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2e15f-f78f-49fd-9ad5-593b3e3312e3 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.315668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.316290 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.316575 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.316839 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.317480 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.319132 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.329958 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4394/8836] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:10:45.334323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.345076 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa60993-1cbf-4eb8-b8d7-49d6a9f64154 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.350534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5d41b-8270-44fe-877a-76c3c25fac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.351163 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d41b-8270-44fe-877a-76c3c25fac35 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.351561 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d41b-8270-44fe-877a-76c3c25fac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.351832 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5d41b-8270-44fe-877a-76c3c25fac35 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.352473 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5d41b-8270-44fe-877a-76c3c25fac35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.354120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5d41b-8270-44fe-877a-76c3c25fac35 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.365429 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4443/8837] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:10:45.370144 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.380436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c22d1-ec93-4be6-9e77-f72a9b089547 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.385631 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.386318 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.386596 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.386879 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] PATH_INFO: `/v3/projects/d1f0589e74da4bef8f38623954cb94ca/users/533f2ae735974e27977c592a514e856e/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.408470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1f0589e74da4bef8f38623954cb94ca, user_id=533f2ae735974e27977c592a514e856e, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.411149 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.427843 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4395/8838] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:10:45 2022] PUT /identity/v3/projects/d1f0589e74da4bef8f38623954cb94ca/users/533f2ae735974e27977c592a514e856e/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 04:10:45.433405 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a1a00-1514-41bf-b3ec-293a472b35c8 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.433694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a1a00-1514-41bf-b3ec-293a472b35c8 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.434073 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a1a00-1514-41bf-b3ec-293a472b35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.454192 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-e46a1a00-1514-41bf-b3ec-293a472b35c8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:45.455423 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e46a1a00-1514-41bf-b3ec-293a472b35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:45.517625 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4444/8839] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:45.528133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:45.530168 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:45.593773 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc318eae-4f5c-4db2-a82d-0743b39b50c4 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:45.598278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:45.598900 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:45.599178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:45.599443 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:45.610006 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:45.611452 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:45.620895 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4396/8840] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:10:49.729565 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:49.730101 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:49.730286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:49.761598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] MFA Rules not processed for user `533f2ae735974e27977c592a514e856e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:49.763024 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:49.841605 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4445/8841] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:49.846473 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:49.856820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d35c2-212a-4bcb-8984-884fe6382f55 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:49.861896 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:49.862524 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:49.862797 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:49.863068 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] PATH_INFO: `/v3/projects` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:49.863721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:49.865630 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:49.878783 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:49.899048 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4397/8842] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 04:10:49 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:10:49.903472 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:49.910500 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:49.915594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d0ac-c8f4-40ce-bd80-9331ba8a0db7 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:49.978043 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:49.978680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:49.978958 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:49.979233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] PATH_INFO: `/v3/users` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:49.979895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:49.982037 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:50.006590 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4446/8843] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 04:10:49 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:10:50.010857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:50.021695 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7a2be-4063-4768-bf4f-e7c9f8b47710 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:50.026740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:50.027369 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:50.027726 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:50.028008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:50.028755 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:50.030431 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:50.045393 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4398/8844] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:10:50.046643 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:50.057341 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c9750-5e42-43bd-ba1b-395752a3a7de admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:50.063514 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:50.064203 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:50.064480 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:50.064755 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] PATH_INFO: `/v3/projects/15a1f7853d334752bb12045c5cfba2fa/users/27f0eb14e6d94ba3bebde354e3140286/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:50.082188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1f7853d334752bb12045c5cfba2fa, user_id=27f0eb14e6d94ba3bebde354e3140286, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:50.084940 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:50.101015 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4447/8845] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:10:50 2022] PUT /identity/v3/projects/15a1f7853d334752bb12045c5cfba2fa/users/27f0eb14e6d94ba3bebde354e3140286/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:10:50.105374 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:50.117148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357086e-9a73-4426-a603-9f2682591581 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:50.181739 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387a653-0e8e-4113-9a55-e53c3f6ad7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:50.182389 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a653-0e8e-4113-9a55-e53c3f6ad7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:50.182665 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a653-0e8e-4113-9a55-e53c3f6ad7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:50.182931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387a653-0e8e-4113-9a55-e53c3f6ad7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:50.183580 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a653-0e8e-4113-9a55-e53c3f6ad7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:50.185225 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387a653-0e8e-4113-9a55-e53c3f6ad7b1 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:50.195198 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4399/8846] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:10:50.199980 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:50.210805 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c87b4e-2189-404b-b6b2-129fbaea4422 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:50.217097 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:50.218099 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:50.218375 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:50.218685 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] PATH_INFO: `/v3/projects/15a1f7853d334752bb12045c5cfba2fa/users/27f0eb14e6d94ba3bebde354e3140286/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:50.220696 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a1f7853d334752bb12045c5cfba2fa, user_id=27f0eb14e6d94ba3bebde354e3140286, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:50.223402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:50.236864 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4448/8847] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:10:50 2022] PUT /identity/v3/projects/15a1f7853d334752bb12045c5cfba2fa/users/27f0eb14e6d94ba3bebde354e3140286/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:10:54.863706 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037c00-d384-42a8-946d-21fc599c0389 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:54.865288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037c00-d384-42a8-946d-21fc599c0389 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:54.865733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86037c00-d384-42a8-946d-21fc599c0389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:54.896221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-86037c00-d384-42a8-946d-21fc599c0389 None None] MFA Rules not processed for user `27f0eb14e6d94ba3bebde354e3140286`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:54.897570 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-86037c00-d384-42a8-946d-21fc599c0389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:55.000253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4400/8848] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:55.029969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:55.032323 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:55.141857 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd12c9d-8d12-4328-a0c8-5d787190df0c admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:55.149130 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df982465-201a-493a-a768-ad1122087074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:55.149909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982465-201a-493a-a768-ad1122087074 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:55.150779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982465-201a-493a-a768-ad1122087074 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:55.151155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df982465-201a-493a-a768-ad1122087074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:55.205971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:10:55.224917 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df982465-201a-493a-a768-ad1122087074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:55.226577 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df982465-201a-493a-a768-ad1122087074 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:55.238135 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4449/8849] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:10:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:10:56.292506 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:56.293078 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:56.293316 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:56.313338 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] MFA Rules not processed for user `533f2ae735974e27977c592a514e856e`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:10:56.314634 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:56.321674 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4401/8850] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:10:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:10:57.007676 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df982465-201a-493a-a768-ad1122087074 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:10:57.009383 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-df982465-201a-493a-a768-ad1122087074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:57.110579 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df982465-201a-493a-a768-ad1122087074 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:10:57.116428 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:10:57.117103 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:10:57.117419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:10:57.117720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:10:57.119782 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:10:57.132522 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:10:57.134155 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:10:57.145237 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4450/8851] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:10:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:11:06.307548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:07.140485 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=40 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:07.925611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:11:07.989678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1b65c-aa95-4776-8422-aae602eaefb0 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:11:07.993661 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:11:07.994307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:11:07.994584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:11:07.994849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:11:08.004122 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:11:08.005576 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:11:08.015597 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4402/8852] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:11:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:11:18.011288 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=26 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:11:55.626250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:11:55.627875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:11:55.641689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c0cfa-8ed9-471e-8e81-8ef818dff444 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:11:55.648227 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:11:55.648828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:11:55.649102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:11:55.649359 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:11:55.651384 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:11:55.662912 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:11:55.664469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08053b3b-80c2-4c47-b8af-69b2a1d974be service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:11:55.674352 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4451/8853] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:11:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:12:05.670404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:12:36.733516 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:12:36.760808 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd967b5-5b14-47a8-abbd-32a29a998325 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:12:36.766689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:12:36.767344 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:12:36.767622 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:12:36.767892 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:12:36.770252 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:12:36.782844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:12:36.784451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:12:36.795253 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4403/8854] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:12:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:12:46.791537 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:17.590597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:17.591148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:17.591148 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:17.643415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:13:17.644631 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:17.712422 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4452/8855] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:13:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:13:17.763917 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:17.765428 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:17.864803 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fffc84-3a4b-4225-82ff-fe134e94fd6a service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:17.871236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:17.871854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:17.872133 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:17.872398 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:17.880951 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:17.882586 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:17.890558 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4404/8856] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:13:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:13:18.738291 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:18.741732 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:18.762871 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea4235-0ecb-447d-9d1f-5a59347ae8cf None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:18.773496 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:18.774193 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:18.774477 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:18.774737 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:18.776655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:18.790415 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:18.792124 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fcbcc-e8fe-4971-a8db-c98b45eb1f1e service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:18.808764 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4453/8857] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:13:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:13:27.887613 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=41 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:28.803098 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=46 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:29.410875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:29.412425 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:29.425699 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcd0da-4a7c-424a-ba68-f04f1201a49f service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:29.430160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:29.430955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:29.431263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:29.431561 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:29.433651 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:29.443396 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:29.444832 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:29.453102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4405/8858] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:13:29.586828 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:29.587378 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:29.587653 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:29.614713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] MFA Rules not processed for user `81efa701407b4cb583969bef4ad35194`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:13:29.616914 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:29.627738 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4454/8859] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Oct 29 04:13:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:13:29.641300 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:29.642795 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:29.724715 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea63-59a9-476f-924d-8ca4413df35b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:29.730008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e800c060beb045008c905a591d290cb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:29.730956 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:29.731436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:29.731860 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:29.748170 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:29.749770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:29.760911 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4406/8860] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:13:29.838799 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:29.848075 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531adaea-03f8-4236-aafe-8db52cfa1a3b None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:29.852615 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:29.853217 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:29.853491 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:29.853760 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:29.855913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:29.866336 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:29.867969 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:29.875904 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4455/8861] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:13:29.952854 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:29.963151 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85bd61-6262-46ea-ac73-1035fb87665c service glance] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:29.967617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:29.968236 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:29.968509 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:29.968770 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:29.970857 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:29.985134 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:29.986577 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2cf67-a46e-47ed-841f-64183349be24 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:29.997605 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4407/8862] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:13:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:13:30.068119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:30.082847 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17769428-ee23-40f6-858a-096a8f705875 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:30.089469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:30.090200 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:30.090501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:30.090775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:30.092860 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:30.105594 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:30.107241 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:30.118171 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4456/8863] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:13:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:13:31.816200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8a9f-2bc0-46f7-b2bf-d83b544bf335 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:31.816736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8a9f-2bc0-46f7-b2bf-d83b544bf335 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:31.816736 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a8a9f-2bc0-46f7-b2bf-d83b544bf335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:31.838548 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-5e0a8a9f-2bc0-46f7-b2bf-d83b544bf335 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:13:31.839751 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-5e0a8a9f-2bc0-46f7-b2bf-d83b544bf335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:31.847351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4408/8864] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:13:31.859749 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:31.871689 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cf83-4e83-44c3-afeb-22322cc90c9e service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:31.877235 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:31.877846 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:31.878128 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:31.878398 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:31.886807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:31.888413 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:31.896808 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4457/8865] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:13:41.833321 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=50 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:41.893534 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=21 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:48.137578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:48.138140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:48.138247 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:48.160811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:13:48.162086 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:13:48.170806 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4409/8866] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 04:13:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:13:48.186311 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:13:48.200686 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7986844-3e14-46bb-80a2-655b9c2d1d66 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:13:48.208255 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:13:48.208887 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:13:48.209154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:13:48.209417 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:13:48.218895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:13:48.220532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:13:48.229496 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4458/8867] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:13:58.155114 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:13:58.225935 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:14:59.256453 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:14:59.312913 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad345ec8-ab9c-4834-8f04-3b1396e3485f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:14:59.319309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:14:59.320200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:14:59.320563 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:14:59.320873 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:14:59.322950 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:14:59.361139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:14:59.363720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:14:59.387666 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4410/8868] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:14:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:14:59.459715 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:14:59.480519 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13019516-9129-453d-b415-ffe3c881b209 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:14:59.484657 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:14:59.485546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:14:59.485720 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:14:59.485945 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:14:59.487807 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:14:59.502802 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:14:59.504581 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f0101-09b4-4fc4-b4da-e630d3bf5232 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:14:59.516335 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4459/8869] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:14:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:15:00.876672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:15:00.887166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90b220-9a60-45cc-a2f3-1a727eb36a81 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:15:00.891927 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:15:00.892573 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:15:00.892849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:15:00.893120 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:15:00.895244 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:15:00.905733 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:15:00.907280 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:15:00.915847 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4411/8870] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:15:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:15:04.276639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:15:04.277172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:15:04.277172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:15:04.297661 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] MFA Rules not processed for user `533f2ae735974e27977c592a514e856e`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:15:04.298982 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:15:04.307113 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4460/8871] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:15:10.912145 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=34 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:14.292513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=14 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:20.962032 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:15:20.987361 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ef20a-b866-411d-9cbb-ab2241ce8b11 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:15:20.994606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:15:20.995608 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:15:20.996014 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:15:20.996468 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:15:20.999331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:15:21.011177 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:15:21.012611 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:15:21.021020 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4412/8872] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:15:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:15:24.463173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:15:24.480455 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e625f7a-204d-402d-a7b6-e9266b70e029 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:15:24.487693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:15:24.488328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:15:24.488804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:15:24.489396 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:15:24.491414 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:15:24.508597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:15:24.510713 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:15:24.522749 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4461/8873] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:15:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:15:31.017498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=10 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:31.243435 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:15:31.253246 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f742e6a-3348-4dbc-8085-4f110673d171 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:15:31.257768 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:15:31.258407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:15:31.258694 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:15:31.259130 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:15:31.261197 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:15:31.275451 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:15:31.276878 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:15:31.287946 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4413/8874] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:15:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:15:34.517853 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:15:41.283021 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:01.635736 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:17:01.648162 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2243d2-eb05-4845-9fb6-f61b10fa2bd1 service nova] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:17:01.654351 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:17:01.654959 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:17:01.655237 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:17:01.655513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:17:01.665168 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:17:01.666818 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:17:01.677229 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4462/8875] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:17:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:17:11.672951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:37.194487 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:17:37.206140 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e4b0b-d7a3-4731-ba6d-e36938b0a047 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:17:37.212383 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:17:37.212934 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:17:37.213209 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:17:37.213481 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:17:37.223764 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:17:37.225379 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:17:37.235102 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4414/8876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:17:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:17:43.747474 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:17:43.761584 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa12d3-276f-4ee0-a2e4-3b22a56775ae service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:17:43.768250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:17:43.768861 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:17:43.769139 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:17:43.769411 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:17:43.778738 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:17:43.780345 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:17:43.791268 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4463/8877] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:17:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:17:47.230403 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=6 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:17:53.786764 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:32.334716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:32.344574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c07786-d911-4ad6-a0a2-5de08bf3583a service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:32.348282 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:32.348889 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:32.349166 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:32.349438 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:32.414470 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:32.416353 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:32.427443 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4415/8878] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:19:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:19:35.817438 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:35.829591 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474ec8b-c6f4-4d1f-be15-e60bd623d684 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:35.835009 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:35.835627 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:35.835909 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:35.836187 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:35.838156 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:35.872677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:35.872677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:35.883699 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4464/8879] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:19:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 04:19:38.938765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:38.952222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb4e5-871a-43bc-b94b-ad6a1c4e2895 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:38.957471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:38.958181 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:38.958465 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:38.958741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] PATH_INFO: `/v3/users/533f2ae735974e27977c592a514e856e` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:38.959972 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=533f2ae735974e27977c592a514e856e)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:38.962081 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:39.019973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '533f2ae735974e27977c592a514e856e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.034811 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '533f2ae735974e27977c592a514e856e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.035550 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '533f2ae735974e27977c592a514e856e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.042659 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '533f2ae735974e27977c592a514e856e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.043328 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '533f2ae735974e27977c592a514e856e'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.074689 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4416/8880] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:19:38 2022] DELETE /identity/v3/users/533f2ae735974e27977c592a514e856e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:39.566198 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:39.579556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b358a7-2b6e-49eb-be81-afd26b5111a1 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:39.639360 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:39.640011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:39.640292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:39.640570 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] PATH_INFO: `/v3/projects/d1f0589e74da4bef8f38623954cb94ca` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:39.641759 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1f0589e74da4bef8f38623954cb94ca)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:39.643698 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:39.693464 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f0589e74da4bef8f38623954cb94ca', 'request_id': 'req-a5d8e2a4-d285-410b-92ac-72f8660af147'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.699951 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f0589e74da4bef8f38623954cb94ca', 'request_id': 'req-a5d8e2a4-d285-410b-92ac-72f8660af147'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.705852 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f0589e74da4bef8f38623954cb94ca', 'request_id': 'req-a5d8e2a4-d285-410b-92ac-72f8660af147'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.720758 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] The token cache is being invalidate because project d1f0589e74da4bef8f38623954cb94ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:19:39.721046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.721835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.723479 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4465/8881] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:19:39 2022] DELETE /identity/v3/projects/d1f0589e74da4bef8f38623954cb94ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:39.729436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:39.730929 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:39.745161 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79351075-ca5c-4e2e-85aa-8ecf91efe5f9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:39.809141 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:39.809704 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:39.810007 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:39.810278 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] PATH_INFO: `/v3/users/27f0eb14e6d94ba3bebde354e3140286` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:39.811526 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f0eb14e6d94ba3bebde354e3140286)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:39.813493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:39.819708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:39.866192 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f0eb14e6d94ba3bebde354e3140286'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.878798 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f0eb14e6d94ba3bebde354e3140286'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.879483 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f0eb14e6d94ba3bebde354e3140286'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.887148 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f0eb14e6d94ba3bebde354e3140286'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.887872 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-91bb7aaa-f782-44de-b021-4cc0f4fb2ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f0eb14e6d94ba3bebde354e3140286'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:39.903787 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4417/8882] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:19:39 2022] DELETE /identity/v3/users/27f0eb14e6d94ba3bebde354e3140286 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:40.082626 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.084134 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:40.098469 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8e2a4-d285-410b-92ac-72f8660af147 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.157850 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.158498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.158776 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.159045 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] PATH_INFO: `/v3/projects/15a1f7853d334752bb12045c5cfba2fa` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.160206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a1f7853d334752bb12045c5cfba2fa)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.162183 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.170915 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:40.213105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a1f7853d334752bb12045c5cfba2fa', 'request_id': 'req-a100b74e-b953-488e-8473-87b1fbe47bde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:40.219639 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a1f7853d334752bb12045c5cfba2fa', 'request_id': 'req-a100b74e-b953-488e-8473-87b1fbe47bde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:40.225638 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a1f7853d334752bb12045c5cfba2fa', 'request_id': 'req-a100b74e-b953-488e-8473-87b1fbe47bde'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:40.245466 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] The token cache is being invalidate because project 15a1f7853d334752bb12045c5cfba2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82080) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:19:40.245775 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:40.246911 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-a100b74e-b953-488e-8473-87b1fbe47bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:19:40.249428 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4466/8883] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:19:40 2022] DELETE /identity/v3/projects/15a1f7853d334752bb12045c5cfba2fa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:40.257026 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.257603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.257603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.290180 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:19:40.291437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:40.360485 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4418/8884] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:19:40.368664 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.368949 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.369326 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.390447 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:19:40.391677 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:40.401086 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4467/8885] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:19:40.405535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.415463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7d42a-e03f-4cb9-a88f-50bff83c4f8e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.420518 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.421121 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.421397 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.421668 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.422317 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=82079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 04:19:40.422617 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.424213 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.436348 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4419/8886] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Oct 29 04:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 04:19:40.441014 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.450729 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d87768-a07e-4def-91fe-e4892cbb01f5 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.456745 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.457354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.457629 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.457968 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.458597 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.460556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.493517 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4468/8887] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 04:19:40 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:19:40.496414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.506849 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02876016-e8d9-4e1b-a959-4e02420d7a2a admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.565568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.566251 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.566533 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.566806 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.567448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.569378 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.579644 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:40.593341 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4420/8888] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 04:19:40 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 04:19:40.597630 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.608948 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c36097-748f-4292-80bd-869a997db33d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.615061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.615692 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.615971 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.616233 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.616875 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.618538 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.629157 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4469/8889] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:19:40.633350 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.643820 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24412371-6c3e-4310-8c5c-6a4367637d33 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.649296 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2552146-cd56-47e3-86dc-dfcfc69e528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.649931 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2552146-cd56-47e3-86dc-dfcfc69e528a admin admin] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.650334 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2552146-cd56-47e3-86dc-dfcfc69e528a admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.650603 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2552146-cd56-47e3-86dc-dfcfc69e528a admin admin] PATH_INFO: `/v3/roles` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.651228 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2552146-cd56-47e3-86dc-dfcfc69e528a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.652943 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2552146-cd56-47e3-86dc-dfcfc69e528a admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.663981 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4421/8890] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 04:19:40.668395 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.679225 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e192bb5-6cda-45f9-aafe-19ef72508912 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.684880 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.685536 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] REQUEST_METHOD: `PUT` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.685835 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.686112 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] PATH_INFO: `/v3/projects/0d4d73e96d1944a997cd6800e473d954/users/a69bfc3664804c19867852340dfc2017/roles/c74dbb4a211246e2bcfa31161d49118e` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.703083 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4d73e96d1944a997cd6800e473d954, user_id=a69bfc3664804c19867852340dfc2017, role_id=c74dbb4a211246e2bcfa31161d49118e)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.705779 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.721107 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4470/8891] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:19:40 2022] PUT /identity/v3/projects/0d4d73e96d1944a997cd6800e473d954/users/a69bfc3664804c19867852340dfc2017/roles/c74dbb4a211246e2bcfa31161d49118e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:40.726437 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4667-6df6-48f9-a214-9e7ce275c6f8 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.726750 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4667-6df6-48f9-a214-9e7ce275c6f8 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.727005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4667-6df6-48f9-a214-9e7ce275c6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.747263 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-c04b4667-6df6-48f9-a214-9e7ce275c6f8 None None] MFA Rules not processed for user `16efc903cbf0459289b5f4c2d93cddb0`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:19:40.748490 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c04b4667-6df6-48f9-a214-9e7ce275c6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:40.816638 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4422/8892] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:19:40.827107 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:40.829084 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:40.901046 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec5e1f-e452-4c58-acb7-3fddbe784a61 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:40.905214 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:40.905838 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:40.906132 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:40.906404 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:40.916095 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:40.917532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:40.927653 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4471/8893] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:19:45.093871 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.094523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.094523 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.127493 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] MFA Rules not processed for user `a69bfc3664804c19867852340dfc2017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:19:45.129064 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:45.212037 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4423/8894] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:19:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:19:45.217120 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:45.232110 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313df35-a491-45b2-8a8b-aba03d2c9b4d service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:45.243766 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:45.244819 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.245143 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.245358 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.246061 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:45.249402 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:45.283146 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4472/8895] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Oct 29 04:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 04:19:45.284414 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:45.296924 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed0b66-07af-42ab-8cf2-138b5a74042e None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:45.358324 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:45.358964 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.359229 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.359498 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.360176 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:45.362142 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:45.389639 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4424/8896] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Oct 29 04:19:45 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 04:19:45.390913 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:45.396553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:45.403957 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdc3ad-55d5-4bf7-8596-d7610c524bc4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:45.410350 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:45.411002 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.411280 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.411556 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.412213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:45.413864 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:45.429043 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4473/8897] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 04:19:45.430266 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:45.435654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:45.441574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52713d8b-f6ac-4d14-8e95-4545d07dfcf5 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:45.448864 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:45.449568 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.449875 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.450167 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] PATH_INFO: `/v3/projects/00953245a81d449ca5c68f00f3a9d562/users/dabbcb97c4e74f9d923fdc7340539f04/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.466394 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00953245a81d449ca5c68f00f3a9d562, user_id=dabbcb97c4e74f9d923fdc7340539f04, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:45.469046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:45.488351 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4425/8898] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:19:45 2022] PUT /identity/v3/projects/00953245a81d449ca5c68f00f3a9d562/users/dabbcb97c4e74f9d923fdc7340539f04/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:45.493489 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:45.518172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbbeeb-c5d3-4179-a9ae-6d5078df2e8d admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:45.583063 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1e7ea-ba1d-4278-8f52-849205685dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:45.583801 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e7ea-ba1d-4278-8f52-849205685dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.584102 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e7ea-ba1d-4278-8f52-849205685dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.584431 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1e7ea-ba1d-4278-8f52-849205685dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.585117 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e7ea-ba1d-4278-8f52-849205685dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:45.587026 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef1e7ea-ba1d-4278-8f52-849205685dd0 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:45.601424 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4474/8899] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Oct 29 04:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 04:19:45.602912 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:45.614364 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c225fc3-4f6d-43f5-8fd2-bfb61d6afad9 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:45.619165 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:45.619947 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:45.620222 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:45.620640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] PATH_INFO: `/v3/projects/00953245a81d449ca5c68f00f3a9d562/users/dabbcb97c4e74f9d923fdc7340539f04/roles/7cfb0f87b5f748c9a420873e8002b480` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:45.622765 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00953245a81d449ca5c68f00f3a9d562, user_id=dabbcb97c4e74f9d923fdc7340539f04, role_id=7cfb0f87b5f748c9a420873e8002b480)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:45.628322 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:45.637528 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4426/8900] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Oct 29 04:19:45 2022] PUT /identity/v3/projects/00953245a81d449ca5c68f00f3a9d562/users/dabbcb97c4e74f9d923fdc7340539f04/roles/7cfb0f87b5f748c9a420873e8002b480 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:19:49.755315 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6e046-e95f-4f3e-aeb4-a7271da8e504 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:49.755840 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6e046-e95f-4f3e-aeb4-a7271da8e504 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:49.756292 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6e046-e95f-4f3e-aeb4-a7271da8e504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:49.839636 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-84b6e046-e95f-4f3e-aeb4-a7271da8e504 None None] MFA Rules not processed for user `dabbcb97c4e74f9d923fdc7340539f04`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:19:49.841564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-84b6e046-e95f-4f3e-aeb4-a7271da8e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:49.973052 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:49.975094 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:49.981372 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4475/8901] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:19:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:19:50.094658 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47502e17-f0a4-45f1-b44d-5204c8e77c77 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:50.102571 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:50.103858 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:50.104221 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:50.104496 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:50.176439 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:50.178388 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:50.191081 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4427/8902] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 04:19:51.582811 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:51.583332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:51.583332 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:51.602890 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] MFA Rules not processed for user `a69bfc3664804c19867852340dfc2017`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:19:51.604184 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:51.611608 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4476/8903] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:19:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:19:51.950200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:51.951789 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:52.012065 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a46aa-52c0-4330-aa7f-a260b293dc90 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:52.015999 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:52.016626 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:52.016902 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:52.017172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:52.019046 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:52.029531 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:52.031033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:52.039582 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4428/8904] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:19:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:19:52.396501 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:19:52.398082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:52.475476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3da384-9495-4b12-88c4-dc4a3e6b5595 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:19:52.480883 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:19:52.481526 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:19:52.481796 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:19:52.482094 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:19:52.484234 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:19:52.495213 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=100 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:19:52.497612 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:19:52.499532 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:19:52.511713 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4477/8905] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:19:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:20:00.450385 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:20:00.459753 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:00.465530 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e594db9-f9f8-4dcc-b270-59abe0a4b6c1 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:20:00.472279 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:20:00.472898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:20:00.473195 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:20:00.473463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:20:00.475402 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:20:00.488535 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:20:00.490160 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:20:00.500758 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4429/8906] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:20:00.621725 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:20:00.631761 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4314c-391e-429e-865f-f555386f3e60 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:20:00.635546 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:20:00.636154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:20:00.636427 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:20:00.636693 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:20:00.638471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:20:00.652439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:20:00.653901 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:20:00.665776 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4478/8907] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:20:00.708335 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:20:00.719866 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a8b33-5644-4555-9cb5-cf2d547435ee service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:20:00.725262 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:20:00.725990 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:20:00.726341 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:20:00.726682 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:20:00.729178 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:20:00.741110 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:20:00.742817 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:20:00.752593 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4430/8908] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:20:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:20:02.209116 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:20:02.218655 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cd8fc-d81c-4720-858f-40c5fbbdc871 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:20:02.223201 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe84d46e-c185-4a6a-93c2-8e62aab9ed2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:20:02.223814 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84d46e-c185-4a6a-93c2-8e62aab9ed2e service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:20:02.224087 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84d46e-c185-4a6a-93c2-8e62aab9ed2e service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:20:02.224354 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe84d46e-c185-4a6a-93c2-8e62aab9ed2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:20:02.234434 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84d46e-c185-4a6a-93c2-8e62aab9ed2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:20:02.235891 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe84d46e-c185-4a6a-93c2-8e62aab9ed2e service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:20:02.246257 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4479/8909] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:20:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:20:03.876489 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:20:03.890904 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12ea14-ac0d-4e17-8aa2-d6e08d4e8d20 service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:20:03.896758 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:20:03.897376 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:20:03.897657 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:20:03.897970 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:20:03.899787 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:20:03.912677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:20:03.914311 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:20:03.926724 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4431/8910] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:20:12.241572 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=14 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:20:13.922543 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=16 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:21:59.953893 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979539-d54d-4ff4-9a78-018533678502 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:21:59.954439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979539-d54d-4ff4-9a78-018533678502 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:21:59.954439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24979539-d54d-4ff4-9a78-018533678502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:21:59.992934 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-24979539-d54d-4ff4-9a78-018533678502 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:21:59.994191 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24979539-d54d-4ff4-9a78-018533678502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:00.070772 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4480/8911] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:21:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:22:00.121838 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:00.124154 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:00.201215 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654d211-c07e-4ca4-a6fd-e638c89752a4 service nova] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:00.206555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd05ae8-0e43-46ae-a454-ed5068a57897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:00.207172 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd05ae8-0e43-46ae-a454-ed5068a57897 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:00.207450 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd05ae8-0e43-46ae-a454-ed5068a57897 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:00.207720 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd05ae8-0e43-46ae-a454-ed5068a57897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:00.216707 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd05ae8-0e43-46ae-a454-ed5068a57897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:00.218323 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd05ae8-0e43-46ae-a454-ed5068a57897 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:00.227672 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4432/8912] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:22:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:22:06.673328 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979539-d54d-4ff4-9a78-018533678502 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:06.675119 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-24979539-d54d-4ff4-9a78-018533678502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:06.690785 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24979539-d54d-4ff4-9a78-018533678502 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:06.697908 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:06.698709 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:06.699079 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:06.699416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:06.701348 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:06.716154 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:06.716512 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:06.728487 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4481/8913] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:22:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:22:10.035716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:10.036258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:10.036258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:10.056654 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] MFA Rules not processed for user `a69bfc3664804c19867852340dfc2017`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:22:10.057928 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:10.066422 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4433/8914] 10.222.0.16 () {58 vars in 958 bytes} [Sat Oct 29 04:22:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:22:10.732086 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:10.743842 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f06c4f-6051-4797-ba04-7adb632faa7b service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:10.749716 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:10.750394 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:10.750671 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:10.750937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:10.752960 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:10.757975 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:10.765642 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:10.767250 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dddd6-51de-4151-8581-5abb9dd14ac1 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:10.768331 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d524932-0d59-4ea7-9007-895652df15f7 None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:10.772305 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:10.773028 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:10.773309 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:10.773708 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:10.775779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:10.778501 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4482/8915] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:22:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:22:10.803745 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:10.805314 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:10.831646 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4434/8916] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:22:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:22:12.199065 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] REQUEST_METHOD: `POST` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:12.199680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:12.199680 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:12.220694 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.auth.core [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:22:12.222147 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:12.230114 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4483/8917] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:22:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:22:12.243384 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:12.255327 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19a76-c2b2-4c5d-b546-6da98eedf65b service neutron] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:12.260967 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:12.261591 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:12.261898 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:12.262171 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:12.270672 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:12.272258 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:12.281122 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4435/8918] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:22:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:22:20.754285 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:20.764281 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9963138-9149-4c88-a9d9-7e0fa639c819 None None] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:20.768215 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e12ad7dd0524e218c5d4be524ec7cb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:20.768810 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:20.769082 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:20.769353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:20.771219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:20.781008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:20.782476 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:20.790342 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4484/8919] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:22:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:22:21.474375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:21.476232 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:21.493713 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c0eea-b70c-4b23-aa54-4b1c28795eb1 service swift] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:21.499978 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81efa701407b4cb583969bef4ad35194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:21.501139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:21.501139 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:21.501380 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:21.503038 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:21.516097 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:21.517794 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2e446-c9c8-4fed-8f06-ea6d9dc6dd65 service nova] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:21.530012 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4436/8920] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:22:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:22:30.787074 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=53 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:31.524200 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=62 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:22:46.712321 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:22:46.740498 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5416ca5-0fe3-490f-86f2-afbafddfad48 service neutron] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:22:46.746817 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:22:46.747450 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:22:46.747707 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:22:46.747979 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:22:46.750003 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:22:46.762011 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:22:46.763609 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:22:46.773786 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4485/8921] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:22:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:22:56.769771 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=10 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:03.809375 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a67f56-387c-48de-ac4c-d311d9699116 None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:03.809973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a67f56-387c-48de-ac4c-d311d9699116 None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:03.809973 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a67f56-387c-48de-ac4c-d311d9699116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:03.860005 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-d7a67f56-387c-48de-ac4c-d311d9699116 None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:24:03.861223 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-d7a67f56-387c-48de-ac4c-d311d9699116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:24:03.878746 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4437/8922] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Oct 29 04:24:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:24:03.919105 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:03.942236 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6fa1-4cac-4d58-9d58-da0cdd338410 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:03.947681 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:03.948296 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:03.948573 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:03.948845 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:03.957598 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:03.959249 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:03.967781 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4486/8923] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:24:12.601304 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0767a-09e1-4ab1-9e79-e13f8c65887c None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:12.601876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0767a-09e1-4ab1-9e79-e13f8c65887c None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:12.601876 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0767a-09e1-4ab1-9e79-e13f8c65887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:12.621938 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-58c0767a-09e1-4ab1-9e79-e13f8c65887c None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:24:12.623147 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-58c0767a-09e1-4ab1-9e79-e13f8c65887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:24:12.630975 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4438/8924] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 04:24:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:24:12.643426 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:12.654150 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454db8d-2328-40f3-ab14-e9efd6bef851 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:12.660690 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:12.661416 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:12.661724 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:12.662089 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:12.671429 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:12.673195 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:12.682457 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4487/8925] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:24:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:24:17.589090 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] REQUEST_METHOD: `POST` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:17.589606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:17.589721 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:17.619460 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.auth.core [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] MFA Rules not processed for user `fbb367d26b64430385f8032099f9e311`. Rule list: `[]` (Enabled: `True`). {{(pid=82079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 04:24:17.620700 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:24:17.628684 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4439/8926] 10.222.0.16 () {58 vars in 967 bytes} [Sat Oct 29 04:24:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 04:24:17.641456 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:17.652711 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df4f3-6af7-4cce-aea2-eefdd6b68db6 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:17.658567 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f8edd4b12d54ce39915d2e9831b3d88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:17.659172 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:17.659449 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:17.659743 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:17.668541 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:17.670188 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:17.679259 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4488/8927] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Oct 29 04:24:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 04:24:26.284365 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:26.297640 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fd9ca-703c-43bb-8dfa-d3006a80891f None None] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:26.303502 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:26.304136 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:26.304407 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:26.304678 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:26.306521 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:24:26.320786 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:26.322448 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:26.334326 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4440/8928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:24:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:24:27.675305 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=22 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:29.738804 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:29.833353 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da745f-a43e-4f77-8c4c-ff0454353559 service swift] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:29.838008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:29.838658 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:29.838937 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:29.839206 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] PATH_INFO: `/v3/users/a69bfc3664804c19867852340dfc2017` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:29.840357 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69bfc3664804c19867852340dfc2017)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:29.842329 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:29.894286 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69bfc3664804c19867852340dfc2017'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:29.907439 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69bfc3664804c19867852340dfc2017'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:29.908310 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69bfc3664804c19867852340dfc2017'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:29.916309 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69bfc3664804c19867852340dfc2017'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:29.917010 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69bfc3664804c19867852340dfc2017'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:29.935071 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4489/8929] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:24:29 2022] DELETE /identity/v3/users/a69bfc3664804c19867852340dfc2017 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:24:30.129846 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:30.141703 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c8126-7758-4e3a-a2f2-4cf4c047ff74 service placement] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:30.203663 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:30.204302 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:30.204578 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:30.204844 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] PATH_INFO: `/v3/projects/0d4d73e96d1944a997cd6800e473d954` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:30.206008 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4d73e96d1944a997cd6800e473d954)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:30.207961 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:30.262436 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4d73e96d1944a997cd6800e473d954', 'request_id': 'req-07561973-cf03-49ed-8579-ad89f5161dc0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.269035 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4d73e96d1944a997cd6800e473d954', 'request_id': 'req-07561973-cf03-49ed-8579-ad89f5161dc0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.275033 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4d73e96d1944a997cd6800e473d954', 'request_id': 'req-07561973-cf03-49ed-8579-ad89f5161dc0'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.302741 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] The token cache is being invalidate because project 0d4d73e96d1944a997cd6800e473d954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:24:30.302997 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.303673 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.305221 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4441/8930] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:24:30 2022] DELETE /identity/v3/projects/0d4d73e96d1944a997cd6800e473d954 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:24:30.309589 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:30.311059 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:24:30.324365 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddee8ec-7945-4955-9002-ff50158fc9f4 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:30.384513 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:30.385165 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:30.385443 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:30.385714 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] PATH_INFO: `/v3/users/dabbcb97c4e74f9d923fdc7340539f04` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:30.386895 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabbcb97c4e74f9d923fdc7340539f04)` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:30.388816 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:30.391159 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:30.439008 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabbcb97c4e74f9d923fdc7340539f04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.449173 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabbcb97c4e74f9d923fdc7340539f04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.449820 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabbcb97c4e74f9d923fdc7340539f04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.456833 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabbcb97c4e74f9d923fdc7340539f04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.457548 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.notifications [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabbcb97c4e74f9d923fdc7340539f04'} {{(pid=82080) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.474761 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4490/8931] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Oct 29 04:24:30 2022] DELETE /identity/v3/users/dabbcb97c4e74f9d923fdc7340539f04 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 04:24:30.665921 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:24:30.667471 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:24:30.680779 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07561973-cf03-49ed-8579-ad89f5161dc0 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:24:30.692307 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:30.745210 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16efc903cbf0459289b5f4c2d93cddb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78e88c459a88409388afe930208caca8', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:24:30.745886 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:24:30.746193 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:24:30.746463 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] PATH_INFO: `/v3/projects/00953245a81d449ca5c68f00f3a9d562` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:24:30.747588 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00953245a81d449ca5c68f00f3a9d562)` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:24:30.749540 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:24:30.798000 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00953245a81d449ca5c68f00f3a9d562', 'request_id': 'req-7936dbb1-7334-4a38-9079-db6b78b70a24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.804740 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00953245a81d449ca5c68f00f3a9d562', 'request_id': 'req-7936dbb1-7334-4a38-9079-db6b78b70a24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.810677 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00953245a81d449ca5c68f00f3a9d562', 'request_id': 'req-7936dbb1-7334-4a38-9079-db6b78b70a24'} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.825606 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] The token cache is being invalidate because project 00953245a81d449ca5c68f00f3a9d562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=82079) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 04:24:30.825955 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.826584 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.notifications [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=82079) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 04:24:30.828150 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4442/8932] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Oct 29 04:24:30 2022] DELETE /identity/v3/projects/00953245a81d449ca5c68f00f3a9d562 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 04:24:40.471157 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:24:40.822574 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=45,keystone:DELETE=7,keystone:INSERT=1 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:27:11.575588 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:27:11.577166 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:27:11.705419 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c9fe4-ec5c-45d5-a989-94b9ddd87304 admin admin] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:27:11.769553 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:27:11.770219 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:27:11.770442 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:27:11.770741 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:27:11.772610 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.fernet_utils [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:27:11.783660 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:27:11.785260 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:27:11.796217 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4491/8933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:27:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:27:21.791298 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=80 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:27:51.727285 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Authenticating user token {{(pid=82079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:27:51.729555 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:27:51.777716 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936dbb1-7334-4a38-9079-db6b78b70a24 admin admin] Validating token access rules against request {{(pid=82079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:27:51.783503 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:27:51.784150 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] REQUEST_METHOD: `GET` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:27:51.784424 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] SCRIPT_NAME: `/identity` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:27:51.784689 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:27:51.786685 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.fernet_utils [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=82079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 04:27:51.798979 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:27:51.800600 n-d-862964-4 devstack@keystone.service[82079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc333154-89c5-43ef-a0e1-72efc4257a43 service placement] RBAC: Authorization granted {{(pid=82079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:27:51.812032 n-d-862964-4 devstack@keystone.service[82079]: [pid: 82079|app: 0|req: 4443/8934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:27:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:28:01.807118 n-d-862964-4 devstack@keystone.service[82079]: DEBUG dbcounter [-] [82079] Writing DB stats keystone:SELECT=17 {{(pid=82079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 29 04:32:15.613153 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] Authenticating user token {{(pid=82080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 04:32:15.626564 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9079d1-8ee0-441a-b877-111a2e8ae419 service placement] Validating token access rules against request {{(pid=82080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 04:32:15.632471 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a89ad9-0c1d-4021-bf3c-61a4b36f5e35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ca3aaf505f4d76bae1ad093ddb64f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b35131b35f2480ca98805b81ea3f741', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 04:32:15.633081 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a89ad9-0c1d-4021-bf3c-61a4b36f5e35 service placement] REQUEST_METHOD: `GET` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 04:32:15.633380 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a89ad9-0c1d-4021-bf3c-61a4b36f5e35 service placement] SCRIPT_NAME: `/identity` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 04:32:15.633648 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a89ad9-0c1d-4021-bf3c-61a4b36f5e35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=82080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 04:32:15.644515 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a89ad9-0c1d-4021-bf3c-61a4b36f5e35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 04:32:15.646194 n-d-862964-4 devstack@keystone.service[82080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a89ad9-0c1d-4021-bf3c-61a4b36f5e35 service placement] RBAC: Authorization granted {{(pid=82080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 04:32:15.656549 n-d-862964-4 devstack@keystone.service[82080]: [pid: 82080|app: 0|req: 4492/8935] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Oct 29 04:32:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 04:32:25.652202 n-d-862964-4 devstack@keystone.service[82080]: DEBUG dbcounter [-] [82080] Writing DB stats keystone:SELECT=6 {{(pid=82080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}